q-ary symmetric channel error probability












0












$begingroup$


Why is it valid to assume that $0< p < (q-1)/q$, where $p$ is the probability of symbol error. When $(q-1) / q< p <1$, why are we able to flip it? We are not in binary channel, so we are not able to flip all 1 to 0, all 0 to 1, how can we do that?
My thought is to randomly pick any other symbol at an equal probability










share|cite|improve this question











$endgroup$








  • 1




    $begingroup$
    Perhaps you should add some more context (details of the channel, and where you've read that assumption)
    $endgroup$
    – leonbloy
    Jan 15 at 20:52










  • $begingroup$
    Since $q$ is an integer that has value at least $2$ and $p$ is a nonzero probability, the inequalities $$0 < p < q-1/q$$ are trivially true. What are you really trying to ask?
    $endgroup$
    – Dilip Sarwate
    Jan 17 at 15:02










  • $begingroup$
    @DilipSarwate The most likely explanation for that strange thing you observed was that when an earlier editor TeXified the post, they didn't think about this, and didn't add the parentheses I just added. When written in ASCII it is a bit ambiguos whether the parens were intended. My educated guess is that they were intended :-)
    $endgroup$
    – Jyrki Lahtonen
    Jan 17 at 23:04










  • $begingroup$
    Even so, the question is a bit unclear. I'm seconding leonbloy's request.
    $endgroup$
    – Jyrki Lahtonen
    Jan 17 at 23:05
















0












$begingroup$


Why is it valid to assume that $0< p < (q-1)/q$, where $p$ is the probability of symbol error. When $(q-1) / q< p <1$, why are we able to flip it? We are not in binary channel, so we are not able to flip all 1 to 0, all 0 to 1, how can we do that?
My thought is to randomly pick any other symbol at an equal probability










share|cite|improve this question











$endgroup$








  • 1




    $begingroup$
    Perhaps you should add some more context (details of the channel, and where you've read that assumption)
    $endgroup$
    – leonbloy
    Jan 15 at 20:52










  • $begingroup$
    Since $q$ is an integer that has value at least $2$ and $p$ is a nonzero probability, the inequalities $$0 < p < q-1/q$$ are trivially true. What are you really trying to ask?
    $endgroup$
    – Dilip Sarwate
    Jan 17 at 15:02










  • $begingroup$
    @DilipSarwate The most likely explanation for that strange thing you observed was that when an earlier editor TeXified the post, they didn't think about this, and didn't add the parentheses I just added. When written in ASCII it is a bit ambiguos whether the parens were intended. My educated guess is that they were intended :-)
    $endgroup$
    – Jyrki Lahtonen
    Jan 17 at 23:04










  • $begingroup$
    Even so, the question is a bit unclear. I'm seconding leonbloy's request.
    $endgroup$
    – Jyrki Lahtonen
    Jan 17 at 23:05














0












0








0





$begingroup$


Why is it valid to assume that $0< p < (q-1)/q$, where $p$ is the probability of symbol error. When $(q-1) / q< p <1$, why are we able to flip it? We are not in binary channel, so we are not able to flip all 1 to 0, all 0 to 1, how can we do that?
My thought is to randomly pick any other symbol at an equal probability










share|cite|improve this question











$endgroup$




Why is it valid to assume that $0< p < (q-1)/q$, where $p$ is the probability of symbol error. When $(q-1) / q< p <1$, why are we able to flip it? We are not in binary channel, so we are not able to flip all 1 to 0, all 0 to 1, how can we do that?
My thought is to randomly pick any other symbol at an equal probability







abstract-algebra coding-theory






share|cite|improve this question















share|cite|improve this question













share|cite|improve this question




share|cite|improve this question








edited Jan 17 at 23:02









Jyrki Lahtonen

109k13169372




109k13169372










asked Jan 15 at 15:59









JoeJoe

223




223








  • 1




    $begingroup$
    Perhaps you should add some more context (details of the channel, and where you've read that assumption)
    $endgroup$
    – leonbloy
    Jan 15 at 20:52










  • $begingroup$
    Since $q$ is an integer that has value at least $2$ and $p$ is a nonzero probability, the inequalities $$0 < p < q-1/q$$ are trivially true. What are you really trying to ask?
    $endgroup$
    – Dilip Sarwate
    Jan 17 at 15:02










  • $begingroup$
    @DilipSarwate The most likely explanation for that strange thing you observed was that when an earlier editor TeXified the post, they didn't think about this, and didn't add the parentheses I just added. When written in ASCII it is a bit ambiguos whether the parens were intended. My educated guess is that they were intended :-)
    $endgroup$
    – Jyrki Lahtonen
    Jan 17 at 23:04










  • $begingroup$
    Even so, the question is a bit unclear. I'm seconding leonbloy's request.
    $endgroup$
    – Jyrki Lahtonen
    Jan 17 at 23:05














  • 1




    $begingroup$
    Perhaps you should add some more context (details of the channel, and where you've read that assumption)
    $endgroup$
    – leonbloy
    Jan 15 at 20:52










  • $begingroup$
    Since $q$ is an integer that has value at least $2$ and $p$ is a nonzero probability, the inequalities $$0 < p < q-1/q$$ are trivially true. What are you really trying to ask?
    $endgroup$
    – Dilip Sarwate
    Jan 17 at 15:02










  • $begingroup$
    @DilipSarwate The most likely explanation for that strange thing you observed was that when an earlier editor TeXified the post, they didn't think about this, and didn't add the parentheses I just added. When written in ASCII it is a bit ambiguos whether the parens were intended. My educated guess is that they were intended :-)
    $endgroup$
    – Jyrki Lahtonen
    Jan 17 at 23:04










  • $begingroup$
    Even so, the question is a bit unclear. I'm seconding leonbloy's request.
    $endgroup$
    – Jyrki Lahtonen
    Jan 17 at 23:05








1




1




$begingroup$
Perhaps you should add some more context (details of the channel, and where you've read that assumption)
$endgroup$
– leonbloy
Jan 15 at 20:52




$begingroup$
Perhaps you should add some more context (details of the channel, and where you've read that assumption)
$endgroup$
– leonbloy
Jan 15 at 20:52












$begingroup$
Since $q$ is an integer that has value at least $2$ and $p$ is a nonzero probability, the inequalities $$0 < p < q-1/q$$ are trivially true. What are you really trying to ask?
$endgroup$
– Dilip Sarwate
Jan 17 at 15:02




$begingroup$
Since $q$ is an integer that has value at least $2$ and $p$ is a nonzero probability, the inequalities $$0 < p < q-1/q$$ are trivially true. What are you really trying to ask?
$endgroup$
– Dilip Sarwate
Jan 17 at 15:02












$begingroup$
@DilipSarwate The most likely explanation for that strange thing you observed was that when an earlier editor TeXified the post, they didn't think about this, and didn't add the parentheses I just added. When written in ASCII it is a bit ambiguos whether the parens were intended. My educated guess is that they were intended :-)
$endgroup$
– Jyrki Lahtonen
Jan 17 at 23:04




$begingroup$
@DilipSarwate The most likely explanation for that strange thing you observed was that when an earlier editor TeXified the post, they didn't think about this, and didn't add the parentheses I just added. When written in ASCII it is a bit ambiguos whether the parens were intended. My educated guess is that they were intended :-)
$endgroup$
– Jyrki Lahtonen
Jan 17 at 23:04












$begingroup$
Even so, the question is a bit unclear. I'm seconding leonbloy's request.
$endgroup$
– Jyrki Lahtonen
Jan 17 at 23:05




$begingroup$
Even so, the question is a bit unclear. I'm seconding leonbloy's request.
$endgroup$
– Jyrki Lahtonen
Jan 17 at 23:05










1 Answer
1






active

oldest

votes


















1












$begingroup$

In a $q$-ary channel with input and output alphabet ${0,1, ldots, q-1}$, consider the transition probabilities $p_{i,j}$ that tell us the probability that a transmitted $i$ is received as a $j$. Note that for each $i$, $sum_{j=0}^{q-1} p_{i,j} = 1$ since something must be received when $i$ is transmitted. In a $q$-ary symmetric channel, all the $p_{i,j}$ have the same value $hat{p}$ for all $ineq j$ while all the $p_{i,i}$ have the same value $alpha$. Thus,
$$hat{p}(q-1) + alpha = 1.$$ The OP defines the probability of symbol error as $p = hat{p}(q-1)$ -- it is the probability that an incorrect symbol is received -- and so we have that $p+alpha = 1$.



Now, of the $q$ numbers $p_{i,0}, p_{i,0}, ldots, p_{i,q-1}$ whose sum is $1$, at least one, hopefully $p_{i,i} = alpha$, must be larger than $frac 1q$ because if none of the $p_{I,j}$ exceed $frac 1q$, then they must all will equal $frac 1q$ and the channel will be useless: the output will be independent of the input. So, since $p+alpha = 1$ and $alpha > frac 1q$, we see that $$p + frac 1q < 1 implies p < 1 - frac 1q = frac{q-1}{q}.$$



So why does this argument not work when $q = 2$?? well for the binary symmetric channel, if $p > frac 12 = frac{q-1}{q}bigvert_{q=2}$, as mathematicians we can just cuss the engineer for mis-labeling the channel outputs and tell him to flip the output bits, thus converting the binary symmetric channel with crossover probability $p > frac 12$ into a binary symmetric channel with crossover probability $1-p < frac 12$. Unfortunately such "flipping" does not work when $q>2$






share|cite|improve this answer









$endgroup$













    Your Answer





    StackExchange.ifUsing("editor", function () {
    return StackExchange.using("mathjaxEditing", function () {
    StackExchange.MarkdownEditor.creationCallbacks.add(function (editor, postfix) {
    StackExchange.mathjaxEditing.prepareWmdForMathJax(editor, postfix, [["$", "$"], ["\\(","\\)"]]);
    });
    });
    }, "mathjax-editing");

    StackExchange.ready(function() {
    var channelOptions = {
    tags: "".split(" "),
    id: "69"
    };
    initTagRenderer("".split(" "), "".split(" "), channelOptions);

    StackExchange.using("externalEditor", function() {
    // Have to fire editor after snippets, if snippets enabled
    if (StackExchange.settings.snippets.snippetsEnabled) {
    StackExchange.using("snippets", function() {
    createEditor();
    });
    }
    else {
    createEditor();
    }
    });

    function createEditor() {
    StackExchange.prepareEditor({
    heartbeatType: 'answer',
    autoActivateHeartbeat: false,
    convertImagesToLinks: true,
    noModals: true,
    showLowRepImageUploadWarning: true,
    reputationToPostImages: 10,
    bindNavPrevention: true,
    postfix: "",
    imageUploader: {
    brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
    contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
    allowUrls: true
    },
    noCode: true, onDemand: true,
    discardSelector: ".discard-answer"
    ,immediatelyShowMarkdownHelp:true
    });


    }
    });














    draft saved

    draft discarded


















    StackExchange.ready(
    function () {
    StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fmath.stackexchange.com%2fquestions%2f3074581%2fq-ary-symmetric-channel-error-probability%23new-answer', 'question_page');
    }
    );

    Post as a guest















    Required, but never shown

























    1 Answer
    1






    active

    oldest

    votes








    1 Answer
    1






    active

    oldest

    votes









    active

    oldest

    votes






    active

    oldest

    votes









    1












    $begingroup$

    In a $q$-ary channel with input and output alphabet ${0,1, ldots, q-1}$, consider the transition probabilities $p_{i,j}$ that tell us the probability that a transmitted $i$ is received as a $j$. Note that for each $i$, $sum_{j=0}^{q-1} p_{i,j} = 1$ since something must be received when $i$ is transmitted. In a $q$-ary symmetric channel, all the $p_{i,j}$ have the same value $hat{p}$ for all $ineq j$ while all the $p_{i,i}$ have the same value $alpha$. Thus,
    $$hat{p}(q-1) + alpha = 1.$$ The OP defines the probability of symbol error as $p = hat{p}(q-1)$ -- it is the probability that an incorrect symbol is received -- and so we have that $p+alpha = 1$.



    Now, of the $q$ numbers $p_{i,0}, p_{i,0}, ldots, p_{i,q-1}$ whose sum is $1$, at least one, hopefully $p_{i,i} = alpha$, must be larger than $frac 1q$ because if none of the $p_{I,j}$ exceed $frac 1q$, then they must all will equal $frac 1q$ and the channel will be useless: the output will be independent of the input. So, since $p+alpha = 1$ and $alpha > frac 1q$, we see that $$p + frac 1q < 1 implies p < 1 - frac 1q = frac{q-1}{q}.$$



    So why does this argument not work when $q = 2$?? well for the binary symmetric channel, if $p > frac 12 = frac{q-1}{q}bigvert_{q=2}$, as mathematicians we can just cuss the engineer for mis-labeling the channel outputs and tell him to flip the output bits, thus converting the binary symmetric channel with crossover probability $p > frac 12$ into a binary symmetric channel with crossover probability $1-p < frac 12$. Unfortunately such "flipping" does not work when $q>2$






    share|cite|improve this answer









    $endgroup$


















      1












      $begingroup$

      In a $q$-ary channel with input and output alphabet ${0,1, ldots, q-1}$, consider the transition probabilities $p_{i,j}$ that tell us the probability that a transmitted $i$ is received as a $j$. Note that for each $i$, $sum_{j=0}^{q-1} p_{i,j} = 1$ since something must be received when $i$ is transmitted. In a $q$-ary symmetric channel, all the $p_{i,j}$ have the same value $hat{p}$ for all $ineq j$ while all the $p_{i,i}$ have the same value $alpha$. Thus,
      $$hat{p}(q-1) + alpha = 1.$$ The OP defines the probability of symbol error as $p = hat{p}(q-1)$ -- it is the probability that an incorrect symbol is received -- and so we have that $p+alpha = 1$.



      Now, of the $q$ numbers $p_{i,0}, p_{i,0}, ldots, p_{i,q-1}$ whose sum is $1$, at least one, hopefully $p_{i,i} = alpha$, must be larger than $frac 1q$ because if none of the $p_{I,j}$ exceed $frac 1q$, then they must all will equal $frac 1q$ and the channel will be useless: the output will be independent of the input. So, since $p+alpha = 1$ and $alpha > frac 1q$, we see that $$p + frac 1q < 1 implies p < 1 - frac 1q = frac{q-1}{q}.$$



      So why does this argument not work when $q = 2$?? well for the binary symmetric channel, if $p > frac 12 = frac{q-1}{q}bigvert_{q=2}$, as mathematicians we can just cuss the engineer for mis-labeling the channel outputs and tell him to flip the output bits, thus converting the binary symmetric channel with crossover probability $p > frac 12$ into a binary symmetric channel with crossover probability $1-p < frac 12$. Unfortunately such "flipping" does not work when $q>2$






      share|cite|improve this answer









      $endgroup$
















        1












        1








        1





        $begingroup$

        In a $q$-ary channel with input and output alphabet ${0,1, ldots, q-1}$, consider the transition probabilities $p_{i,j}$ that tell us the probability that a transmitted $i$ is received as a $j$. Note that for each $i$, $sum_{j=0}^{q-1} p_{i,j} = 1$ since something must be received when $i$ is transmitted. In a $q$-ary symmetric channel, all the $p_{i,j}$ have the same value $hat{p}$ for all $ineq j$ while all the $p_{i,i}$ have the same value $alpha$. Thus,
        $$hat{p}(q-1) + alpha = 1.$$ The OP defines the probability of symbol error as $p = hat{p}(q-1)$ -- it is the probability that an incorrect symbol is received -- and so we have that $p+alpha = 1$.



        Now, of the $q$ numbers $p_{i,0}, p_{i,0}, ldots, p_{i,q-1}$ whose sum is $1$, at least one, hopefully $p_{i,i} = alpha$, must be larger than $frac 1q$ because if none of the $p_{I,j}$ exceed $frac 1q$, then they must all will equal $frac 1q$ and the channel will be useless: the output will be independent of the input. So, since $p+alpha = 1$ and $alpha > frac 1q$, we see that $$p + frac 1q < 1 implies p < 1 - frac 1q = frac{q-1}{q}.$$



        So why does this argument not work when $q = 2$?? well for the binary symmetric channel, if $p > frac 12 = frac{q-1}{q}bigvert_{q=2}$, as mathematicians we can just cuss the engineer for mis-labeling the channel outputs and tell him to flip the output bits, thus converting the binary symmetric channel with crossover probability $p > frac 12$ into a binary symmetric channel with crossover probability $1-p < frac 12$. Unfortunately such "flipping" does not work when $q>2$






        share|cite|improve this answer









        $endgroup$



        In a $q$-ary channel with input and output alphabet ${0,1, ldots, q-1}$, consider the transition probabilities $p_{i,j}$ that tell us the probability that a transmitted $i$ is received as a $j$. Note that for each $i$, $sum_{j=0}^{q-1} p_{i,j} = 1$ since something must be received when $i$ is transmitted. In a $q$-ary symmetric channel, all the $p_{i,j}$ have the same value $hat{p}$ for all $ineq j$ while all the $p_{i,i}$ have the same value $alpha$. Thus,
        $$hat{p}(q-1) + alpha = 1.$$ The OP defines the probability of symbol error as $p = hat{p}(q-1)$ -- it is the probability that an incorrect symbol is received -- and so we have that $p+alpha = 1$.



        Now, of the $q$ numbers $p_{i,0}, p_{i,0}, ldots, p_{i,q-1}$ whose sum is $1$, at least one, hopefully $p_{i,i} = alpha$, must be larger than $frac 1q$ because if none of the $p_{I,j}$ exceed $frac 1q$, then they must all will equal $frac 1q$ and the channel will be useless: the output will be independent of the input. So, since $p+alpha = 1$ and $alpha > frac 1q$, we see that $$p + frac 1q < 1 implies p < 1 - frac 1q = frac{q-1}{q}.$$



        So why does this argument not work when $q = 2$?? well for the binary symmetric channel, if $p > frac 12 = frac{q-1}{q}bigvert_{q=2}$, as mathematicians we can just cuss the engineer for mis-labeling the channel outputs and tell him to flip the output bits, thus converting the binary symmetric channel with crossover probability $p > frac 12$ into a binary symmetric channel with crossover probability $1-p < frac 12$. Unfortunately such "flipping" does not work when $q>2$







        share|cite|improve this answer












        share|cite|improve this answer



        share|cite|improve this answer










        answered Jan 18 at 4:31









        Dilip SarwateDilip Sarwate

        19.1k13076




        19.1k13076






























            draft saved

            draft discarded




















































            Thanks for contributing an answer to Mathematics Stack Exchange!


            • Please be sure to answer the question. Provide details and share your research!

            But avoid



            • Asking for help, clarification, or responding to other answers.

            • Making statements based on opinion; back them up with references or personal experience.


            Use MathJax to format equations. MathJax reference.


            To learn more, see our tips on writing great answers.




            draft saved


            draft discarded














            StackExchange.ready(
            function () {
            StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fmath.stackexchange.com%2fquestions%2f3074581%2fq-ary-symmetric-channel-error-probability%23new-answer', 'question_page');
            }
            );

            Post as a guest















            Required, but never shown





















































            Required, but never shown














            Required, but never shown












            Required, but never shown







            Required, but never shown

































            Required, but never shown














            Required, but never shown












            Required, but never shown







            Required, but never shown







            Popular posts from this blog

            Mario Kart Wii

            The Binding of Isaac: Rebirth/Afterbirth

            What does “Dominus providebit” mean?