{"id":80,"date":"2011-12-07T09:10:16","date_gmt":"2011-12-07T09:10:16","guid":{"rendered":"http:\/\/florian-roemer.de\/blog\/?p=80"},"modified":"2013-11-29T15:45:00","modified_gmt":"2013-11-29T15:45:00","slug":"widely-linear-systems-of-equations","status":"publish","type":"post","link":"https:\/\/florian-roemer.de\/blog\/widely-linear-systems-of-equations\/","title":{"rendered":"Widely linear systems of equations"},"content":{"rendered":"<p>I would strongly assume that this must exist already somewhere but I couldn&#8217;t find the solution so I thought it would be interesting to post it here. The closest to this I could find is widely linear estimation (e.g., Picinbono, TSP, 1995), but it&#8217;s not quite the same.<\/p>\n<p>Consider the following widely linear system of equations:<\/p>\n<p>$$\\ma{A} \\cdot \\ma{x} + \\ma{B} \\cdot \\ma{x}^* = \\ma{c},$$<\/p>\n<p>where $\\ma{A},\\ma{B} \\in \\compl^{N \\times N}$ are square invertible matrices and $\\ma{x}, \\ma{c} \\in \\compl^{N \\times 1}$ vectors of corresponding dimension. We would like to find the vector $\\ma{x}$ which satisfies this equation given $\\ma{A}$, $\\ma{B}$, and $\\ma{c}$, if it exists.<\/p>\n<p>This is a system of equations but it is not linear in $\\ma{x}$. It is widely linear though and this implies that it is linear in\u00a0 ${\\rm Re}\\{\\ma{x}\\}$ and in ${\\rm Im}\\{\\ma{x}\\}$. Therefore, it can easily be rewritten as a set of linear equations by introducing the real and imaginary parts of all quantities, i.e., $\\ma{A} = \\ma{A}_{\\rm R} + \\jmath \\ma{A}_{\\rm I}$, $\\ma{B} = \\ma{B}_{\\rm R} + \\jmath \\ma{B}_{\\rm I}$, $\\ma{c} = \\ma{c}_{\\rm R} + \\jmath \\ma{c}_{\\rm I}$, and $\\ma{x} = \\ma{x}_{\\rm R} + \\jmath \\ma{x}_{\\rm I}$. Inserting this into the widely linear system of equations and separating real and imaginary parts we obtain<\/p>\n<p>$$\\left( \\left[ \\ma{A}_{\\rm R} + \\ma{B}_{\\rm R} \\right] \\cdot \\ma{x}_{\\rm R} + \\left[ -\\ma{A}_{\\rm I} + \\ma{B}_{\\rm I} \\right] \\cdot \\ma{x}_{\\rm I}\\right) + \\jmath \\cdot \\left( \\left[ \\ma{A}_{\\rm I} + \\ma{B}_{\\rm I} \\right] \\cdot \\ma{x}_{\\rm R} + \\left[ \\ma{A}_{\\rm R} &#8211; \\ma{B}_{\\rm R} \\right] \\cdot \\ma{x}_{\\rm I}\\right) = \\ma{c}_{\\rm R} + \\jmath \\ma{c}_{\\rm I}.$$<\/p>\n<p>As both sides of the equations are complex numbers, they are equal only if the real parts are equal and the imaginary parts are equal. Hence we have two real-valued systems of equation, which we can write in one larger system:<\/p>\n<p>$$ \\begin{bmatrix}<br \/>\n\\ma{A}_{\\rm R} + \\ma{B}_{\\rm R} &amp; -\\ma{A}_{\\rm I} + \\ma{B}_{\\rm I}\u00a0 \\\\<br \/>\n\\ma{A}_{\\rm I} + \\ma{B}_{\\rm I} &amp; \\ma{A}_{\\rm R} &#8211; \\ma{B}_{\\rm R}<br \/>\n\\end{bmatrix}<br \/>\n\\cdot<br \/>\n\\begin{bmatrix} \\ma{x}_{\\rm R} \\\\ \\ma{x}_{\\rm I} \\end{bmatrix}<br \/>\n= \\begin{bmatrix} \\ma{c}_{\\rm R} \\\\ \\ma{c}_{\\rm I} \\end{bmatrix}.$$<br \/>\n$$ \\ma{\\tilde{C}} \\cdot<br \/>\n\\begin{bmatrix} \\ma{x}_{\\rm R} \\\\ \\ma{x}_{\\rm I} \\end{bmatrix}<br \/>\n= \\begin{bmatrix} \\ma{c}_{\\rm R} \\\\ \\ma{c}_{\\rm I} \\end{bmatrix}.$$<\/p>\n<p>Consequently we have exactly one solution in $\\ma{x}$ if and only if the block matrix $\\ma{\\tilde{C}}$ is non-singular, which implies additional conditions on $\\ma{A}$ and $\\ma{B}$. For instance, a sufficient (but not necessary) condition is that $\\ma{A}_{\\rm R} + \\ma{B}_{\\rm R}$ and its Schur complement $\\ma{A}_{\\rm R} &#8211; \\ma{B}_{\\rm R} &#8211; (\\ma{A}_{\\rm I} + \\ma{B}_{\\rm I}) \\cdot (\\ma{A}_{\\rm R} + \\ma{B}_{\\rm R})^{-1} \\cdot (-\\ma{A}_{\\rm I} + \\ma{B}_{\\rm I})$ are both invertible.<\/p>\n<p>&nbsp;<\/p>\n<p><span style=\"color: #ff0000;\"><strong>*Update*<\/strong><\/span> We found a simpler, solution, please read the <a title=\"Widely linear system of equations, revisited\" href=\"http:\/\/florian-roemer.de\/blog\/widely-linear-system-of-equations-revisited\/\">follow-up blog post on the closed-form solution that avoids real-valued stacking<\/a>.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>I would strongly assume that this must exist already somewhere but I couldn&#8217;t find the solution so I thought it would be interesting to post it here. The closest to this I could find is widely linear estimation (e.g., Picinbono, TSP, 1995), but it&#8217;s not quite the same. Consider the following widely linear system of [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":[],"categories":[3],"tags":[4],"_links":{"self":[{"href":"https:\/\/florian-roemer.de\/blog\/wp-json\/wp\/v2\/posts\/80"}],"collection":[{"href":"https:\/\/florian-roemer.de\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/florian-roemer.de\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/florian-roemer.de\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/florian-roemer.de\/blog\/wp-json\/wp\/v2\/comments?post=80"}],"version-history":[{"count":12,"href":"https:\/\/florian-roemer.de\/blog\/wp-json\/wp\/v2\/posts\/80\/revisions"}],"predecessor-version":[{"id":255,"href":"https:\/\/florian-roemer.de\/blog\/wp-json\/wp\/v2\/posts\/80\/revisions\/255"}],"wp:attachment":[{"href":"https:\/\/florian-roemer.de\/blog\/wp-json\/wp\/v2\/media?parent=80"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/florian-roemer.de\/blog\/wp-json\/wp\/v2\/categories?post=80"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/florian-roemer.de\/blog\/wp-json\/wp\/v2\/tags?post=80"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}