File Download
There are no files associated with this item.
Links for fulltext
(May Require Subscription)
- Publisher Website: 10.1007/s11222-017-9782-2
- Scopus: eid_2-s2.0-85032507416
- WOS: WOS:000440611000007
- Find via
Supplementary
- Citations:
- Appears in Collections:
Article: Maximum likelihood estimation for incomplete multinomial data via the weaver algorithm
Title | Maximum likelihood estimation for incomplete multinomial data via the weaver algorithm |
---|---|
Authors | |
Keywords | Bradley–Terry model Contingency table Count data Density estimation Incomplete multinomial model |
Issue Date | 2018 |
Publisher | Springer New York LLC. The Journal's web site is located at http://springerlink.metapress.com/openurl.asp?genre=journal&issn=0960-3174 |
Citation | Statistics and Computing, 2018, v. 28 n. 5, p. 1095-1117 How to Cite? |
Abstract | In a multinomial model, the sample space is partitioned into a disjoint union of cells. The partition is usually immutable during sampling of the cell counts. In this paper, we extend the multinomial model to the incomplete multinomial model by relaxing the constant partition assumption to allow the cells to be variable and the counts collected from non-disjoint cells to be modeled in an integrated manner for inference on the common underlying probability. The incomplete multinomial likelihood is parameterized by the complete-cell probabilities from the most refined partition. Its sufficient statistics include the variable-cell formation observed as an indicator matrix and all cell counts. With externally imposed structures on the cell formation process, it reduces to special models including the Bradley–Terry model, the Plackett–Luce model, etc. Since the conventional method, which solves for the zeros of the score functions, is unfruitful, we develop a new approach to establishing a simpler set of estimating equations to obtain the maximum likelihood estimate (MLE), which seeks the simultaneous maximization of all multiplicative components of the likelihood by fitting each component into an inequality. As a consequence, our estimation amounts to solving a system of the equality attainment conditions to the inequalities. The resultant MLE equations are simple and immediately invite a fixed-point iteration algorithm for solution, which is referred to as the weaver algorithm. The weaver algorithm is short and amenable to parallel implementation. We also derive the asymptotic covariance of the MLE, verify main results with simulations, and compare the weaver algorithm with an MM/EM algorithm based on fitting a Plackett–Luce model to a benchmark data set. |
Persistent Identifier | http://hdl.handle.net/10722/246115 |
ISSN | 2023 Impact Factor: 1.6 2023 SCImago Journal Rankings: 0.923 |
ISI Accession Number ID |
DC Field | Value | Language |
---|---|---|
dc.contributor.author | Dong, F | - |
dc.contributor.author | Yin, G | - |
dc.date.accessioned | 2017-09-18T02:22:41Z | - |
dc.date.available | 2017-09-18T02:22:41Z | - |
dc.date.issued | 2018 | - |
dc.identifier.citation | Statistics and Computing, 2018, v. 28 n. 5, p. 1095-1117 | - |
dc.identifier.issn | 0960-3174 | - |
dc.identifier.uri | http://hdl.handle.net/10722/246115 | - |
dc.description.abstract | In a multinomial model, the sample space is partitioned into a disjoint union of cells. The partition is usually immutable during sampling of the cell counts. In this paper, we extend the multinomial model to the incomplete multinomial model by relaxing the constant partition assumption to allow the cells to be variable and the counts collected from non-disjoint cells to be modeled in an integrated manner for inference on the common underlying probability. The incomplete multinomial likelihood is parameterized by the complete-cell probabilities from the most refined partition. Its sufficient statistics include the variable-cell formation observed as an indicator matrix and all cell counts. With externally imposed structures on the cell formation process, it reduces to special models including the Bradley–Terry model, the Plackett–Luce model, etc. Since the conventional method, which solves for the zeros of the score functions, is unfruitful, we develop a new approach to establishing a simpler set of estimating equations to obtain the maximum likelihood estimate (MLE), which seeks the simultaneous maximization of all multiplicative components of the likelihood by fitting each component into an inequality. As a consequence, our estimation amounts to solving a system of the equality attainment conditions to the inequalities. The resultant MLE equations are simple and immediately invite a fixed-point iteration algorithm for solution, which is referred to as the weaver algorithm. The weaver algorithm is short and amenable to parallel implementation. We also derive the asymptotic covariance of the MLE, verify main results with simulations, and compare the weaver algorithm with an MM/EM algorithm based on fitting a Plackett–Luce model to a benchmark data set. | - |
dc.language | eng | - |
dc.publisher | Springer New York LLC. The Journal's web site is located at http://springerlink.metapress.com/openurl.asp?genre=journal&issn=0960-3174 | - |
dc.relation.ispartof | Statistics and Computing | - |
dc.rights | The final publication is available at Springer via http://dx.doi.org/[insert DOI] | - |
dc.subject | Bradley–Terry model | - |
dc.subject | Contingency table | - |
dc.subject | Count data | - |
dc.subject | Density estimation | - |
dc.subject | Incomplete multinomial model | - |
dc.title | Maximum likelihood estimation for incomplete multinomial data via the weaver algorithm | - |
dc.type | Article | - |
dc.identifier.email | Yin, G: gyin@hku.hk | - |
dc.identifier.authority | Yin, G=rp00831 | - |
dc.description.nature | link_to_subscribed_fulltext | - |
dc.identifier.doi | 10.1007/s11222-017-9782-2 | - |
dc.identifier.scopus | eid_2-s2.0-85032507416 | - |
dc.identifier.hkuros | 276185 | - |
dc.identifier.volume | 28 | - |
dc.identifier.issue | 5 | - |
dc.identifier.spage | 1095 | - |
dc.identifier.epage | 1117 | - |
dc.identifier.isi | WOS:000440611000007 | - |
dc.publisher.place | United States | - |
dc.identifier.issnl | 0960-3174 | - |