A Generalized Model of Pac Learning and its Applicability

A publication (journal article) of the University of Göttingen

Jump to: Cite & Linked | Documents & Media | Details | Version history

Cite this publication

​A Generalized Model of Pac Learning and its Applicability​
Brodag, T. ; Herbold, S.   & Waack, S. ​ (2014) 
RAIRO - Theoretical Informatics and Applications48(2) pp. 209​-245​.​

Documents & Media

License

Attribution 4.0 CC BY 4.0

Details

Authors
Brodag, Thomas ; Herbold, Steffen ; Waack, Stephan 
Abstract
We combine a new data model, where the random classification is subjected to rather weak restrictions which in turn are based on the Mammen-Tsybakov [E. Mammen and A. B. Tsybakov, Ann. Statis. 27 (1999) 1808-1829; A. B. Tsybakov, Ann. Statis. 32 (2004) 135-166.] small margin conditions, and the statistical query (SQ) model due to Kearns [M. J. Kearns, J. ACM 45 (1998) 983-1006] to what we refer to as PAC + SQ model. We generalize the class conditional constant noise (CCCN) model introduced by Decatur [S. E. Decatur, in ICML '97: Proc. of the Fourteenth Int. Conf. on Machine Learn. Morgan Kaufmann Publishers Inc. San Francisco, CA, USA (1997) 83-91] to the noise model orthogonal to a set of query functions. We show that every polynomial time PAC + SQ learning algorithm can be efficiently simulated provided that the random noise rate is orthogonal to the query functions used by the algorithm given the target concept. Furthermore, we extend the constant-partition classification noise (CPCN) model due to Decatur [S. E. Decatur, in ICML '97: Proc. of the Fourteenth Int. Conf. on Machine Learn. Morgan Kaufmann Publishers Inc. San Francisco, CA, USA (1997) 83-91] to what we call the constant-partition piecewise orthogonal (CPPO) noise model. We show how statistical queries can be simulated in the CPPO scenario, given the partition is known to the learner. We show how to practically use PAC + SQ simulators in the noise model orthogonal to the query space by presenting two examples from bioinformatics and software engineering. This way, we demonstrate that our new noise model is realistic.
Issue Date
2014
Journal
RAIRO - Theoretical Informatics and Applications 
ISSN
1290-385X; 0988-3754

Reference

Citations


Social Media