University of Waterloo

Most current speech recognition systems use hidden Markov models (HMMs) to deal with the temporal variability of speech and Gaussian mixture models (GMMs) to determine how well each state of each HMM fits a frame or a short window of frames of coefficients that represents the acoustic input. An alternative way to evaluate the fit is to use a feed-forward neural network that takes several frames of coefficients as input and produces posterior probabilities over HMM states as output. Deep neural networks (DNNs) that have many hidden layers and are trained using new methods have been shown to outperform GMMs on a variety of speech recognition benchmarks, sometimes by a large margin. This article provides an overview of this progress and represents the shared views of four research groups that have had recent successes in using DNNs for acoustic modeling in speech recognition.

Preface to the Fourth Edition. 1 Biomechanics as an Interdiscipline. 1.0 Introduction. 1.1 Measurement, Description, Analysis, and Assessment. 1.2 Biomechanics and its Relationship with Physiology and Anatomy. 1.3 Scope of the Textbook. 1.4 References. 2 Signal Processing. 2.0 Introduction. 2.1 Auto- and Cross-Correlation Analyses. 2.2 Frequency Analysis. 2.3 Ensemble Averaging of Repetitive Waveforms. 2.4 References. 3 Kinematics. 3.0 Historical Development and Complexity of Problem. 3.1 Kinematic Conventions. 3.2 Direct Measurement Techniques. 3.3 Imaging Measurement Techniques. 3.4 Processing of Raw Kinematic Data. 3.5 Calculation of Other Kinematic Variables. 3.6 Problems Based on Kinematic Data. 3.7 References. 4 Anthropometry. 4.0 Scope of Anthropometry in Movement Biomechanics. 4.1 Density, Mass, and Inertial Properties. 4.2 Direct Experimental Measures. 4.3 Muscle Anthropometry. 4.4 Problems Based on Anthropometric Data. 4.5 References. 5 Kinetics: Forces and Moments of Force. 5.0 Biomechanical Models. 5.1 Basic Link-Segment Equations-the Free-Body Diagram. 5.2 Force Transducers and Force Plates. 5.3 Bone-on-Bone Forces During Dynamic Conditions. 5.4 Problems Based on Kinetic and Kinematic Data. 5.5 References. 6 Mechanical Work, Energy, and Power. 6.0 Introduction. 6.1 Efficiency. 6.2 Forms of Energy Storage. 6.3 Calculation of Internal and External Work. 6.4 Power Balances at Joints and Within Segments. 6.5 Problems Based on Kinetic and Kinematic Data. 6.6 References. 7 Three-Dimensional Kinematics and Kinetics. 7.0 Introduction. 7.1 Axes Systems. 7.2 Marker and Anatomical Axes Systems. 7.3 Determination of Segment Angular Velocities and Accelerations. 7.4 Kinetic Analysis of Reaction Forces and Moments. 7.5 Suggested Further Reading. 7.6 References. 8 Synthesis of Human Movement-Forward Solutions. 8.0 Introduction. 8.1 Review of Forward Solution Models. 8.2 Mathematical Formulation. 8.3 System Energy. 8.4 External Forces and Torques. 8.5 Designation of Joints. 8.6 Illustrative Example. 8.7 Conclusions. 8.8 References. 9 Muscle Mechanics. 9.0 Introduction. 9.1 Force-Length Characteristics of Muscles. 9.2 Force-Velocity Characteristics. 9.3 Muscle Modeling. 9.4 References. 10 Kinesiological Electromyography. 10.0 Introduction. 10.1 Electrophysiology of Muscle Contraction. 10.2 Recording of the Electromyogram. 10.3 Processing of the Electromyogram,. 10.4 Relationship between Electromyogram and Biomechanical Variables. 10.5 References. 11 Biomechanical Movement Synergies. 11.0 Introduction. 11.1 The Support Moment Synergy. 11.2 Medial/Lateral and Anterior/Posterior Balance in Standing. 11.3 Dynamic Balance during Walking. 11.4 References. APPENDICES. A. Kinematic, Kinetic, and Energy Data. Figure A.1 Walking Trial-Marker Locations and Mass and Frame Rate Information. Table A.1 Raw Coordinate Data (cm). Table A.2( a ) Filtered Marker Kinematics-Rib Cage and Greater Trochanter (Hip). Table A.2( b ) Filtered Marker Kinematics-Femoral Lateral Epicondyle (Knee) and Head of Fibula. Table A.2( c ) Filtered Marker Kinematics-Lateral Malleolus (Ankle) and Heel. Table A.2( d ) Filtered Marker Kinematics-Fifth Metatarsal and Toe. Table A.3( a ) Linear and Angular Kinematics-Foot. Table A.3( b ) Linear and Angular Kinematics-Leg. Table A.3( c ) Linear and Angular Kinematics-Thigh. Table A.3( d ) Linear and Angular Kinematics-1/2 HAT. Table A.4 Relative Joint Angular Kinematics-Ankle, Knee, and Hip. Table A.5( a ) Reaction Forces and Moments of Force-Ankle and Knee. Table A.5( b ) Reaction Forces and Moments of Force-Hip. Table A.6 Segment Potential, Kinetic, and Total Energies-Foot, Leg, Thigh, and1/2 HAT. Table A.7 Power Generation/Absorption and Transfer-Ankle, Knee, and Hip. B. Units and Definitions Related to Biomechanical and Electromyographical Measurements. Table B.1 Base SI Units. Table B.2 Derived SI Units. Index.

The importance of breastfeeding in low-income and middle-income countries is well recognised, but less consensus exists about its importance in high-income countries. In low-income and middle-income countries, only 37% of children younger than 6 months of age are exclusively breastfed. With few exceptions, breastfeeding duration is shorter in high-income countries than in those that are resource-poor. Our meta-analyses indicate protection against child infections and malocclusion, increases in intelligence, and probable reductions in overweight and diabetes. We did not find associations with allergic disorders such as asthma or with blood pressure or cholesterol, and we noted an increase in tooth decay with longer periods of breastfeeding. For nursing women, breastfeeding gave protection against breast cancer and it improved birth spacing, and it might also protect against ovarian cancer and type 2 diabetes. The scaling up of breastfeeding to a near universal level could prevent 823,000 annual deaths in children younger than 5 years and 20,000 annual deaths from breast cancer. Recent epidemiological and biological findings from during the past decade expand on the known benefits of breastfeeding for women and children, whether they are rich or poor.

Algorithms that must deal with complicated global functions of many variables often exploit the manner in which the given functions factor as a product of "local" functions, each of which depends on a subset of the variables. Such a factorization can be visualized with a bipartite graph that we call a factor graph, In this tutorial paper, we present a generic message-passing algorithm, the sum-product algorithm, that operates in a factor graph. Following a single, simple computational rule, the sum-product algorithm computes-either exactly or approximately-various marginal functions derived from the global function. A wide variety of algorithms developed in artificial intelligence, signal processing, and digital communications can be derived as specific instances of the sum-product algorithm, including the forward/backward algorithm, the Viterbi algorithm, the iterative "turbo" decoding algorithm, Pearl's (1988) belief propagation algorithm for Bayesian networks, the Kalman filter, and certain fast Fourier transform (FFT) algorithms.

In 2008 we published the first set of guidelines for standardizing research in autophagy. Since then, research on this topic has continued to accelerate, and many new scientists have entered the field. Our knowledge base and relevant new technologies have also been expanding. Accordingly, it is important to update these guidelines for monitoring autophagy in different organisms. Various reviews have described the range of assays that have been used for this purpose. Nevertheless, there continues to be confusion regarding acceptable methods to measure autophagy, especially in multicellular eukaryotes. For example, a key point that needs to be emphasized is thatthere is a difference between measurements that monitor the numbers or volume of autophagic elements (e.g., autophagosomes or autolysosomes) at any stage of the autophagic process versus those that measure flux through the autophagy pathway (i.e., the completeprocess including the amount and rate of cargo sequestered and degraded). In particular, a block in macroautophagy that results in autophagosome accumulation must be differentiated from stimuli that increase autophagic activity, defined as increasedautophagy induction coupled with increased delivery to, and degradation within, lysosomes (inmost higher eukaryotes and some protists such as Dictyostelium) or the vacuole (in plants and fungi). In other words, it is especially important that investigators new to the field understand that the appearance of more autophagosomes does not necessarily equate with more autophagy. In fact, in manycases, autophagosomes accumulate because of a block in trafficking to lysosomes without a concomitant change in autophagosome biogenesis, whereas an increase in autolysosomes may reflect a reduction in degradative activity. It is worth emphasizing here that lysosomal digestion is a stage of autophagy and evaluating its competence is a crucial part of the evaluation of autophagic flux, or complete autophagy. Here, we present a set of guidelines for the selection and interpretation of methods for use by investigators who aim to examine macroautophagy and related processes, as well as forreviewers who need to provide realistic and reasonable critiques of papers that are focused on these processes. These guidelines are not meant to be a formulaic set of rules, because the appropriate assays depend in part on the question being asked and the system being used. In addition, we emphasize that no individual assay is guaranteed to be the most appropriate one in every situation, and we strongly recommend the use of multipleassays to monitor autophagy. Along these lines, because of the potential for pleiotropic effects due to blocking autophagy through genetic manipulation, it is imperative to target by gene knockout or RNA interference more than one autophagyrelated protein. In addition, some individual Atg proteins, or groups of proteins, are involved in other cellular pathways implying that not all Atg proteins can be used as a specific marker for an autophagic process. In these guidelines, we consider these various methods of assessing autophagy and what information can, or cannot, be obtained from them. Finally, by discussing the merits and limits of particular assays, we hope to encourage technical innovation in the field.

Over the past 30 years, significant commercial and academic progress has been made on Li-based battery technologies. From the early Li-metal anode iterations to the current commercial Li-ion batteries (LIBs), the story of the Li-based battery is full of breakthroughs and back tracing steps. This review will discuss the main roles of material science in the development of LIBs. As LIB research progresses and the materials of interest change, different emphases on the different subdisciplines of material science are placed. Early works on LIBs focus more on solid state physics whereas near the end of the 20th century, researchers began to focus more on the morphological aspects (surface coating, porosity, size, and shape) of electrode materials. While it is easy to point out which specific cathode and anode materials are currently good candidates for the next-generation of batteries, it is difficult to explain exactly why those are chosen. In this review, for the reader a complete developmental story of LIB should be clearly drawn, along with an explanation of the reasons responsible for the various technological shifts. The review will end with a statement of caution for the current modern battery research along with a brief discussion on beyond lithium-ion battery chemistries.

The novel coronavirus (COVID-19) is challenging the world. With no vaccine and limited medical capacity to treat the disease, nonpharmaceutical interventions (NPI) are the main strategy to contain the pandemic. Unprecedented global travel restrictions and stay-at-home orders are causing the most severe disruption of the global economy since World War II. With international travel bans affecting over 90% of the world population and wide-spread restrictions on public gatherings and community mobility, tourism largely ceased in March 2020. Early evidence on impacts on air travel, cruises, and accommodations have been devastating. While highly uncertain, early projections from UNWTO for 2020 suggest international arrivals could decline by 20 to 30% relative to 2019. Tourism is especially susceptible to measures to counteract pandemics because of restricted mobility and social distancing. The paper compares the impacts of COVID-19 to previous epidemic/pandemics and other types of global crises and explores how the pandemic may change society, the economy, and tourism. It discusses why COVID-19 is an analogue to the ongoing climate crisis, and why there is a need to question the volume growth tourism model advocated by UNWTO, ICAO, CLIA, WTTC and other tourism organizations.

Abstract When surrounded by a transparent emission region, black holes are expected to reveal a dark shadow caused by gravitational light bending and photon capture at the event horizon. To image and study this phenomenon, we have assembled the Event Horizon Telescope, a global very long baseline interferometry array observing at a wavelength of 1.3 mm. This allows us to reconstruct event-horizon-scale images of the supermassive black hole candidate in the center of the giant elliptical galaxy M87. We have resolved the central compact radio source as an asymmetric bright emission ring with a diameter of 42 ± 3 μ as, which is circular and encompasses a central depression in brightness with a flux ratio ≳10:1. The emission ring is recovered using different calibration and imaging schemes, with its diameter and width remaining stable over four different observations carried out in different days. Overall, the observed image is consistent with expectations for the shadow of a Kerr black hole as predicted by general relativity. The asymmetry in brightness in the ring can be explained in terms of relativistic beaming of the emission from a plasma rotating close to the speed of light around a black hole. We compare our images to an extensive library of ray-traced general-relativistic magnetohydrodynamic simulations of black holes and derive a central mass of M = (6.5 ± 0.7) × 10 9 M ⊙ . Our radio-wave observations thus provide powerful evidence for the presence of supermassive black holes in centers of galaxies and as the central engines of active galactic nuclei. They also present a new tool to explore gravity in its most extreme limit and on a mass scale that was so far not accessible.

Discriminative learning methods for classification perform well when training and test data are drawn from the same distribution. Often, however, we have plentiful labeled training data from a source domain but wish to learn a classifier which performs well on a target domain with a different distribution and little or no labeled training data. In this work we investigate two questions. First, under what conditions can a classifier trained from source data be expected to perform well on target data? Second, given a small amount of labeled target data, how should we combine it during training with the large amount of labeled source data to achieve the lowest target error at test time? We address the first question by bounding a classifier’s target error in terms of its source error and the divergence between the two domains. We give a classifier-induced divergence measure that can be estimated from finite, unlabeled samples from the domains. Under the assumption that there exists some hypothesis that performs well in both domains, we show that this quantity together with the empirical source error characterize the target error of a source-trained classifier. We answer the second question by bounding the target error of a model which minimizes a convex combination of the empirical source and target errors. Previous theoretical work has considered minimizing just the source error, just the target error, or weighting instances from the two domains equally. We show how to choose the optimal combination of source and target error as a function of the divergence, the sample sizes of both domains, and the complexity of the hypothesis class. The resulting bound generalizes the previously studied cases and is always at least as tight as a bound which considers minimizing only the target error or an equal weighting of source and target errors.

Abstract Cloud computing has recently emerged as a new paradigm for hosting and delivering services over the Internet. Cloud computing is attractive to business owners as it eliminates the requirement for users to plan ahead for provisioning, and allows enterprises to start from the small and increase resources only when there is a rise in service demand. However, despite the fact that cloud computing offers huge opportunities to the IT industry, the development of cloud computing technology is currently at its infancy, with many issues still to be addressed. In this paper, we present a survey of cloud computing, highlighting its key concepts, architectural principles, state-of-the-art implementation as well as research challenges. The aim of this paper is to provide a better understanding of the design challenges of cloud computing and identify important research directions in this increasingly important area.

Pilot studies for phase III trials - which are comparative randomized trials designed to provide preliminary evidence on the clinical efficacy of a drug or intervention - are routinely performed in many clinical areas. Also commonly know as "feasibility" or "vanguard" studies, they are designed to assess the safety of treatment or interventions; to assess recruitment potential; to assess the feasibility of international collaboration or coordination for multicentre trials; to increase clinical experience with the study medication or intervention for the phase III trials. They are the best way to assess feasibility of a large, expensive full-scale study, and in fact are an almost essential pre-requisite. Conducting a pilot prior to the main study can enhance the likelihood of success of the main study and potentially help to avoid doomed main studies. The objective of this paper is to provide a detailed examination of the key aspects of pilot studies for phase III trials including: 1) the general reasons for conducting a pilot study; 2) the relationships between pilot studies, proof-of-concept studies, and adaptive designs; 3) the challenges of and misconceptions about pilot studies; 4) the criteria for evaluating the success of a pilot study; 5) frequently asked questions about pilot studies; 7) some ethical aspects related to pilot studies; and 8) some suggestions on how to report the results of pilot investigations using the CONSORT format.

Variations of the SIMPLE method of Patankar and Spalding have been widely used over the past decade to obtain numerical solutions to problems involving incompressible flows. The present paper shows several modifications to the method which both simplify its implementation and reduce solution costs. The performances of SIMPLE, SIMPLER, and SIMPLEC (the present method) are compared for two recirculating flow problems. The paper is addressed to readers who already have experience with SIMPLE or its variants.

Subwavelength resolution imaging requires high numerical aperture (NA) lenses, which are bulky and expensive. Metasurfaces allow the miniaturization of conventional refractive optics into planar structures. We show that high-aspect-ratio titanium dioxide metasurfaces can be fabricated and designed as metalenses with NA = 0.8. Diffraction-limited focusing is demonstrated at wavelengths of 405, 532, and 660 nm with corresponding efficiencies of 86, 73, and 66%. The metalenses can resolve nanoscale features separated by subwavelength distances and provide magnification as high as 170×, with image qualities comparable to a state-of-the-art commercial objective. Our results firmly establish that metalenses can have widespread applications in laser-based microscopy, imaging, and spectroscopy.

The worldwide increases in both environmental damage and human population pressure have the unfortunate consequence that global food production may soon become insufficient to feed all of the world's people. It is therefore essential that agricultural productivity be significantly increased within the next few decades. To this end, agricultural practice is moving toward a more sustainable and environmentally friendly approach. This includes both the increasing use of transgenic plants and plant growth-promoting bacteria as a part of mainstream agricultural practice. Here, a number of the mechanisms utilized by plant growth-promoting bacteria are discussed and considered. It is envisioned that in the not too distant future, plant growth-promoting bacteria (PGPB) will begin to replace the use of chemicals in agriculture, horticulture, silviculture, and environmental cleanup strategies. While there may not be one simple strategy that can effectively promote the growth of all plants under all conditions, some of the strategies that are discussed already show great promise.

The Coronavirus Disease 2019 (COVID-19) pandemic continues to have a devastating effect on the health and well-being of the global population. A critical step in the fight against COVID-19 is effective screening of infected patients, with one of the key screening approaches being radiology examination using chest radiography. It was found in early studies that patients present abnormalities in chest radiography images that are characteristic of those infected with COVID-19. Motivated by this and inspired by the open source efforts of the research community, in this study we introduce COVID-Net, a deep convolutional neural network design tailored for the detection of COVID-19 cases from chest X-ray (CXR) images that is open source and available to the general public. To the best of the authors' knowledge, COVID-Net is one of the first open source network designs for COVID-19 detection from CXR images at the time of initial release. We also introduce COVIDx, an open access benchmark dataset that we generated comprising of 13,975 CXR images across 13,870 patient patient cases, with the largest number of publicly available COVID-19 positive cases to the best of the authors' knowledge. Furthermore, we investigate how COVID-Net makes predictions using an explainability method in an attempt to not only gain deeper insights into critical factors associated with COVID cases, which can aid clinicians in improved screening, but also audit COVID-Net in a responsible and transparent manner to validate that it is making decisions based on relevant information from the CXR images. By no means a production-ready solution, the hope is that the open access COVID-Net, along with the description on constructing the open source COVIDx dataset, will be leveraged and build upon by both researchers and citizen data scientists alike to accelerate the development of highly accurate yet practical deep learning solutions for detecting COVID-19 cases and accelerate treatment of those who need it the most.

In this article, we have reviewed the reasons why we (collectively) want to love or leave the venerable (but perhaps hoary) MSE. We have also reviewed emerging alternative signal fidelity measures and discussed their potential application to a wide variety of problems. The message we are trying to send here is not that one should abandon use of the MSE nor to blindly switch to any other particular signal fidelity measure. Rather, we hope to make the point that there are powerful, easy-to-use, and easy-to-understand alternatives that might be deployed depending on the application environment and needs. While we expect (and indeed, hope) that the MSE will continue to be widely used as a signal fidelity measure, it is our greater desire to see more advanced signal fidelity measures being used, especially in applications where perceptual criteria might be relevant. Ideally, the performance of a new signal processing algorithm might be compared to other algorithms using several fidelity criteria. Lastly, we hope that we have given further motivation to the community to consider recent advanced signal fidelity measures as design criteria for optimizing signal processing algorithms and systems. It is in this direction that we believe that the greatest benefit eventually lies.

Machine learning is one of the fastest growing areas of computer science, with far-reaching applications. The aim of this textbook is to introduce machine learning, and the algorithmic paradigms it offers, in a principled way. The book provides an extensive theoretical account of the fundamental ideas underlying machine learning and the mathematical derivations that transform these principles into practical algorithms. Following a presentation of the basics of the field, the book covers a wide array of central topics that have not been addressed by previous textbooks. These include a discussion of the computational complexity of learning and the concepts of convexity and stability; important algorithmic paradigms including stochastic gradient descent, neural networks, and structured output learning; and emerging theoretical concepts such as the PAC-Bayes approach and compression-based bounds. Designed for an advanced undergraduate or beginning graduate course, the text makes the fundamentals and algorithms of machine learning accessible to students and non-expert readers in statistics, computer science, mathematics, and engineering.

A fundamental analysis of the meaning of second-moment reliability in multivariate problems is presented. The format described is entirely derived from one basic assumption concerning the measurement of reliability. All formulations are exact, and approximations involving the assumption of small variance are only introduced to simplify practical equations. The format is fully invariant under any change of formulation of the failure criteria consistent with the laws of algebra and mechanics.

BACKGROUND: Many causes of vision impairment can be prevented or treated. With an ageing global population, the demands for eye health services are increasing. We estimated the prevalence and relative contribution of avoidable causes of blindness and vision impairment globally from 1990 to 2020. We aimed to compare the results with the World Health Assembly Global Action Plan (WHA GAP) target of a 25% global reduction from 2010 to 2019 in avoidable vision impairment, defined as cataract and undercorrected refractive error. METHODS: We did a systematic review and meta-analysis of population-based surveys of eye disease from January, 1980, to October, 2018. We fitted hierarchical models to estimate prevalence (with 95% uncertainty intervals [UIs]) of moderate and severe vision impairment (MSVI; presenting visual acuity from <6/18 to 3/60) and blindness (<3/60 or less than 10° visual field around central fixation) by cause, age, region, and year. Because of data sparsity at younger ages, our analysis focused on adults aged 50 years and older. FINDINGS: Global crude prevalence of avoidable vision impairment and blindness in adults aged 50 years and older did not change between 2010 and 2019 (percentage change -0·2% [95% UI -1·5 to 1·0]; 2019 prevalence 9·58 cases per 1000 people [95% IU 8·51 to 10·8], 2010 prevalence 96·0 cases per 1000 people [86·0 to 107·0]). Age-standardised prevalence of avoidable blindness decreased by -15·4% [-16·8 to -14·3], while avoidable MSVI showed no change (0·5% [-0·8 to 1·6]). However, the number of cases increased for both avoidable blindness (10·8% [8·9 to 12·4]) and MSVI (31·5% [30·0 to 33·1]). The leading global causes of blindness in those aged 50 years and older in 2020 were cataract (15·2 million cases [9% IU 12·7-18·0]), followed by glaucoma (3·6 million cases [2·8-4·4]), undercorrected refractive error (2·3 million cases [1·8-2·8]), age-related macular degeneration (1·8 million cases [1·3-2·4]), and diabetic retinopathy (0·86 million cases [0·59-1·23]). Leading causes of MSVI were undercorrected refractive error (86·1 million cases [74·2-101·0]) and cataract (78·8 million cases [67·2-91·4]). INTERPRETATION: Results suggest eye care services contributed to the observed reduction of age-standardised rates of avoidable blindness but not of MSVI, and that the target in an ageing global population was not reached. FUNDING: Brien Holden Vision Institute, Fondation Théa, The Fred Hollows Foundation, Bill & Melinda Gates Foundation, Lions Clubs International Foundation, Sightsavers International, and University of Heidelberg.

The increasing interest in integrating intermittent renewable energy sources into microgrids presents major challenges from the viewpoints of reliable operation and control. In this paper, the major issues and challenges in microgrid control are discussed, and a review of state-of-the-art control strategies and trends is presented; a general overview of the main control principles (e.g., droop control, model predictive control, multi-agent systems) is also included. The paper classifies microgrid control strategies into three levels: primary, secondary, and tertiary, where primary and secondary levels are associated with the operation of the microgrid itself, and tertiary level pertains to the coordinated operation of the microgrid and the host grid. Each control level is discussed in detail in view of the relevant existing technical literature.