<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink" xmlns:mml="http://www.w3.org/1998/Math/MathML" article-type="research-article"><?properties manuscript?><front><journal-meta><journal-id journal-id-type="nlm-journal-id">8809320</journal-id><journal-id journal-id-type="pubmed-jr-id">1600</journal-id><journal-id journal-id-type="nlm-ta">Neuron</journal-id><journal-id journal-id-type="iso-abbrev">Neuron</journal-id><journal-title-group><journal-title>Neuron</journal-title></journal-title-group><issn pub-type="ppub">0896-6273</issn><issn pub-type="epub">1097-4199</issn></journal-meta><article-meta><article-id pub-id-type="pmid">26774159</article-id><article-id pub-id-type="pmc">4724224</article-id><article-id pub-id-type="doi">10.1016/j.neuron.2015.12.012</article-id><article-id pub-id-type="manuscript">NIHMS745170</article-id><article-categories><subj-group subj-group-type="heading"><subject>Article</subject></subj-group></article-categories><title-group><article-title>Simultaneous multi-plane imaging of neural circuits</article-title></title-group><contrib-group><contrib contrib-type="author"><name><surname>Yang</surname><given-names>Weijian</given-names></name><xref ref-type="aff" rid="A1">1</xref><xref ref-type="corresp" rid="cor1">*</xref></contrib><contrib contrib-type="author"><name><surname>Miller</surname><given-names>Jae-eun Kang</given-names></name><xref ref-type="aff" rid="A1">1</xref></contrib><contrib contrib-type="author"><name><surname>Carrillo-Reid</surname><given-names>Luis</given-names></name><xref ref-type="aff" rid="A1">1</xref></contrib><contrib contrib-type="author"><name><surname>Pnevmatikakis</surname><given-names>Eftychios</given-names></name><xref ref-type="aff" rid="A2">2</xref><xref ref-type="aff" rid="A3">3</xref></contrib><contrib contrib-type="author"><name><surname>Paninski</surname><given-names>Liam</given-names></name><xref ref-type="aff" rid="A1">1</xref><xref ref-type="aff" rid="A3">3</xref></contrib><contrib contrib-type="author"><name><surname>Yuste</surname><given-names>Rafael</given-names></name><xref ref-type="aff" rid="A1">1</xref></contrib><contrib contrib-type="author"><name><surname>Peterka</surname><given-names>Darcy S.</given-names></name><xref ref-type="aff" rid="A1">1</xref></contrib></contrib-group><aff id="A1"><label>1</label>Neurotechnology Center, Department of Biological Sciences, Columbia University, New York, NY 10027, USA</aff><aff id="A2"><label>2</label>Center for Computational Biology, Simons Foundation, New York, NY 10010, USA</aff><aff id="A3"><label>3</label>Department of Statistics, Center for Theoretical Neuroscience, and Grossman Center for the Statistics of Mind, Columbia University, New York, NY 10027, USA</aff><author-notes><corresp id="cor1"><label>*</label>Corresponding Author: Weijian Yang, <email>wy2221@columbia.edu</email>, Phone: +1.646.330.4609</corresp></author-notes><pub-date pub-type="nihms-submitted"><day>20</day><month>12</month><year>2015</year></pub-date><pub-date pub-type="epub"><day>07</day><month>1</month><year>2016</year></pub-date><pub-date pub-type="ppub"><day>20</day><month>1</month><year>2016</year></pub-date><pub-date pub-type="pmc-release"><day>20</day><month>1</month><year>2017</year></pub-date><volume>89</volume><issue>2</issue><fpage>269</fpage><lpage>284</lpage><!--elocation-id from pubmed: 10.1016/j.neuron.2015.12.012--><abstract><title>Summary</title><p id="P1">Recording the activity of large populations of neurons is an important step towards understanding the emergent function of neural circuits. Here we present a simple holographic method to simultaneously perform two-photon calcium imaging of neuronal populations across multiple areas and layers of mouse cortex <italic>in vivo</italic>. We use prior knowledge of neuronal locations, activity sparsity and a constrained nonnegative matrix factorization algorithm to extract signals from neurons imaged simultaneously and located in different focal planes or fields of view. Our laser multiplexing approach is simple and fast and could be used as a general method to image the activity of neural circuits in three dimensions across multiple areas in the brain.</p></abstract></article-meta></front><body><sec sec-type="intro" id="S1"><title>Introduction</title><p id="P2">The coherent activity of individual neurons, firing in precise spatiotemporal patterns, is likely to underlie the function of the nervous system, so methods to record the activity of large neuronal populations appear necessary to identity these emergent patterns in animals and humans (<xref rid="R4" ref-type="bibr">Alivisatos et al., 2012</xref>). Calcium imaging can be used to capture the activity of neuronal populations (<xref rid="R64" ref-type="bibr">Yuste and Katz, 1991</xref>), and one can use it, for example, to image the firing of nearly the entire brain of the larval zebrafish, with single-cell resolution (<xref rid="R1" ref-type="bibr">Ahrens et al., 2013</xref>). But the larval zebrafish is transparent, and in scattering tissue, where nonlinear microscopy is necessary (<xref rid="R20" ref-type="bibr">Denk et al., 1990</xref>; <xref rid="R63" ref-type="bibr">Williams et al., 2001</xref>; <xref rid="R65" ref-type="bibr">Zipfel et al., 2003</xref>; <xref rid="R27" ref-type="bibr">Helmchen and Denk, 2005</xref>), progress toward imaging large numbers of neurons in three dimensions has been slower. In fact, in nearly all existing two-photon microscopes, a single laser beam is serially scanned in a continuous trajectory across the sample, in a raster pattern or with a specified trajectory that intersects targets of interest along the path. To image several focal planes one needs to change the focus and then reimage. This serial scanning leads necessarily to a low imaging speed, which becomes slower with increases in the number of neurons or focal planes to be imaged. Since the inception of two-photon microscopy, there have been many efforts to increase the speed and depth of imaging. One approach is to use inertia-free scanning using acousto-optic deflectors (AODs) (<xref rid="R52" ref-type="bibr">Reddy et al., 2008</xref>; <xref rid="R44" ref-type="bibr">Otsu et al., 2008</xref>; <xref rid="R25" ref-type="bibr">Grewe et al., 2010</xref>; <xref rid="R34" ref-type="bibr">Kirkby et al., 2010</xref>; <xref rid="R32" ref-type="bibr">Katona et al., 2012</xref>). Another approach is to parallelize the light and use many laser beams instead of a single one. Parallelized multifocal scanning has been developed (<xref rid="R9" ref-type="bibr">Bewersdorf et al., 1998</xref>; <xref rid="R14" ref-type="bibr">Carriles et al., 2008</xref>; <xref rid="R62" ref-type="bibr">Watson et al., 2009</xref>), as well as scanless approaches utilizing spatial light modulators (SLMs) which build holograms that target specific regions of interest (<xref rid="R43" ref-type="bibr">Nikolenko et al., 2008</xref>; <xref rid="R21" ref-type="bibr">Ducros et al., 2013</xref>; <xref rid="R50" ref-type="bibr">Quirin et al., 2014</xref>). As a further innovation of SLM-based imaging, we describe a novel &#x0201c;hybrid&#x0201d; multiplexed approach, combining traditional galvanometers and a spatial light modulator (SLM) to provide a powerful, flexible, and cost-effective platform for 3D two-photon imaging. We demonstrate its performance by simultaneously imaging multiple areas and layers of the mouse cortex, <italic>in vivo</italic>.</p><p id="P3">In particular, one key challenge in non-linear microscopies is expanding the spatial extent of imaging while still maintaining high temporal resolution and high sensitivity. This is because of the inverse relationship between the total volume scanned per second, and the signal collected per voxel, in that time. Our SLM hybrid-multiplexed scanning approach helps overcome this limitation by creating multiple beamlets that scan the sample simultaneously, and leverages advanced computational methods (<xref rid="R47" ref-type="bibr">Pnevmatikakis et al., 2016</xref>), companion paper in this issue of Neuron to extract the underlying signals reliably.</p></sec><sec sec-type="results" id="S2"><title>Results</title><p id="P4">The basic configuration of our SLM microscope consists of a two-photon microscope, with traditional galvanometers, along with an added SLM module. <xref ref-type="fig" rid="F1">Fig. 1A</xref> shows a schematic of the SLM-based multiplexed two-photon microscope. The layout is based on that described in detail in (<xref rid="R43" ref-type="bibr">Nikolenko et al., 2008</xref>; <xref rid="R50" ref-type="bibr">Quirin et al., 2014</xref>) and similar to that in (<xref rid="R19" ref-type="bibr">Dal Maschio et al., 2010</xref>). The SLM module was created by diverting the input path of the microscope, prior to the galvanometer mirrors, with retractable kinematic mirrors, onto a compact optical breadboard with the SLM and associated components. The essential features of the SLM module are folding mirrors for redirection, a pre-SLM afocal telescope to resize the incoming beam to match the active area of the SLM, the SLM itself, and a post-SLM afocal telescope to resize the beam again to match the open aperture of the galvanometers and to fill the back focal plane of the objective appropriately. The SLM is optically conjugated to the galvanometers, and to the back aperture of the microscope objective (see <italic>Experimental Procedures</italic> for details). We coupled this module, with negligible mechanical changes, to a home-built two-photon microscope, as well as a lightly modified Prairie/Bruker system. The SLM is used as a programmable optical multiplexer that allows for high-speed independent control of each generated beamlet. The SLM performs this beam splitting by imprinting a phase profile across the incoming wavefront, resulting in a farfield diffraction pattern that yields the desired illumination pattern. These multiple beamlets are directed to different regions or depths on the sample simultaneously. When the galvanometers are scanned, each individual beamlet sweeps across its targeted area on the sample, and the total fluorescence is collected by a single photomultiplier tube. The resultant &#x0201c;image&#x0201d; is a superposition of all of the individual images that would have been produced by scanning each separate beamlet individually (see <xref ref-type="fig" rid="F1">Fig. 1B, C</xref>).</p><p id="P5">To demonstrate the multi-plane imaging system, we first performed structural imaging of a brine shrimp, <italic>Artemia naupili</italic>, collecting its intrinsic autofluorescence. First, we acquired a traditional serial &#x0201c;z-stack&#x0201d;, with seven planes, by moving the objective 50 &#x000b5;m axially between each plane (<xref ref-type="fig" rid="F1">Fig. 1D</xref>). Next, we acquired a serial z-stack with seven planes separated by 50 &#x000b5;m each, but with the objective fixed, and the axial displacements generated by imparting a lens phase function on the SLM (<xref ref-type="fig" rid="F1">Fig. 1E</xref>). In <xref ref-type="fig" rid="F1">Fig.1F and 1G</xref>, we show the arithmetic sums of the individual sections in D and E, respectively. Finally, we used the SLM to generate all seven axially displaced beamlets <italic>simultaneously</italic>, and scanned them across the sample (<xref ref-type="fig" rid="F1">Fig. 1H</xref>). We note that we can control the power delivered to each beamlet independently, which differentiates this method from traditional extended depth of field approaches, where near uniform intensity is imposed across the entire depth of field. <xref ref-type="fig" rid="F1">Fig. 1I</xref> shows the image where the power at the 50 &#x000b5;m plane is selectively increased to enhance the signal at that depth. This flexibility is important for inhomogeneously stained samples, and is especially critical for multi-depth <italic>in vivo</italic> imaging in scattering tissue. Additionally, we can effectively control the complexity of the final image - we deterministically control the number of sections we illuminate.</p><p id="P6">To demonstrate functional imaging on our system, we perform <italic>in vivo</italic> two-photon imaging of layer 2/3 (L2/3) in the primary visual cortex (V1) in an awake head-fixed mouse, at a depth of 280 &#x000b5;m, at 10 Hz, (<xref ref-type="fig" rid="F2">Fig. 2A</xref>) that expresses the genetically encoded calcium indicator, GCaMP6f (<xref rid="R16" ref-type="bibr">Chen et al., 2013</xref>) (details in <italic>Experimental Procedures</italic>). We configure the SLM as illustrated in <xref ref-type="fig" rid="F1">Fig. 1C</xref>. We split the beam laterally, creating two beams with an on-sample separation of ~300 &#x000b5;m, centered on the original field-of-view (FOV) (<xref ref-type="fig" rid="F2">Fig. 2A</xref>). A small beam block is placed in the excitation path to eliminate the zero order beam, leaving only the two SLM steered beams for imaging (details in <italic>Experimental Procedures</italic>). <xref ref-type="fig" rid="F2">Figs. 2B&#x02013;D</xref>, top, show images of the intensity standard deviation (std. dev.) of the time series image stack that results from scanning each of these displaced beams individually, and their arithmetic sum, respectively; while <xref ref-type="fig" rid="F2">Fig. 2E</xref>, top, shows the std. dev. image acquired when both beams are simultaneously scanned across the sample. The lower images in <xref ref-type="fig" rid="F2">Fig. 2B&#x02013;E</xref> show the spatial components of detected sources from the images, with the colors coded to reflect the originated FOV. The areas contained in the red rectangle in <xref ref-type="fig" rid="F2">Fig.2B and 2C</xref> highlights the area that is scanned by both beams, and hence their spatial components are present twice in the dual plane image.</p><p id="P7"><xref ref-type="fig" rid="F2">Fig.2F and 2G</xref> show some representative fluorescence time series extracted from the detected spatial components (40 out of 235 shown), from the sequential single plane imaging and simultaneous dual plane imaging respectively. The same spatial components are displayed in both 2F and 2G, with the same ordering, to facilitate direct comparison of the single and dual plane traces. For <xref ref-type="fig" rid="F2">Fig. 2F</xref>, the red and green traces from the two FOVs were collected sequentially, whereas in <xref ref-type="fig" rid="F2">Fig. 2G</xref>, they were collected simultaneously. Because of the spatial sparsity of active neurons (see <xref ref-type="fig" rid="F2">Fig. 2E</xref>, bottom), many of the spatial components are separable even in the overlaid dual region image, and fluorescence time series data can be easily extracted using conventional techniques. However, some spatial components show clear overlap, and more sophisticated methods, such as independent component analysis (ICA) (<xref rid="R41" ref-type="bibr">Mukamel et al., 2009</xref>), or non-negative matrix factorization methods (NMF) (<xref rid="R37" ref-type="bibr">Maruyama et al., 2014</xref>), perform better at extracting the activity. The traces shown were extracted using a novel constrained NMF method (CNMF), which is discussed in greater detail later in this paper (Fig. 4), and is described fully in the companion paper by Pnevmatikakis et al.. The collected multi-region image is simply the arithmetic sum of the two single region images, and thus we can use the detected spatial components from the single region image as prior for source localization. We leverage this to get very good initial estimates on the number of independent sources, and their spatial locations in the dual region image. We examine the &#x0201c;uniqueness&#x0201d; of signal recovery by looking at the spatial components that appear twice in the dual plane image and hence should display identical dynamics. Two examples are highlighted in blue on <xref ref-type="fig" rid="F2">Fig. 2G</xref>, and expanded in <xref ref-type="fig" rid="F2">Fig. 2H</xref> &#x02013; each respective color shows the source copy generated from each beamlet, and show the extremely high correlation between the extracted traces (R&#x0003e;0.985).</p><p id="P8">Compared to the original FOV, the dual region image includes signals from a significantly larger total area, with no loss in temporal resolution. The maximal useful lateral displacement of each beamlet from the center of the FOV depends on the whole optical system, and is discussed in details in <xref ref-type="supplementary-material" rid="SD1">Supplemental Information</xref>. Besides increasing the effective imaged FOV, we can instead choose to also increase the effective frame rate, while keeping the same FOV (see <xref ref-type="supplementary-material" rid="SD1">Supplemental Information</xref>).</p><p id="P9">While the lateral imaging method increase performance, the full power of multiplexed SLM imaging lies in its ability to address axially displaced planes, with independent control of beamlet power and position. We can introduce a defocus aberration to the wavefront, which shifts the beam focus away from the nominal focal plane. In practice, we also include higher order axially dependent phase terms to correct higher-order aberrations (see <xref ref-type="supplementary-material" rid="SD1">Supplemental Information</xref>), and impose lateral displacements between the beamlets if desired. The SLM could also be used for further wavefront engineering such as adaptive optics to correct any beam distortion from the system or the sample, but it was not necessary in these experiments. Our current system can address axial planes separated by ~ 500 &#x000b5;m while maintaining the total collected two-photon fluorescence at &#x0003e;50% to that generated at the objective&#x02019;s natural focal plane (see <xref ref-type="supplementary-material" rid="SD1">Supplemental Fig. S1 B</xref>). This gives considerable range for scanning without moving the objective, which eliminates vibrations and acoustic noise, and simplifies coupling with targetable photostimulation (<xref rid="R46" ref-type="bibr">Packer et al., 2015</xref>).</p><p id="P10">Using the SLM, we can address multiple axial planes simultaneously (schematic shown in <xref ref-type="fig" rid="F3">Fig. 3A</xref>). <xref ref-type="fig" rid="F3">Fig.3B and 3C</xref> show two examples of conventional &#x0201c;single-plane&#x0201d; two-photon images (intensity std. dev. of the time series image stack) in mouse V1, the first 170 &#x000b5;m below the pial surface, in L2/3, and the second 500 &#x000b5;m below the surface, in L5. These images were acquired with SLM focusing &#x02013; the objective&#x02019;s focal plane was fixed at a depth of 380 &#x000b5;m, and the axial displacements were generated by imposing the appropriate lens phase on the SLM (see <italic>Experimental Procedures</italic> for details.). At each depth, we recorded functional signals at 10 Hz, with <xref ref-type="fig" rid="F3">Fig. 3F</xref> showing some representative extracted fluorescence traces from L2/3, and L5, in red and green, respectively (154 and 191 total spatial components detected across the upper and lower planes, respectively). The SLM was then used to simultaneously split the incoming beam into two axially displaced beams, directed to these two cortical depths, and scanned over the sample at 10 Hz (<xref ref-type="fig" rid="F3">Fig. 3E</xref>). The power delivered to the two layers is adjusted such that the collected fluorescence from each plane was approximately equal (see <xref ref-type="supplementary-material" rid="SD1">Supplemental Information</xref> for details). Scanning these beamlets over the sample, we collect the dual plane image. This is shown together with the spatial components in <xref ref-type="fig" rid="F3">Fig. 3E</xref>, which corresponds very well to the arithmetic sum of the individual plane images as shown in <xref ref-type="fig" rid="F3">Fig. 3D</xref>. In <xref ref-type="fig" rid="F3">Fig. 3G</xref>, we show 20 representative traces (out of 345 spatial source components), showing spontaneous activity across L2/3 and L5. The ordering of traces is identical with that of <xref ref-type="fig" rid="F3">Fig. 3F</xref>, which facilitates comparison. The lightly shaded regions in <xref ref-type="fig" rid="F3">Fig. 3F</xref>, G, are enlarged and shown in <xref ref-type="fig" rid="F3">Fig. 3H, I</xref>. The signals show very clear events, with high apparent SNR. Further zooms of small events are shown in <xref ref-type="fig" rid="F3">Fig. 3J</xref>, which reveals expanded views of the small peaks labeled i-iv on <xref ref-type="fig" rid="F3">Figs. 3H, I</xref>.</p><p id="P11">In the dual plane image, it is clear that there is significant overlap between a number of sources. As mentioned earlier, CNMF (<xref rid="R47" ref-type="bibr">Pnevmatikakis et al., 2016</xref>) is used to demix the signal. We use a statistical model to relate the detected fluorescence from a source (neuron) to the underlying activity (spiking) (<xref rid="R61" ref-type="bibr">Vogelstein et al., 2009</xref>; <xref rid="R60" ref-type="bibr">Vogelstein et al., 2010</xref>). We extend this to cases where the detected signal (fluorescence plus noise) in each single pixel can come from multiple underlying sources, which produces a spatiotemporal mixing of signals in that pixel. The goal is, given a set of pixels of time varying intensity, infer the low-rank matrix of underlying signal sources that generated the measured signals. We take advantage of the non-negativity of the underlying neuronal activity to allow computationally efficient constrained non-negative matrix factorization methods to perform the source separation.</p><p id="P12">Operationally, to extract signals from the multiplane image, we initialize the algorithm with the expected number of sources (the rank), along with the nominal expected spatial location of the sources as prior knowledge, as identified by running the algorithm on the previously acquired single plane image sequences. For the single plane images, the complexity and number of overlapping sources are significantly less than the multi-plane images, and the algorithm works very well for identifying sources without additional guidance (see <xref ref-type="supplementary-material" rid="SD1">Supplemental Information</xref>). <xref ref-type="supplementary-material" rid="SD1">Supplemental Fig. S2</xref> shows a single plane imaging example, from which various spatial components, including doughnut shape cell body and perisomatic dendritic processes, can be automatically extracted using CNMF, together with various calcium dynamics in the extracted temporal signals. The effectiveness of this method applied to multi-plane imaging is highlighted in <xref ref-type="fig" rid="F4">Fig. 4</xref>, where we compare it against our &#x0201c;best&#x0201d; human effort at selecting only the non or minimally overlapping pixels from each source, and against ICA, which previously has proved successful in extracting individual sources from mixed signals in calcium imaging movies (<xref rid="R41" ref-type="bibr">Mukamel et al., 2009</xref>).</p><p id="P13">In <xref ref-type="fig" rid="F4">Fig. 4A&#x02013;B</xref>, we show progressively more complex spatial patches of the dual plane image series. The overall structure of <xref ref-type="fig" rid="F4">Fig. 4A and B</xref> is identical. In each panel, the uppermost row of images shows first the boundary of the spatial component contour, then the maximum intensity projection of the time series, along with the subsequent images showing representative time points where the component sources are independently active. The spatial components in red and in green come from L2/3, and L5, respectively. The leftmost column of images shows the weighted mask, labeled with the spatial component selection scheme (binary mask from maximum intensity projection, human selected non-overlapped region (NOL), ICA, or CNMF) that produces the activity traces presented immediately to the right of these boxes. On top of the full CNMF extracted traces in red, we also show, in cyan, the signal extracted considering only the CNMF spatial component, but with uniform pixel-weighting, and no spatio-temporal demixing. This comparison shows the power and effectiveness of the source separation.</p><p id="P14">We first discuss the spatial component selection scheme using NOL. In simple cases, like in <xref ref-type="fig" rid="F4">Fig. 4A</xref>, we see only a subset of the events in the combined binary mask. In more complex cases (<xref ref-type="fig" rid="F4">Fig. 4B</xref>, and <xref ref-type="supplementary-material" rid="SD1">Supplemental Fig. S4 B&#x02013;D</xref>), where multiple distinct sources can overlap with the chosen source, the non-overlapped portion may only contain a few pixels, yielding poor SNR, or those pixels may not be fully free from contamination, yielding mixed signals. Nevertheless, in regions where the non-overlapped portion is identifiable, we can use this as a reference to evaluate the other two algorithms.</p><p id="P15">We then examine the ICA extracted sources. ICA identifies the sources automatically without human intervention, and with high speed. For cases where the number of sources in space is low and there are &#x0201c;clean&#x0201d; non-overlapping pixels with high SNR (<xref ref-type="fig" rid="F4">Fig. 4A</xref>), the extracted components are spatially consistent with the known source location (<italic>cf</italic>. top row of images). In many cases, they include a region of low magnitude negative weights, which on inspection, appear to spatially overlap with adjacent detected sources, presumably because this decreases the apparent mixing of signals between the components. More consequential is that for the complex overlapping signals in our experiment, ICA routinely fails to identify human and CNMF identified spatial source components, and appears to have less clean separation of mixed signals (<italic>cf</italic>. activity traces in <xref ref-type="fig" rid="F4">Fig 4A</xref>, and the complete failure of ICA to identify spatial component 2 in <xref ref-type="fig" rid="F4">Fig. 4B</xref>). See also <xref ref-type="supplementary-material" rid="SD1">Supplemental Fig. S3</xref> for the comparison on a large population.</p><p id="P16">We further compare CNMF traces against the human selected non-overlapping traces for a larger population in <xref ref-type="fig" rid="F5">Fig. 5</xref> (and additionally in <xref ref-type="supplementary-material" rid="SD1">Supplemental Fig. S4, and S5</xref>). <xref ref-type="fig" rid="F5">Fig. 5A</xref> shows the cross correlation between 250 CNMF sources and the NOL source related to it. The correlation is high, as would be expected if the CNMF traces accurately detect the underlying source. The majority of the signals show a correlation coefficient of &#x0003e; 0.94, and the mean correlation coefficient is 0.91. The distribution of coefficients is strongly asymmetric, and it contains some notable outliers. Examining the underlying traces of these outliers (<xref ref-type="fig" rid="F5">Fig. 5C</xref>, and <xref ref-type="supplementary-material" rid="SD1">Supplemental Fig. S4 B&#x02013;E</xref>), we can identify the origin of the poor correlation between the NOL traces and the CNMF traces. In these cases, the NOL spatial component consists of only a few pixels, and is extremely noisy; they also contain contamination from neighboring sources. The related spatial component from CNMF contains more pixels, has less noise, and shows clean demixed signal. They have generally higher SNR, especially for those NOL spatial components with low SNR (<xref ref-type="fig" rid="F5">Fig. 5B&#x02013;E</xref>; see <italic>Experimental Procedure</italic> for definition of SNR).</p><p id="P17">The fraction of cells with low correlation between the NOL and CNMF components are <italic>exactly</italic> the sources that simple signal extraction techniques <italic>cannot</italic> cleanly separate &#x02013; they are the imaged sources that <italic>require</italic> CNMF. Without CNMF, extracted signals would falsely show high correlation between sources that are imaged into the same region in the dual plane image. In the dual plane image collected in <xref ref-type="fig" rid="F3">Fig. 3</xref> and analyzed here, we find that ~26% of the cells have correlations below 0.9. The SNR comparison in <xref ref-type="fig" rid="F5">Fig. 5B</xref> is between the NOL signal and that from CNMF <italic>with residue</italic> (i.e. noise, see <italic>Experimental Procedure</italic>), to not simply boost the CNMF SNR from full deconvolution. Globally, the SNR of CNMF is 13% higher than that from NOL. The pooled data (~1800 spatial components from 10 dual-plane imaging sessions across 5 mice) presented in <xref ref-type="supplementary-material" rid="SD1">Supplemental Fig. S5</xref> show similar results.</p><p id="P18">The power of our simultaneous multi-plane imaging and source separation approach can be seen in <xref ref-type="fig" rid="F6">Fig. 6</xref>, where we are able to record spontaneous and evoked activity across multiple layers, which is critical for understanding microcircuit dynamics in the brain. We examined visually evoked activity in L2/3 and L5, simultaneously, while we projected drifting gratings to probe the orientation and directional sensitivity of the neuronal responses (OS and DS, see <italic>Experimental Procedures</italic>). This paradigm was chosen because drifting gratings produce robust responses in V1 (<xref rid="R42" ref-type="bibr">Niell and Stryker, 2008</xref>). They are used frequently in the community (<xref rid="R30" ref-type="bibr">Huberman and Niell, 2011</xref>; <xref rid="R54" ref-type="bibr">Rochefort et al., 2011</xref>), and can be used to examine the performance of our imaging method in a functional context. <xref ref-type="fig" rid="F6">Fig. 6A</xref> shows some representative extracted traces from cells with different OS, along with an indicator showing the timings of presentation of stimuli (traces shown were acquired under the dual-plane paradigm). During the entire recording period, this mouse had particularly strong spontaneous activity in nearly all of the cells in the FOV. Nonetheless, many cells showed strong and consistent orientation tuning across the trials (76 out of 260 cells). For these cells, we compared the computed single-plane DS and OS to those computed from the same neurons, but from the dual-plane image series. If the dual-plane images had increased noise, or more seriously, if overlapping sources could not be cleanly separated, we would expect decreased, or even altered OS. This is neither the case on the population level, nor on the single cell level, as seen in <xref ref-type="fig" rid="F6">Fig. 6B and C</xref>. In <xref ref-type="fig" rid="F6">Fig. 6D</xref> we show the std. dev. dual-plane image, and the extracted spatial component contours. The two small boxes on the contour image indicate two pairs of cells with significant spatial overlap in the dual-plane image. We examine the DS of these cells in more detail in <xref ref-type="fig" rid="F6">Fig. 6E</xref>, and it is clear that we can fully separate the functional activity of even strongly overlapping cells, without cross contamination.</p><p id="P19">The data shown in <xref ref-type="fig" rid="F3">Figs. 3</xref>&#x02013;<xref ref-type="fig" rid="F5">5</xref> and <xref ref-type="fig" rid="F6">6</xref> were taken with two planes, with inter-plane spacing of 330 &#x000b5;m and 250 &#x000b5;m, respectively, which is far from the limit of the method. In <xref ref-type="fig" rid="F7">Fig. 7A&#x02013;I</xref>, we show experimental results from simultaneous three-plane imaging of mouse V1. The intermediate plane is set to be the same as the nominal focal plane (the undiffracted beam&#x02019;s location). <xref ref-type="fig" rid="F7">Fig. 7A&#x02013;C</xref> show the images of the intensity std. dev. of the time series image stack from single-plane imaging at three different depths. The SLM simultaneous three-plane imaging is shown in <xref ref-type="fig" rid="F7">Fig. 7E</xref>, well corresponding to the arithmetic sum of <xref ref-type="fig" rid="F7">Fig. 7A&#x02013;C</xref> shown in <xref ref-type="fig" rid="F7">Fig. 7D</xref>. The spatial contour of the extracted source components are shown in <xref ref-type="fig" rid="F7">Fig. 7F</xref>, along with the representative fluorescence traces shown in <xref ref-type="fig" rid="F7">Fig. 7G and H</xref> for sequential single plane and simultaneous three plane imaging respectively. In <xref ref-type="fig" rid="F7">Fig. 7I</xref>, we show an example where three overlapped sources from the three planes can be cleanly separated using CNMF. We can further extend the extremal range between planes to over 500 &#x000b5;m, shown in <xref ref-type="supplementary-material" rid="SD1">Supplemental Fig. S6 A&#x02013;G</xref>.</p><p id="P20">The multiplane imaging can be further extended with a time-multiplexed scheme. The SLM used in our experiments can switch between different holograms at high speed (&#x0003e; 300 Hz). In <xref ref-type="fig" rid="F7">Fig. 7J</xref>, we show that we can fully transition between two sets of simultaneous dual-plane images in &#x0003c; 3 ms, a switching time confirmed &#x0201c;offline&#x0201d;, using a simple structured Rhodamine 6G target, in <xref ref-type="fig" rid="F7">Fig. 7K</xref>. This spatial-multiplane imaging and time-multiplexed scheme paves the path towards high speed volumetric imaging (schematic shown in <xref ref-type="supplementary-material" rid="SD1">Supplemental Fig. S6 H</xref>).</p></sec><sec sec-type="discussion" id="S3"><title>Discussion</title><p id="P21">In this work, we extend two-photon holographic microscopy (<xref rid="R43" ref-type="bibr">Nikolenko et al., 2008</xref>; <xref rid="R6" ref-type="bibr">Anselmi et al., 2011</xref>) to demonstrate successful simultaneous 3D multi-plane <italic>in vivo</italic> imaging with a hybrid SLM multiplexed-scanning approach that leverages spatiotemporal sparseness of activity and prior structural information to efficiently extract single cell neuronal activity. We can extend the effective area that can be sampled, target multiple axial planes over an extended range, &#x0003e; 500 &#x000b5;m, or do both, at depth within the cortex. This enables the detailed examination of intra- and inter-laminar functional activity. The method can be easily implemented on any microscope with the addition of a relatively simple SLM module to the excitation path, and without any additional hardware modifications in the detection path. The regional targeting is performed remotely, through holography, without any motion of the objective, which makes the technique a strong complement to 3D two-photon activation (<xref rid="R45" ref-type="bibr">Packer et al., 2012</xref>; <xref rid="R53" ref-type="bibr">Rickgauer et al., 2014</xref>; <xref rid="R46" ref-type="bibr">Packer et al., 2015</xref>). This approach is an initial demonstration of an essential paradigm for future high speed <italic>in vivo</italic> volumetric imaging in scattering tissue, combining structured multiplexed excitation along with computational reconstruction that is aided by additional prior knowledge - in this case, the simplified single plane source locations.</p><sec id="S4"><title>Comparisons to alternative methods</title><p id="P22">There are many imaging modalities today that are capable of collecting functional data within a 3D volume. The simplest systems that provide volumetric imaging combine a piezo mounted objective with resonant galvanometers, which have high optical performance throughout their focusing range. A critical component for determining the imaging rate is the speed of the piezo - how fast the objective can be translated axially. For deep imaging in scattering tissue, the fluorescence collection efficiency scales as <inline-formula><mml:math id="M1" overflow="scroll"><mml:mfrac><mml:mrow><mml:mi>N</mml:mi><mml:msup><mml:mi>A</mml:mi><mml:mn>2</mml:mn></mml:msup></mml:mrow><mml:msup><mml:mi>M</mml:mi><mml:mn>2</mml:mn></mml:msup></mml:mfrac></mml:math></inline-formula>, with <italic>M</italic> being the objective magnification (<xref rid="R8" ref-type="bibr">Beaurepaire and Mertz, 2002</xref>). The combination of high NA with low magnification invariable means that the objectives are large, and heavy. This large effective mass lowers the resonant frequency of the combined piezo/objective system, and necessitates significant forces to move axially quickly, as well as lengthens the settle times (~15 ms); this also lowers the duty cycles as imaging cannot take place during objective settling. The distance that the piezo can travel is also limited, with the current state-of-the-art systems offering 400 &#x000b5;m of total travel. Compared to piezo-based systems, our SLM-based approach has significantly greater axial range, and couples no vibrations into the sample. Additionally, we can change between different planes through the full range very rapidly, in &#x0003c;3 ms and allows for axial switching <italic>within</italic> a frame (<xref ref-type="fig" rid="F7">Fig. 7J&#x02013;K</xref>).</p><p id="P23">Remote focusing has also been used for faster volumetric imaging, either with the use of a secondary objective and movable mirror (<xref rid="R11" ref-type="bibr">Botcherby et al., 2012</xref>), with electrotunable lenses (ETL) (<xref rid="R26" ref-type="bibr">Grewe et al., 2011</xref>), and very recently, with ultrasound lenses (<xref rid="R35" ref-type="bibr">Kong et al., 2015</xref>). While these have higher performance than piezo mounted objectives, none of these have yet been demonstrated to allow for <italic>in vivo</italic> functional imaging at the axial span that we show here. For applications where a perfect PSF is paramount, remote focusing with a mirror may offer better optical performance, but requires careful alignment and engineering. Ultrasound lenses give very high speed axial scanning, but must be continuously scanned, a severe limitation of the technology. The standalone ETL, when properly inserted into the microscope, represents perhaps the most cost effective solution for fast focusing. While the electrotunable lens provides a lower cost solution, it is not as fast as the SLM and it cannot provide any adaptive optics capabilities, nor flexible beam reconfiguration, such as lateral shift or multiplexed excitation. Ultrasound lenses also lack convenient beam multiplexing or complex optical corrections. SLMs, on the other hand, allow for all of these.</p><p id="P24">While fast sequential imaging strategies such as acousto-optic deflector (AOD) systems offer good performance, with the state-of-the-art 3-D AOD systems currently providing high performance imaging over relatively large volumes of tissue (<xref rid="R52" ref-type="bibr">Reddy et al., 2008</xref>; <xref rid="R34" ref-type="bibr">Kirkby et al., 2010</xref>; <xref rid="R32" ref-type="bibr">Katona et al., 2012</xref>), these systems are very complex and expensive, with a cost that is at least a few times that of conventional two-photon microscopes, severely limiting their practical use. They are also very sensitive to wavelength, requiring extensive realignment with changes in wavelength. An additional complication of any point targeting strategy, like AOD systems, is that sample motions are significantly more difficult to treat (<xref rid="R18" ref-type="bibr">Cotton et al., 2013</xref>).</p><p id="P25">A bigger limitation of all of these serially scanned systems is that all are near the fundamental limits on their speed, as finite dwell times are required on each pixel to maintain SNR. As fluorophore saturation ultimately limits the maximum emission rate regardless of excitation intensity, increases in intensity simply cause photodamage, bleaching, and reduced spatial resolution. Wide-field fluorescence imaging can overcome the speed limit with the developments of high speed cameras. Despite their high performance, wide-field imaging schemes such as light-sheet microscopy (<xref rid="R1" ref-type="bibr">Ahrens et al., 2013</xref>), light field microscopy (<xref rid="R49" ref-type="bibr">Prevedel et al., 2014</xref>), or swept confocally-aligned planar excitation (SCAPE) (<xref rid="R12" ref-type="bibr">Bouchard et al., 2015</xref>), suffer from light scattering in deep tissues and are thus better suited for relatively superficial imaging or imaging in weakly scattering samples.</p><p id="P26">Multiplexed two-photon based approaches become a clear way to increase overall system performance by taking advantage of the benefits of nonlinear imaging, while maintaining sufficient dwell times for high sensitivity. Spatially multiplexed strategies have been used before (<xref rid="R9" ref-type="bibr">Bewersdorf et al., 1998</xref>; <xref rid="R24" ref-type="bibr">Fricke and Nielsen, 2005</xref>; <xref rid="R7" ref-type="bibr">Bahlmann et al., 2007</xref>; <xref rid="R33" ref-type="bibr">Kim et al., 2007</xref>; <xref rid="R38" ref-type="bibr">Matsumoto et al., 2014</xref>), but with very limited success for imaging neuronal activity in scattering samples. The fluorescence produced deep in the samples scatters extensively while travelling through the sample, which limits the ability to &#x0201c;assign&#x0201d; each fluorescence photon to its source (<xref rid="R5" ref-type="bibr">Andresen et al., 2001</xref>; <xref rid="R33" ref-type="bibr">Kim et al., 2007</xref>; <xref rid="R15" ref-type="bibr">Cha et al., 2014</xref>). A more successful approach has been to temporally multiplex each separate excitation beam (<xref rid="R22" ref-type="bibr">Egner and Hell, 2000</xref>; <xref rid="R23" ref-type="bibr">Fittinghoff et al., 2000</xref>; <xref rid="R5" ref-type="bibr">Andresen et al., 2001</xref>; <xref rid="R17" ref-type="bibr">Cheng et al., 2011</xref>), and use customized electronics for temporal demixing. For multilayer imaging, our current system exceeds the demonstrated FOV and axial range of published implementations using temporally multiplexed beams, and provides a cleaner signal demixing, with significantly greater flexibility and speed in choosing targeted depths. However, we do not consider other spatially separated multibeam or temporally multiplexed strategies as competitors, but rather as complementary methods that could be leveraged to further increase the overall system performance.</p></sec><sec id="S5"><title>Current limitations and Technical Outlook</title><sec id="S6"><title>Phase only SLMs for beam steering</title><p id="P27">The performance of our current system is strongly dependent on the SLM, a 512&#x000d7;512 pixel phase-only device that performs beam-splitting by imparting phase modulation on the incoming laser pulse, and uses diffraction to redirect the beams to their targeted sites. Multiple factors are needed to be considered when designing an SLM based imaging system. Firstly, the efficiency of the SLM diffraction is notably affected by the fill factor and the effective number of phase levels per &#x0201c;feature&#x0201d;. The effective power throughput from the SLM module ranges from ~82% to 40% for the patterns used in this paper. This is significantly better than &#x0003c;20% overall efficiency of a full 3-D AOD system. The efficiency of this method can be improved by better SLMs; that is devices that have higher fill factors, increased pixel number, and increased phase modulation &#x02013; all of which are the subject of active development. Secondly, any diffractive device is inherently chromatic &#x02013; the deflection depends on the wavelength of the light. This chromatic dispersion can be reduced with the incorporation of a custom dispersion compensation optical element. For axial displacements on our system, the effect of chromatic dispersion on performance is markedly less. More details are presented in <xref ref-type="supplementary-material" rid="SD1">Supplemental Information</xref>.</p><p id="P28">Regarding the maximal number of planes addressable, and limitations to the axial spacing, practically, we find acceptable results when the separation between planes is at least 5 times the axial PSF for shifts without lateral displacements. Shorter separations appear to give decreased sectioning. In our experiments, the maximal number of planes (3) demonstrated for functional imaging was limited by the total power deliverable on sample, as we specifically aimed to target deeper layers where scattering losses are significant. By targeting more superficial layers, more planes were addressable. Adaptive optics could also extend the gains to deeper layers. Fundamentally, the maximal usable number of planes is limited by the biology and functional indicators &#x02013; relatively sparse signals with little background would promote the use of more planes, while dense, complex sources may require limiting the number of planes to low numbers to achieve effective demixing. In the dual plane experiments shown in <xref ref-type="fig" rid="F3">Fig. 3</xref>&#x02013;5, the strongly overlapped sources represent ~30% of all detected sources (as can be seen in the correlation between NOL and CNMF in <xref ref-type="fig" rid="F5">Fig. 5A</xref>), so we believe there is significant room to push the total number of planes with the current setup.</p></sec><sec id="S7"><title>Volumetric imaging</title><p id="P29">The overall speed of multiplane imaging can be increased with additional simple methods. With the current system&#x02019;s high apparent sensitivity, we anticipate that we could reduce the nominal dwell time per pixel, and still collect enough photons for effective detection. By transitioning our microscope from conventional galvanometers to resonant galvanometers, we could speed up the imaging by at least a factor of three. Combined with the fast switching time of our device (&#x0003c; 3 ms, see <xref ref-type="fig" rid="F7">Fig. 7J&#x02013;K</xref>, and Thalhammer, et al. (<xref rid="R57" ref-type="bibr">Thalhammer et al., 2013</xref>)), we anticipate being able to image large volumes of neural tissue at high speed. Our strategy is to rapidly interleave multiplane images in successive scans to generate a complete picture of neural activity with schematics shown in <xref ref-type="supplementary-material" rid="SD1">Supplemental Fig. S6 H</xref>.</p></sec><sec id="S8"><title>Outlook</title><p id="P30">SLM-based multi-region imaging is one implementation of the general strategy of computationally enhanced projective imaging, which will make possible the ability to interrogate neurons over a very large area, with high temporal resolution and SNR. Projective imaging is extremely powerful, especially when combined with prior information about the system to be studied. Basic knowledge of the underlying physical structure of the neural circuit and sparsity of its activity are used to define constraints for the recovery of the underlying signal, and allow for higher fidelity reconstruction and increased imaging speed in complex samples. With our multiplexed SLM approach we determine the number of areas simultaneously illuminated and have direct control over the effective number of sources, in contrast to alternate extended two-photon approaches, such as Bessel beam scanning (<xref rid="R10" ref-type="bibr">Botcherby et al., 2006</xref>; <xref rid="R58" ref-type="bibr">Theriault et al., 2014</xref>), where the sample alone controls the complexity of the signal.</p><p id="P31">There are many questions that can be addressed by high speed volumetric imaging. First, the simple increase in total neurons monitored in the local circuit greatly increases the chances for capturing the richness and variability of the dynamics in cortical processing (<xref rid="R2" ref-type="bibr">Alivisatos et al., 2013a</xref>; <xref rid="R3" ref-type="bibr">Alivisatos et al., 2013b</xref>; <xref rid="R31" ref-type="bibr">Insel et al., 2013</xref>). For instance, what is the organization of functionally or behaviorally relevant ensembles in cortical columns? How do upstream interneurons affect downstream activity and synchrony, and output (<xref rid="R29" ref-type="bibr">Helmstaedter et al., 2008</xref>; <xref rid="R28" ref-type="bibr">Helmstaedter et al., 2009</xref>; <xref rid="R40" ref-type="bibr">Meyer et al., 2011</xref>)? Without the ability to probe interlaminar activity simultaneously, answering these questions definitively will be very difficult, if not impossible. Though we have focused on somatic imaging in this paper, this technique works equally well for imaging dendrites, or dendrites and soma together (data not shown, see companion paper (<xref rid="R47" ref-type="bibr">Pnevmatikakis et al., 2016</xref>), for dendritic source separation with CNMF). The extended axial range of our method would allow exploring L5 soma and their apical tufts simultaneously, and may give direct insight into the role of dendritic spikes and computation in neuronal output (<xref rid="R36" ref-type="bibr">London and Hausser, 2005</xref>; <xref rid="R56" ref-type="bibr">Shai et al., 2015</xref>). Thus, SLM-based multiplane imaging appears to be a powerful method for addressing these, and other questions that require high speed volumetric imaging with clear cellular resolution. The system is flexible, easily configurable, and compatible with most existing two photon microscopes, and could thus provide a novel powerful platform with which to study neural circuits function and computation.</p></sec></sec></sec><sec sec-type="methods" id="S9"><title>Experimental Procedures</title><sec id="S10"><title>Animals and Surgery</title><p id="P32">All experimental procedures were carried out in accordance with animal protocols approved by Columbia University Institutional Animal Care and Use Committee. All Experiments were performed with C57BL/6 wild-type mice at the age of postnatal day (P) 60&#x02013;120. Virus AAV1synGCaMP6f (<xref rid="R16" ref-type="bibr">Chen et al., 2013</xref>) was injected to both layer 2/3 and layer 5 of the left V1 of the mouse cortex, 4&#x02013;5 weeks prior to craniotomy. The virus (6.91e13 GC/ml) was front-loaded into the injection pipette and injected at a rate of 80 nl/min. The injection sites were at 2.5 mm lateral and 0.3 mm anterior from the lambda, putative monocular region at the left hemisphere. Injections (500 nL per site) were made at two different depths from the cortical surface, at 200 &#x000b5;m-250 &#x000b5;m and 400 &#x000b5;m-500 &#x000b5;m respectively.</p><p id="P33">After 4&#x02013;5 weeks of expression, mice were anesthetized with isoflurane (1&#x02013;2% v/v in air). Before surgery, dexamethasone sodium phosphate (2 mg per kg of body weight; to prevent cerebral edema) and bupivacaine (5 mg/ml) were administered subcutaneously, and enrofloxacin (4.47 mg per kg) and carprofen (5 mg per kg) were administered intraperitoneally. A 2 mm diameter circular craniotomy was made over the injection cite with a dental drill and the dura mater was removed. 1.5% agarose was placed over the craniotomy and a 3-mm circular glass coverslip (Warner instruments) was placed and sealed using a cyanoacrylate adhesive. A titanium head plate was attached to the skull using dental cement. The imaging experiments were performed 1&#x02013;14 days after the chronic window implantation. During imaging, the head-fixed mouse is awake and can walk on a circular treadmill.</p><p id="P34">The shrimp used in the structural imaging were <italic>artemia nauplii</italic> (Brine Shrimp Direct).</p></sec><sec id="S11"><title>Two-photon SLM laser scanning microscope</title><p id="P35">The setup of the two-photon SLM laser scanning microscope is illustrated in <xref ref-type="fig" rid="F1">Fig. 1</xref>. The laser source is a pulsed Ti:Sapphire laser (Coherent Mira HP) tuned to 940 nm with a maximum output power of ~1.4 W (~140 fs pulse width, 80 MHz repetition rate). The laser power is controlled with a Pockels cell (ConOptics EO350-160-BK). A &#x003bb;/2 waveplate (Thorlabs AHWP05M-980) is used to rotate the laser polarization so that it is parallel with the active axis of the spatial light modulator (Meadowlark Optics, HSP512-1064, 7.68 &#x000d7; 7.68 mm<sup>2</sup> active area, 512 &#x000d7; 512 pixels). The laser beam is expanded by a 1:1.5 telescope (f1=50 mm, f2=75 mm, Thorlabs plano-convex lenses, &#x0201c;B&#x0201d; coated) to fill the active area of the SLM. The light incident angle to the SLM is ~ 3.5&#x000b0;. The reflected beam is scaled by a 4:1 telescope (f3=400 mm, f4=100 mm, Thorlabs achromatic doublets lenses, &#x0201c;B&#x0201d; coated), and imaged onto a set of close-coupled galvanometer mirrors (Cambridge 6215HM40B). In the dual lateral plane imaging, a beam block made of a small metallic mask on a thin pellicle is placed at the intermediate plane of this 4:1 telescope to remove the zero order beam. The galvanometer mirrors are located conjugate to the microscope objective pupil of a modified Olympus BX-51 microscope through an Olympus pupil transfer lens (f5=50 mm) and tube lens (fTL=180 mm). An Olympus 25&#x000d7; NA 1.05 XLPlan N objective is used for the imaging. The fluorescent signal from the sample is detected with a photo-multiplier tube (PMT, Hamamatsu H7422P-40) and a low noise amplifier (Stanford Research Systems SR570). ScanImage 3.8 (<xref rid="R48" ref-type="bibr">Pologruto et al., 2003</xref>), is used to control the galvanometer mirrors, and digitize and store the signal from the PMT amplifier. The line scanning is bidirectional with a single line scan rate of 2 kHz. For a 256 &#x000d7; 200 pixel image, the frame rate is 10 fps.</p><p id="P36">A detailed characterization of the performance of SLM beam steering, and its dependence on other optics in the microscope, such as the objective, are presented in <xref ref-type="supplementary-material" rid="SD1">Supplemental Information</xref>.</p></sec><sec id="S12"><title>Hologram generation</title><p id="P37">Custom software using MATLAB (The MathWorks, Natick, MA) was developed to generate and project the phase hologram pattern on the SLM through a PCIe interface (Meadowlark Optics). At the operating wavelength of 940 nm, the SLM outputs ~ 80 effective phase levels over a 2&#x003c0; phase range, with relatively uniform phase-level spacing (see <xref ref-type="supplementary-material" rid="SD1">Supplemental Fig. S1 A</xref>).</p><p id="P38">To create a 3D beamlet pattern on the sample (a total of N beamlets, each with coordinates[x<sub>i</sub>, y<sub>i</sub>, z<sub>i</sub>], <italic>i</italic>=1,2&#x02026;N), the phase hologram on the SLM, &#x003d5;(u, v), can be expressed as:
<disp-formula id="FD1"><label>(1)</label><mml:math id="M2" display="block" overflow="scroll"><mml:mi mathvariant="normal">&#x003d5;</mml:mi><mml:mo stretchy="false">(</mml:mo><mml:mi mathvariant="normal">u</mml:mi><mml:mo>,</mml:mo><mml:mi mathvariant="normal">v</mml:mi><mml:mo stretchy="false">)</mml:mo><mml:mo>=</mml:mo><mml:mtext>phase</mml:mtext><mml:mo stretchy="false">{</mml:mo><mml:msubsup><mml:mo>&#x02211;</mml:mo><mml:mrow><mml:mi mathvariant="normal">i</mml:mi><mml:mo>=</mml:mo><mml:mn>1</mml:mn></mml:mrow><mml:mi mathvariant="normal">N</mml:mi></mml:msubsup><mml:msub><mml:mi mathvariant="normal">A</mml:mi><mml:mi mathvariant="normal">i</mml:mi></mml:msub><mml:msup><mml:mi mathvariant="normal">e</mml:mi><mml:mrow><mml:mn>2</mml:mn><mml:mi mathvariant="normal">&#x003c0;</mml:mi><mml:mi mathvariant="normal">j</mml:mi><mml:mo stretchy="false">{</mml:mo><mml:msub><mml:mi mathvariant="normal">x</mml:mi><mml:mi mathvariant="normal">i</mml:mi></mml:msub><mml:mi mathvariant="normal">u</mml:mi><mml:mo>+</mml:mo><mml:msub><mml:mi mathvariant="normal">y</mml:mi><mml:mi mathvariant="normal">i</mml:mi></mml:msub><mml:mi mathvariant="normal">u</mml:mi><mml:mo>+</mml:mo><mml:mo stretchy="false">[</mml:mo><mml:msubsup><mml:mi mathvariant="normal">Z</mml:mi><mml:mn>2</mml:mn><mml:mn>0</mml:mn></mml:msubsup><mml:mo stretchy="false">(</mml:mo><mml:mi mathvariant="normal">u</mml:mi><mml:mo>,</mml:mo><mml:mi mathvariant="normal">v</mml:mi><mml:mo stretchy="false">)</mml:mo><mml:msubsup><mml:mi mathvariant="normal">C</mml:mi><mml:mn>2</mml:mn><mml:mn>0</mml:mn></mml:msubsup><mml:mo stretchy="false">(</mml:mo><mml:msub><mml:mi mathvariant="normal">z</mml:mi><mml:mi mathvariant="normal">i</mml:mi></mml:msub><mml:mo stretchy="false">)</mml:mo><mml:mo>+</mml:mo><mml:msubsup><mml:mi mathvariant="normal">Z</mml:mi><mml:mn>4</mml:mn><mml:mn>0</mml:mn></mml:msubsup><mml:mo stretchy="false">(</mml:mo><mml:mi mathvariant="normal">u</mml:mi><mml:mo>,</mml:mo><mml:mi mathvariant="normal">v</mml:mi><mml:mo stretchy="false">)</mml:mo><mml:msubsup><mml:mi mathvariant="normal">C</mml:mi><mml:mn>4</mml:mn><mml:mn>0</mml:mn></mml:msubsup><mml:mo stretchy="false">(</mml:mo><mml:msub><mml:mi mathvariant="normal">z</mml:mi><mml:mi mathvariant="normal">i</mml:mi></mml:msub><mml:mo stretchy="false">)</mml:mo><mml:mo>+</mml:mo><mml:msubsup><mml:mi mathvariant="normal">Z</mml:mi><mml:mn>6</mml:mn><mml:mn>0</mml:mn></mml:msubsup><mml:mo stretchy="false">(</mml:mo><mml:mi mathvariant="normal">u</mml:mi><mml:mo>,</mml:mo><mml:mi mathvariant="normal">v</mml:mi><mml:mo stretchy="false">)</mml:mo><mml:msubsup><mml:mi mathvariant="normal">C</mml:mi><mml:mn>6</mml:mn><mml:mn>0</mml:mn></mml:msubsup><mml:mo stretchy="false">(</mml:mo><mml:msub><mml:mi mathvariant="normal">z</mml:mi><mml:mi mathvariant="normal">i</mml:mi></mml:msub><mml:mo stretchy="false">)</mml:mo><mml:mo stretchy="false">]</mml:mo><mml:mo stretchy="false">}</mml:mo></mml:mrow></mml:msup><mml:mo stretchy="false">}</mml:mo></mml:math></disp-formula>
</p><p id="P39">A<sub>i</sub> is the electrical field weighting factor for the individual beamlet. <inline-formula><mml:math id="M3" overflow="scroll"><mml:msubsup><mml:mi mathvariant="normal">Z</mml:mi><mml:mi mathvariant="normal">m</mml:mi><mml:mn>0</mml:mn></mml:msubsup><mml:mo stretchy="false">(</mml:mo><mml:mi mathvariant="normal">u</mml:mi><mml:mo>,</mml:mo><mml:mi mathvariant="normal">v</mml:mi><mml:mo stretchy="false">)</mml:mo></mml:math></inline-formula> and <inline-formula><mml:math id="M4" overflow="scroll"><mml:msubsup><mml:mi mathvariant="normal">C</mml:mi><mml:mi mathvariant="normal">m</mml:mi><mml:mn>0</mml:mn></mml:msubsup><mml:mo stretchy="false">(</mml:mo><mml:msub><mml:mi mathvariant="normal">z</mml:mi><mml:mi mathvariant="normal">i</mml:mi></mml:msub><mml:mo stretchy="false">)</mml:mo></mml:math></inline-formula> are the Zernike polynomials and Zernike coefficients, respectively, which fulfills the defocusing functionality and compensates some of the higher order spherical aberrations due to defocusing. The expressions of <inline-formula><mml:math id="M5" overflow="scroll"><mml:msubsup><mml:mi mathvariant="normal">Z</mml:mi><mml:mi mathvariant="normal">m</mml:mi><mml:mn>0</mml:mn></mml:msubsup><mml:mo stretchy="false">(</mml:mo><mml:mi mathvariant="normal">u</mml:mi><mml:mo>,</mml:mo><mml:mi mathvariant="normal">v</mml:mi><mml:mo stretchy="false">)</mml:mo></mml:math></inline-formula> and <inline-formula><mml:math id="M6" overflow="scroll"><mml:msubsup><mml:mi mathvariant="normal">C</mml:mi><mml:mi mathvariant="normal">m</mml:mi><mml:mn>0</mml:mn></mml:msubsup><mml:mo stretchy="false">(</mml:mo><mml:msub><mml:mi mathvariant="normal">z</mml:mi><mml:mi mathvariant="normal">i</mml:mi></mml:msub><mml:mo stretchy="false">)</mml:mo></mml:math></inline-formula> are shown in <xref ref-type="supplementary-material" rid="SD1">Supplemental Table S1</xref> (<xref rid="R6" ref-type="bibr">Anselmi et al., 2011</xref>). A 2D coordinate calibration between the SLM phase hologram and the PMT image is carried out on a pollen grain slide, and an affine transformation can be extracted to map the coordinates. For the axial defocusing, the defocusing length set in the SLM phase hologram is matched with the actual defocusing length by adjusting the apparent &#x0201c;effective N.A.&#x0201d; in the Zernike coefficients, after calibration following the procedure described in (<xref rid="R51" ref-type="bibr">Quirin et al., 2013</xref>). This is done mainly for convenience, and it changes very little over the full axial range of the SLM (range 0.43&#x02013;0.48). In multiplane imaging, the field weighting factors <italic>A<sub>i</sub></italic> in <xref ref-type="disp-formula" rid="FD1">Eq. 1</xref> alter the power ratio of different imaging planes. We adjust the parameter empirically to achieve similar fluorescent signals from different imaging planes, but can also calculate the expected power ratio from first principles, considering the depths of each plane, nominal scattering length of light in the tissue, the SLM steering efficiency (see <xref ref-type="supplementary-material" rid="SD1">Supplemental Information</xref>), and perform numerical beam propagation of the electric field (<xref rid="R55" ref-type="bibr">Schmidt, 2010</xref>).</p></sec><sec id="S13"><title>Visual Stimulation</title><p id="P40">Visual stimuli were generated using MATLAB and the Psychophysics Toolbox (<xref rid="R13" ref-type="bibr">Brainard, 1997</xref>) and displayed on a monitor (Dell P1914Sf, 19-inch, 60-Hz refresh rate) positioned 28 cm from the right eye, at ~45&#x000b0; to the long axis of the animal. Each visual stimuli session consisted of 8 different trials, each trial with a 3 s drifting square grating (100% contrast, 0.035 cycles per degree, two cycles per second), followed by 5 s of mean luminescence gray screen. Eight drifting directions (separated by 45 degrees) were presented in random order in the 8 trials in each session. 17 sessions were recorded continuously (1088 s).</p></sec><sec id="S14"><title>Image Analysis and Source Separation Algorithm</title><p id="P41">The raw images are motion corrected using a pyramid approach (<xref rid="R59" ref-type="bibr">Thevenaz et al., 1998</xref>), and analyzed using a novel constrained non-negative matrix factorization algorithm detailed in the companion paper (<xref rid="R47" ref-type="bibr">Pnevmatikakis et al., 2016</xref>), coded in MATLAB. The core of the CNMF algorithm is that the spatiotemporal fluorescence signals <italic>Y</italic> from the whole recording can be expressed as a product of two matrices: a spatial matrix <italic>A</italic> that encodes the location of each spatial component and a temporal matrix <italic>C</italic> that characterizes the fluorescent signal of each spatial component, as well as the background <italic>B</italic> and noise (residue) <italic>E</italic>, expressed as <italic>Y</italic>=<italic>AC</italic>+<italic>B+E</italic>. This can be solved using a constrained minimization method. The method imposes sparsity penalties on the matrix <italic>A</italic> to promote localized spatial footprints, and enforces the dynamics of the calcium indicator in the temporal components of <italic>C</italic>, which results in increased SNR. The individual single plane recordings are first analyzed per Pnevmatikakis (<xref rid="R47" ref-type="bibr">Pnevmatikakis et al., 2016</xref>), and the resulting spatial matrix <italic>A</italic> for the spatial components and the background, as well as the temporal calcium transient characteristics of each spatial component, are used as initial estimates for the sources in the analysis of the multiplane recording. The matrix <italic>A</italic>, which characterizes the individual pixel weights for each spatial component, is no longer re-optimized. We then apply the identical procedure as in the single plane analysis to solve the convex optimization problem for the multiplane data. Once <italic>C</italic>, and <italic>B</italic> are estimated, the fluorescence signal, as well as the background baseline of each spatial component can be extracted from these matrices, and &#x00394;F/F can be calculated.</p><p id="P42">To detect the events from the extracted fluorescent signal, the &#x00394;F/F is first normalized and then temporally deconvolved with the parametrized fluorescent decay (from fitting the auto-regressive model). Independently, a temporal first derivative is also applied to the &#x00394;F/F signal. The deconvolved signal and the derivative are then thresholded with 2% and at least 2 std. dev. from mean derivative signal respectively. At each time point, if both of them are larger than the threshold, an activity event is recorded, in binary format.</p></sec><sec id="S15"><title>Evaluation of CNMF, NOL and ICA</title><p id="P43">To evaluate the signals extracted from CNMF, we compared them against signals extracted from pixels of each spatial component that do not have contribution from other sources. Temporal signals from these pixels are averaged with a uniform weighting, followed by subtraction of the background baseline obtained from CNMF. We term this non-overlapped (NOL) signal. This is similar to conventional fluorescence extraction methods, except that the background baselines subtraction is automated.</p><p id="P44">The signals extracted from CNMF are compared with the NOL signals in two aspects: similarity (or correlation) and signal-to-noise ratio (SNR). In the calculation of SNR, the &#x0201c;signal&#x0201d; is estimated by the maximum of the &#x00394;F/F trace, and the &#x0201c;noise&#x0201d; is estimated as described below. A histogram of the difference between the &#x00394;F/F values of adjacent time points is first calculated. Considering temporal regions where there are few transients, this histogram should have a maximum around 0, and the local distribution around 0 should characterizes the noise. The shape of this histogram can then be fitted with a Gaussian function, and the standard deviation coefficient of this Gaussian function is considered as the &#x0201c;noise&#x0201d; in the SNR calculation.</p><p id="P45">ICA was also used to analyze the data, with software written in Matlab (<xref rid="R41" ref-type="bibr">Mukamel et al., 2009</xref>). The motion-corrected image stack is first normalized, followed by principal component analysis (PCA) for dimensionality reduction and noise removal. ICA is then applied to extract the spatiotemporal information of each independent sources. <xref ref-type="supplementary-material" rid="SD1">Supplemental Fig. S3</xref> provides a comparison between the performance of ICA and CNMF on a large population.</p></sec><sec id="S16"><title>Analysis of the Cell Orientation Selectivity of the Drifting Grating Visual Stimulation</title><p id="P46">To analyze the orientation and direction selectivity of the spatial components in response to the drifting grating visual stimulation, the total number of neuronal events are counted during the visual stimulation period in each session, for all 8 different grating angles. These event numbers are then mapped into a vector space (<xref rid="R39" ref-type="bibr">Mazurek et al., 2014</xref>). The direction and magnitude of their vector sum represents the orientation selectivity and the orientation index. With N<sub>visualsession</sub> visual stimulation sessions, N<sub>visualsession</sub> vectors are obtained. Hotelling&#x02019;s T<sup>2</sup>-test is used to calculate whether these vectors are significantly different from 0 (<italic>i.e</italic>. whether the spatial component has a strong orientation selectivity). Only spatial components with their vectors significant different from 0 (&#x0003c;0.25 probability that null 0 is true) are selected, and their orientation selectivity is calculated by averaging the N<sub>visualsession</sub> vectors and extracting the angle (N<sub>visualsession</sub>=17 for the experiments shown in <xref ref-type="fig" rid="F6">Fig. 6</xref>).</p></sec></sec><sec sec-type="supplementary-material" id="SM"><title>Supplementary Material</title><supplementary-material content-type="local-data" id="SD1"><label/><media xlink:href="NIHMS745170-supplement.pdf" orientation="portrait" xlink:type="simple" id="d37e1292" position="anchor"/></supplementary-material></sec></body><back><fn-group><fn id="FN1"><p id="P47" content-type="publisher-disclaimer">This is a PDF file of an unedited manuscript that has been accepted for publication. As a service to our customers we are providing this early version of the manuscript. The manuscript will undergo copyediting, typesetting, and review of the resulting proof before it is published in its final citable form. Please note that during the production process errors may be discovered which could affect the content, and all legal disclaimers that apply to the journal pertain.</p></fn><fn id="FN2" fn-type="conflict"><p id="P48"><bold>Conflict of Interest:</bold> The authors declare no competing financial interests.</p></fn><fn id="FN3" fn-type="con"><p id="P49">Author Contributions Conceptualization, D.S.P.; Methodology, W.Y., R.Y. and D.S.P.; Investigation, W.Y.; Software, E.P., L.P, W.Y. and D.S.P.; Formal Analysis, W.Y and D.S.P; Resources, J.M. and L.C-R. Funding Acquisition, R.Y., Writing &#x02013; Original Draft, W.Y and D.S.P. Writing &#x02013; Review and Editing, W.Y., E.P., L.P., R.Y., and D.S.P; Supervision, R.Y. and D.S.P.</p></fn></fn-group><ack id="S17"><title>Acknowledgements</title><p id="P50">This work is supported by the NEI (DP1EY024503, R01EY011787), NIMH (R01MH101218, R41MH100895, R01MH100561), DARPA contract W91NF-14-1-0269 and N66001-15-C-4032. This material is based upon work supported by, or in part by, the U. S. Army Research Laboratory and the U. S. Army Research Office under contract number W911NF-12-1-0594 (MURI). The authors thank Yeonsook Shin for virus injection of the mice.</p></ack><ref-list><title>References</title><ref id="R1"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Ahrens</surname><given-names>MB</given-names></name><name><surname>Orger</surname><given-names>MB</given-names></name><name><surname>Robson</surname><given-names>DN</given-names></name><name><surname>Li</surname><given-names>JM</given-names></name><name><surname>Keller</surname><given-names>PJ</given-names></name></person-group><article-title>Whole-brain functional imaging at cellular resolution using light-sheet microscopy</article-title><source>Nature Methods</source><year>2013</year><volume>10</volume><fpage>413</fpage><lpage>420</lpage><pub-id pub-id-type="pmid">23524393</pub-id></element-citation></ref><ref id="R2"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Alivisatos</surname><given-names>AP</given-names></name><name><surname>Andrews</surname><given-names>AM</given-names></name><name><surname>Boyden</surname><given-names>ES</given-names></name><name><surname>Chun</surname><given-names>M</given-names></name><name><surname>Church</surname><given-names>GM</given-names></name><name><surname>Deisseroth</surname><given-names>K</given-names></name><name><surname>Donoghue</surname><given-names>JP</given-names></name><name><surname>Fraser</surname><given-names>SE</given-names></name><name><surname>Lippincott-Schwartz</surname><given-names>J</given-names></name><name><surname>Looger</surname><given-names>LL</given-names></name><etal/></person-group><article-title>Nanotools for Neuroscience and Brain Activity Mapping</article-title><source>Acs Nano</source><year>2013a</year><volume>7</volume><fpage>1850</fpage><lpage>1866</lpage><pub-id pub-id-type="pmid">23514423</pub-id></element-citation></ref><ref id="R3"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Alivisatos</surname><given-names>AP</given-names></name><name><surname>Chun</surname><given-names>M</given-names></name><name><surname>Church</surname><given-names>GM</given-names></name><name><surname>Deisseroth</surname><given-names>K</given-names></name><name><surname>Donoghue</surname><given-names>JP</given-names></name><name><surname>Greenspan</surname><given-names>RJ</given-names></name><name><surname>McEuen</surname><given-names>PL</given-names></name><name><surname>Roukes</surname><given-names>ML</given-names></name><name><surname>Sejnowski</surname><given-names>TJ</given-names></name><name><surname>Weiss</surname><given-names>PS</given-names></name><etal/></person-group><article-title>The Brain Activity Map</article-title><source>Science</source><year>2013b</year><volume>339</volume><fpage>1284</fpage><lpage>1285</lpage><pub-id pub-id-type="pmid">23470729</pub-id></element-citation></ref><ref id="R4"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Alivisatos</surname><given-names>AP</given-names></name><name><surname>Chun</surname><given-names>M</given-names></name><name><surname>Church</surname><given-names>GM</given-names></name><name><surname>Greenspan</surname><given-names>RJ</given-names></name><name><surname>Roukes</surname><given-names>ML</given-names></name><name><surname>Yuste</surname><given-names>R</given-names></name></person-group><article-title>The Brain Activity Map Project and the Challenge of Functional Connectomics</article-title><source>Neuron</source><year>2012</year><volume>74</volume><fpage>970</fpage><lpage>974</lpage><pub-id pub-id-type="pmid">22726828</pub-id></element-citation></ref><ref id="R5"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Andresen</surname><given-names>V</given-names></name><name><surname>Egner</surname><given-names>A</given-names></name><name><surname>Hell</surname><given-names>SW</given-names></name></person-group><article-title>Time-multiplexed multifocal multiphoton microscope</article-title><source>Optics Letters</source><year>2001</year><volume>26</volume><fpage>75</fpage><lpage>77</lpage><pub-id pub-id-type="pmid">18033511</pub-id></element-citation></ref><ref id="R6"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Anselmi</surname><given-names>F</given-names></name><name><surname>Ventalon</surname><given-names>C</given-names></name><name><surname>Begue</surname><given-names>A</given-names></name><name><surname>Ogden</surname><given-names>D</given-names></name><name><surname>Emiliani</surname><given-names>V</given-names></name></person-group><article-title>Three-dimensional imaging and photostimulation by remote-focusing and holographic light patterning</article-title><source>Proceedings of the National Academy of Sciences of the United States of America</source><year>2011</year><volume>108</volume><fpage>19504</fpage><lpage>19509</lpage><pub-id pub-id-type="pmid">22074779</pub-id></element-citation></ref><ref id="R7"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Bahlmann</surname><given-names>K</given-names></name><name><surname>So</surname><given-names>PTC</given-names></name><name><surname>Kirber</surname><given-names>M</given-names></name><name><surname>Reich</surname><given-names>R</given-names></name><name><surname>Kosicki</surname><given-names>B</given-names></name><name><surname>McGonagle</surname><given-names>W</given-names></name><name><surname>Bellve</surname><given-names>K</given-names></name></person-group><article-title>Multifocal multiphoton microscopy (MMM) at a frame rate beyond 600 Hz</article-title><source>Optics Express</source><year>2007</year><volume>15</volume><fpage>10991</fpage><lpage>10998</lpage><pub-id pub-id-type="pmid">19547456</pub-id></element-citation></ref><ref id="R8"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Beaurepaire</surname><given-names>E</given-names></name><name><surname>Mertz</surname><given-names>J</given-names></name></person-group><article-title>Epifluorescence collection in two-photon microscopy</article-title><source>Applied Optics</source><year>2002</year><volume>41</volume><fpage>5376</fpage><lpage>5382</lpage><pub-id pub-id-type="pmid">12211567</pub-id></element-citation></ref><ref id="R9"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Bewersdorf</surname><given-names>J</given-names></name><name><surname>Pick</surname><given-names>R</given-names></name><name><surname>Hell</surname><given-names>SW</given-names></name></person-group><article-title>Multifocal multiphoton microscopy</article-title><source>Optics Letters</source><year>1998</year><volume>23</volume><fpage>655</fpage><lpage>657</lpage><pub-id pub-id-type="pmid">18087301</pub-id></element-citation></ref><ref id="R10"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Botcherby</surname><given-names>EJ</given-names></name><name><surname>Juskaitis</surname><given-names>R</given-names></name><name><surname>Wilson</surname><given-names>T</given-names></name></person-group><article-title>Scanning two photon fluorescence microscopy with extended depth of field</article-title><source>Optics Communications</source><year>2006</year><volume>268</volume><fpage>253</fpage><lpage>260</lpage></element-citation></ref><ref id="R11"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Botcherby</surname><given-names>EJ</given-names></name><name><surname>Smith</surname><given-names>CW</given-names></name><name><surname>Kohl</surname><given-names>MM</given-names></name><name><surname>Debarre</surname><given-names>D</given-names></name><name><surname>Booth</surname><given-names>MJ</given-names></name><name><surname>Juskaitis</surname><given-names>R</given-names></name><name><surname>Paulsen</surname><given-names>O</given-names></name><name><surname>Wilson</surname><given-names>T</given-names></name></person-group><article-title>Aberration-free three-dimensional multiphoton imaging of neuronal activity at kHz rates</article-title><source>Proceedings of the National Academy of Sciences of the United States of America</source><year>2012</year><volume>109</volume><fpage>2919</fpage><lpage>2924</lpage><pub-id pub-id-type="pmid">22315405</pub-id></element-citation></ref><ref id="R12"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Bouchard</surname><given-names>MB</given-names></name><name><surname>Voleti</surname><given-names>V</given-names></name><name><surname>Mendes</surname><given-names>CS</given-names></name><name><surname>Lacefield</surname><given-names>C</given-names></name><name><surname>Grueber</surname><given-names>WB</given-names></name><name><surname>Mann</surname><given-names>RS</given-names></name><name><surname>Bruno</surname><given-names>RM</given-names></name><name><surname>Hillman</surname><given-names>EMC</given-names></name></person-group><article-title>Swept confocally-aligned planar excitation (SCAPE) microscopy for high-speed volumetric imaging of behaving organisms</article-title><source>Nature Photonics</source><year>2015</year><volume>9</volume><fpage>113</fpage><lpage>119</lpage><pub-id pub-id-type="pmid">25663846</pub-id></element-citation></ref><ref id="R13"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Brainard</surname><given-names>DH</given-names></name></person-group><article-title>The psychophysics toolbox</article-title><source>Spatial Vision</source><year>1997</year><volume>10</volume><fpage>433</fpage><lpage>436</lpage><pub-id pub-id-type="pmid">9176952</pub-id></element-citation></ref><ref id="R14"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Carriles</surname><given-names>R</given-names></name><name><surname>Sheetz</surname><given-names>KE</given-names></name><name><surname>Hoover</surname><given-names>EE</given-names></name><name><surname>Squier</surname><given-names>JA</given-names></name><name><surname>Barzda</surname><given-names>V</given-names></name></person-group><article-title>Simultaneous multifocal, multiphoton, photon counting microscopy</article-title><source>Optics Express</source><year>2008</year><volume>16</volume><fpage>10364</fpage><lpage>10371</lpage><pub-id pub-id-type="pmid">18607447</pub-id></element-citation></ref><ref id="R15"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Cha</surname><given-names>JW</given-names></name><name><surname>Singh</surname><given-names>VR</given-names></name><name><surname>Kim</surname><given-names>KH</given-names></name><name><surname>Subramanian</surname><given-names>J</given-names></name><name><surname>Peng</surname><given-names>Q</given-names></name><name><surname>Yu</surname><given-names>H</given-names></name><name><surname>Nedivi</surname><given-names>E</given-names></name><name><surname>So</surname><given-names>PTC</given-names></name></person-group><article-title>Reassignment of Scattered Emission Photons in Multifocal Multiphoton Microscopy</article-title><source>Scientific Reports</source><year>2014</year><volume>4</volume></element-citation></ref><ref id="R16"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Chen</surname><given-names>TW</given-names></name><name><surname>Wardill</surname><given-names>TJ</given-names></name><name><surname>Sun</surname><given-names>Y</given-names></name><name><surname>Pulver</surname><given-names>SR</given-names></name><name><surname>Renninger</surname><given-names>SL</given-names></name><name><surname>Baohan</surname><given-names>A</given-names></name><name><surname>Schreiter</surname><given-names>ER</given-names></name><name><surname>Kerr</surname><given-names>RA</given-names></name><name><surname>Orger</surname><given-names>MB</given-names></name><name><surname>Jayaraman</surname><given-names>V</given-names></name><etal/></person-group><article-title>Ultrasensitive fluorescent proteins for imaging neuronal activity</article-title><source>Nature</source><year>2013</year><volume>499</volume><fpage>295</fpage><lpage>300</lpage><pub-id pub-id-type="pmid">23868258</pub-id></element-citation></ref><ref id="R17"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Cheng</surname><given-names>A</given-names></name><name><surname>Goncalves</surname><given-names>JT</given-names></name><name><surname>Golshani</surname><given-names>P</given-names></name><name><surname>Arisaka</surname><given-names>K</given-names></name><name><surname>Portera-Cailliau</surname><given-names>C</given-names></name></person-group><article-title>Simultaneous two-photon calcium imaging at different depths with spatiotemporal multiplexing</article-title><source>Nature Methods</source><year>2011</year><volume>8</volume><fpage>139</fpage><lpage>142</lpage><pub-id pub-id-type="pmid">21217749</pub-id></element-citation></ref><ref id="R18"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Cotton</surname><given-names>RJ</given-names></name><name><surname>Froudarakis</surname><given-names>E</given-names></name><name><surname>Storer</surname><given-names>P</given-names></name><name><surname>Saggau</surname><given-names>P</given-names></name><name><surname>Tolias</surname><given-names>AS</given-names></name></person-group><article-title>Three-dimensional mapping of microcircuit correlation structure</article-title><source>Frontiers in Neural Circuits</source><year>2013</year><volume>7</volume><fpage>151</fpage><pub-id pub-id-type="pmid">24133414</pub-id></element-citation></ref><ref id="R19"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Dal Maschio</surname><given-names>M</given-names></name><name><surname>Difato</surname><given-names>F</given-names></name><name><surname>Beltramo</surname><given-names>R</given-names></name><name><surname>Blau</surname><given-names>A</given-names></name><name><surname>Benfenati</surname><given-names>F</given-names></name><name><surname>Fellin</surname><given-names>T</given-names></name></person-group><article-title>Simultaneous two-photon imaging and photo-stimulation with structured light illumination</article-title><source>Optics Express</source><year>2010</year><volume>18</volume><fpage>18720</fpage><lpage>18731</lpage><pub-id pub-id-type="pmid">20940765</pub-id></element-citation></ref><ref id="R20"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Denk</surname><given-names>W</given-names></name><name><surname>Strickler</surname><given-names>JH</given-names></name><name><surname>Webb</surname><given-names>WW</given-names></name></person-group><article-title>Two-photon laser scanning fluorescence microscopy</article-title><source>Science (New York, NY)</source><year>1990</year><volume>248</volume><fpage>73</fpage><lpage>76</lpage></element-citation></ref><ref id="R21"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Ducros</surname><given-names>M</given-names></name><name><surname>Houssen</surname><given-names>YG</given-names></name><name><surname>Bradley</surname><given-names>J</given-names></name><name><surname>de Sars</surname><given-names>V</given-names></name><name><surname>Charpak</surname><given-names>S</given-names></name></person-group><article-title>Encoded multisite two-photon microscopy</article-title><source>Proceedings of the National Academy of Sciences of the United States of America</source><year>2013</year><volume>110</volume><fpage>13138</fpage><lpage>13143</lpage><pub-id pub-id-type="pmid">23798397</pub-id></element-citation></ref><ref id="R22"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Egner</surname><given-names>A</given-names></name><name><surname>Hell</surname><given-names>SW</given-names></name></person-group><article-title>Time multiplexing and parallelization in multifocal multiphoton microscopy</article-title><source>Journal of the Optical Society of America a-Optics Image Science and Vision</source><year>2000</year><volume>17</volume><fpage>1192</fpage><lpage>1201</lpage></element-citation></ref><ref id="R23"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Fittinghoff</surname><given-names>DN</given-names></name><name><surname>Wiseman</surname><given-names>PW</given-names></name><name><surname>Squier</surname><given-names>JA</given-names></name></person-group><article-title>Widefield multiphoton and temporally decorrelated multifocal multiphoton microscopy</article-title><source>Optics Express</source><year>2000</year><volume>7</volume><fpage>273</fpage><lpage>279</lpage><pub-id pub-id-type="pmid">19407875</pub-id></element-citation></ref><ref id="R24"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Fricke</surname><given-names>M</given-names></name><name><surname>Nielsen</surname><given-names>T</given-names></name></person-group><article-title>Two-dimensional imaging without scanning by multifocal multiphoton microscopy</article-title><source>Applied Optics</source><year>2005</year><volume>44</volume><fpage>2984</fpage><lpage>2988</lpage><pub-id pub-id-type="pmid">15929287</pub-id></element-citation></ref><ref id="R25"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Grewe</surname><given-names>BF</given-names></name><name><surname>Langer</surname><given-names>D</given-names></name><name><surname>Kasper</surname><given-names>H</given-names></name><name><surname>Kampa</surname><given-names>BM</given-names></name><name><surname>Helmchen</surname><given-names>F</given-names></name></person-group><article-title>High-speed in vivo calcium imaging reveals neuronal network activity with near-millisecond precision</article-title><source>Nature Methods</source><year>2010</year><volume>7</volume><fpage>399</fpage><lpage>405</lpage><pub-id pub-id-type="pmid">20400966</pub-id></element-citation></ref><ref id="R26"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Grewe</surname><given-names>BF</given-names></name><name><surname>Voigt</surname><given-names>FF</given-names></name><name><surname>van 't Hoff</surname><given-names>M</given-names></name><name><surname>Helmchen</surname><given-names>F</given-names></name></person-group><article-title>Fast two-layer two-photon imaging of neuronal cell populations using an electrically tunable lens</article-title><source>Biomedical optics express</source><year>2011</year><volume>2</volume><fpage>2035</fpage><lpage>2046</lpage><pub-id pub-id-type="pmid">21750778</pub-id></element-citation></ref><ref id="R27"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Helmchen</surname><given-names>F</given-names></name><name><surname>Denk</surname><given-names>W</given-names></name></person-group><article-title>Deep tissue two-photon microscopy</article-title><source>Nature Methods</source><year>2005</year><volume>2</volume><fpage>932</fpage><lpage>940</lpage><pub-id pub-id-type="pmid">16299478</pub-id></element-citation></ref><ref id="R28"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Helmstaedter</surname><given-names>M</given-names></name><name><surname>Sakmann</surname><given-names>B</given-names></name><name><surname>Feldmeyer</surname><given-names>D</given-names></name></person-group><article-title>Neuronal Correlates of Local, Lateral, and Translaminar Inhibition with Reference to Cortical Columns</article-title><source>Cerebral Cortex</source><year>2009</year><volume>19</volume><fpage>926</fpage><lpage>937</lpage><pub-id pub-id-type="pmid">18832335</pub-id></element-citation></ref><ref id="R29"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Helmstaedter</surname><given-names>M</given-names></name><name><surname>Staiger</surname><given-names>JF</given-names></name><name><surname>Sakmann</surname><given-names>B</given-names></name><name><surname>Feldmeyer</surname><given-names>D</given-names></name></person-group><article-title>Efficient recruitment of layer 2/3 interneurons by layer 4 input in single columns of rat somatosensory cortex</article-title><source>Journal of Neuroscience</source><year>2008</year><volume>28</volume><fpage>8273</fpage><lpage>8284</lpage><pub-id pub-id-type="pmid">18701690</pub-id></element-citation></ref><ref id="R30"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Huberman</surname><given-names>AD</given-names></name><name><surname>Niell</surname><given-names>CM</given-names></name></person-group><article-title>What can mice tell us about how vision works?</article-title><source>Trends in Neurosciences</source><year>2011</year><volume>34</volume><fpage>464</fpage><lpage>473</lpage><pub-id pub-id-type="pmid">21840069</pub-id></element-citation></ref><ref id="R31"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Insel</surname><given-names>TR</given-names></name><name><surname>Landis</surname><given-names>SC</given-names></name><name><surname>Collins</surname><given-names>FS</given-names></name></person-group><article-title>The NIH BRAIN Initiative</article-title><source>Science</source><year>2013</year><volume>340</volume><fpage>687</fpage><lpage>688</lpage><pub-id pub-id-type="pmid">23661744</pub-id></element-citation></ref><ref id="R32"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Katona</surname><given-names>G</given-names></name><name><surname>Szalay</surname><given-names>G</given-names></name><name><surname>Maak</surname><given-names>P</given-names></name><name><surname>Kaszas</surname><given-names>A</given-names></name><name><surname>Veress</surname><given-names>M</given-names></name><name><surname>Hillier</surname><given-names>D</given-names></name><name><surname>Chiovini</surname><given-names>B</given-names></name><name><surname>Vizi</surname><given-names>ES</given-names></name><name><surname>Roska</surname><given-names>B</given-names></name><name><surname>Rozsa</surname><given-names>B</given-names></name></person-group><article-title>Fast two-photon in vivo imaging with three-dimensional random-access scanning in large tissue volumes</article-title><source>Nature Methods</source><year>2012</year><volume>9</volume><fpage>201</fpage><lpage>208</lpage><pub-id pub-id-type="pmid">22231641</pub-id></element-citation></ref><ref id="R33"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Kim</surname><given-names>KH</given-names></name><name><surname>Buehler</surname><given-names>C</given-names></name><name><surname>Bahlmann</surname><given-names>K</given-names></name><name><surname>Ragan</surname><given-names>T</given-names></name><name><surname>Lee</surname><given-names>W-CA</given-names></name><name><surname>Nedivi</surname><given-names>E</given-names></name><name><surname>Heffer</surname><given-names>EL</given-names></name><name><surname>Fantini</surname><given-names>S</given-names></name><name><surname>So</surname><given-names>PTC</given-names></name></person-group><article-title>Multifocal multiphoton microscopy based on multianode photomultiplier tubes</article-title><source>Optics Express</source><year>2007</year><volume>15</volume><fpage>11658</fpage><lpage>11678</lpage><pub-id pub-id-type="pmid">19547526</pub-id></element-citation></ref><ref id="R34"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Kirkby</surname><given-names>PA</given-names></name><name><surname>Nadella</surname><given-names>KMNS</given-names></name><name><surname>Silver</surname><given-names>RA</given-names></name></person-group><article-title>A compact acousto-optic lens for 2D and 3D femtosecond based 2-photon microscopy</article-title><source>Optics Express</source><year>2010</year><volume>18</volume><fpage>13720</fpage><lpage>13744</lpage></element-citation></ref><ref id="R35"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Kong</surname><given-names>LJ</given-names></name><name><surname>Tang</surname><given-names>JY</given-names></name><name><surname>Little</surname><given-names>JP</given-names></name><name><surname>Yu</surname><given-names>Y</given-names></name><name><surname>Lammermann</surname><given-names>T</given-names></name><name><surname>Lin</surname><given-names>CP</given-names></name><name><surname>Germain</surname><given-names>RN</given-names></name><name><surname>Cuil</surname><given-names>M</given-names></name></person-group><article-title>Continuous volumetric imaging via an optical phase-locked ultrasound lens</article-title><source>Nature Methods</source><year>2015</year><volume>12</volume><fpage>759</fpage><lpage>762</lpage><pub-id pub-id-type="pmid">26167641</pub-id></element-citation></ref><ref id="R36"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>London</surname><given-names>M</given-names></name><name><surname>Hausser</surname><given-names>M</given-names></name></person-group><article-title>Dendritic computation</article-title><source>In Annual Review of Neuroscience</source><year>2005</year><fpage>503</fpage><lpage>532</lpage></element-citation></ref><ref id="R37"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Maruyama</surname><given-names>R</given-names></name><name><surname>Maeda</surname><given-names>K</given-names></name><name><surname>Moroda</surname><given-names>H</given-names></name><name><surname>Kato</surname><given-names>I</given-names></name><name><surname>Inoue</surname><given-names>M</given-names></name><name><surname>Miyakawa</surname><given-names>H</given-names></name><name><surname>Aonishi</surname><given-names>T</given-names></name></person-group><article-title>Detecting cells using non-negative matrix factorization on calcium imaging data</article-title><source>Neural Networks</source><year>2014</year><volume>55</volume><fpage>11</fpage><lpage>19</lpage><pub-id pub-id-type="pmid">24705544</pub-id></element-citation></ref><ref id="R38"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Matsumoto</surname><given-names>N</given-names></name><name><surname>Okazaki</surname><given-names>S</given-names></name><name><surname>Fukushi</surname><given-names>Y</given-names></name><name><surname>Takamoto</surname><given-names>H</given-names></name><name><surname>Inoue</surname><given-names>T</given-names></name><name><surname>Terakawa</surname><given-names>S</given-names></name></person-group><article-title>An adaptive approach for uniform scanning in multifocal multiphoton microscopy with a spatial light modulator</article-title><source>Optics Express</source><year>2014</year><volume>22</volume><fpage>633</fpage><lpage>645</lpage><pub-id pub-id-type="pmid">24515023</pub-id></element-citation></ref><ref id="R39"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Mazurek</surname><given-names>M</given-names></name><name><surname>Kager</surname><given-names>M</given-names></name><name><surname>Van Hooser</surname><given-names>SD</given-names></name></person-group><article-title>Robust quantification of orientation selectivity and direction selectivity</article-title><source>Frontiers in Neural Circuits</source><year>2014</year><volume>8</volume></element-citation></ref><ref id="R40"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Meyer</surname><given-names>HS</given-names></name><name><surname>Schwarz</surname><given-names>D</given-names></name><name><surname>Wimmer</surname><given-names>VC</given-names></name><name><surname>Schmitt</surname><given-names>AC</given-names></name><name><surname>Kerr</surname><given-names>JND</given-names></name><name><surname>Sakmann</surname><given-names>B</given-names></name><name><surname>Helmstaedter</surname><given-names>M</given-names></name></person-group><article-title>Inhibitory interneurons in a cortical column form hot zones of inhibition in layers 2 and 5A</article-title><source>Proceedings of the National Academy of Sciences of the United States of America</source><year>2011</year><volume>108</volume><fpage>16807</fpage><lpage>16812</lpage><pub-id pub-id-type="pmid">21949377</pub-id></element-citation></ref><ref id="R41"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Mukamel</surname><given-names>EA</given-names></name><name><surname>Nimmerjahn</surname><given-names>A</given-names></name><name><surname>Schnitzer</surname><given-names>MJ</given-names></name></person-group><article-title>Automated Analysis of Cellular Signals from Large-Scale Calcium Imaging Data</article-title><source>Neuron</source><year>2009</year><volume>63</volume><fpage>747</fpage><lpage>760</lpage><pub-id pub-id-type="pmid">19778505</pub-id></element-citation></ref><ref id="R42"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Niell</surname><given-names>CM</given-names></name><name><surname>Stryker</surname><given-names>MP</given-names></name></person-group><article-title>Highly selective receptive fields in mouse visual cortex</article-title><source>Journal of Neuroscience</source><year>2008</year><volume>28</volume><fpage>7520</fpage><lpage>7536</lpage><pub-id pub-id-type="pmid">18650330</pub-id></element-citation></ref><ref id="R43"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Nikolenko</surname><given-names>V</given-names></name><name><surname>Watson</surname><given-names>BO</given-names></name><name><surname>Araya</surname><given-names>R</given-names></name><name><surname>Woodruff</surname><given-names>A</given-names></name><name><surname>Peterka</surname><given-names>DS</given-names></name><name><surname>Yuste</surname><given-names>R</given-names></name></person-group><article-title>SLM microscopy: scanless two-photon imaging and photostimulation with spatial light modulators</article-title><source>Frontiers in Neural Circuits</source><year>2008</year><volume>2</volume></element-citation></ref><ref id="R44"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Otsu</surname><given-names>Y</given-names></name><name><surname>Bormuth</surname><given-names>V</given-names></name><name><surname>Wong</surname><given-names>J</given-names></name><name><surname>Mathieu</surname><given-names>B</given-names></name><name><surname>Dugue</surname><given-names>GP</given-names></name><name><surname>Feltz</surname><given-names>A</given-names></name><name><surname>Dieudonne</surname><given-names>S</given-names></name></person-group><article-title>Optical monitoring of neuronal activity at high frame rate with a digital random-access multiphoton (RAMP) microscope</article-title><source>Journal of Neuroscience Methods</source><year>2008</year><volume>173</volume><fpage>259</fpage><lpage>270</lpage><pub-id pub-id-type="pmid">18634822</pub-id></element-citation></ref><ref id="R45"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Packer</surname><given-names>AM</given-names></name><name><surname>Peterka</surname><given-names>DS</given-names></name><name><surname>Hirtz</surname><given-names>JJ</given-names></name><name><surname>Prakash</surname><given-names>R</given-names></name><name><surname>Deisseroth</surname><given-names>K</given-names></name><name><surname>Yuste</surname><given-names>R</given-names></name></person-group><article-title>Two-photon optogenetics of dendritic spines and neural circuits</article-title><source>Nature Methods</source><year>2012</year><volume>9</volume><fpage>1202</fpage><lpage>1205</lpage><pub-id pub-id-type="pmid">23142873</pub-id></element-citation></ref><ref id="R46"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Packer</surname><given-names>AM</given-names></name><name><surname>Russell</surname><given-names>LE</given-names></name><name><surname>Dalgleish</surname><given-names>HWP</given-names></name><name><surname>Hausser</surname><given-names>M</given-names></name></person-group><article-title>Simultaneous all-optical manipulation and recording of neural circuit activity with cellular resolution in vivo</article-title><source>Nature Methods</source><year>2015</year><volume>12</volume><fpage>140</fpage><lpage>146</lpage><pub-id pub-id-type="pmid">25532138</pub-id></element-citation></ref><ref id="R47"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Pnevmatikakis</surname><given-names>EA</given-names></name><name><surname>Soudry</surname><given-names>D</given-names></name><name><surname>Gao</surname><given-names>Y</given-names></name><name><surname>Machado</surname><given-names>TA</given-names></name><name><surname>Pfau</surname><given-names>D</given-names></name><name><surname>Reardon</surname><given-names>T</given-names></name><name><surname>Mu</surname><given-names>Y</given-names></name><name><surname>Lacefield</surname><given-names>C</given-names></name><name><surname>Yang</surname><given-names>W</given-names></name><name><surname>Ahrens</surname><given-names>MB</given-names></name><etal/></person-group><article-title>Simultaneous denoising, deconvolution, and demixing of calcium imaging data</article-title><source>Neuron</source><year>2016</year></element-citation></ref><ref id="R48"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Pologruto</surname><given-names>TA</given-names></name><name><surname>Sabatini</surname><given-names>BL</given-names></name><name><surname>Svoboda</surname><given-names>K</given-names></name></person-group><article-title>ScanImage: flexible software for operating laser scanning microscopes</article-title><source>Biomedical engineering online</source><year>2003</year><volume>2</volume><fpage>13</fpage><lpage>13</lpage><pub-id pub-id-type="pmid">12801419</pub-id></element-citation></ref><ref id="R49"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Prevedel</surname><given-names>R</given-names></name><name><surname>Yoon</surname><given-names>Y-G</given-names></name><name><surname>Hoffmann</surname><given-names>M</given-names></name><name><surname>Pak</surname><given-names>N</given-names></name><name><surname>Wetzstein</surname><given-names>G</given-names></name><name><surname>Kato</surname><given-names>S</given-names></name><name><surname>Schrodel</surname><given-names>T</given-names></name><name><surname>Raskar</surname><given-names>R</given-names></name><name><surname>Zimmer</surname><given-names>M</given-names></name><name><surname>Boyden</surname><given-names>ES</given-names></name><etal/></person-group><article-title>Simultaneous whole-animal 3D imaging of neuronal activity using light-field microscopy</article-title><source>Nature Methods</source><year>2014</year><volume>11</volume><fpage>727</fpage><lpage>730</lpage><pub-id pub-id-type="pmid">24836920</pub-id></element-citation></ref><ref id="R50"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Quirin</surname><given-names>S</given-names></name><name><surname>Jackson</surname><given-names>J</given-names></name><name><surname>Peterka</surname><given-names>DS</given-names></name><name><surname>Yuste</surname><given-names>R</given-names></name></person-group><article-title>Simultaneous imaging of neural activity in three dimensions</article-title><source>Frontiers in Neural Circuits</source><year>2014</year><volume>8</volume></element-citation></ref><ref id="R51"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Quirin</surname><given-names>S</given-names></name><name><surname>Peterka</surname><given-names>DS</given-names></name><name><surname>Yuste</surname><given-names>R</given-names></name></person-group><article-title>Instantaneous three-dimensional sensing using spatial light modulator illumination with extended depth of field imaging</article-title><source>Optics Express</source><year>2013</year><volume>21</volume><fpage>16007</fpage><lpage>16021</lpage><pub-id pub-id-type="pmid">23842387</pub-id></element-citation></ref><ref id="R52"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Reddy</surname><given-names>GD</given-names></name><name><surname>Kelleher</surname><given-names>K</given-names></name><name><surname>Fink</surname><given-names>R</given-names></name><name><surname>Saggau</surname><given-names>P</given-names></name></person-group><article-title>Three-dimensional random access multiphoton microscopy for functional imaging of neuronal activity</article-title><source>Nature Neuroscience</source><year>2008</year><volume>11</volume><fpage>713</fpage><lpage>720</lpage><pub-id pub-id-type="pmid">18432198</pub-id></element-citation></ref><ref id="R53"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Rickgauer</surname><given-names>JP</given-names></name><name><surname>Deisseroth</surname><given-names>K</given-names></name><name><surname>Tank</surname><given-names>DW</given-names></name></person-group><article-title>Simultaneous cellular-resolution optical perturbation and imaging of place cell firing fields</article-title><source>Nature Neuroscience</source><year>2014</year><volume>17</volume><fpage>1816</fpage><lpage>1824</lpage><pub-id pub-id-type="pmid">25402854</pub-id></element-citation></ref><ref id="R54"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Rochefort</surname><given-names>NL</given-names></name><name><surname>Narushima</surname><given-names>M</given-names></name><name><surname>Grienberger</surname><given-names>C</given-names></name><name><surname>Marandi</surname><given-names>N</given-names></name><name><surname>Hill</surname><given-names>DN</given-names></name><name><surname>Konnerth</surname><given-names>A</given-names></name></person-group><article-title>Development of Direction Selectivity in Mouse Cortical Neurons</article-title><source>Neuron</source><year>2011</year><volume>71</volume><fpage>425</fpage><lpage>432</lpage><pub-id pub-id-type="pmid">21835340</pub-id></element-citation></ref><ref id="R55"><element-citation publication-type="book"><person-group person-group-type="author"><name><surname>Schmidt</surname><given-names>JD</given-names></name></person-group><source>Numerical Simulation of Optical Wave Propagation with Examples in MATLAB</source><year>2010</year><publisher-loc>Bellingham, Washington 98227-0010 USA</publisher-loc><publisher-name>SPIE Press</publisher-name></element-citation></ref><ref id="R56"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Shai</surname><given-names>AS</given-names></name><name><surname>Anastassiou</surname><given-names>CA</given-names></name><name><surname>Larkum</surname><given-names>ME</given-names></name><name><surname>Koch</surname><given-names>C</given-names></name></person-group><article-title>Physiology of Layer 5 Pyramidal Neurons in Mouse Primary Visual Cortex: Coincidence Detection through Bursting</article-title><source>PLoS computational biology</source><year>2015</year><volume>11</volume><fpage>e1004090</fpage><lpage>e1004090</lpage><pub-id pub-id-type="pmid">25768881</pub-id></element-citation></ref><ref id="R57"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Thalhammer</surname><given-names>G</given-names></name><name><surname>Bowman</surname><given-names>RW</given-names></name><name><surname>Love</surname><given-names>GD</given-names></name><name><surname>Padgett</surname><given-names>MJ</given-names></name><name><surname>Ritsch-Marte</surname><given-names>M</given-names></name></person-group><article-title>Speeding up liquid crystal SLMs using overdrive with phase change reduction</article-title><source>Optics Express</source><year>2013</year><volume>21</volume><fpage>1779</fpage><lpage>1797</lpage><pub-id pub-id-type="pmid">23389162</pub-id></element-citation></ref><ref id="R58"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Theriault</surname><given-names>G</given-names></name><name><surname>Cottet</surname><given-names>M</given-names></name><name><surname>Castonguay</surname><given-names>A</given-names></name><name><surname>McCarthy</surname><given-names>N</given-names></name><name><surname>De Koninck</surname><given-names>Y</given-names></name></person-group><article-title>Extended two-photon microscopy in live samples with Bessel beams: steadier focus, faster volume scans, and simpler stereoscopic imaging</article-title><source>Frontiers in Cellular Neuroscience</source><year>2014</year><volume>8</volume></element-citation></ref><ref id="R59"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Thevenaz</surname><given-names>P</given-names></name><name><surname>Ruttimann</surname><given-names>UE</given-names></name><name><surname>Unser</surname><given-names>M</given-names></name></person-group><article-title>A pyramid approach to subpixel registration based on intensity</article-title><source>Ieee Transactions on Image Processing</source><year>1998</year><volume>7</volume><fpage>27</fpage><lpage>41</lpage><pub-id pub-id-type="pmid">18267377</pub-id></element-citation></ref><ref id="R60"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Vogelstein</surname><given-names>JT</given-names></name><name><surname>Packer</surname><given-names>AM</given-names></name><name><surname>Machado</surname><given-names>TA</given-names></name><name><surname>Sippy</surname><given-names>T</given-names></name><name><surname>Babadi</surname><given-names>B</given-names></name><name><surname>Yuste</surname><given-names>R</given-names></name><name><surname>Paninski</surname><given-names>L</given-names></name></person-group><article-title>Fast Nonnegative Deconvolution for Spike Train Inference From Population Calcium Imaging</article-title><source>Journal of Neurophysiology</source><year>2010</year><volume>104</volume><fpage>3691</fpage><lpage>3704</lpage><pub-id pub-id-type="pmid">20554834</pub-id></element-citation></ref><ref id="R61"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Vogelstein</surname><given-names>JT</given-names></name><name><surname>Watson</surname><given-names>BO</given-names></name><name><surname>Packer</surname><given-names>AM</given-names></name><name><surname>Yuste</surname><given-names>R</given-names></name><name><surname>Jedynak</surname><given-names>B</given-names></name><name><surname>Paninski</surname><given-names>L</given-names></name></person-group><article-title>Spike Inference from Calcium Imaging Using Sequential Monte Carlo Methods</article-title><source>Biophysical Journal</source><year>2009</year><volume>97</volume><fpage>636</fpage><lpage>655</lpage><pub-id pub-id-type="pmid">19619479</pub-id></element-citation></ref><ref id="R62"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Watson</surname><given-names>BO</given-names></name><name><surname>Nikolenko</surname><given-names>V</given-names></name><name><surname>Yuste</surname><given-names>R</given-names></name></person-group><article-title>Two-photon imaging with diffractive optical elements</article-title><source>Frontiers in Neural Circuits</source><year>2009</year><volume>3</volume></element-citation></ref><ref id="R63"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Williams</surname><given-names>RM</given-names></name><name><surname>Zipfel</surname><given-names>WR</given-names></name><name><surname>Webb</surname><given-names>WW</given-names></name></person-group><article-title>Multiphoton microscopy in biological research</article-title><source>Current Opinion in Chemical Biology</source><year>2001</year><volume>5</volume><fpage>603</fpage><lpage>608</lpage><pub-id pub-id-type="pmid">11578936</pub-id></element-citation></ref><ref id="R64"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Yuste</surname><given-names>R</given-names></name><name><surname>Katz</surname><given-names>LC</given-names></name></person-group><article-title>Control of postsynaptic Ca2+ influx in developing neocortex by excitatory and inhibitory neurotransmitters</article-title><source>Neuron</source><year>1991</year><volume>6</volume><fpage>333</fpage><lpage>344</lpage><pub-id pub-id-type="pmid">1672071</pub-id></element-citation></ref><ref id="R65"><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Zipfel</surname><given-names>WR</given-names></name><name><surname>Williams</surname><given-names>RM</given-names></name><name><surname>Webb</surname><given-names>WW</given-names></name></person-group><article-title>Nonlinear magic: Multiphoton microscopy in the biosciences</article-title><source>Nature Biotechnology</source><year>2003</year><volume>21</volume><fpage>1369</fpage><lpage>1377</lpage></element-citation></ref></ref-list></back><floats-group><fig id="F1" orientation="portrait" position="float"><label>Figure 1</label><caption><title>SLM Two-photon Microscope and Multiplane Structural Imaging</title><p id="P51">(A) SLM two-photon microscope. The laser beam from the Ti:Sapphire laser is expanded to illuminate the SLM. The spatially-modulated reflected beam from the SLM passes through a telescope, followed by an XY galvanometric mirror, and directed into a two-photon microscope. This setup is essentially composed of a conventional two-photon microscope, and an SLM beam shaping component (red dashed box).</p><p id="P52">(B) Illustration of axial dual plane imaging, where two planes at different depths can be simultaneously imaged.</p><p id="P53">(C) Illustration of lateral dual plane imaging, where two fields of view at the same depth can be simultaneously imaged.</p><p id="P54">(D) Two-photon structural imaging of a shrimp at different depths through the sample, obtained by mechanically moving the objective with a micrometer. Each imaging depth is pseudo-colored. The last image is constructed by overlaying all other images together. Scale bar, 100 &#x000b5;m.</p><p id="P55">(E) Software based SLM focusing of the same shrimp as (D). The SLM is used to modify the wavefront of the light to control the focal depth, while the position of the objective is fixed. The nominal focus of the objective is fixed at the 100 &#x000b5;m plane. This set of images looks similar to that in (D). Scale bar, 100 &#x000b5;m.</p><p id="P56">(F) Arithmetic sum of all the images at the seven planes shown in (D).</p><p id="P57">(G) Arithmetic sum of all the images at the seven planes shown in (E).</p><p id="P58">(H) Seven-axial-plane imaging of the same shrimp as (D)&#x02013;(G), using the SLM to create 7 beamlets that simultaneously target all seven planes.</p><p id="P59">(I) Same as (H), but using the SLM to increase the illumination intensity <italic>only</italic> for the 50 &#x000b5;m plane. Features on that plane are highlighted compared to panel (H). Scale bar, 100 &#x000b5;m.</p></caption><graphic xlink:href="nihms745170f1"/></fig><fig id="F2" orientation="portrait" position="float"><label>Figure 2</label><caption><title>Lateral Dual Plane <italic>in-vivo</italic> Functional Imaging of Mouse V1</title><p id="P60">(A) Schematic of the <italic>in-vivo</italic> experiment, imaging V1 in the mouse. In this experiment, two fields of view (FOV), laterally displaced by 300 &#x000b5;m, are simultaneously imaged.</p><p id="P61">(B) /(C) Top panel, temporal standard deviation image of the sequential single plane recording (10 fps) of FOV 1 (B), and FOV 2 (C), of mouse V1 at a depth of 280 &#x000b5;m from the pial surface. Bottom panel, spatial component contours overlaid on the top panel. The boxes in dashed line show the overlapped region, shared in both FOVs. Scale bar, 50 &#x000b5;m.</p><p id="P62">(D) Arithmetic sum of (B) and (C).</p><p id="P63">(E) Top panel, temporal standard deviation image of the simultaneous dual plane recording (10 fps) of the two FOVs. Bottom panel, overlaid spatial component contours from the two FOVs.</p><p id="P64">(F) Representative extracted &#x00394;F/F traces, using the CNMF algorithm, of the selected spatial components from the two field of views (red, FOV 1; green, FOV 2), from the sequential single plane recording.</p><p id="P65">(G) Extracted &#x00394;F/F traces, using the CNMF algorithm, of the same spatial components shown in (F), from the simultaneous dual plane recording. The areas highlighted in blue in the dual plane &#x00394;F/F traces are two spatial components taken from the overlapped area of the two FOVs. Their spatial contours are shown with the black box in the bottom panel in (E).</p><p id="P66">(H) Zoomed view of the &#x00394;F/F traces in the shaded area in (G), showing the extremely high correlation between the independently extracted dynamics from the twinned spatial components.</p></caption><graphic xlink:href="nihms745170f2"/></fig><fig id="F3" orientation="portrait" position="float"><label>Figure 3</label><caption><title>Axial Dual Plane <italic>in-vivo</italic> Functional Imaging of Mouse V1 at Layer 2/3 and 5</title><p id="P67">(A) Schematic of the <italic>in-vivo</italic> experiment, imaging V1 in the mouse. In this experiment, two different planes, axially separated by 330 &#x000b5;m, are simultaneously imaged.</p><p id="P68">(B) / (C) Top panel, temporal standard deviation images of the sequential single plane recording (10 fps) of mouse V1 at depth of 170 &#x000b5;m (layer 2/3) and depth of 500 &#x000b5;m (layer 5) from the pial surface. The images are false-colored. Bottom panel, spatial component contours overlaid on the top panel. Scale bar, 50 &#x000b5;m.</p><p id="P69">(D) Arithmetic sum of (B) and (C).</p><p id="P70">(E) Top panel, temporal standard deviation image of the simultaneous dual plane (10 fps) recording of the two planes shown in (B) and (C). Bottom panel, overlaid spatial component contours from the two planes.</p><p id="P71">(F) Representative extracted &#x00394;F/F traces, using the CNMF algorithm, of 20 spatial components out of 345 from the two planes (red, layer 2/3; green, layer 5), from the sequential single plane recording.</p><p id="P72">(G) Extracted &#x00394;F/F traces, using the CNMF algorithm, of the same spatial components shown in (F), from the simultaneous dual plane recording.</p><p id="P73">(H) / (I) Zoomed in view of the extracted &#x00394;F/F traces in the shaded area in (F) and (G) respectively.</p><p id="P74">(J) Further enlargement of the small events in the &#x00394;F/F traces shown in the blue shaded areas in (H) and (I).</p></caption><graphic xlink:href="nihms745170f3"/></fig><fig id="F4" orientation="portrait" position="float"><label>Figure 4</label><caption><title>Source Separation</title><p id="P75">Source separation of the fluorescent signal from spatially overlapped spatial components (SCs) in the dual plane images shown in <xref ref-type="fig" rid="F3">Fig 3</xref>. (A) and (B) show two different examples with increasing complexity. In each example, the contours of the overlapped spatial components are plotted in red (from layer 2/3) and green (from layer 5) with their source ID. A pixel maximum projection of the recorded movie are shown to illustrate the spatial overlap of these SCs. Raw image frames from the recorded movie show the neuronal activity of these individual spatial components. For the temporal traces, the first trace (in gray) shows that extracted from all the pixels of the overlapped SCs. The following traces show the demixed signal of the individual SCs. Three different methods are used to extract the signal from individual SCs: non-overlapped pixel (NOL), with the extracted signal shown in orange, independent component analysis (ICA) in green, and constrained non-negative matrix factorization (CNMF) in red. The corresponding SC contours result from these methods are shown next to their &#x00394;F/F traces, and the color code of the pixel weighting is shown immediately below (B). Using the SC contour from CNMF, but with uniform pixel weighting and without temporal demixing, the extracted &#x00394;F/F trace is plotted in cyan, superimposed onto the traces extracted from CNMF. In (B), ICA fails to find the spatial component 2. The traces are plotted independently scaled for display convenience. The scaling applied is as follows: the scale bar of &#x00394;F/F is 1.27 for SC 1 and 1.46 for SC 2 in (A); 1.24 for SC 1, 0.48 for SC 2, 0.36 for SC 3, 0.24 for SC 4, 0.78 for SC 5, 0.85 for SC 6, and 0.79 for SC 7 in (B).</p></caption><graphic xlink:href="nihms745170f4"/></fig><fig id="F5" orientation="portrait" position="float"><label>Figure 5</label><caption><title>Comparison between CNMF and NOL</title><p id="P76">(A) Correlation coefficient between the &#x00394;F/F extracted from CNMF and NOL for a total of 250 spatial components (SCs) in the dual plane imaging shown in <xref ref-type="fig" rid="F3">Fig. 3</xref>. The blue dashed line indicates the median (0.947) of the correlation coefficients. The SC IDs are sorted by the SNR of the signals extracted by NOL.</p><p id="P77">(B) Signal to noise ratio (SNR) comparison between the &#x00394;F/F extracted from CNMF (with residue) and the &#x00394;F/F extracted from NOL for the 250 SCs. The overall SNR of CNMF (with residue) is 13% higher than that from NOL.</p><p id="P78">(C) An example where three sources that are spatially overlapped in the dual plane imaging is studied. The contours of the overlapped SCs are plotted in red (from layer 2/3) and green (from layer 5) with their spatial component ID. The CNMF and NOL extracted &#x00394;F/F signals are plotted in red and orange respectively. The signal that CNMF extracted, with residual noise is plotted in blue. Using the SC contour in the CNMF but with uniform pixel weighting and without temporal demixing, the extracted &#x00394;F/F trace is plotted in gray, and labelled as &#x0201c;Raw&#x0201d;. The corresponding correlation and SNR values for these two SC are labelled in (A) and (B). The traces are plotted independently scaled for display convenience. The scaling applied is as follows: the scale bar of &#x00394;F/F is 0.29 for SC 1, 0.14 for SC 2, and 0.51 for SC 3.</p><p id="P79">(D) / (E) Histogram of the &#x00394;F/F noise for (D) SC 1 and (E) SC 2. The orange color shows that for the NOL extracted signal, whereas blue shows that for CNMF with residue. The histograms are fitted with a Gaussian function, shown as a solid-line curve.</p></caption><graphic xlink:href="nihms745170f5"/></fig><fig id="F6" orientation="portrait" position="float"><label>Figure 6</label><caption><title>Orientation and Direction Selectivity Analysis with Simultaneous Dual Plane Imaging</title><p id="P80">(A) Normalized &#x00394;F/F traces for selected spatial components (SCs) with strong response to drifting grating visual stimulation, recorded with simultaneous dual plane imaging. The red and green color traces are from SCs at depths of 200 &#x000b5;m and 450 &#x000b5;m from the pial surface of mouse V1. The color bar in the bottom of each trace indicates the visual stimulation orientation of the drifting grating, with the legend shown on top of (B), i.e. red: 0&#x000b0;/180&#x000b0;, yellow: 45&#x000b0;/225&#x000b0;, green: 90&#x000b0;/270&#x000b0;, purple: 135&#x000b0;/315&#x000b0;.</p><p id="P81">(B) Left panel, response of the SCs to the drifting grating in visual stimulation. The SCs are on the 200 &#x000b5;m plane. The SCs are separated into four groups, corresponding to a preferred orientation angle of 0&#x000b0;/180&#x000b0;, 45&#x000b0;/225&#x000b0;, 90&#x000b0;/270&#x000b0;, and 135&#x000b0;/315&#x000b0;. The black curves are the average response of the group. Right panel, comparison of the SCs&#x02019; preferred orientation angle to the drifting gratings, between signals extracted from the single plane recording (blue dots) and the dual plane recording (orange dots).</p><p id="P82">(C) Same as (B), for spatial components located at 450 &#x000b5;m depth from pial surface.</p><p id="P83">(D) Left, overlaid temporal standard deviation image (with false color) of the sequential single plane recording from the 200 &#x000b5;m plane (red) and from the 450 &#x000b5;m plane (green). Right, extracted SC contours from the two planes. Scale bar, 50 &#x000b5;m.</p><p id="P84">(E) Examples of the evoked responses of the SCs with spatial lateral overlaps from the two planes. The blue color shows that extracted from single plane recording, and the orange shows that extracted from dual plane recording. The arrow inside each SC indicates its preferred direction. The locations of these SCs are indicated in the small black boxes in the SC contours in (D).</p></caption><graphic xlink:href="nihms745170f6"/></fig><fig id="F7" orientation="portrait" position="float"><label>Figure 7</label><caption><title>Axial Three Plane <italic>in-vivo</italic> Functional Imaging of Mouse V1, and Fast SLM Switching between Different Holograms</title><p id="P85">(A) &#x02013; (C) Temporal standard deviation image of the sequential single plane recording (10 fps) of mouse V1 at depths of 170 &#x000b5;m, 350 &#x000b5;m and 500 &#x000b5;m from the pial surface. The images are false-colored. Scale bar, 50 &#x000b5;m.</p><p id="P86">(D) Arithmetic sum of (A) &#x02013; (C).</p><p id="P87">(E) Temporal standard deviation image of the simultaneous three-plane recording (10 fps) of the same planes shown in (A) &#x02013; (C).</p><p id="P88">(F) Overlaid spatial component (SC) contours from the three planes.</p><p id="P89">(G) Representative extracted &#x00394;F/F traces of the selected SCs from the three planes (red, 170 &#x000b5;m plane, 10 SCs out of 58; blue, 350 &#x000b5;m plane, 10 SCs out of 65; green, 500 &#x000b5;m depth, 10 SCs out of 95), from the sequential single plane recording.</p><p id="P90">(H) Extracted &#x00394;F/F traces of the same SCs shown in (G), from the simultaneous three-plane recording.</p><p id="P91">(I) An example of source separation of the fluorescent signal from spatially overlapped components in the three plane imaging. The locations of these SCs are shown in the small black box in (F). The contours of the overlapped SCs are plotted in color with their SC ID. For each SC, the signal is extracted using NOL shown in orange, and CNMF in red. The corresponding SC contours result from these methods are shown next to their &#x00394;F/F traces. A raw trace, generated from the CNMF SC, but with uniform pixel weighting, and without temporal demixing, is plotted in cyan, superimposed onto the traces extracted with CNMF. Fluorescent traces are independently scaled for display convenience. The scale bar of &#x00394;F/F is 0.268, 0.376, and 0.351 for SC 1&#x02013;3 respectively.</p><p id="P92">(J) SLM switching between two sets of dual plane imaging on mouse V1. State 1 is the dual plane for depth of 210 &#x000b5;m and 330 &#x000b5;m from pial surface, and state 2 is the dual plane for depth of 110 &#x000b5;m and 270 &#x000b5;m from pial surface. Imaging frame rate is 10 fps. The SLM switching happens at the middle and at the end of each frame. The zoom-in-view of the switching region shows that the switching time between the two state is less than 3 ms. Scale bar, 50 &#x000b5;m.</p><p id="P93">(K) SLM switching time between two different states, measured from the change in fluorescent signal emitted from spatially localized planes of Rhodamine 6G. The switching time between different states is less than 3 ms. The black indicator marks when the switching starts.</p></caption><graphic xlink:href="nihms745170f7"/></fig></floats-group></article>