Another California City has moved its GIS Environment to the Cloud! The City of San Marcos has not only reduced the costs of maintaining on-site infrastructure but can also take advantage of cloud infrastructure's performance, security, and integration capabilities.
San Diego-based Esri business partner Quartic Solutions worked hand-in-hand with City staff to assess organizational needs and designed and built an Esri ArcGIS Enterprise Cloud environment running in Microsoft Azure. The City's primary goal, to relieve the strain on overburdened on-site resources, was achieved and exceeded, with a robust environment that will improve communication between people and multiple specialized municipal systems.
The City of San Marcos GIS staff is responsible for maintaining and providing high-quality, site-specific, authoritative spatial data to all departments within the City, including Planning, Development Services, City Clerk, Finance, Fire, Public Works, Parks and recreation, Storm Water, and Community Economic Development. Since 2006, the City has developed over a hundred different GIS data layers and maps that have supported both planning and operations needed for development services and other departmental business.
The City has been running its GIS hardware and software in an on-premise environment for over a decade. As more and more GIS functionality has moved to the cloud, it has become common for cities to move away from limited internal infrastructure to more flexible and reliable off-premise solutions. The City of San Marcos has done just that. The City’s miniature GIS web deployment has gone from a poorly performing, low-reliability mapping system to one that is stable and ready for the future.
The GIS database underwent a significant overhaul in the cloud migration project. The GIS database structures were streamlined, eliminating redundancies and enabling better data management. The database version is now 10.9.1.
The City also took advantage of this opportunity to retire its old GIS desktop client software, ArcMap. Migration is proving to be a success, and Esri’s ArcGIS Pro is proving to be a big jump in functionality and adaptability.ArcGIS Pro, the powerful single desktop GIS application, is a feature-packed software developed with enhancements and ideas from the ArcGIS Pro user community.
The City of San Marcos GIS staff is responsible for maintaining and providing high-quality, site-specific, authoritative spatial data to all departments within the City, including Development Services, City Clerk, Finance, Fire, Public Works, Parks and recreation, Storm Water, and Community Economic Development. Since 2006, the City has developed over a hundred different GIS data layers and maps that have supported both planning and operations needed for development services and other departmental business.
Quartic worked closely with the San Marcos CIO to develop a comprehensive design and implementation strategy for this specific Cloud implementation and upgrade project. The production rollout of the new system needed to go smoothly and without hiccups because there were existing system integrations supporting mission-critical applications. City crews use Lucity daily, The City's asset and work order management system. The City wanted a precise and automated rollout of the new system, so Quartic strategically automated the deployment process using a streamlined scripted solution.
The team considered two rollout script development paths: Esri's ArcGIS Enterprise Cloud Builder Tools or Microsoft's Azure Bicep. Both solutions would have been successful, but since the City's Information Technology staff have expertise with Azure DevOps Pipelines, the final decision was to use Azure Bicep.
With the City leading, the comprehensive rollout plan enabled Quartic to execute the scripts, resulting in a smooth deployment into production. The migration went seamlessly, with no data or configuration loss and no service failure to the users.
The architecture of the new solution required careful consideration to ensure that the foundation was set for the GIS application needs of the future. The team carefully planned all components, including the network, storage, database, applications, and security. This careful planning has set a strong foundation for growth in the future.
Focus was put on the new environment's stability, performance, and reliability while upgrading the software versions, migrating the third-party applications, and completing the ArcGIS Enterprise deployment.
Network: Azure Cloud is connected to San Marcos’ local network, and there is a solution for resolving website names between Azure and the on-site network. The Cloud networks consist of a central network for shared cloud services and another specifically for ArcGIS Enterprise.
Storage: Azure's newest storage system replaces San Marcos' aging on-premise file storage. All components leverage premium storage options and Azure and Esri tools to ensure data is safely backed up to multiple locations.
Database: Azure's managed database stores San Marcos GIS data, which can scale to fit their needs and is also cost-efficient. This component was configured to create data backups every 12 hours to protect the data.
Application and Web: A "multi-machine" ArcGIS Enterprise deployment model runs on the latest Azure editions of Windows and Linux. This model best fits San Marcos' desire for future growth. Automatic operating system updates are tailored to ensure that all GIS applications are consistently available and responsive.
Security: To enhance security for the end product, the team used Cloud-native security tools in Windows and Azure that continually monitor for potential threats following Microsoft's security recommendations.
The new infrastructure was built using Azure Bicep Templates and Azure Pipelines (DevOps). Esri PowerShell DSC was used for the automated installation and configuration of ArcGIS Enterprise. The team used Azure Monitor, Azure Recovery Services, and Azure Automation Update Manager for regular infrastructure maintenance, backups, and upkeep.
Having GIS in the cloud will reduce the reliability risk and costs of maintaining on-site infrastructure. By retiring two on-premises servers and instead leveraging the latest technology, the City will experience a faster and more stable environment, enabling City staff to do their jobs more efficiently.
The new deployment also ensures that there will be no recurring outages that waste valuable time and resources. The speed at which staff can access and edit GIS data is increased. The display speed of imagery has also significantly improved, making spatial data editing more straightforward and efficient. Staff can now take advantage of the performance, security, and integration capabilities provided by Cloud infrastructure.
The City of San Marcos and Quartic Solutions implementation team tackled technical and logistical challenges by working together. The result was an Azure-hosted complete deployment of ArcGIS Enterprise, replacing an on-premises ArcGIS Server and Enterprise Geodatabase. Also, the team implemented an editing and publishing workflow leveraging ArcGIS Pro.
The City of San Marcos and the Quartic team were pleased with the project outcome and look forward to continuing the collaboration in 2024. There is discussion regarding further improvements for the GIS program, for example, leveraging Esri's ArcGIS Monitor application for better performance monitoring and migrating data editing to hosted data store items.
"Apart from already leveraging one of their staff as “on-site” staff for the City of San Marcos, I am myself a former member of their staff and was familiar with their excellent team and leadership. I was 100% confident in their ability to deliver a fully functional, secure, and integrated Azure cloud migration product.“
- James Crandall, GIS Program Manager, City of San Marcos.
Visit: The City of San Marcos,
Check out our partner Esri, to learn more about the industry.
In early 2022, Long Beach Transit was looking for solutions to the challenges they were facing in maintaining the condition of bus stops and bus stop amenities.
Long Beach Transit (LBT) is a municipal transit company that provides bus transportation in Los Angeles and Orange County. The company has a fleet of 250 buses across fourteen cities that cover 100 square miles. LBT has a ridership of more than 23 million customers.
LBT uses Geographic Information System (GIS) technology to both generate interactive and static route network maps and analyze ridership patterns across its service area. The GIS supports the transit business by enabling staff to plan, maintain, and locate transit infrastructure. GIS analysts regularly fulfill map and data requests and keep the GIS databases and web maps current as the bus timetables and routes are updated.
Check out more here: LBT GIS Data Catalog.
The project team was a coalition of three companies, Long Beach Transit (LBT), Environmental Research Institute (Esri), and Quartic Solutions. LBT uses Esri’s ArcGIS platform for their GIS and thus turned to Esri for guidance in choosing an ArcGIS based solution. ArcGIS Field Maps, along with a customizable survey template, were selected. Quartic Solutions, a woman-owned Esri business partner and premier GIS services firm, was chosen to provide GIS staffing and expertise to LBT in March 2022.
The project started.
A prototype was successfully tested.
The first stage of systemwide fieldwork is projected to begin in the summer 2023.
Public transportation in Los Angeles is essential to many people’s everyday lives. Long Beach Transit ensures everyone feels safe and can enjoy the entire bus experience, from waiting for the bus to reaching their final destination.
LBT (Long Beach Transit) has over 2,000 bus stops in its service area. While their Transit Customer Amenities (TCA) Department is responsible for maintaining the cleanliness at each bus stop, they have faced some challenges. Issues like how to maintain an up-to-date database of site conditions, ensuring ADA accessibility, and making sure amenities are maintained and available at each bus stop. The condition information about the bus stops is critical and necessary for making sound decisions, such as which bus stops need improvements.
TCA had a legacy solution in place that provided access to the bus stop data but, was looking for additional tools to help make their jobs easier.
Back in 2012, LBT developed a bus stop survey that contained basic information about bus stops. After using the old system for over ten years, the staff knew exactly what they wanted to change. They needed a solution that would help minimize data entry errors during the field data collection and that would have a new option for capturing photos. Being able to attach photos would really help staff record details of the visual conditions at specific locations. They also wanted a more streamlined user-friendly application interface. By standardizing the wording of the amenity inventory, they felt they could reduce data entry errors, such as typos and non-accurate descriptions. The plan was to develop a database that was better suited for storing the complex infrastructure relationships (1 to many relationships). Then, design an application allowing supervisors to review and approve work. Adding better tracking of data associated with bus stop amenities was also important.
The three organizations worked well together to address and resolve the complications LBT was facing with their previous legacy software.
The project team architected a cloud-based solution using AWS infrastructure and the Esri ArcGIS platform. The solution included both a mobile field map data collection application and an on-premise web mapping application.
A solid foundation for the project was built by cleaning and loading existing data into a new database. The data were organized into 14 related tables covering a wide variety of information such as passenger amenity types, amenity condition, comments, and pictures. Then, crucial data regarding ADA compliance was incorporated. The traffic condition data was added to enrich the dataset, including the site conditions, such as the stop area location and pedestrian crosswalks.
The field data collection application was created using the survey template that is included with ArcGIS Field Maps. The Field Maps App is available for download via the Apple App Store and/or Google Play Store. Once downloaded, the Field Maps App was configured for LBT staff, and tools to minimize user input errors, archive data, and easy editing were included.
Offline data collection is built into the Field Maps App. Once a field user is reconnected to the network, the local data stored in the Field App is uploaded to ArcGIS Portal.
Then, after the sync, a supervisor can view the approval screen, where all the new and/or edited records are presented in an intuitive table format, ready to approve.
More advanced functionality is available with the Service Planning Bus Stop Web Application when staff is on-premise. The Bus Stop Web App is a web map containing current LBT stops, active routes, and historical ridership data combined with the new bus stop amenity data. The progress of staff working in the field is easily visualized by viewing the color of the bus stops. Staff can quickly review a stop’s amenity data in pop-up menus by clicking on the map.
Three times a year, LBT makes service changes to its service network. To facilitate these recurring service changes, the solution also includes functionality to automatically add new stops and inactivate old stops if a new service change is initiated.
Like in every complex project, there were some obstacles to overcome. In this case, the challenge arose when incorporating the old 2012 amenity data. The data was collected as one big database table with no relationship classes. Specific amenities had multiple values and duplicate entries. In order to load the old data to the new normalized tables, Quartic designed an ETL model that appended and split data as needed for the improved schema. Data cleanup tasks, such as standardizing to coded domain values, were automated, resulting in a tidy dataset with increased data integrity.
The picture 5. is a screenshot of an example of the coded value domains - the left column is the domain name to be assigned to certain fields, and the right is the options for that domain. This prevents users from making spelling/formatting errors.
With the data being collected and turned into an easy-to-read format, LBT can provide up-to-date bus stop amenity and ADA information to the public and transit customers. LBT staff can more easily identify which bus stops have accessibility improvements and the condition of those improvements. They can collaborate with related government agencies, such as municipal public works departments, to better prioritize crosswalk and sidewalk pedestrian improvements.
The restructured data and new application architecture were tested in June 2022 by LBT staff by collecting bus stop amenities and ADA information. The test used the Metro Route 130 service transition to LBT Route 141. The first stage of systemwide fieldwork will begin in the summer of 2023.
Based on the successful conclusion of the prototype project, LBT will consider planning a larger system-wide implementation and rollout, incorporating the updated bus stop data into LBT's GIS databases alongside GTFS (General Transit Feed System) network, land use, ridership, and demographic information.
This is an example of how GIS technology can support transit operations and ultimately make public transit safer and more enjoyable for everyone.
"Quartic has extensive experience with a highly qualified GIS technical service team.”- Long Beach Transit, Service Development Manager.
The City of San Marcos wanted to have a way to share mapping data easily and directly with citizens. They developed an easy to use website that is now open to the public. Check it out here: City of San Marcos ArcGIS HUB
The data site hosts a full range of GIS data, most of which is available for download. To make it easier to find specific datasets, the data were grouped into categories. Data such as parcels, roads, jurisdiction boundaries, addresses, parks, trees and more can be downloaded with just one click.
The website, called the San Marcos HUB, has showcased the City's interactive web maps and web applications. The engine behind the site is Esri's ArcGIS Portal HUB application. The site was developed by the City with the help of a San Diego based woman owned small business Quartic Solutions . Quartic specializes in delivering GIS solutions to local government and utility organizations.
The City of San Marcos, CA Emergency Management Operations has implemented their Incident Status Dashboard using Esri's State and Local Government Tools.
The Incident Status Dashboard is a comprehensive web-based dashboard that offers information that may be used to make decisions and enables staff to give a more effective incident briefing.
GIS can be used in many ways to improve the operations of cities and local governments. The City of El Cajon uses GIS as a tool to discover, maintain, and visualize its NFPA 704 Warning Placard data.
Whenever large amounts of hazardous materials are being stored and used at a business, warning placards are required. These placards act as an immediate warning system for emergency service personnel, helping them to identify the kinds of materials present and the dangers they pose.
The City of El Cajon uses Environmental Systems Research Institute's (ESRI) Enterprise ArcGIS products in daily operations. They have a small GIS team that expertly tackles all problems. The City's GIS team supports 911 response, Pavement & Sidewalk Management, Sewer and Storm Drain Maintenance, Traffic Data, Street Light, Signal, Signage, Capital Improvement Projects, Planning Data, Housing Information, Inspection data for Fire & Building Inspectors & PW Inspectors, Special Event Coordination, Park Assets, Street Furniture, and more. With all that data, they use GIS tools to help others with Data Sciences and Spatial analysis to clarify facts, visualize patterns, etc.
In August 2022, Quartic was brought in to streamline processes by automating repetitive tasks and modernizing the City’s enterprise GIS system. Quartic is available to provide GIS expertise when El Cajon needs GIS consulting services.
Heartland Fire & Rescue is a joint powers agreement (JPA) between El Cajon, La Mesa, and Lemon Grove, which creates a cohesive Fire Rescue/EMS service area. Quartic created a field solution that would provide fire inspectors a way to catalog NFPA 704 Placard information. The NFPA 704 regulations ensure public safety by clearly identifying businesses that house hazardous materials.
The ArcGIS Field Maps solution included a new feature service, a new web map, and a new mobile data entry form. The solution greatly simplified in-situ data collection for Heartland’s inspectors.
By taking advantage of the newer capabilities of Arcade in ArcGIS Field Maps, field inspectors are able to maintain placard data more accurately. Once the Quartic team published the new enterprise geodatabase feature class as an editable service and built a web map for field editing, new functionality was exposed to users.
Eliminating data entry errors in the field was a requirement of the project. The new Arcade Editor enables more complex and creative expressions and is designed to enhance data quality by using controls such as field auto-calculations and required fields.
The team at the City maintains a central database of valid addresses and wanted this same address dataset to be used when assigning a business address to a new placard location. In cases where a placard is located where there is not already a valid address, inspectors can manually add an address on the fly. This was implemented by writing an auto-calculate Arcade expression. Using the spatial function” closest”, the application finds the nearest existing address and populates the address field. If inspectors know the address calculated is incorrect, they are able to flag the record and type the correct address into another field. This flag is useful for both controlling the initial address entry and tracking potential address corrections needed in the primary address database.
The new mobile data entry application meets or exceeds the scope outlined by the client, and the new map viewer is a great visual tool with point symbology that matches the 704 placard standards to a tee.
Heartland Fire & Rescue inspectors are now equipped with the latest Esri field collection technology and can quickly and accurately survey businesses for compliance with hazardous chemical placard posting regulations.
Because the project was built using an enterprise geodatabase-based feature service, the companion viewer web application refreshes the map in real time. In addition, Heartland and El Cajon GIS staff are able to further QC the address data and amend the primary source address database when inspectors flag missing addresses. This is a great example of a project which benefits the City long-term by improving not only the hazard placard maintenance process but also improving the process for maintaining the City’s core address data.
"My favorite part of this project has been working with the Quartic team, who are always upbeat, professional, innovative, positive, and smart. The outcome of this project was just what we wanted, and it benefitted us on many levels."- The GIS analyst at the City of El Cajon.
Read more about the collaboration of Quartic and the City of El Cajon:
Providing highly-technical solutions to complex problems is something Quartic excels at. However, fast-response and general staff augmentation can be just as necessary, which was an immediate need for the City of El Cajon .
El Cajon’s small GIS team expertly tackles all problems thrown their way. Quartic was brought in to assist their efforts, reduce their individual workloads through automation, provide new capabilities, and upgrade/maintain their overall enterprise GIS system. Quartic provides Senior GIS Programmer/Analyst expertise available to support El Cajon’s GIS needs as they occur.
Several of the City’s ArcGIS products, on both the backend and frontend were upgraded. The City was supporting daily operations by using Environmental Systems Research Institute’s (ESRI) Enterprise ArcGIS System 10.7.1. Their work used to be done primarily in ArcGIS Desktop ArcMap and ArcCatalog, but now since ArcGIS Pro is available, those older user interfaces are slated for retirement in early 2026. Services published to ArcGIS Server were based on ArcMap runtime, which has been retired as of ArcGIS Server 11. The database was re-worked and is now in alignment with best practices better supporting versioned editing and logical groupings of data. Actively edited data that was in stand-alone file geodatabases are now stored in the centralized enterprise geodatabase.
ArcGIS Server was upgraded to 10.9.1 to access newer capabilities allowing the City time to re-publish all services with ArcGIS Pro runtime and prepare for the 11. x version migration.
A new SQL Server enterprise geodatabase was built and all existing data migrated into it from the old database. This database structure implements smarter versioning and avoids using feature datasets as storage folders. Almost all actively edited data now resides in the enterprise geodatabase, consolidating it into a single production editing environment.
ArcGIS Pro is now the go-to, and new attribute rules both maintain data quality and encourage program use.
With Quartic’s professional GIS support and Esri’s current software, the City has successfully resolved many legacy issues. The GIS team now has access to current software capabilities, has better organized and maintained data, and has renewed confidence that the GIS system is in good shape and more able to support City operations going forward.
The City of El Cajon has been working with Quartic to streamline, automate and upgrade many routine GIS data maintenance tasks. For the City’s GIS staff, the manual GIS maintenance was consuming too much of their valuable time. Since the work has been completed, the team has been able to be more efficient and put their energy towards other priority projects.
Municipalities often share GIS data with neighboring jurisdictions and regional government agencies. El Cajon is no exception. The City of El Cajon shares data with both regional GIS agencies: SanGIS and SanDAG . Keeping data current between government organizations can sometimes be a challenge. Quartic helped the City to improve these data sharing processes. The previously manually downloaded data from the SanGIS/SANDAG Regional Data Warehouse has been automated. Python scripts have replaced labor intensive processes for download, extract, and data enrichment. These scripts also perform data administrative tasks such as cleaning up disk space.
With all of these changes/upgrades, there are no longer questions about where the data is located. The team knows that all the SanGIS data is up to date at the beginning of each month and can rely on its currency and authoritativeness. The new database is more performant than it was before. The team learned that migrating from ArcMap to ArcGIS Pro has a bit of a learning curve, but that was quickly shaken off with the proper guidance.
With the initial upgrades complete, Quartic is now assisting El Cajon with several other projects that have been on the back burner. The variety of the GIS work is great and exactly what Quartic is established for; providing quality professional services for all kinds of GIS-related tasks. For example, the team has published the City’s historical imagery, created new enterprise feature classes with enforced data quality checks, published new services, and built web apps and experiences for both internal and public-facing audiences. Together the team developed a City asset dashboard, a FieldMaps application for fire inspectors, and a Survey123 application for bicycle registration, and helped update the City’s organizational theme for its ArcGIS Hub and web applications.
"The Quartic Solutions Team has really helped my GIS vision come to life here at the City of El Cajon. Quartic can take a project and run with it, they listen to what you really want, and then they create that dream that you have always wanted to do for your City.”-The GIS analyst at the City of El Cajon
Geographic Information System (GIS) technology can be used in various industries to enhance efficient data usage and, through that, better decision-making. Long Beach Transit (LBT) has realized the importance of good-quality data and the benefits of GIS. LBT is a municipal transit company that provides bus transportation in Los Angeles and Orange County. LBT has a fleet of 250 buses across fourteen cities. LBT has a ridership of 23 million customers.
LBT uses GIS technology to generate both interactive and static route network maps and analyze ridership patterns across its service area. The GIS supports the transit business by enabling staff to plan, maintain, and locate transit infrastructure. GIS analysts regularly fulfill map and data requests and keep the GIS databases and web maps current as the bus timetables and routes are updated.
In early 2022 LBT turned to Esri (Environmental Systems Research Institute) for guidance and support for their GIS operations. As an Esri Advantage program member, LBT uses Esri’s ArcGIS platform for their GIS. As a forward from Esri, Quartic Solutions, a woman-owned Esri business partner and premier GIS services firm was chosen to provide GIS staffing and expertise to LBT in March 2022.
LBT goes through 3 service changes a year. The service changes involve a change of bus routes, stops, and schedules. Preparation for the service changes takes months and the collaboration of multiple departments. Quartic support these transitions by adding new bus stops to their geospatial bus stop bank, editing or adding route lines for static and interactive maps, updating the systemwide web map, and maintaining their GIS Data Catalog that is available to the public.
When the service planners at LBT consider limiting or expanding the hours of transit in an area, Quartic has assisted by visualizing the spatial component of ridership data for the area. This allows LBT to have an easy-to-read document that supports their decision-making. Ridership data is collected in various ways across the transit network. One example is TAP (Transit Access Pass), which is a contactless smart card used for automatic fare collection. The TAP data that is recorded includes the longitude and latitude of the bus stop where the card was used. This data is used to visualize the amount of boardings and/or alightings (departures) in the Long Beach area. The maps are helpful when service changes are proposed or when micro transit (small-scale on-demand transit) opportunities are being considered. Quartic has also implemented a monthly dashboard that provides average daily boardings at bus stops with the option to filter by route, time period, amount of boardings, weekday, and stop number.
Quartic has been a part of various projects at LBT. One major project was a collaboration with Quartic and ESRI to develop a prototype of field surveying that would streamline the collection of bus stop amenities, such as seating, shelters, lighting, and ADA accessibility. The three organizations used Field Maps and Enterprise to create a customized survey template in Field Maps that standardizes the amenity data collection, allows for picture attachments, and syncs to the LBT Portal, where a supervisor can approve the records. After a successful test of a prototype, LBT is planning on conducting the field surveying soon.
Another request was an improvement to the current Comfort Zones Application. Comfort zones are rest stops for bus drivers and can change when routes or bus stops are added or removed. The original map application consisted of individual maps for each route and did not allow for any feedback from the drivers or filtering.
Quartic combined Survey123 with ArcGIS Dashboards to create a dashboard with one map that the driver can filter by their duty number, weekday, and/or route. When a driver clicks on a comfort zone, they see a picture of the rest stop, the building address, and a link to Google Streetview. A right-side panel on the dashboard opens a Survey123 form where the driver can add or view comments concerning the comfort zone.
Making Los Angeles a better place to live for everyone is not easy, but the Los Angeles Homeless Services Agency (LAHSA) is up to the task. Every year they organize a homeless count that gives us a better understanding of the current situation and allows the city and county to plan accordingly.
Once again, LAHSA successfully organized a team of volunteers to hit the streets and count the homeless in the Los Angeles region.
The annual survey was held over the weekend from January 24-26 and utilized the latest location-based software from the industry leader, Environmental Systems Research Institute (Esri).
Quartic Solutions, a local women-owned business, assisted with the geographic information system (GIS) technology.
This year the count went smoothly, with over 6,600 citizens and staff enthusiastically signing up to volunteer using an online sign-up system. LAHSA had mapped out a network of dispatch locations, ensuring that volunteers knew where to start their shifts and that all areas of the region were covered correctly.
Homelessness in California is a huge problem, particularly in large urban areas such as Los Angeles County. To better understand and address the challenge of homelessness, quantifying the number and extent of homeless people is critical. Once a year, LAHSA conducts the annual Point in Time (PIT) Homeless Count to provide needed data for allocating resources. The state and city programs use the information the count offers to implement more effective and targeted relief programs.
Finding and counting the homeless in a large urban area such as Los Angeles has its challenges. Taking advantage of lessons learned from last year, LAHSA set out to create an application for the volunteers that was easy to use and dependable. This year the data collection utilized the latest location-based technology collecting not only a count of homeless individuals but also which census tracts they were discovered in. Using a lightweight mobile application made data collection easy for volunteers, and organized for LAHSA.
"The goal of the count is to get an accurate picture of the homelessness in our communities. With this information, strategies can be developed to reduce and end homelessness."- LAHSA
As part of Quartic’s commitment to combat societal ills and promote equity, Quartic Solutions took part in the count in two different ways.
Quartic was on the Esri team to develop a mobile application for the count.
The application developed by the team was based on Esri ArcGIS® QuickCapture. This simple application is the fastest way to capture field observations. It allows the user to count a homeless person or shelter just by pressing a button on their phone. The data captured included the location of the observation, the type of observation, and the ability of the user to view their results in an easy-to-understand dashboard format.
Several quality control features were also built into the application to make data collection trouble-free and more accurate. Having a visual of the boundaries of the area in which they were assigned kept volunteers constantly aware of the boundaries and reduced double counting. Finally, the application displayed a map to the collection teams, clearly showing a GPS track of where they had driven or walked. This valuable feature allowed the user to easily see if they had missed any road segments so they could go back and traverse any gaps.
Quartic also had two people, the company President, and Quartic's Director of Marketing, volunteering as counters on the night of January 25.
All volunteers' common goal is to commit to the community and make a difference. The ultimate goal is to make Los Angeles a better place to live for everyone.
Overall, the count was successful, and the QuickCapture mobile app collected the data seamlessly. The count was well-planned, and LAHSA is happy with the result.
According to LAHSA, in 2022, the number of homeless in the Homeless Count by the LA County Supervisorial District was 65,111. That increased from 2020 with the number of 1405 individuals. This year's results from the count are not published yet. According to LAHSA's just-released article, they will turn over the data collected to its data partners at the University of Southern California (USC). USC will perform the statistical analysis, and LAHSA expects to release it in late spring or early summer 2023.
The San Diego Geographic Information Source ( SanGIS ), a Joint Powers Authority (JPA), was able to improve processes used for maintaining the regional geographic information system (GIS) by implementing Esri’s current Parcel Fabric and ArcGIS Pro editing tools.
GIS Land Records in the San Diego Region are maintained by SanGIS joint powers agency. The SanGIS mission is to maintain and promote the use of a regional geographic data warehouse for the San Diego region and to assist in the development of shared geographic data and automated systems that use that data.
SanGIS allows the City and the County to combine resources to meet common objectives to reduce duplication of efforts, maximize resources, provide for an efficient method of sharing information and provide timely updated data to the public.
The combined County and City of San Diego geospatial land base is massive. The dataset consists of over 17 data layers, including lots, parcels, roads, addresses, and open space easements. GIS Database maintenance, including additions, deletions, and updates, are made by 4 - 5 full-time editors. Having a team of trained editors enables the region to have the most updated land base possible.
SanGIS was formed in 1997 and is responsible for the maintenance of
SanGIS decided it was time to update the GIS maintenance environment to a new solution that would enable more effective workflows and streamlined editing. Quartic Solutions, a woman-owned Esri business partner and premier GIS services firm, was chosen and tasked with migrating 20 years of legacy code, tools, and data integrity checks to a brand-new environment. Quartic and SanGIS have worked together for many years on various GIS projects in the San Diego region.
SanGIS was using a GIS editing environment that was developed back in early 2000. While the legacy system was stable, it was lacking current ArcGIS Pro functionality and there was a desire to improve consistency and communication. The old editing system consisted of stand-alone feature classes with their own individual topology rules. Data integrity was maintained by a mixture of ArcObjects Class extensions and custom ArcObjects ArcMap tools. All editing was done in ArcMap directly against a local Oracle geodatabase.
There are many departments within the stakeholders’ organizations, such as Sheriffs, Fire, and Assessors, who all need to be able to update parts of the SanGIS geodatabase. Because many of the Departments have separate networks, in the past shared editing was accomplished via two-way replication of feature classes to an ArcGIS Enterprise deployment in the cloud. The external organizations could then edit via their own check-out, check-in replica workflows. While effective, this model led to a lag between updates being shared as well as communication problems.
The impending retirement of ArcMap and the ArcObjects SDK, along with the release of ESRIs focused Land records solution Parcel Fabric provided the opportunity for SanGIS to migrate to a modern editing environment: ArcGIS Pro in combination with ArcGIS Enterprise service-based architecture.
The Parcel Fabric, along with the required web feature service, allowed for the smooth migration of this legacy code and workflows to a more modern service-based architecture.
The Esri Parcel Fabric is designed specifically to handle many of the data quality control issues that previously had been implemented through custom programs such as ArcObjects tools and class extensions. Issues such as maintaining Tax Parcel history and external organization updates are a core part of the Parcel Fabric product, which simplified the upgrade tasks.
Quartic was tasked with migrating the legacy code, tools, and data integrity checks to this brand-new environment. Most of the dozens of old custom tools had out-of-the-box replacements. A good example of this was the incrementor tool. SanGIS had created a tool to sequentially update the assessor parcel number on new polygons, but this was an out-of-the-box tool in Pro.
Old approach vs. New approach.
Once prototyping and testing were complete the data migration models that Quartic developed allowed for the final migration to occur over a single weekend with no downtime.
A total of 17 feature classes and 5 standalone tables had to be migrated to the new environment. Most of these were related to the Parcel Fabric. The migration process used a combination of geoprocessing models and Python scripts to automate the migration.
During testing, users practiced editing using the new interfaces making sure they could take advantage of the new functionality while still achieving predictable and accurate results. There were Approx. 5 months of testing and data model refinement.
In an effort to reduce custom programming, the decision was made to not migrate any of the legacy custom tools. All workflows would be designed using out of the box ArcGIS Pro tools. Editors would then identify if there were functions remaining that really needed to be added via customization for the purposes of timesaving and data integrity. There are a few custom tools that editors identified that will be deployed in future phases of the project. To date, 4 required development, with a further of at least 1 one approved for the future.
Quartic delivered a new modern editing environment that utilizes the latest Esri software and architectural practices to SanGIS. The JPA seamlessly migrated from a 20-year-old environment to the next iteration of Esri’s GIS software without hiccups. The project ensures that SanGIS will continue to meet its goal of providing a current land records system for the entire San Diego Region.
SanGIS editors are quickly coming up to speed in using ArcGIS Pro and are impressed with the new tools and features available to them. They are also regularly discovering new Pro tools and features that allow them to edit more efficiently and accurately than in the past.
The web-based services have also been streamlined and have simplified the collaborative editing environment. The County Assessor can easily create their own Tax Parcel updates directly in the fabric. This has led to a substantial reduction in the duplication of work.
"Since SanGIS went live with the new ArcGIS Pro editing environment, there have been no platform or system issues, and Parcel Fabric has been running smoothly.”Program Manager at SanGIS
For more information about SanGIS: firstname.lastname@example.org
The City of San Diego has recently expanded its green waste recycling program to include weekly organic waste recycling collection for all households currently eligible for collection services. This is good news as it will enable the City of San Diego to get closer to its goal of reducing the waste that is being put into landfills. The City’s goal is to reduce waste going into its landfills almost entirely by the year 2040.
The Environmental Services Department (ESD) wanted to take advantage of smart technologies to make the task of managing the new green bins and greenery collection efficient. The technology employed includes three automated business systems: 1) work management, 2) Geographic Information System (GIS), and 3) fleet management.
The new weekly organic waste recycling collection includes curbside pickup of food scraps, food-soiled paper and yard waste. Some residents have already started receiving their new green bins and all neighborhoods should have curbside greenery pickup over the next several months.
Cities can substantially increase the life of their landfills by recycling green waste. The City has estimated that over three cubic yards of landfill are saved for every ton of greens recycled. With numbers like this it is obvious why in 2022 the City of San Diego began a significant expansion of its green waste management program.
The Environmental Services Department (ESD) in San Diego ensures that residents have a clean and safe environment by pursuing waste management strategies that emphasize waste reduction and recycling, composting, and environmentally sound landfill management.
Learn more about environmental services, recycling, and waste management here: https://www.sandiego.gov/environmental-services/geninfo .
The Environmental Services Department already had a Geographical Information System (GIS) in place to manage waste collection routes for refuse, recycling, and green waste and wanted to leverage that investment for the expanded organics pickup program. The GIS software ESD uses for collection is based on Esri’s ArcGIS Platform . The Department also had work management software, Salesforce, for managing the weekly schedules for bin pickup. The third, and new system added to the mix was chosen to provide fleet management capabilities. ESD chose Routeware as the additional software which is installed on in-cab units, gathers data from smart sensors, and cameras mounted on the waste collection trucks.
To reduce staff manual labor and increase efficiency, the City of San Diego needed an integrated interface that would pull together data from these three specialized systems. To assist with the integration, Quartic Solutions , a San Diego-based woman-owned GIS services company, was brought in. Quartic’s job was to implement an automated process for keeping data current between these systems. As Salesforce, ArcGIS, and Routeware are all modern technologies, they all utilize web service technology for communication. Quartic was responsible for creating the web service components (ArcGIS feature and map services) that bring Salesforce and Routeware data together.
By using web services, the team was able to design and construct a smart system architecture that would meet all the requirements of the drivers, supervisors and office staff. The team redesigned the previous Extract Transform Load (ETL) job to handle the complex table structures needed to keep the location site data, the bin container data, the route data, and fleet data organized and in-sync. They also created a REST endpoint for Routeware so the truck drivers can update the routing Information themselves.
The batch data synchronization process begins with Salesforce updating records in multiple GIS tables via an ArcGIS feature service. GIS synthesizes information and performs geoprocessing at the container level, the smallest unit among multiple tables, and brings in additional information from a variety of reference layers. The intermediate product includes the truck routing information which is sent to Routeware also via a feature service. Once Routeware reads data from GIS, routes are displayed in RCC for the drivers to view and update. After drivers pick up all the bins and make route attribute changes, the updated route information gets back to the GIS database via the same feature service. GIS performs another batch of geoprocessing to update individual polygons that represent routes per each bin type and then converts the container-level data back to the site-level data and sends the updates to Salesforce. Salesforce pulls the GIS delta via a feature service, and the department accesses the dataset via either the map service or Enterprise database connections.
Integrating complex systems can be tricky. The new system had to manage much larger datasets than in the past. To keep data in sync between the three systems, ETL jobs are scheduled to run at night when system usage is lowest. The Salesforce, GIS, and Routeware batch jobs are also scheduled to run in a sequential order at specific times, nightly. If any one of the batch jobs takes too long to complete it will likely have an impact on the subsequent job run. In order to improve performance, the team employed a solution called multiprocessing. This technique allows the GIS software to process large amounts of data within limited server resources. By using the GIS multiprocessing technique, the ETL job run time was able to be significantly reduced.
Then, to improve performance even more, the GIS was configured to take advantage of database structures, called database views. These database views speed up the processing by having the modified (aka delta) records in Salesforce and Routeware indexed and in-memory, greatly shortening the data pulling time.
The Esri ArcGIS technology used in the project was ArcGIS Pro, ArcGIS Enterprise and ArcGIS online / Portal.
The new system allows ESD access to the functionality they need to effectively manage the organic waste recycling program. Now, drivers can take advantage of in-cab tablets loaded with a wealth of quality spatial data. In-office staff can also be more productive by taking advantage of an integrated system of Salesforce, GIS, and Routeware. The benefits are anticipated to increase the productivity of staff and increase reliability and response times to the public.
The project was planned and scheduled to roll out in three phases. The first two phases are now complete, and the final one is estimated to begin by the end of the year.
Visit: The City of San Diego Environmental Services , Routeware, and please check out our partner Esri, and Quartic Solutions , to learn more about Spatial Technologies and how you can utilize them at your organization.
Have you ever wanted to identify the perfect location for an event, say for a wedding, a meeting, or a workshop?
Quartic worked with a client that identifies ideal event locations based on a customer's specific event needs and then coordinates with local jurisdictions to obtain any of the required permits for the chosen location.
Quartic was able to configure the tools to quickly answer questions from the client’s customers such as “Where can I have a gathering for 50 people on a Thursday afternoon in a suburban neighborhood within 200 feet of a park?”
Utilizing GIS, Quartic was able to configure the tools to quickly answer questions from the client’s customers such as “Where can I have a gathering for 50 people on a Thursday afternoon in a suburban neighborhood within 200 feet of a park?” Relying on outdated and slow technology, and a manual process to find ideal locations was replaced by a GIS based web application that identifies ideal event locations based on complex search criteria.
There were 3 primary goals that Quartic needed to address when configuring a GIS Enterprise environment:
The client was already using the Cloud, so Quartic architected a GeoSpatial Cloud solution using the ArcGIS Enterprise Platform. Google Cloud was used for the underlying infrastructure. ArcGIS Server and Portal were installed, along with a PostgreSQL geodatabase to enable the client to both edit their own GIS data, and publish it to the web. Utilizing Esri’s out of the box Web AppBuilder for Portal, Quartic designed a web application that could search through many GIS layers to identify event locations based on the specific needs. In addition, the client also needed to be able to filter all of the data in the map by date and time as well as location. To address the date/time component of the filtering, Quartic designed a custom widget to be used in the application that could filter multiple layers in the map by date range and time range. To satisfy the need for data editing, a second application using Web AppBuilder was configured that takes advantage of Esri’s existing editing widgets. By utilizing a combination of COTS solutions and minor enhancements with code, all public and internal requirements were successfully met.
Separate CentOS virtual servers used for the installation of ArcGIS Server and Portal. Another CentOS server was used to host a PostgreSQL geodatabase. Once the software was installed and configured ArcGIS Server was federated with Portal. Portal was then configured to use the client's SAML identity provider for a single sign on experience. Since the identity provider is hosted in an Azure cloud it allowed safe, secure sign in not just for on premise users but remote workers as well. A Google file share was added to the VPC to allow for regular backups. Native PostgreSQL tools were used to schedule regular database backups. The ArcGIS Enterprise webgisdr utility was configured to create regular backups of Portal and ArcGIS Server.
Web AppBuilder was chosen for the creation of the application because of the ease of use of setting up and maintaining the application. Using Web AppBuilder meant that the application was hosted in Portal and could easily utilize both public GIS services and any client data that was hosted in Portal. The screening widget was the main component of the application widget. This widget allowed the user to search by either entering an address, or drawing a point, line or polygon on the map. They could then add a buffer to search results within that radius. The screening widget would then search all layers turned on in the map to find locations within the search area. The output could then be printed as a PDF map, or exported to a CSV file. This enabled the client to keep a record of the results at the time which they performed the search.
The custom widget was customized by using the "Filter" widget as a template. The Filter widget already had a method to allow user input for a date range, so the modifications could be made to the internal query to allow a date search. These modifications included customized field names, data format considerations, and Boolean logic changes (from AND to OR as needed). Additionally, the modified query could then be looped through a list of layers to accomplish the multi-layer requirement. The custom list of layers and their associated field names were contained in the configuration JSON, just as the normal widget configurations are kept.
The time portion of the filter was more complex. Time values needed to be entered by a user as a string in format "HH:MM". This was needed to separate the date values for time values so that users could see when features overlap only a time range (such as during a sunset). Applying this filter to a date/time field required significant parsing of the original query to allow the custom variables to be fitted. Adding to the complexity was that this data for time did not exist yet, so the initial prototype was using an assumed time structure. Once this was added to the source data, adjustments had to be made. A requirement for a "time buffer" component to allow users to assume late projects also became complicated when approaching midnight (either as a pre-buffer or post-buffer of the range). Complicated conditional logic was written to account for day-crossing buffers.
In addition to an application to search for event locations, the customer requested an application for their Community Outreach team to be able to edit their own data through the web. These users would not have any GIS experience and needed an easy and intuitive way to edit the data. Using database roles and groups in Portal, Quartic was able to publish the two community outreach layers to Portal while only allowing those Community Outreach staff the ability to edit the data. Once published as a service, those layers were used in the Smart Editor widget in Web Appbuilder, where they could easily be edited with minimal training by the Community Outreach staff.
There was some initial apprehension amongst the staff who would be the ones using the application. Although trained IT staff would maintain the GIS architecture, the users of the application and those maintaining the data were not technical staff and were hesitant to have to learn unfamiliar and new technology. After completing the initial application, Quartic provided a demonstration and training session, as well as written documentation to all of the staff who would be using it. When the training was completed and the staff could see how robust and easy to use the application was especially compared to their old environment, there was overwhelming excitement for a new application that would make their job easier.