Next Article in Journal
Anti-Obesity Effects of Polyphenol Intake: Current Status and Future Possibilities
Next Article in Special Issue
Emerging Roles of USP18: From Biology to Pathophysiology
Previous Article in Journal
The Role of Semaphorins in Metabolic Disorders
Previous Article in Special Issue
Deubiquitination Reactions on the Proteasome for Proteasome Versatility
 
 
Search for Articles:
Title / Keyword
Author / Affiliation / Email
Journal
Article Type
 
 
Advanced Search
 
Section
Special Issue
Volume
Issue
Number
Page
 
Journals
IJMS
Volume 21
Issue 16
10.3390/ijms21165638
ijms-logo
Submit to this Journal Review for this Journal Propose a Special Issue
► Article Menu

Article Menu

share Share announcement Help format_quote Cite question_answer Discuss in SciProfiles
first_page
settings
Order Article Reprints
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Review

Assay Systems for Profiling Deubiquitinating Activity

by
Jinhong Cho
1,†,
Jinyoung Park
2,†,
Eunice EunKyeong Kim
1 and
Eun Joo Song
3,*
1
Biomedical Research Institute, Korea Institute of Science and Technology, Seoul 02792, Korea
2
Molecular Recognition Research Center, Korea Institute of Science and Technology, Seoul 02792, Korea
3
Graduate School of Pharmaceutical Sciences and College of Pharmacy, Ewha Womans University, Seoul 03760, Korea
*
Author to whom correspondence should be addressed.
†
These authors contributed equally to this work.
Int. J. Mol. Sci. 2020, 21(16), 5638; https://doi.org/10.3390/ijms21165638
Submission received: 1 July 2020 / Revised: 4 August 2020 / Accepted: 4 August 2020 / Published: 6 August 2020
(This article belongs to the Special Issue Proteolytic Control of Deubiquitinating Enzymes in Health and Disease)
Browse Figures
Versions Notes

Abstract

:
Deubiquitinating enzymes regulate various cellular processes, particularly protein degradation, localization, and protein–protein interactions. The dysregulation of deubiquitinating enzyme (DUB) activity has been linked to several diseases; however, the function of many DUBs has not been identified. Therefore, the development of methods to assess DUB activity is important to identify novel DUBs, characterize DUB selectivity, and profile dynamic DUB substrates. Here, we review various methods of evaluating DUB activity using cell lysates or purified DUBs, as well as the types of probes used in these methods. In addition, we introduce some techniques that can deliver DUB probes into the cells and cell-permeable activity-based probes to directly visualize and quantify DUB activity in live cells. This review could contribute to the development of DUB inhibitors by providing important information on the characteristics and applications of various probes used to evaluate and detect DUB activity in vitro and in vivo.

1. Introduction

Post-translational modifications (PTMs) contribute to the dynamic regulation of cellular processes by changing the structure and properties of proteins through the covalent modification of proteins. Ubiquitination is a versatile PTM and it is involved in various cellular processes such as protein degradation, protein–protein interaction, and cellular localization. Ubiquitination is carried out by the cascade of three enzymes, i.e., E1 (ubiquitin-activating enzyme), which mediates the activation step, E2 (ubiquitin-conjugating enzyme), which mediates the conjugation step, and E3 (ubiquitin ligase), which mediates the ligation step. These three enzymes catalyze the isopeptide bond between the Lys (K) residue on a substrate protein and the Gly residue on the C-terminus of ubiquitin, resulting in ubiquitination of a substrate [1,2]. Mono-ubiquitination affects proteins in different ways, e.g., it may regulate processes such as endocytic trafficking, inflammation, translation, and DNA repair. However, once attached to a substrate, ubiquitin can be subjected to further modifications. Ubiquitin can be ubiquitinated on seven lysine residues (K6, K11, K27, K29, K33, K48, and K63) or on the N-terminus leading to polyubiquitin chains that can encompass complex topologies. Differently linked chains have specific effects on the protein to which they are attached depending on differences in the conformations of the protein chains, which translate into different functions [3,4]. The most well-known role of ubiquitination is proteasomal degradation [4]. The K48-linked ubiquitin chain mainly serves as a protein degradation signal for the 26S proteasome, whereas other linkage-specific ubiquitin chains such as the K63-linked ubiquitin chain participate in various intracellular signal transduction pathways such as DNA damage and immune response rather than degradation. The formation of uniform ubiquitin linkages or mixed ubiquitin linkages has been reported and contributes to biological complexity [2].
Ubiquitination can be reversed via the cleavage of ubiquitin from the substrate mediated by a group of enzymes known as deubiquitinating enzymes (DUBs). Approximately 100 DUBs have been identified in the human genome and are grouped in seven different families: ubiquitin C-terminal hydrolases (UCHs), ubiquitin-specific proteases (USPs), ovarian tumor proteases (OTUs), Machado–Joseph domain proteases (MJDs), JAB1/MPN/Mov34 metalloenzymes (JAMMs, also known as JAMM/MPN+), and zinc finger with UFM1-specific peptidases (ZUFSPs), and MIU-containing novel DUB family (MINDY). Members of the JAMM/MPN + family are zinc metalloproteases, but the others are cysteine proteases also known as thiol proteases [1]. The deubiquitination process also regulates several intracellular pathways, and it is often associated with various human diseases. For example, USP2 overexpression is related to prostate cancer [5,6] and breast cancer [7]. USP7 plays multi-dimensional roles in various cancers, including prostate cancer, lung cancer, brain cancer, colon cancer, breast cancer, epithelial ovarian carcinoma, liver cancer, and leukemia [8,9,10]. Cezanne 1 is amplified in breast cancer [11]. OTUB1 promotes prostate cancer [12]. Several studies have revealed that DUBs are associated with neurodegenerative diseases. I93M and S18Y polymorphisms of UCH-L1 are associated with Parkinson’s disease (PD) [13,14]. In addition, USP9X levels are significantly lower in PD and diffuse Lewy body disease (DLBD) [15]. The dysregulation of USP14 leads to ataxia [16]. USP30 and USP35 can delay PARK2-mediated mitophagy, which leads to mitochondrial dysfunction and affects development of PD and Alzheimer’s disease [17]. Furthermore, DUBs play key roles in infectious diseases; CYLD can be targeted as an inhibitor in control of certain pathogenic inflammations [18]. USP18 overexpression restricts porcine reproductive and respiratory syndrome (PRRSV) growth [19]. The inhibition of USP14 is found to impair the replication of Dengue virus (DENV) which causes fatal Dengue hemorrhagic fever [20]. Therefore, DUBs may be considered as novel targets, and inhibitors targeting DUBs are currently being investigated by research institutes and pharmaceutical companies with some inhibitors undergoing preclinical stages. For example, ADC-01, ADC-03, HBX41108, HBX19818, P5091, and P22077, which target USP7, are under preclinical investigation as candidates for anti-cancer drugs [21]. Proteasome-associated DUBs such as PSMD14, USP14, and UCHL-5 have attracted attention as anti-cancer drug targets and several compounds, e.g., b-AP15, targeting these DUBs are in the preclinical stages of development [22,23]. The USP11 inhibitor mitoxantrone and the USP20 inhibitor GSK2643943A are in preclinical stages for development as anti-cancer drugs [22,23]. Furthermore, the USP2 inhibitor ML364 and a dual inhibitor of USP10 and USP13 (spautin 1) are in preclinical stages for development as anti-inflammatory drugs. The USP14 inhibitor IU1 and the USP30 inhibitor 15-oxospiramilactone are in preclinical stages for development as neurodegeneration-targeted drugs [21]. Considering the importance of DUBs, deubiquitination assays are vital for characterizing the ubiquitination mechanism.
To elucidate the biological roles of DUB or to evaluate the effect of DUB inhibitors, assay systems that can provide a precise assessment of the degree of ubiquitination are essential. Particularly, high-throughput screening (HTS) -based deubiquitination assay is required for more efficient screening of compounds targeting DUBs, and the global demand for new probes and methods applicable to HTS is growing as the importance of DUBs as a drug target increases. Here, we review the currently available deubiquitination assay systems.

2. In vitro Deubiquitination Assays

Deubiquitination assay typically measures the degree of ubiquitination, thus, requiring ubiquitinated substrate and DUBs. For the assays, purified recombinant DUBs are usually used; however, immunoprecipitated DUBs from cell lysates could also be used. In a typical process of determining the activity of DUBs or DUB inhibitors, deubiquitination assays with purified recombinant DUBs are performed first, followed by deubiquitination assays with immunoprecipitated DUBs or deubiquitination assays with mammalian cells to assess and confirm intracellular activity. The use of immunoprecipitated DUBs for deubiquitination assays including ubiquitin chain cleavage assays allows the analysis of DUBs as an intracellular moiety. Recombinant proteins extracted from Escherichia coli are limited due to lack of PTMs such as phosphorylation [24]. However, the PTM of DUBs is very important for their activity; thus, deubiquitination assays with immunoprecipitated DUB could be performed to confirm reactivity [25,26]. In comparison with cell-based methods, in vitro deubiquitination assays produce objective and quantifiable results. Here, we describe in vitro deubiquitination assays and summarize them in Figure 1.

2.1. Ubiquitin Chain Cleavage Assay

Ubiquitin chain cleavage assay can allow for the visualization of DUB activity based on the mono-ubiquitin band by SDS-PAGE including Coomassie blue staining, silver staining, or western blotting using ubiquitin antibodies. DUBs can disassemble the ubiquitin chain, forming mono-ubiquitin. Therefore, DUB activity can be measured by examining the mono-ubiquitin band on the gel. As the deubiquitinating reaction progresses, more mono-ubiquitin bands appear. To quantify the results, the band intensity of mono-ubiquitin should be analyzed by a program such as ImageJ. Ubiquitin chains in this assay are purified recombinant protein substrates and are reacted with either purified recombinant DUBs or immunoprecipitated DUBs. Ubiquitin chains can be used for various experimental purposes. These chains have different lengths depending on the types of ubiquitin, e.g., di-Ub, tetra-Ub, and hexa-Ub. Furthermore, ubiquitin chains can be classified according to the type of ubiquitin linkage. The different types of ubiquitin chains allow the analysis of ubiquitin-linkage specificity, e.g., K11, K48, or K63 linkage chains. The linkage specificity of DUBs can be determined by performing ubiquitin chain cleavage assay using different types of linkage chains. For example, MINDY-1 is a specific DUB for K48-linked ubiquitin chains [27]. USP35 mainly disassembles K11- and K63-linked ubiquitin chains and weakly disassembles K48-linked chains, indicating that USP35 has partial specificity or preference for K11- and K63-linked chains [28]. Moreover, some candidate compounds of TRABID inhibitor have demonstrated their ability in inhibiting the cleavage of hexa-K63 ubiquitin by TRABID [29].

2.2. Ubiquitin Probes

As mentioned above, ubiquitin substrate and DUB are needed for deubiquitination assays. In addition to ubiquitin chains, ubiquitin probes are used as ubiquitinated substrates for deubiquitination assays. Ubiquitin probes can measure and quantify the activity of DUB through various detection methods, such as fluorescence, luminescence, mass spectrometry, HPLC, SDS-PAGE, western blotting, and MALDI-TOF assay. Traditionally, the ubiquitination of target proteins has been monitored using ubiquitin that is either epitope-tagged or radiolabeled, thus requiring laborious detection methods. Currently, fluorescent or luminescent-labeled ubiquitin is frequently used for examining ubiquitination in vitro because this approach is rapid. Here, we summarize the various ubiquitin probes commonly used.

2.2.1. Ubiquitin-7-Amino-4-Methylcoumarin (Ub-AMC)

Assays with Ub-AMC can visualize the DUB activity by measuring fluorescence. Ub-AMC is the most frequently used fluorescent ubiquitin substrate whose C-terminal derivative is AMC [30]. This derivative quenches the intrinsic fluorescence but releases fluorescence following hydrolysis by DUBs; fluorescence emission facilitates the real-time monitoring of the sensitivity or activity of DUBs [31]. This monitoring can be performed using 380 nm excitation and 460 nm emission wavelengths. Therefore, as the deubiquitinating reaction progresses, the fluorescence increases. However, the linkage between ubiquitin and the fluorophore AMC is not an isopeptide bond shown in the natural ubiquitin chain; and AMC is just covalently linked to ubiquitin. In a previous study, the DUB activity of USP4 was inhibited by neutral red (NR) treatment in a dose-dependent manner, which was measured by Ub-AMC analysis [32]. WP1130 inhibited purified recombinant USP5 and UCH-L1 and immunoprecipitated USP9X in a dose-dependent manner, which was also measured by Ub-AMC analysis [33].

2.2.2. Ubiquitin-Aminoluciferin (Ub-AML)

Assays with Ub-AML can visualize DUB activity by measuring the luminescence. Ub-AML is a ubiquitin reporter substrate whose C-terminal derivative is AML. Luciferin is released from Ub-AML via DUB activity. Subsequently, ATP and luciferase are added to produce a luminescent signal in proportion to DUB activity [34]. Therefore, as the deubiquitinating reaction progresses, the luminescence increases. Luminescence assays are strong and sensitive; thus, these assays are beneficial against noise contamination compared with traditional fluorophore-based assays with low sensitivity. However, the linkage between ubiquitin and the luminophore AML is not an isopeptide bond shown in the natural ubiquitin chain; and AML is just covalently linked to ubiquitin. Ub-AML has shown enhanced sensitivity in detecting DUBs that were otherwise difficult to detect by Ub-AMC [34]. Moreover, a benzophenazine compound, OR141, inhibited the cleavage of Ub-AML by DUBs present in purified 19S proteasome [35].

2.2.3. Ubiquitin-Phospholipase A2 (Ub-PLA2)

Assays with Ub-PLA2 can visualize the DUB activity by measuring fluorescence. Ub-PLA2 is a ubiquitin reporter substrate whose C-terminal is fused to PLA2. PLA2 requires a free amino terminus to be catalytically active. Active PLA2 cleaves the 2-acyl linkage of 3-sn-phosphoglycerides in a Ca2+-dependent reaction and is dose-dependently detected by the release of the fluorophore 7-nitrobenz-2-oxa-1,3-diazole (NBD) from 2-(6-(7-nitrobenz-2-oxa-1,3-diazol-4-yl)amino)hexanoyl-1-hexadecanoyl-sn-glycero-3-phosphocholine (NBD C6-HPC) [36]. Therefore, DUBs can produce a fluorescent signal by cleaving the ubiquitin C terminus of Ub-PLA2 to give a free amino terminus for catalytically active PLA2. Reaction monitoring can be performed using 460 nm excitation and 534 nm emission wavelengths. In a previous study, the nonselective isopeptidase inhibitor NSC 632839 did not inhibit the PLA2 reporter enzyme, indicating that the reported inhibition was selective for isopeptidases but not for the PLA2 reporter reaction [36]. However, the linkage between ubiquitin and the fluorophore PLA2 is not an isopeptide bond shown in the natural ubiquitin chain; and PLA2 is just covalently linked to ubiquitin. A deubiquitination assay with Ub-PLA2 demonstrated that the DUB inhibitor P22077 inhibited USP7 and USP47, which have high similarity. In contrast, another DUB inhibitor, PR-619, exhibited a limited inhibitory effect on multiple DUBs [37].

2.2.4. Ubiquitin-Rhodamine110 (Ub-Rho110)

Assays with Ub-Rho110 can visualize DUB activity by measuring fluorescence. Ub-Rho110 is a ubiquitin substrate whose C-terminal derivatives are Rho110. While rhodamine is in the Ub-Rho110 moiety, it is di-substituted thereby quenching the intrinsic fluorescence. However, mono-substituted rhodamine, which exhibits intense fluorescence, is released by the DUBs, thus allowing the real-time monitoring of the sensitivity or activity of DUBs. This monitoring can be performed using 485 nm excitation and 535 nm emission wavelengths [38]. With these longer wavelengths, the risks of artifacts in auto-fluorescence are reduced. However, the linkage between ubiquitin and the fluorophore Rho110 is not an isopeptide bond shown in the natural ubiquitin chain; and Rho110 is just covalently linked to ubiquitin. The USP7-selective inhibitory effects of XL188 on 41 purified DUBs were measured by Ub-Rho110 [39]. In another study, Ub-Rho110 confirmed that USP14 aptamers specifically inhibited the DUB activity of USP14; however, they failed to inhibit the DUB activities of UCHL3, USP47, USP5, and UCHL5/UCH37 [40].

2.2.5. Fluorescence Polarization (FP)-Based Ubiquitin-Lys-5-Tetramethylrhodamine-Gly (Ub-Lys-TAMRA-Gly)

FP is a technique based on the difference between the polarized fluorescent light emitted when a fluorescent-labeled molecule is highly excited by polarized light and the less polarized fluorescent light emitted when a fluorescent-labeled molecule is cleaved by DUBs. Therefore, the signal is inversely proportional to DUB activity. The higher the DUB activity, the lower the emitted fluorescence. FP assays are readily adaptable to HTS, which would be useful for the screening of DUB inhibitors [41,42,43].
Assays with Ub-Lys-TAMRA-Gly can visualize DUB activity by measuring fluorescence. TAMRA is a fluorophore, and Ub-TAMRA is a ubiquitin substrate whose derivative is TAMRA. The Lys-Gly sequence is modified by TAMRA and is linked to ubiquitin through an isopeptide bond with a lysine side-chain, thus mimicking ubiquitinated substrates. It is useful for studying C-terminal ubiquitin hydrolytic activity over a continuous period at longer wavelengths. Ub-Lys-TAMRA-Gly has been prepared by chemical synthesis, and this probe allows the detection of ubiquitination based on fluorescence [44]. The activity of TAMRA-labeled ubiquitin is validated by the cleavage of the fluorophore TAMRA from ubiquitin after incubation with DUBs. The high molecular weight TAMRA-labeled ubiquitin emits highly polarized light when it is excited. After cleavage by DUBs, the fluorophore, which is covalently attached to ubiquitin, emits less polarized light. Thus, higher DUB activity is associated with reduced fluorescence. DUB activity is monitored based on these changes in polarization using 544 nm excitation and 572 nm emission wavelengths. The DUB activities of USP7, UCH-L3, USP21, and OTU were measured by deubiquitination assays with Ub-Lys-TAMRA-Gly [44]. The DUB activities of USP2, vOTU, OTUD3, OTUB2, and OTUD6A were also measured by this assay [45]. If the N-terminal TAMRA-tagged ubiquitin is transfected to cells by electroporation for cell-based assays, it can be detected by microscopy or SDS-PAGE [46].

2.2.6. Fluorescence Resonance Energy Transfer (FRET)-Based Di-Ub Probes

Similar to ubiquitin chain cleavage assays, deubiquitination assays with di-Ub probe allow a better understanding of the DUB linkage-type preference [47]. The ubiquitin chain linkage specificity of a DUB determines its function in signaling mechanisms, and di-Ub probes can be labeled with a fluorescent molecule for the absolute quantification of the chain cleavage specificity of the DUB. Fluorescent labeling is difficult with polyubiquitin chains; thus, di-Ub is usually used for the quantification of the linkage specificity of a DUB. Fluorescent TAMRA, AMC, and Rho110 can be labeled with di-Ub. The FRET-based di-Ub deubiquitination assay also involves the use of fluorescent-labeled di-Ub probes. For example, the deubiquitinase OTUD2 showed specificity for K11-linked di-Ub, which is labeled with either TAMRA or AMC [48]. FRET is a measuring tool for observing two fluorophores of different colors. Energy transfer occurs over distances less than 10 nm and allows the detection of protein–protein interactions and protein conformational changes [49]. FRET-based di-Ub comprises two ubiquitin modules, one equipped with a donor fluorophore and the other as an acceptor. Intrinsic fluorescence from the donor fluorophore is transferred to the acceptor fluorophore thereby emitting fluorescence. These two ubiquitin modules are specifically linked to one of the seven lysine residues by an isopeptide bond. In the presence of a DUB, the FRET-based di-Ub pair is cleaved, resulting in the loss of the FRET signal and the consequent decrease in acceptor emission [50,51]. Therefore, as the deubiquitinating reaction progresses, the fluorescence emission of the acceptor and donor is decreased and increased, respectively. FRET pairs of 5-carboxyrhodamine110 (Rho110) as the donor and 5-carboxytetramethylrhodamine (TAMRA) as the acceptor showed that loss of the FRET signal was caused by TRABID-mediated di-Ub cleavage [50]. In addition, FRET-based nanoparticles were used for monitoring DUB activity. The UCH-L1 inhibitor IS-1 (an isatin O-acyl oxime compound) was observed to inhibit the DUB activity of UCH-L1 towards mesoporous silica nanoparticle-terbium-UbR (MSN-Tb-UbR), which was prepared by modifying rhodamine B-labeled Ubs (Ub-Rs) (the acceptor) on the surface of MSNs-loaded with Tb3+-complexes (the donor). This modified assay showed good sensitivity and selectivity for monitoring the effect of the UCH-L1 inhibitor [52].

2.2.7. Limitations

Fluorescence-based deubiquitination assays have been found to have a few limitations. The most common and widely used Ub-AMC has a relatively narrow wavelength range compared to other Ub-based probes, and the excitation wavelength is in the UV range. Therefore, it is not suitable for drug discovery because it can excite many screening compounds and cause false positives [53]. Unfortunately, it cannot be efficiently hydrolyzed by the USP enzymes, the largest group of DUBs [54]. Ub-Rho110, which exhibits a red-shifted fluorescence in both the excitation and emission spectra would be an excellent alternative to Ub-AMC because it provides a considerable improvement in detection. Analysis with Ub-AMC or Ub-Rho110 is not suitable for experiments that require high concentrations of enzymes and/or low concentrations of substrates, such as optimization of lead compounds [34]. The FRET assay developed for HTS is not only difficult to apply to a multi-well plate format where the end point can be read directly, but also requires special reagents and equipment. In addition, there is a disadvantage that signal loss may occur during the reaction [54]. The wavelength range of the Ub-PLA2 assay is better suited for drug discovery than that of the Ub-AMC assay. However, in an experiment screening commercial libraries for USP7 inhibitors using this assay, it could not be distinguished whether the inhibitors found inhibited USP7 or PLA2, which limits its broader applicability [55]. Unlike other assays, Ub-AML assay requires the external addition of luciferase [47].

3. Deubiquitination Assays for Mammalian Cells

Deubiquitination assays with mammalian cells are performed using mammalian cell lysates or live cells. This allows the monitoring of DUB activity within the intracellular environment. In cell lysates, DUB retains its native form, either bound to interacting proteins required for proper folding or multimeric assembly, or modified by “authentic” human-like PTMs such as phosphorylation [56]. Therefore, deubiquitination assays with mammalian cells can confirm their native activity within the entire intracellular environment. Furthermore, the ubiquitin chain cleavage assay can be performed with immunoprecipitated DUBs, which would reflect their activity within the intracellular environment. For DUB studies, it is recommended to validate the activity of the DUB or the DUB inhibitor by deubiquitination assays with mammalian cells to assess their actual activity within the intracellular environment. Nickel pull-down assays are typical deubiquitination assays with mammalian cells; however, the use of activity-based probes (ABPs) is also increasing. Here, we review deubiquitination assays with mammalian cells for assessing the intracellular activity of DUBs or the effect of DUB inhibitors (Figure 2).

3.1. Nickel Pull-Down Assays

Nickel pull-down assays can visualize the ubiquitination of the substrate protein by western blotting using anti-substrate antibodies. In these assays, the substrate, DUB, and His-tagged ubiquitin are overexpressed in cells, and ubiquitinated cellular proteins are extracted by Ni-NTA agarose and analyzed by western blotting. Ni-NTA agarose is a nickel-charged affinity resin for purifying proteins tagged with a polyhistidine (6 × His) sequence. His residues of the His-tagged protein bind to the immobilized nickel ions with high specificity and affinity [57], and other proteins pass through the matrix. A ubiquitinated substrate can generate high-molecular weight bands. Consequently, quantification is usually difficult, as is a comparison with another sample. If the western blot signal is too weak, autoclaving the transferred membrane before blocking could improve the signal of the ubiquitinated substrate during western blotting. Furthermore, the ubiquitination of substrates and deubiquitinating activity of DUBs could be confirmed using site mutants of ubiquitinK, e.g., only the Lys48 residue is replaced with Arg and all Lys residues are replaced with Arg except Lys48 [58]. Nickel pull-down assays demonstrate ubiquitinating or deubiquitinating activity within the intracellular environment. Therefore, the assay allows us to examine the effect of DUB depletion on substrate ubiquitination. In the case of DUB depletion, the decreased ubiquitination of a substrate would be attenuated. This confirms the intracellular deubiquitinating activity of DUBs. However nickel pull-down assays are limited as they can only be used for known substrates and thus are not suitable for HTS. The Ni-NTA pull-down assay was used to measure the activity of USP47 towards its substrate, RPS2 [59]. In another study, the assay showed that HBX 19818 inhibited USP7, and the ubiquitination of MDM2, a substrate of USP7 was increased by HBX 19818 treatment in a dose-dependent manner [60].

3.2. Activity-Based Probes (ABPs)

Deubiquitination assays with mammalian cells and ABPs can confirm DUB activity by SDS-PAGE using anti-DUB antibodies or antibodies to tag the probes. Activity-based DUB probes (DUB ABPs) include various electrophiles, substrates, and N-terminal tags. Propargylamide (PA or Prg), vinylmethyl ester (VME), and vinylsulfone (VS) are typical electrophiles and their classification is summarized in Table 1.
When ABPs are incubated with mammalian cell lysates, they form a covalent bond with the active site of DUBs. Monoubiquitin probes are widely used; thus, a DUB bound to the probes is shifted to a higher molecular weight position on the gel. This upper band suggests that the active DUB is well labeled with the probes. As the extent of probe labeling depends on the activity of the DUB, the more intense the probe-bound band, the higher the DUB activity. When the DUB is inhibited by a DUB inhibitor, the upper band disappears or shows a lower band intensity [62,63]. In contrast to Ni-NTA assays, ABP-based assays are performed with untransfected whole-cell lysates; thus, HTS is possible.

3.3. Cell-Permeable ABPs

A number of probe designs have been reported since the development of the first DUB-related ABP; however, none of them showed cell permeability, which may be attributed to the large size of the recognition element in the probes [61]. ABPs for most proteases require only a short peptide recognition element; however, DUB ABPs require a full-length ubiquitin [61,64]. Hence, to date, DUB ABPs have only been used with cell lysates. However, cell lysis causes the large-scale dilution of the cytosols, which in turn can lead to the dissociation of protein complexes with the loss of activity [65]. Therefore, DUBs need to be labeled in their native cellular environment, where their intracellular location, protein–protein interactions, and activity can be maintained. To fully understand the function of DUBs in a physiological environment, cell permeability issues should be addressed.

3.3.1. Delivery of ABPs to Cells

Previously, pore-forming toxin and electroporation were used to deliver DUB ABPs that could not pass through the cell membrane into cells. Claessen et al. were the first to use perfringolysin O (PFO), a pore-forming toxin that binds to cholesterol in the plasma membrane and forms a large pore complex, to deliver their developed catch-and-release ubiquitin ABP, which is a Ub-VME derivative with a cleavable linker (release motif) attached to a biotin affinity handle (catch part), into cells [65]. When the cells are exposed to mild hypotonic conditions and incubated with PFO and the catch-and-release ubiquitin ABP, the probe is transferred into the cells through the pores [65,66]. Electroporation has been used to directly monitor the cascade-dependent enzymatic activity of Ub-conjugating enzymes in cells. Imaging-based experiments using the Cy5-UbDha probe could allow the measurement of ubiquitination in cells [67]. However, these methods may affect ubiquitination and the signaling cascade, thus disrupting cell homeostasis [68].

3.3.2. Cell-Penetrating Peptide (CPP)-Based ABPs

Recently, ABPs that can cross the cell membrane have been developed. Attaching a CPP to DUB ABPs allows the probes to pass through the cell membrane. CPPs have been reported as versatile delivery vehicles for cell-impermeable molecules [69]. Gui et al. synthesized a novel DUB ABP containing a disulfide-linked cyclic polyarginine (cR10) peptide that is known to enhance the cellular uptake of proteins at the N-terminus of the probe [69,70]. CPP-based DUB ABPs have been used for proteome-wide DUB profiling in combination with quantitative mass spectrometry in a previous study. The study confirmed 10 DUBs in cell lysates using CPP-based DUB ABPs; a total of 27 DUBs were identified in the intracellular DUB profiling experiment, including the 10 DUBs found in cell lysates. Safa et al. generated another CPP-based DUB ABP by conjugating a β-hairpin sequence motif (RWVRVpGRWIRQ) to a DUB recognition element consisting of the last four amino acid residues (LRGG) of ubiquitin [71,72]. The β-hairpin motif provides enhanced protease resilience, thus allowing the dynamic measurements of the activity of a DUB over a long period of time in its intact form. Taken together, CPP-based DUB ABPs could help identify the biological function and activity of DUBs in a physiological environment, and they are suitable for HTS and the discovery of DUB inhibitors [70].

3.3.3. Small Molecule-Based ABPs

As mentioned above, the requirement of a full-length ubiquitin as a recognition element is the main reason why DUB ABPs cannot pass through cell membrane. To address this problem, the use of small molecule-based DUB ABPs has been considered. The idea of using small molecule-based DUB ABPs was proposed during the development of DUB inhibitors. Small molecules covalently bound to DUBs have been modified by the addition of a reporter group e.g., fluorescent molecules and used for competitive activity-based protein profiling (ABPP).
A small molecule-based DUB ABP, based on a chloroacetylpyrrole scaffold, was first introduced by Ward et al., which had an inhibitory effect on USP4 and USP11 [62]. This inhibitory compound was used as a DUB ABP for quantitative target engagement in live cells with ABPP methods, and it labeled a total of 12 DUBs in the cells.
Small-molecule covalent inhibitors of ubiquitin carboxy-terminal hydrolases (UCHs), another DUB subfamily, are useful as novel cell-permeable ABPs for identifying and quantifying target protein in cells. Panyain et al. developed a cyanamide-containing inhibitor for UCHL1. This inhibitor and its alkyne-tagged analog, IMP1720, labeled the catalytic Cys residue of UCHL1 in an activity-dependent manner and provided a new tool to examine UCHL1 activity in several cell types [73]. Another small molecule inhibitor for UCHL1 has been reported by Geurink et al. They synthesized several compounds including 6RK73, 8RK54, and 8RK64 with a cyanamide moiety based on a collection of cyanopyrrolidine-based inhibitors for UCHL1. These compounds selectively inhibited UCHL1 in the presence of other DUBs in live cells [74].
There have been limited reports of effective small-molecule DUB ABPs. Nevertheless, the development of small-molecule DUB ABPs is regarded as vital for the application of DUB ABPs at low concentrations (nanomolar levels) in cells. However, strong off-target effects and toxicity may limit the utility of these probes in living systems. If these problems are addressed, small-molecule-based ABPs will be a potent cell-permeable tool with selective DUB activity for target identification in cells.

3.4. Limitations

All DUBs bind to ubiquitin adjacent to their catalytic site. Therefore, ABPs for DUBs typically include full-length ubiquitin as a substrate with a Cys reactive electrophilic group. However, some reports revealed that DUB ABPs also label various non-DUB proteins [75,76,77]. It is unclear whether these proteins covalently bind to the probes or interact through non-covalent interactions with the probes or other probe-labeled DUBs. Furthermore, Wang et al. reported that OTUB1 reacted with Ub-VS on a non-catalytic Cys residue, suggesting that DUB ABPs may not always react with DUBs at their active site [78]. In addition, the ubiquitin chain linkage specificity of DUBs may be determined by the development of di-Ub ABPs [79]. However, despite various efforts, ABPs are still limited in the analysis of DUB specificity towards target proteins and the selectivity between DUBs [80,81,82].
The use of CPPs with ABPs to pass through the cell membrane has also been reported to substantially disrupt cell membrane integrity, leading to the formation of non-physiological subcellular compartments [83]. Indeed, unexpected pore formation by CPPs can disrupt cell homeostasis, inducing cell death processes such as apoptosis and necrosis [84]. In addition, the CPP-based probe method requires a large amount of probes (>10 nM); however, analysis of the cellular target engagement and selectivity of novel DUB inhibitors require the ABP labeling of a wide range of DUBs at low concentration [69].
Small-molecule-based ABPs have strong off-target effects, affecting proteins such as non-DUB proteins, which could induce cellular toxicity. For example, b-AP15, a known inhibitor of USP14 and UCH-37 [85], and its analog, VLX1570, could react with multiple proteins in a non-specific manner, causing intracellular toxicity [86]. Through both a quantitative proteomic approach and immunoblot assay, Ward et al. found that these inhibitors could target various proteins, resulting in the formation of complexes with a higher molecular weight. Particularly, VLX1570 was strongly covalently linked to CIAPIN1. VLX1570 formed a complex with CIAPIN1, leading to the aggregation of CIAPIN1 in intact cells [86]. As CIAPIN1 exerts anti-apoptotic effects [87], its aggregation may induce cellular toxicity. In addition, the minor off-targets (UCHL3 and FGFR2) of IMP1720 were identified through proteome-wide competitive ABPP [73]. Geurink et al. reported that their UCHL1 inhibitors reacted with the non-DUB protein DJ-1 (PARK7), a major off-target [74].

4. Conclusions

The profiling of DUB activity using various probes is important for characterizing novel DUBs and identifying DUB inhibitors. Since each probe has different reactivities and specific applications, it is necessary to understand their features and efficacy. We have summarized deubiquitination assays according to the detection methods (Table 2) and purpose (Table 3). Thus far, most DUB assays have been performed using cell lysates or purified proteins. Since this is greatly different from the native cell environment, there are limitations in determining DUB activity and function. A method capable of measuring DUB activity in living cells is essential. The development of new tools such as cell-permeable DUB probes will allow us to explore a wide range of DUB processes. In addition to the accurate measurement of DUB activity by these assays, insights into the biological role of DUBs based on knockdown experiments, PTMs, and catalytic mutants [25,26,59,88] are needed to determine the feasibility of DUB as a target for new drugs.

Author Contributions

Conceptualization, J.C., J.P., and E.J.S.; writing—original draft preparation, J.C. and J.P.; writing—review and editing, E.E.K. and E.J.S.; visualization, J.C. and J.P.; supervision, E.J.S. All authors have read and agreed to the published version of the manuscript.

Funding

This work was supported by a National Research Foundation of Korea (NRF) grant funded by the Ministry of Science and ICT (2020R1A4A4079494, 2019R1A2C2004052, and 2017R1A2B3007224).

Conflicts of Interest

The authors declare no conflict of interest.

Abbreviations

DUBDeubiquitinating Enzyme
ABPActivity-Based Probe
HTSHigh-Throughput Screening
UbUbiquitin
AMC7-amino-4-methylcoumarin
AMLAminoluciferin
PLA2Phospholipase A2
NBD7-nitrobenz-2-oxa-1,3-diazole
NBD C6-HPC2-(6-(7-nitrobenz-2-oxa-1,3-diazol-4-yl)amino)hexanoyl-1-hexadecanoyl-sn-glycero-3-phosphocholine
RhoRhodamine 110
FPFluorescence Polarization
TAMRA5-tetramethylrhodamine
FRETFluorescence Resonance Energy Transfer
PAPropargylamide
VMEVinylmethyl Ester
VSVinylsulfone
PFOPerfringolysin O
CPPCell-Penetrating Peptide

References

  1. Komander, D.; Clague, M.J.; Urbe, S. Breaking the chains: Structure and function of the deubiquitinases. Nat. Rev. Mol. Cell Biol. 2009, 10, 550–563. [Google Scholar] [CrossRef] [PubMed]
  2. Komander, D.; Rape, M. The ubiquitin code. Annu. Rev. Biochem. 2012, 81, 203–229. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  3. Kulathu, Y.; Komander, D. Atypical ubiquitylation—the unexplored world of polyubiquitin beyond Lys48 and Lys63 linkages. Nat. Rev. Mol. Cell Biol. 2012, 13, 508–523. [Google Scholar] [CrossRef] [PubMed]
  4. Komander, D. The emerging complexity of protein ubiquitination. Biochem. Soc. Trans. 2009, 37, 937–953. [Google Scholar] [CrossRef] [Green Version]
  5. Priolo, C.; Tang, D.; Brahamandan, M.; Benassi, B.; Sicinska, E.; Ogino, S.; Farsetti, A.; Porrello, A.; Finn, S.; Zimmermann, J.; et al. The isopeptidase USP2a protects human prostate cancer from apoptosis. Cancer Res. 2006, 66, 8625–8632. [Google Scholar] [CrossRef] [Green Version]
  6. Stevenson, L.F.; Sparks, A.; Allende-Vega, N.; Xirodimas, D.P.; Lane, D.P.; Saville, M.K. The deubiquitinating enzyme USP2a regulates the p53 pathway by targeting Mdm2. Embo. J. 2007, 26, 976–986. [Google Scholar] [CrossRef] [Green Version]
  7. Qu, Q.; Mao, Y.; Xiao, G.; Fei, X.; Wang, J.; Zhang, Y.; Liu, J.; Cheng, G.; Chen, X.; Wang, J.; et al. USP2 promotes cell migration and invasion in triple negative breast cancer cell lines. Tumour Biol. 2015, 36, 5415–5423. [Google Scholar] [CrossRef]
  8. Bhattacharya, S.; Chakraborty, D.; Basu, M.; Ghosh, M.K. Emerging insights into HAUSP (USP7) in physiology, cancer and other diseases. Signal. Transduct Target Ther. 2018, 3, 17. [Google Scholar] [CrossRef]
  9. Wang, Z.; Kang, W.; You, Y.; Pang, J.; Ren, H.; Suo, Z.; Liu, H.; Zheng, Y. USP7: Novel Drug Target in Cancer Therapy. Front. Pharm. 2019, 10, 427. [Google Scholar] [CrossRef] [Green Version]
  10. Zhou, J.; Wang, J.; Chen, C.; Yuan, H.; Wen, X.; Sun, H. USP7: Target Validation and Drug Discovery for Cancer Therapy. Med. Chem. 2018, 14, 3–18. [Google Scholar] [CrossRef]
  11. Pareja, F.; Ferraro, D.A.; Rubin, C.; Cohen-Dvashi, H.; Zhang, F.; Aulmann, S.; Ben-Chetrit, N.; Pines, G.; Navon, R.; Crosetto, N.; et al. Deubiquitination of EGFR by Cezanne-1 contributes to cancer progression. Oncogene 2012, 31, 4599–4608. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  12. Iglesias-Gato, D.; Chuan, Y.C.; Jiang, N.; Svensson, C.; Bao, J.; Paul, I.; Egevad, L.; Kessler, B.M.; Wikström, P.; Niu, Y.; et al. OTUB1 de-ubiquitinating enzyme promotes prostate cancer cell invasion in vitro and tumorigenesis in vivo. Mol. Cancer 2015, 14, 8. [Google Scholar] [CrossRef] [Green Version]
  13. Liu, Y.; Fallon, L.; Lashuel, H.A.; Liu, Z.; Lansbury, P.T., Jr. The UCH-L1 gene encodes two opposing enzymatic activities that affect alpha-synuclein degradation and Parkinson’s disease susceptibility. Cell 2002, 111, 209–218. [Google Scholar] [CrossRef] [Green Version]
  14. Xilouri, M.; Kyratzi, E.; Pitychoutis, P.M.; Papadopoulou-Daifoti, Z.; Perier, C.; Vila, M.; Maniati, M.; Ulusoy, A.; Kirik, D.; Park, D.S.; et al. Selective neuroprotective effects of the S18Y polymorphic variant of UCH-L1 in the dopaminergic system. Hum. Mol. Genet. 2012, 21, 874–889. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  15. Rott, R.; Szargel, R.; Haskin, J.; Bandopadhyay, R.; Lees, A.J.; Shani, V.; Engelender, S. alpha-Synuclein fate is determined by USP9X-regulated monoubiquitination. Proc. Natl. Acad. Sci. USA 2011, 108, 18666–18671. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  16. Bhattacharyya, B.J.; Wilson, S.M.; Jung, H.; Miller, R.J. Altered neurotransmitter release machinery in mice deficient for the deubiquitinating enzyme Usp14. Am. J. Physiol. Cell Physiol. 2012, 302, C698–C708. [Google Scholar] [CrossRef] [Green Version]
  17. Wang, Y.Q.; Serricchio, M.; Jauregui, M.; Shanbhag, R.; Stoltz, T.; Di Paolo, C.T.; Kim, P.K.; McQuibban, G.A. Deubiquitinating enzymes regulate PARK2-mediated mitophagy. Autophagy 2015, 11, 595–606. [Google Scholar] [CrossRef] [Green Version]
  18. Ahmed, N.; Zeng, M.; Sinha, I.; Polin, L.; Wei, W.Z.; Rathinam, C.; Flavell, R.; Massoumi, R.; Venuprasad, K. The E3 ligase Itch and deubiquitinase Cyld act together to regulate Tak1 and inflammation. Nat. Immunol. 2011, 12, 1176–1183. [Google Scholar] [CrossRef] [Green Version]
  19. Xu, D.; Lillico, S.G.; Barnett, M.W.; Whitelaw, C.B.; Archibald, A.L.; Ait-Ali, T. USP18 restricts PRRSV growth through alteration of nuclear translocation of NF-kappaB p65 and p50 in MARC-145 cells. Virus Res. 2012, 169, 264–267. [Google Scholar] [CrossRef] [Green Version]
  20. Nag, D.K.; Finley, D. A small-molecule inhibitor of deubiquitinating enzyme USP14 inhibits Dengue virus replication. Virus Res. 2012, 165, 103–106. [Google Scholar] [CrossRef]
  21. Harrigan, J.A.; Jacq, X.; Martin, N.M.; Jackson, S.P. Deubiquitylating enzymes and drug discovery: Emerging opportunities. Nat. Rev. Drug Discov. 2018, 17, 57–78. [Google Scholar] [CrossRef] [PubMed]
  22. Bhattacharya, S.; Ghosh, M.K. Cell death and deubiquitinases: Perspectives in cancer. Biomed. Res. Int 2014, 2014, 435197. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  23. Yuan, T.; Yan, F.; Ying, M.; Cao, J.; He, Q.; Zhu, H.; Yang, B. Inhibition of Ubiquitin-Specific Proteases as a Novel Anticancer Therapeutic Strategy. Front. Pharm. 2018, 9, 1080. [Google Scholar] [CrossRef] [Green Version]
  24. Smolskaya, S.; Logashina, Y.A.; Andreev, Y.A. Escherichia coli Extract-Based Cell-Free Expression System as an Alternative for Difficult-to-Obtain Protein Biosynthesis. Int. J. Mol. Sci. 2020, 21, 928. [Google Scholar] [CrossRef] [Green Version]
  25. Xu, D.; Shan, B.; Lee, B.H.; Zhu, K.; Zhang, T.; Sun, H.; Liu, M.; Shi, L.; Liang, W.; Qian, L.; et al. Phosphorylation and activation of ubiquitin-specific protease-14 by Akt regulates the ubiquitin-proteasome system. eLife 2015, 4, e10510. [Google Scholar] [CrossRef] [PubMed]
  26. Sonego, M.; Pellarin, I.; Costa, A.; Vinciguerra, G.L.R.; Coan, M.; Kraut, A.; D’Andrea, S.; Dall’Acqua, A.; Castillo-Tong, D.C.; Califano, D.; et al. USP1 links platinum resistance to cancer cell dissemination by regulating Snail stability. Sci Adv. 2019, 5, eaav3235. [Google Scholar] [CrossRef] [Green Version]
  27. Abdul Rehman, S.A.; Kristariyanto, Y.A.; Choi, S.Y.; Nkosi, P.J.; Weidlich, S.; Labib, K.; Hofmann, K.; Kulathu, Y. MINDY-1 Is a Member of an Evolutionarily Conserved and Structurally Distinct New Family of Deubiquitinating Enzymes. Mol. Cell 2016, 63, 146–155. [Google Scholar] [CrossRef] [Green Version]
  28. Park, J.; Kwon, M.S.; Kim, E.E.; Lee, H.; Song, E.J. USP35 regulates mitotic progression by modulating the stability of Aurora B. Nat. Commun. 2018, 9, 688. [Google Scholar] [CrossRef] [Green Version]
  29. Shi, T.; Bao, J.; Wang, N.X.; Zheng, J.; Wu, D. Identification of Small Molecule TRABID Deubiquitinase Inhibitors By Computation-Based Virtual Screen. BMC Chem. Biol. 2012, 12, 4. [Google Scholar] [CrossRef] [Green Version]
  30. Dang, L.C.; Melandri, F.D.; Stein, R.L. Kinetic and mechanistic studies on the hydrolysis of ubiquitin C-terminal 7-amido-4-methylcoumarin by deubiquitinating enzymes. Biochemistry 1998, 37, 1868–1879. [Google Scholar] [CrossRef]
  31. Morgan, M.T.; Wolberger, C. Competition Assay for Measuring Deubiquitinating Enzyme Substrate Affinity. Methods Mol. Biol. 2018, 1844, 59–70. [Google Scholar] [CrossRef] [PubMed]
  32. Nguyen, H.H.; Kim, T.; Nguyen, T.; Hahn, M.J.; Yun, S.I.; Kim, K.K. A Selective Inhibitor of Ubiquitin-Specific Protease 4 Suppresses Colorectal Cancer Progression by Regulating β-Catenin Signaling. Cell. Physiol. Biochem. 2019, 53, 157–171. [Google Scholar] [CrossRef] [PubMed]
  33. Kapuria, V.; Peterson, L.F.; Fang, D.; Bornmann, W.G.; Talpaz, M.; Donato, N.J. Deubiquitinase inhibition by small-molecule WP1130 triggers aggresome formation and tumor cell apoptosis. Cancer Res. 2010, 70, 9265–9276. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  34. Orcutt, S.J.; Wu, J.; Eddins, M.J.; Leach, C.A.; Strickler, J.E. Bioluminescence assay platform for selective and sensitive detection of Ub/Ubl proteases. Biochim. Biophys. Acta 2012, 1823, 2079–2086. [Google Scholar] [CrossRef] [Green Version]
  35. Pinto, A.; Mace, Y.; Drouet, F.; Bony, E.; Boidot, R.; Draoui, N.; Lobysheva, I.; Corbet, C.; Polet, F.; Martherus, R.; et al. A new ER-specific photosensitizer unravels (1)O2-driven protein oxidation and inhibition of deubiquitinases as a generic mechanism for cancer PDT. Oncogene 2016, 35, 3976–3985. [Google Scholar] [CrossRef]
  36. Nicholson, B.; Leach, C.A.; Goldenberg, S.J.; Francis, D.M.; Kodrasov, M.P.; Tian, X.; Shanks, J.; Sterner, D.E.; Bernal, A.; Mattern, M.R.; et al. Characterization of ubiquitin and ubiquitin-like-protein isopeptidase activities. Protein Sci. 2008, 17, 1035–1043. [Google Scholar] [CrossRef] [Green Version]
  37. Altun, M.; Kramer, H.B.; Willems, L.I.; McDermott, J.L.; Leach, C.A.; Goldenberg, S.J.; Kumar, K.G.; Konietzny, R.; Fischer, R.; Kogan, E.; et al. Activity-based chemical proteomics accelerates inhibitor development for deubiquitylating enzymes. Chem. Bio.l 2011, 18, 1401–1412. [Google Scholar] [CrossRef] [Green Version]
  38. Hassiepen, U.; Eidhoff, U.; Meder, G.; Bulber, J.F.; Hein, A.; Bodendorf, U.; Lorthiois, E.; Martoglio, B. A sensitive fluorescence intensity assay for deubiquitinating proteases using ubiquitin-rhodamine110-glycine as substrate. Anal. Biochem. 2007, 371, 201–207. [Google Scholar] [CrossRef]
  39. Lamberto, I.; Liu, X.; Seo, H.S.; Schauer, N.J.; Iacob, R.E.; Hu, W.; Das, D.; Mikhailova, T.; Weisberg, E.L.; Engen, J.R.; et al. Structure-Guided Development of a Potent and Selective Non-covalent Active-Site Inhibitor of USP7. Cell Chem. Biol. 2017, 24, 1490–1500.e1411. [Google Scholar] [CrossRef] [Green Version]
  40. Lee, J.H.; Shin, S.K.; Jiang, Y.; Choi, W.H.; Hong, C.; Kim, D.E.; Lee, M.J. Facilitated Tau Degradation by USP14 Aptamers via Enhanced Proteasome Activity. Sci. Rep. 2015, 5, 10757. [Google Scholar] [CrossRef]
  41. Moerke, N.J. Fluorescence Polarization (FP) Assays for Monitoring Peptide-Protein or Nucleic Acid-Protein Binding. Curr. Protoc. Chem. Biol. 2009, 1, 1–15. [Google Scholar] [CrossRef] [PubMed]
  42. Huang, X.; Aulabaugh, A. Application of Fluorescence Polarization in HTS Assays. Methods Mol. Biol. 2016, 1439, 115–130. [Google Scholar] [CrossRef] [PubMed]
  43. Du, Y. Fluorescence polarization assay to quantify protein-protein interactions in an HTS format. Methods Mol. Biol. 2015, 1278, 529–544. [Google Scholar] [CrossRef]
  44. Geurink, P.P.; El Oualid, F.; Jonker, A.; Hameed, D.S.; Ovaa, H. A general chemical ligation approach towards isopeptide-linked ubiquitin and ubiquitin-like assay reagents. Chembiochem 2012, 13, 293–297. [Google Scholar] [CrossRef] [Green Version]
  45. De Cesare, V.; Lopez, D.C.; Mabbitt, P.D.; Antico, O.; Wood, N.T.; Virdee, S. Deubiquitinating Enzyme Amino Acid Profiling Reveals a Class of Ubiquitin Esterases. bioRxiv 2020. [Google Scholar] [CrossRef]
  46. Juenemann, K.; Jansen, A.H.P.; van Riel, L.; Merkx, R.; Mulder, M.P.C.; An, H.; Statsyuk, A.; Kirstein, J.; Ovaa, H.; Reits, E.A. Dynamic recruitment of ubiquitin to mutant huntingtin inclusion bodies. Sci. Rep. 2018, 8, 1405. [Google Scholar] [CrossRef] [PubMed]
  47. Gopinath, P.; Ohayon, S.; Nawatha, M.; Brik, A. Chemical and semisynthetic approaches to study and target deubiquitinases. Chem. Soc. Rev. 2016, 45, 4171–4198. [Google Scholar] [CrossRef] [Green Version]
  48. Flierman, D.; van der Heden van Noort, G.J.; Ekkebus, R.; Geurink, P.P.; Mevissen, T.E.; Hospenthal, M.K.; Komander, D.; Ovaa, H. Non-hydrolyzable Diubiquitin Probes Reveal Linkage-Specific Reactivity of Deubiquitylating Enzymes Mediated by S2 Pockets. Cell Chem. Biol. 2016, 23, 472–482. [Google Scholar] [CrossRef] [Green Version]
  49. Piston, D.W.; Rizzo, M.A. FRET by fluorescence polarization microscopy. Methods Cell Biol. 2008, 85, 415–430. [Google Scholar] [CrossRef]
  50. Geurink, P.P.; van Tol, B.D.; van Dalen, D.; Brundel, P.J.; Mevissen, T.E.; Pruneda, J.N.; Elliott, P.R.; van Tilburg, G.B.; Komander, D.; Ovaa, H. Development of Diubiquitin-Based FRET Probes to Quantify Ubiquitin Linkage Specificity of Deubiquitinating Enzymes. Chembiochem 2016, 17, 816–820. [Google Scholar] [CrossRef] [Green Version]
  51. Hameed, D.S.; Sapmaz, A.; Ovaa, H. How Chemical Synthesis of Ubiquitin Conjugates Helps To Understand Ubiquitin Signal Transduction. Bioconjug. Chem. 2017, 28, 805–815. [Google Scholar] [CrossRef] [PubMed]
  52. Liang, Y.Y.; Zhang, J.; Cui, H.; Shao, Z.S.; Cheng, C.; Wang, Y.B.; Wang, H.S. Fluorescence resonance energy transfer (FRET)-based nanoarchitecture for monitoring deubiquitinating enzyme activity. Chem. Commun. (Camb) 2020, 56, 3183–3186. [Google Scholar] [CrossRef] [PubMed]
  53. Tirat, A.; Schilb, A.; Riou, V.; Leder, L.; Gerhartz, B.; Zimmermann, J.; Worpenberg, S.; Eidhoff, U.; Freuler, F.; Stettler, T.; et al. Synthesis and characterization of fluorescent ubiquitin derivatives as highly sensitive substrates for the deubiquitinating enzymes UCH-L3 and USP-2. Anal. Biochem. 2005, 343, 244–255. [Google Scholar] [CrossRef] [PubMed]
  54. Goldenberg, S.J.; McDermott, J.L.; Butt, T.R.; Mattern, M.R.; Nicholson, B. Strategies for the identification of novel inhibitors of deubiquitinating enzymes. Biochem. Soc. Trans. 2008, 36, 828–832. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  55. Weinstock, J.; Wu, J.; Cao, P.; Kingsbury, W.D.; McDermott, J.L.; Kodrasov, M.P.; McKelvey, D.M.; Suresh Kumar, K.G.; Goldenberg, S.J.; Mattern, M.R.; et al. Selective Dual Inhibitors of the Cancer-Related Deubiquitylating Proteases USP7 and USP47. ACS Med. Chem. Lett. 2012, 3, 789–792. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  56. McDonald, K.A. 2.32-Heterologous Protein Expression. In Comprehensive Biotechnology, 2nd ed.; Moo-Young, M., Ed.; Academic Press: Burlington, MA, USA, 2011; pp. 441–449. [Google Scholar]
  57. Spriestersbach, A.; Kubicek, J.; Schäfer, F.; Block, H.; Maertens, B. Purification of His-Tagged Proteins. Methods Enzym. 2015, 559, 1–15. [Google Scholar] [CrossRef]
  58. Cho, J.; Park, J.; Shin, S.C.; Kim, J.H.; Kim, E.E.; Song, E.J. Ribosomal protein S2 interplays with MDM2 to induce p53. Biochem. Biophys. Res. Commun. 2020, 523, 542–547. [Google Scholar] [CrossRef] [PubMed]
  59. Cho, J.; Park, J.; Shin, S.C.; Jang, M.; Kim, J.H.; Kim, E.E.; Song, E.J. USP47 Promotes Tumorigenesis by Negative Regulation of p53 through Deubiquitinating Ribosomal Protein S2. Cancers (Basel) 2020, 12, 1137. [Google Scholar] [CrossRef] [PubMed]
  60. Reverdy, C.; Conrath, S.; Lopez, R.; Planquette, C.; Atmanene, C.; Collura, V.; Harpon, J.; Battaglia, V.; Vivat, V.; Sippl, W.; et al. Discovery of specific inhibitors of human USP7/HAUSP deubiquitinating enzyme. Chem. Biol. 2012, 19, 467–477. [Google Scholar] [CrossRef] [Green Version]
  61. Hewings, D.S.; Flygare, J.A.; Bogyo, M.; Wertz, I.E. Activity-based probes for the ubiquitin conjugation-deconjugation machinery: New chemistries, new tools, and new insights. FEBS J. 2017, 284, 1555–1576. [Google Scholar] [CrossRef] [Green Version]
  62. Ward, J.A.; McLellan, L.; Stockley, M.; Gibson, K.R.; Whitlock, G.A.; Knights, C.; Harrigan, J.A.; Jacq, X.; Tate, E.W. Quantitative Chemical Proteomic Profiling of Ubiquitin Specific Proteases in Intact Cancer Cells. ACS Chem. Biol. 2016, 11, 3268–3272. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  63. Kramer, H.B.; Nicholson, B.; Kessler, B.M.; Altun, M. Detection of ubiquitin-proteasome enzymatic activities in cells: Application of activity-based probes to inhibitor development. Biochim. Biophys. Acta 2012, 1823, 2029–2037. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  64. Sanman, L.E.; Bogyo, M. Activity-based profiling of proteases. Annu. Rev. Biochem. 2014, 83, 249–273. [Google Scholar] [CrossRef] [Green Version]
  65. Claessen, J.H.L.; Witte, M.D.; Yoder, N.C.; Zhu, A.Y.; Spooner, E.; Ploegh, H.L. Catch-and-release probes applied to semi-intact cells reveal ubiquitin-specific protease expression in Chlamydia trachomatis infection. Chembiochem 2013, 14, 343–352. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  66. Sanyal, S.; Claessen, J.H.; Ploegh, H.L. A viral deubiquitylating enzyme restores dislocation of substrates from the endoplasmic reticulum (ER) in semi-intact cells. J. Biol. Chem. 2012, 287, 23594–23603. [Google Scholar] [CrossRef] [Green Version]
  67. Mulder, M.P.; Witting, K.; Berlin, I.; Pruneda, J.N.; Wu, K.P.; Chang, J.G.; Merkx, R.; Bialas, J.; Groettrup, M.; Vertegaal, A.C.; et al. A cascading activity-based probe sequentially targets E1-E2-E3 ubiquitin enzymes. Nat. Chem. Biol. 2016, 12, 523–530. [Google Scholar] [CrossRef]
  68. Van Wijk, S.J.; Fulda, S.; Dikic, I.; Heilemann, M. Visualizing ubiquitination in mammalian cells. EMBO Rep. 2019, 20, e46520. [Google Scholar] [CrossRef]
  69. Raucher, D.; Ryu, J.S. Cell-penetrating peptides: Strategies for anticancer treatment. Trends Mol. Med. 2015, 21, 560–570. [Google Scholar] [CrossRef]
  70. Gui, W.; Ott, C.A.; Yang, K.; Chung, J.S.; Shen, S.; Zhuang, Z. Cell-Permeable Activity-Based Ubiquitin Probes Enable Intracellular Profiling of Human Deubiquitinases. J. Am. Chem. Soc. 2018, 140, 12424–12433. [Google Scholar] [CrossRef]
  71. Safa, N.; Anderson, J.C.; Vaithiyanathan, M.; Pettigrew, J.H.; Pappas, G.A.; Liu, D.; Gauthier, T.J.; Melvin, A.T. CPProtectides: Rapid uptake of well-folded beta-hairpin peptides with enhanced resistance to intracellular degradation. Pept. Sci. (Hoboken) 2019, 111, e24092. [Google Scholar] [CrossRef]
  72. Safa, N.; Pettigrew, J.H.; Gauthier, T.J.; Melvin, A.T. Direct measurement of deubiquitinating enzyme activity in intact cells using a protease-resistant, cell-permeable, peptide-based reporter. Biochem. Eng. J. 2019, 151, 107320. [Google Scholar] [CrossRef]
  73. Panyain, N.; Godinat, A.; Lanyon-Hogg, T.; Lachiondo-Ortega, S.; Will, E.J.; Soudy, C.; Mason, K.; Elkhalifa, S.; Smith, L.M.; Harrigan, J.A. Discovery of a potent and selective covalent inhibitor and activity-based probe for the deubiquitylating enzyme UCHL1, with anti-fibrotic activity. ChemRxiv 2019. [Google Scholar] [CrossRef]
  74. Geurink, P.P.; Kooij, R.; Sapmaz, A.; Liu, S.; Xin, B.-T.; Janssen, G.M.; van Veelen, P.A.; ten Dijke, P.; Ovaa, H. A small-molecule activity-based probe for monitoring ubiquitin C-terminal hydrolase L1 (UCHL1) activity in live cells and zebrafish embryos. BioRxiv 2019, 827642. [Google Scholar] [CrossRef] [Green Version]
  75. Borodovsky, A.; Ovaa, H.; Kolli, N.; Gan-Erdene, T.; Wilkinson, K.D.; Ploegh, H.L.; Kessler, B.M. Chemistry-based functional proteomics reveals novel members of the deubiquitinating enzyme family. Chem. Biol. 2002, 9, 1149–1159. [Google Scholar] [CrossRef] [Green Version]
  76. Love, K.R.; Pandya, R.K.; Spooner, E.; Ploegh, H.L. Ubiquitin C-terminal electrophiles are activity-based probes for identification and mechanistic study of ubiquitin conjugating machinery. ACS Chem. Biol. 2009, 4, 275–287. [Google Scholar] [CrossRef] [Green Version]
  77. McGouran, J.F.; Gaertner, S.R.; Altun, M.; Kramer, H.B.; Kessler, B.M. Deubiquitinating enzyme specificity for ubiquitin chain topology profiled by di-ubiquitin activity probes. Chem. Biol. 2013, 20, 1447–1455. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  78. Wang, T.; Yin, L.; Cooper, E.M.; Lai, M.Y.; Dickey, S.; Pickart, C.M.; Fushman, D.; Wilkinson, K.D.; Cohen, R.E.; Wolberger, C. Evidence for bidentate substrate binding as the basis for the K48 linkage specificity of otubain 1. J. Mol. Biol. 2009, 386, 1011–1023. [Google Scholar] [CrossRef] [Green Version]
  79. Iphofer, A.; Kummer, A.; Nimtz, M.; Ritter, A.; Arnold, T.; Frank, R.; van den Heuvel, J.; Kessler, B.M.; Jansch, L.; Franke, R. Profiling ubiquitin linkage specificities of deubiquitinating enzymes with branched ubiquitin isopeptide probes. Chembiochem 2012, 13, 1416–1420. [Google Scholar] [CrossRef] [PubMed]
  80. Gong, P.; Davidson, G.A.; Gui, W.; Yang, K.; Bozza, W.P.; Zhuang, Z. Activity-based ubiquitin-protein probes reveal target protein specificity of deubiquitinating enzymes. Chem. Sci. 2018, 9, 7859–7865. [Google Scholar] [CrossRef] [Green Version]
  81. Gjonaj, L.; Sapmaz, A.; Gonzalez-Prieto, R.; Vertegaal, A.C.O.; Flierman, D.; Ovaa, H. USP7: Combining tools towards selectivity. Chem. Commun. (Camb) 2019, 55, 5075–5078. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  82. Gjonaj, L.; Sapmaz, A.; Flierman, D.; Janssen, G.M.C.; van Veelen, P.A.; Ovaa, H. Development of a DUB-selective fluorogenic substrate. Chem. Sci. 2019, 10, 10290–10296. [Google Scholar] [CrossRef] [PubMed]
  83. Gao, X.; De Maziere, A.; Iaea, D.B.; Arthur, C.P.; Klumperman, J.; Ciferri, C.; Hannoush, R.N. Visualizing the cellular route of entry of a cystine-knot peptide with Xfect transfection reagent by electron microscopy. Sci. Rep. 2019, 9, 6907. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  84. Etxaniz, A.; Gonzalez-Bullon, D.; Martin, C.; Ostolaza, H. Membrane Repair Mechanisms against Permeabilization by Pore-Forming Toxins. Toxins (Basel) 2018, 10, 234. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  85. D’Arcy, P.; Brnjic, S.; Olofsson, M.H.; Fryknas, M.; Lindsten, K.; De Cesare, M.; Perego, P.; Sadeghi, B.; Hassan, M.; Larsson, R.; et al. Inhibition of proteasome deubiquitinating activity as a new cancer therapy. Nat. Med. 2011, 17, 1636–1640. [Google Scholar] [CrossRef] [PubMed]
  86. Ward, J.A.; Pinto-Fernandez, A.; Cornelissen, L.; Bonham, S.; Diaz-Saez, L.; Riant, O.; Huber, K.V.M.; Kessler, B.M.; Feron, O.; Tate, E.W. Re-Evaluating the Mechanism of Action of alpha, beta-Unsaturated Carbonyl DUB Inhibitors b-AP15 and VLX1570: A Paradigmatic Example of Unspecific Protein Cross-linking with Michael Acceptor Motif-Containing Drugs. J. Med. Chem 2020, 63, 3756–3762. [Google Scholar] [CrossRef] [Green Version]
  87. Shibayama, H.; Takai, E.; Matsumura, I.; Kouno, M.; Morii, E.; Kitamura, Y.; Takeda, J.; Kanakura, Y. Identification of a cytokine-induced antiapoptotic molecule anamorsin essential for definitive hematopoiesis. J. Exp. Med. 2004, 199, 581–592. [Google Scholar] [CrossRef] [Green Version]
  88. Das, T.; Kim, E.E.; Song, E.J. Phosphorylation of USP15 and USP4 Regulates Localization and Spliceosomal Deubiquitination. J. Mol. Biol. 2019, 431, 3900–3912. [Google Scholar] [CrossRef]
  89. Das, D.S.; Das, A.; Ray, A.; Song, Y.; Samur, M.K.; Munshi, N.C.; Chauhan, D.; Anderson, K.C. Blockade of Deubiquitylating Enzyme USP1 Inhibits DNA Repair and Triggers Apoptosis in Multiple Myeloma Cells. Clin. Cancer Res. 2017, 23, 4280–4289. [Google Scholar] [CrossRef] [Green Version]
  90. Lee, J.H.; Lee, M.J. Isolation and Characterization of RNA Aptamers against a Proteasome-Associated Deubiquitylating Enzyme UCH37. Chembiochem 2017, 18, 171–175. [Google Scholar] [CrossRef]
  91. Todi, S.V.; Winborn, B.J.; Scaglione, K.M.; Blount, J.R.; Travis, S.M.; Paulson, H.L. Ubiquitination directly enhances activity of the deubiquitinating enzyme ataxin-3. EMBO J. 2009, 28, 372–382. [Google Scholar] [CrossRef]
  92. Yang, W.L.; Jin, G.; Li, C.F.; Jeong, Y.S.; Moten, A.; Xu, D.; Feng, Z.; Chen, W.; Cai, Z.; Darnay, B.; et al. Cycles of ubiquitination and deubiquitination critically regulate growth factor-mediated activation of Akt signaling. Sci. Signal. 2013, 6, ra3. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  93. Li, X.; Kong, L.; Yang, Q.; Duan, A.; Ju, X.; Cai, B.; Chen, L.; An, T.; Li, Y. Parthenolide inhibits ubiquitin-specific peptidase 7 (USP7), Wnt signaling, and colorectal cancer cell growth. J. Biol. Chem. 2020, 295, 3576–3589. [Google Scholar] [CrossRef] [PubMed]
  94. Pinto-Fernández, A.; Davis, S.; Schofield, A.B.; Scott, H.C.; Zhang, P.; Salah, E.; Mathea, S.; Charles, P.D.; Damianou, A.; Bond, G.; et al. Comprehensive Landscape of Active Deubiquitinating Enzymes Profiled by Advanced Chemoproteomics. Front. Chem. 2019, 7, 592. [Google Scholar] [CrossRef] [PubMed]
  95. Conole, D.; Mondal, M.; Majmudar, J.D.; Tate, E.W. Recent Developments in Cell Permeable Deubiquitinating Enzyme Activity-Based Probes. Front. Chem. 2019, 7, 876. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  96. Heal, W.P.; Dang, T.H.; Tate, E.W. Activity-based probes: Discovering new biology and new drug targets. Chem Soc. Rev. 2011, 40, 246–257. [Google Scholar] [CrossRef]
Ijms 21 05638 g001 550
Figure 1. Schematic overview of in vitro deubiquitination assays. (a) Ubiquitin chain cleavage assay, (b) Ubiquitin-7-aminno-4-methylcoumarin (Ub-AMC), (c) Ubiquitin-aminoluciferin (Ub-AML), (d) Ubiquitin-phospholipase A2 (Ub-PLA2), (e) Ubiquitin-rhodamine110 (Ub-Rho110), (f) Ubiquitin-Lys-5-tetramethylrhodamine-Gly (Ub-Lys-TAMRA-Gly), (g) Fluorescence resonance energy transfer-based di-ubiquitin (FRET-based di-Ub). Ub; ubiquitin, DUB; deubiuquitinating enzyme, ATP; a, NBD C6-HPC; 2-(6-(7-nitrobenz-2-oxa-1,3-diazol-4-yl)amino)hexanoyl-1-hexadecanoyl-sn-glycero-3-phosphocholine, NBD; 7-nitrobenz-2-oxa-1,3-diazole.
Figure 1. Schematic overview of in vitro deubiquitination assays. (a) Ubiquitin chain cleavage assay, (b) Ubiquitin-7-aminno-4-methylcoumarin (Ub-AMC), (c) Ubiquitin-aminoluciferin (Ub-AML), (d) Ubiquitin-phospholipase A2 (Ub-PLA2), (e) Ubiquitin-rhodamine110 (Ub-Rho110), (f) Ubiquitin-Lys-5-tetramethylrhodamine-Gly (Ub-Lys-TAMRA-Gly), (g) Fluorescence resonance energy transfer-based di-ubiquitin (FRET-based di-Ub). Ub; ubiquitin, DUB; deubiuquitinating enzyme, ATP; a, NBD C6-HPC; 2-(6-(7-nitrobenz-2-oxa-1,3-diazol-4-yl)amino)hexanoyl-1-hexadecanoyl-sn-glycero-3-phosphocholine, NBD; 7-nitrobenz-2-oxa-1,3-diazole.
Ijms 21 05638 g001
Ijms 21 05638 g002 550
Figure 2. Schematic overview of deubiquitination assays with mammalian cells. (a) Nickel pull-down assay, (b) Activity-based probes (ABPs). Ub; ubiquitin, His; histidine, DUB; deubiquitinating enzymes, SH; sulfhydryl group
Figure 2. Schematic overview of deubiquitination assays with mammalian cells. (a) Nickel pull-down assay, (b) Activity-based probes (ABPs). Ub; ubiquitin, His; histidine, DUB; deubiquitinating enzymes, SH; sulfhydryl group
Ijms 21 05638 g002
Table
Table 1. Classification of ABPs [61].
Table 1. Classification of ABPs [61].
Reporter TagCys-Reactive Electrophilic Warhead
AffinityFluorescentDirect AdditionConjugate AdditionNucleophilic Substitution
HACy5Nitrile
(Ub-CN)		Vinyl methyl ester(Ub-VME)Chloroethylamine
(Ub-Cl)
BiotinTAMRAPropargyl amide
(Ub-PA/Prg)		Vinyl methyl sulfone
(Ub-VS)		Bromoethylamine
(Ub-Br2)
FlagTERAldehyde
(Ub-al)		Vinyl cyanide
(Ub-CN)		Bromopropylamine
(Ub-Br3)
---Dehydroalanine
(Ub-Dha)		Acyloxymethyl ketone
(Ub-TF3BOK)
----α-Amino-β-lactone
(Ub-Lac)
Table
Table 2. Deubiquitination assays according to detection methods.
Table 2. Deubiquitination assays according to detection methods.
Detection MethodUbiquitin SubstratesRef.
in vitro deubiquitinating assayFluorescenceUb-AMC[30,31,32,33,89]
Ub-PLA2[36,37]
Ub-Rho110[38,39,40,90]
FP-based Ub-Lys-TAMRA-Gly[44,45,46,53]
FRET di-Ub[50,51,52]
LuminescenceUb-AML[34,35]
Gel stainingUbiquitin chain[27,32,77]
Deubiquitinating assay with
mammalian cells		Western blottingUbiquitin chain
(with immunoprecipitated DUB)		[28,29,91]
Nickel pull-down assay[59,60,92]
Activity-based probes[37,62,93]
Mass spectrometryActivity-based probes[37,74,94]
Microscopy (fluorescence)Activity-based probes
(cell permeable only)		[70,95,96]
Table
Table 3. Deubiquitination assays according to experimental purposes.
Table 3. Deubiquitination assays according to experimental purposes.
PurposeDeubiquitination Assays
Substrate specificityNickel pulldown assay
Ubiquitin chain linkage specificityUbiquitin chain cleavage assay, Nickel pulldown assay, FRET di-Ub
KineticsUb-AMC, Ub-AML, Ub-PLA2, Ub-Rho110, FP-based Ub-Lys-TAMRA-Gly, FRET di-Ub
DUB activityUbiquitin chain cleavage assay, Nickel pulldown assay, ABP

Share and Cite

MDPI and ACS Style

Cho, J.; Park, J.; Kim, E.E.; Song, E.J. Assay Systems for Profiling Deubiquitinating Activity. Int. J. Mol. Sci. 2020, 21, 5638. https://doi.org/10.3390/ijms21165638

AMA Style

Cho J, Park J, Kim EE, Song EJ. Assay Systems for Profiling Deubiquitinating Activity. International Journal of Molecular Sciences. 2020; 21(16):5638. https://doi.org/10.3390/ijms21165638

Chicago/Turabian Style

Cho, Jinhong, Jinyoung Park, Eunice EunKyeong Kim, and Eun Joo Song. 2020. "Assay Systems for Profiling Deubiquitinating Activity" International Journal of Molecular Sciences 21, no. 16: 5638. https://doi.org/10.3390/ijms21165638

APA Style

Cho, J., Park, J., Kim, E. E., & Song, E. J. (2020). Assay Systems for Profiling Deubiquitinating Activity. International Journal of Molecular Sciences, 21(16), 5638. https://doi.org/10.3390/ijms21165638

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop