Oct 30 20:35:38.288855 ip-10-0-142-4 systemd[1]: Starting Kubernetes Kubelet...
Oct 30 20:35:38.655537 ip-10-0-142-4 kubenswrapper[2575]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 30 20:35:38.655537 ip-10-0-142-4 kubenswrapper[2575]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Oct 30 20:35:38.655537 ip-10-0-142-4 kubenswrapper[2575]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 30 20:35:38.655537 ip-10-0-142-4 kubenswrapper[2575]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 30 20:35:38.660620 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.660512    2575 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 20:35:38.660620 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.660617    2575 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 20:35:38.660620 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.660623    2575 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 20:35:38.660620 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.660626    2575 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 20:35:38.660868 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.660631    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 20:35:38.660868 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.660634    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 20:35:38.660868 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.660639    2575 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 20:35:38.660868 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.660642    2575 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 20:35:38.660868 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.660646    2575 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 20:35:38.660868 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.660650    2575 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 20:35:38.660868 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.660653    2575 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 20:35:38.660868 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.660657    2575 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 20:35:38.660868 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.660660    2575 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 20:35:38.660868 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.660664    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 20:35:38.660868 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.660668    2575 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 20:35:38.660868 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.660672    2575 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 20:35:38.660868 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.660676    2575 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 20:35:38.660868 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.660680    2575 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 20:35:38.660868 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.660683    2575 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 20:35:38.660868 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.660692    2575 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 20:35:38.660868 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.660697    2575 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 20:35:38.660868 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.660701    2575 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 20:35:38.660868 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.660704    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 20:35:38.660868 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.660708    2575 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 20:35:38.661672 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.660711    2575 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 20:35:38.661672 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.660715    2575 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 20:35:38.661672 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.660719    2575 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 20:35:38.661672 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.660723    2575 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 20:35:38.661672 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.660727    2575 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 20:35:38.661672 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.660731    2575 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 20:35:38.661672 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.660735    2575 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 20:35:38.661672 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.660740    2575 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 20:35:38.661672 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.660743    2575 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 20:35:38.661672 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.660747    2575 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 20:35:38.661672 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.660751    2575 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 20:35:38.661672 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.660756    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 20:35:38.661672 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.660763    2575 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 20:35:38.661672 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.660770    2575 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 20:35:38.661672 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.660776    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 20:35:38.661672 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.660781    2575 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 20:35:38.661672 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.660786    2575 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 20:35:38.661672 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.660791    2575 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 20:35:38.661672 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.660795    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 20:35:38.662420 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.660799    2575 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 20:35:38.662420 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.660804    2575 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 20:35:38.662420 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.660809    2575 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 20:35:38.662420 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.660813    2575 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 20:35:38.662420 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.660817    2575 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 20:35:38.662420 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.660821    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 20:35:38.662420 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.660825    2575 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 20:35:38.662420 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.660830    2575 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 20:35:38.662420 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.660834    2575 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 20:35:38.662420 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.660838    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 20:35:38.662420 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.660843    2575 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 20:35:38.662420 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.660849    2575 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 20:35:38.662420 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.660853    2575 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 20:35:38.662420 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.660857    2575 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 20:35:38.662420 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.660861    2575 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 20:35:38.662420 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.660865    2575 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 20:35:38.662420 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.660869    2575 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 20:35:38.662420 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.660873    2575 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 20:35:38.662420 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.660876    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 20:35:38.662420 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.660880    2575 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 20:35:38.663256 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.660885    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 20:35:38.663256 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.660889    2575 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 20:35:38.663256 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.660893    2575 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 20:35:38.663256 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.660897    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 20:35:38.663256 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.660901    2575 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 20:35:38.663256 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.660907    2575 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 20:35:38.663256 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.660912    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 20:35:38.663256 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.660917    2575 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 20:35:38.663256 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.660921    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 20:35:38.663256 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.660925    2575 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 20:35:38.663256 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.660929    2575 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 20:35:38.663256 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.660934    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 20:35:38.663256 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.660938    2575 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 20:35:38.663256 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.660942    2575 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 20:35:38.663256 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.660948    2575 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 20:35:38.663256 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.660954    2575 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 20:35:38.663256 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.660959    2575 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 20:35:38.663256 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.660963    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 20:35:38.663256 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.660968    2575 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 20:35:38.664098 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.660973    2575 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 20:35:38.664098 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.660977    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 20:35:38.664098 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.660982    2575 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 20:35:38.664098 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.660986    2575 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 20:35:38.664098 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.660991    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 20:35:38.664098 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.660995    2575 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 20:35:38.664098 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.660999    2575 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 20:35:38.664098 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.661003    2575 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 20:35:38.664098 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.661007    2575 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 20:35:38.664098 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.661012    2575 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 20:35:38.664098 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.661015    2575 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 20:35:38.664098 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.661019    2575 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 20:35:38.664098 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.661024    2575 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 20:35:38.664098 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.661028    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 20:35:38.664098 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.661032    2575 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 20:35:38.664098 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.661036    2575 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 20:35:38.664098 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.661040    2575 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 20:35:38.664098 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.661045    2575 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 20:35:38.664098 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.661049    2575 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 20:35:38.664098 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.661053    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 20:35:38.664699 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.661057    2575 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 20:35:38.664699 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.661062    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 20:35:38.664699 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.661067    2575 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 20:35:38.664699 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.661071    2575 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 20:35:38.664699 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.662354    2575 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 20:35:38.664699 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.662364    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 20:35:38.664699 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.662369    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 20:35:38.664699 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.662373    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 20:35:38.664699 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.662378    2575 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 20:35:38.664699 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.662382    2575 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 20:35:38.664699 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.662386    2575 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 20:35:38.664699 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.662391    2575 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 20:35:38.664699 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.662397    2575 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 20:35:38.664699 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.662401    2575 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 20:35:38.664699 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.662405    2575 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 20:35:38.664699 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.662409    2575 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 20:35:38.664699 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.662413    2575 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 20:35:38.664699 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.662417    2575 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 20:35:38.664699 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.662421    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 20:35:38.665178 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.662425    2575 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 20:35:38.665178 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.662429    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 20:35:38.665178 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.662433    2575 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 20:35:38.665178 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.662437    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 20:35:38.665178 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.662441    2575 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 20:35:38.665178 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.662445    2575 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 20:35:38.665178 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.662449    2575 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 20:35:38.665178 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.662454    2575 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 20:35:38.665178 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.662458    2575 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 20:35:38.665178 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.662463    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 20:35:38.665178 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.662467    2575 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 20:35:38.665178 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.662472    2575 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 20:35:38.665178 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.662476    2575 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 20:35:38.665178 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.662481    2575 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 20:35:38.665178 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.662485    2575 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 20:35:38.665178 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.662489    2575 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 20:35:38.665178 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.662493    2575 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 20:35:38.665178 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.662498    2575 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 20:35:38.665178 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.662502    2575 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 20:35:38.665178 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.662506    2575 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 20:35:38.665958 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.662510    2575 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 20:35:38.665958 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.662514    2575 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 20:35:38.665958 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.662519    2575 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 20:35:38.665958 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.662523    2575 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 20:35:38.665958 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.662527    2575 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 20:35:38.665958 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.662532    2575 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 20:35:38.665958 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.662536    2575 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 20:35:38.665958 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.662541    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 20:35:38.665958 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.662544    2575 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 20:35:38.665958 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.662549    2575 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 20:35:38.665958 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.662553    2575 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 20:35:38.665958 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.662557    2575 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 20:35:38.665958 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.662561    2575 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 20:35:38.665958 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.662565    2575 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 20:35:38.665958 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.662569    2575 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 20:35:38.665958 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.662590    2575 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 20:35:38.665958 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.662595    2575 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 20:35:38.665958 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.662598    2575 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 20:35:38.665958 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.662602    2575 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 20:35:38.665958 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.662606    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 20:35:38.666864 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.662611    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 20:35:38.666864 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.662614    2575 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 20:35:38.666864 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.662619    2575 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 20:35:38.666864 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.662623    2575 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 20:35:38.666864 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.662627    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 20:35:38.666864 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.662631    2575 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 20:35:38.666864 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.662635    2575 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 20:35:38.666864 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.662639    2575 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 20:35:38.666864 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.662643    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 20:35:38.666864 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.662647    2575 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 20:35:38.666864 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.662652    2575 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 20:35:38.666864 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.662656    2575 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 20:35:38.666864 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.662660    2575 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 20:35:38.666864 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.662664    2575 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 20:35:38.666864 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.662668    2575 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 20:35:38.666864 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.662672    2575 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 20:35:38.666864 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.662676    2575 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 20:35:38.666864 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.662681    2575 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 20:35:38.666864 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.662686    2575 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 20:35:38.666864 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.662690    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 20:35:38.667685 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.662694    2575 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 20:35:38.667685 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.662698    2575 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 20:35:38.667685 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.662702    2575 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 20:35:38.667685 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.662706    2575 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 20:35:38.667685 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.662710    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 20:35:38.667685 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.662718    2575 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 20:35:38.667685 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.662724    2575 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 20:35:38.667685 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.662728    2575 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 20:35:38.667685 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.662732    2575 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 20:35:38.667685 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.662736    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 20:35:38.667685 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.662740    2575 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 20:35:38.667685 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.662744    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 20:35:38.667685 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.662749    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 20:35:38.667685 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.662752    2575 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 20:35:38.667685 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.662757    2575 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 20:35:38.667685 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.662761    2575 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 20:35:38.667685 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.662766    2575 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 20:35:38.667685 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.662770    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 20:35:38.667685 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.662775    2575 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 20:35:38.668126 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.662781    2575 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 20:35:38.668126 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.662788    2575 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 20:35:38.668126 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.662794    2575 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 20:35:38.668126 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.662803    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 20:35:38.668126 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.662808    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 20:35:38.668126 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.662812    2575 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 20:35:38.668126 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.662816    2575 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 20:35:38.668126 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.662820    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 20:35:38.668126 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.662824    2575 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 20:35:38.668126 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.662828    2575 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 20:35:38.668126 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.662832    2575 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 20:35:38.668126 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.662836    2575 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 20:35:38.668126 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.663720    2575 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 20:35:38.668126 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.663730    2575 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 20:35:38.668126 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.663735    2575 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 20:35:38.668126 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.663739    2575 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 20:35:38.668126 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.663744    2575 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 20:35:38.668126 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.663749    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 20:35:38.668126 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.663757    2575 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 20:35:38.668714 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.663761    2575 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 20:35:38.668714 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.663768    2575 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 20:35:38.668714 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.663775    2575 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 20:35:38.668714 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.663779    2575 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 20:35:38.668714 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.663784    2575 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 20:35:38.668714 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.663788    2575 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 20:35:38.668714 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.663792    2575 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 20:35:38.668714 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.663797    2575 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 20:35:38.668714 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.663801    2575 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 20:35:38.668714 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.663806    2575 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 20:35:38.668714 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.663810    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 20:35:38.668714 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.663814    2575 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 20:35:38.668714 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.663818    2575 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 20:35:38.668714 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.663822    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 20:35:38.668714 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.663826    2575 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 20:35:38.668714 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.663831    2575 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 20:35:38.668714 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.663835    2575 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 20:35:38.668714 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.663839    2575 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 20:35:38.668714 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.663843    2575 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 20:35:38.669240 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.663848    2575 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 20:35:38.669240 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.663852    2575 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 20:35:38.669240 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.663856    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 20:35:38.669240 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.663860    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 20:35:38.669240 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.663864    2575 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 20:35:38.669240 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.663869    2575 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 20:35:38.669240 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.663874    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 20:35:38.669240 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.663878    2575 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 20:35:38.669240 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.663882    2575 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 20:35:38.669240 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.663887    2575 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 20:35:38.669240 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.663891    2575 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 20:35:38.669240 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.663895    2575 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 20:35:38.669240 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.663902    2575 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 20:35:38.669240 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.663906    2575 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 20:35:38.669240 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.663910    2575 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 20:35:38.669240 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.663914    2575 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 20:35:38.669240 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.663918    2575 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 20:35:38.669240 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.663923    2575 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 20:35:38.669240 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.663927    2575 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 20:35:38.669240 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.663931    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 20:35:38.669728 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.663935    2575 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 20:35:38.669728 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.663939    2575 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 20:35:38.669728 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.663944    2575 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 20:35:38.669728 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.663949    2575 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 20:35:38.669728 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.663953    2575 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 20:35:38.669728 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.663957    2575 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 20:35:38.669728 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.663961    2575 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 20:35:38.669728 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.663966    2575 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 20:35:38.669728 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.663970    2575 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 20:35:38.669728 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.663974    2575 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 20:35:38.669728 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.663978    2575 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 20:35:38.669728 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.663982    2575 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 20:35:38.669728 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.663986    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 20:35:38.669728 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.663991    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 20:35:38.669728 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.663995    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 20:35:38.669728 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.663999    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 20:35:38.669728 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.664003    2575 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 20:35:38.669728 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.664007    2575 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 20:35:38.669728 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.664011    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 20:35:38.670253 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.664016    2575 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 20:35:38.670253 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.664020    2575 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 20:35:38.670253 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.664024    2575 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 20:35:38.670253 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.664029    2575 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 20:35:38.670253 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.664033    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 20:35:38.670253 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.664038    2575 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 20:35:38.670253 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.664043    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 20:35:38.670253 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.664047    2575 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 20:35:38.670253 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.664051    2575 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 20:35:38.670253 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.664054    2575 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 20:35:38.670253 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.664061    2575 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 20:35:38.670253 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.664066    2575 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 20:35:38.670253 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.664070    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 20:35:38.670253 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.664074    2575 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 20:35:38.670253 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.664078    2575 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 20:35:38.670253 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.664082    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 20:35:38.670253 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.664086    2575 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 20:35:38.670253 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.664092    2575 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 20:35:38.670253 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.664097    2575 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 20:35:38.670710 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.664102    2575 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 20:35:38.670710 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.664106    2575 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 20:35:38.670710 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.664110    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 20:35:38.670710 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.664113    2575 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 20:35:38.670710 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.664117    2575 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 20:35:38.670710 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.664121    2575 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 20:35:38.670710 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.664125    2575 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 20:35:38.670710 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.664129    2575 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 20:35:38.670710 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.664133    2575 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 20:35:38.670710 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.664138    2575 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 20:35:38.670710 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.664142    2575 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 20:35:38.670710 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.664146    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 20:35:38.670710 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.664150    2575 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 20:35:38.670710 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.664154    2575 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 20:35:38.670710 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.664160    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 20:35:38.670710 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.664164    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 20:35:38.670710 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.664167    2575 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 20:35:38.670710 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.664172    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 20:35:38.670710 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.664176    2575 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 20:35:38.670710 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.664180    2575 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 20:35:38.671168 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.664184    2575 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 20:35:38.671168 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.664190    2575 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 20:35:38.671168 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.665271    2575 flags.go:64] FLAG: --address="0.0.0.0"
Oct 30 20:35:38.671168 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.665294    2575 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Oct 30 20:35:38.671168 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.665305    2575 flags.go:64] FLAG: --anonymous-auth="true"
Oct 30 20:35:38.671168 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.665313    2575 flags.go:64] FLAG: --application-metrics-count-limit="100"
Oct 30 20:35:38.671168 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.665320    2575 flags.go:64] FLAG: --authentication-token-webhook="false"
Oct 30 20:35:38.671168 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.665325    2575 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Oct 30 20:35:38.671168 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.665332    2575 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Oct 30 20:35:38.671168 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.665338    2575 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Oct 30 20:35:38.671168 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.665344    2575 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Oct 30 20:35:38.671168 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.665349    2575 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Oct 30 20:35:38.671168 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.665354    2575 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Oct 30 20:35:38.671168 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.665360    2575 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Oct 30 20:35:38.671168 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.665364    2575 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Oct 30 20:35:38.671168 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.665369    2575 flags.go:64] FLAG: --cgroup-root=""
Oct 30 20:35:38.671168 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.665374    2575 flags.go:64] FLAG: --cgroups-per-qos="true"
Oct 30 20:35:38.671168 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.665378    2575 flags.go:64] FLAG: --client-ca-file=""
Oct 30 20:35:38.671168 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.665383    2575 flags.go:64] FLAG: --cloud-provider="external"
Oct 30 20:35:38.671168 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.665388    2575 flags.go:64] FLAG: --cluster-dns="[]"
Oct 30 20:35:38.671168 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.665396    2575 flags.go:64] FLAG: --cluster-domain=""
Oct 30 20:35:38.671168 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.665401    2575 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Oct 30 20:35:38.671168 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.665405    2575 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Oct 30 20:35:38.671168 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.665410    2575 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Oct 30 20:35:38.671747 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.665416    2575 flags.go:64] FLAG: --container-log-max-files="5"
Oct 30 20:35:38.671747 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.665423    2575 flags.go:64] FLAG: --container-log-max-size="10Mi"
Oct 30 20:35:38.671747 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.665428    2575 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Oct 30 20:35:38.671747 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.665434    2575 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Oct 30 20:35:38.671747 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.665439    2575 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Oct 30 20:35:38.671747 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.665444    2575 flags.go:64] FLAG: --contention-profiling="false"
Oct 30 20:35:38.671747 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.665449    2575 flags.go:64] FLAG: --cpu-cfs-quota="true"
Oct 30 20:35:38.671747 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.665453    2575 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Oct 30 20:35:38.671747 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.665458    2575 flags.go:64] FLAG: --cpu-manager-policy="none"
Oct 30 20:35:38.671747 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.665463    2575 flags.go:64] FLAG: --cpu-manager-policy-options=""
Oct 30 20:35:38.671747 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.665470    2575 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Oct 30 20:35:38.671747 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.665475    2575 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Oct 30 20:35:38.671747 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.665479    2575 flags.go:64] FLAG: --enable-debugging-handlers="true"
Oct 30 20:35:38.671747 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.665484    2575 flags.go:64] FLAG: --enable-load-reader="false"
Oct 30 20:35:38.671747 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.665489    2575 flags.go:64] FLAG: --enable-server="true"
Oct 30 20:35:38.671747 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.665493    2575 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Oct 30 20:35:38.671747 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.665500    2575 flags.go:64] FLAG: --event-burst="100"
Oct 30 20:35:38.671747 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.665506    2575 flags.go:64] FLAG: --event-qps="50"
Oct 30 20:35:38.671747 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.665510    2575 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Oct 30 20:35:38.671747 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.665515    2575 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Oct 30 20:35:38.671747 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.665520    2575 flags.go:64] FLAG: --eviction-hard=""
Oct 30 20:35:38.671747 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.665526    2575 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Oct 30 20:35:38.671747 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.665531    2575 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Oct 30 20:35:38.671747 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.665536    2575 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Oct 30 20:35:38.671747 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.665541    2575 flags.go:64] FLAG: --eviction-soft=""
Oct 30 20:35:38.672327 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.665546    2575 flags.go:64] FLAG: --eviction-soft-grace-period=""
Oct 30 20:35:38.672327 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.665550    2575 flags.go:64] FLAG: --exit-on-lock-contention="false"
Oct 30 20:35:38.672327 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.665555    2575 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Oct 30 20:35:38.672327 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.665560    2575 flags.go:64] FLAG: --experimental-mounter-path=""
Oct 30 20:35:38.672327 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.665564    2575 flags.go:64] FLAG: --fail-cgroupv1="true"
Oct 30 20:35:38.672327 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.665569    2575 flags.go:64] FLAG: --fail-swap-on="true"
Oct 30 20:35:38.672327 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.665589    2575 flags.go:64] FLAG: --feature-gates=""
Oct 30 20:35:38.672327 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.665596    2575 flags.go:64] FLAG: --file-check-frequency="20s"
Oct 30 20:35:38.672327 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.665601    2575 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Oct 30 20:35:38.672327 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.665606    2575 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Oct 30 20:35:38.672327 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.665611    2575 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Oct 30 20:35:38.672327 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.665617    2575 flags.go:64] FLAG: --healthz-port="10248"
Oct 30 20:35:38.672327 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.665623    2575 flags.go:64] FLAG: --help="false"
Oct 30 20:35:38.672327 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.665627    2575 flags.go:64] FLAG: --hostname-override="ip-10-0-142-4.us-west-1.compute.internal"
Oct 30 20:35:38.672327 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.665632    2575 flags.go:64] FLAG: --housekeeping-interval="10s"
Oct 30 20:35:38.672327 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.665636    2575 flags.go:64] FLAG: --http-check-frequency="20s"
Oct 30 20:35:38.672327 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.665641    2575 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Oct 30 20:35:38.672327 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.665647    2575 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Oct 30 20:35:38.672327 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.665653    2575 flags.go:64] FLAG: --image-gc-high-threshold="85"
Oct 30 20:35:38.672327 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.665657    2575 flags.go:64] FLAG: --image-gc-low-threshold="80"
Oct 30 20:35:38.672327 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.665662    2575 flags.go:64] FLAG: --image-service-endpoint=""
Oct 30 20:35:38.672327 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.665667    2575 flags.go:64] FLAG: --kernel-memcg-notification="false"
Oct 30 20:35:38.672327 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.665672    2575 flags.go:64] FLAG: --kube-api-burst="100"
Oct 30 20:35:38.672870 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.665676    2575 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Oct 30 20:35:38.672870 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.665681    2575 flags.go:64] FLAG: --kube-api-qps="50"
Oct 30 20:35:38.672870 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.665686    2575 flags.go:64] FLAG: --kube-reserved=""
Oct 30 20:35:38.672870 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.665691    2575 flags.go:64] FLAG: --kube-reserved-cgroup=""
Oct 30 20:35:38.672870 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.665695    2575 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Oct 30 20:35:38.672870 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.665700    2575 flags.go:64] FLAG: --kubelet-cgroups=""
Oct 30 20:35:38.672870 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.665704    2575 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Oct 30 20:35:38.672870 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.665709    2575 flags.go:64] FLAG: --lock-file=""
Oct 30 20:35:38.672870 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.665713    2575 flags.go:64] FLAG: --log-cadvisor-usage="false"
Oct 30 20:35:38.672870 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.665718    2575 flags.go:64] FLAG: --log-flush-frequency="5s"
Oct 30 20:35:38.672870 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.665723    2575 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Oct 30 20:35:38.672870 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.665732    2575 flags.go:64] FLAG: --log-json-split-stream="false"
Oct 30 20:35:38.672870 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.665737    2575 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Oct 30 20:35:38.672870 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.665741    2575 flags.go:64] FLAG: --log-text-split-stream="false"
Oct 30 20:35:38.672870 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.665746    2575 flags.go:64] FLAG: --logging-format="text"
Oct 30 20:35:38.672870 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.665751    2575 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Oct 30 20:35:38.672870 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.665756    2575 flags.go:64] FLAG: --make-iptables-util-chains="true"
Oct 30 20:35:38.672870 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.665760    2575 flags.go:64] FLAG: --manifest-url=""
Oct 30 20:35:38.672870 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.665765    2575 flags.go:64] FLAG: --manifest-url-header=""
Oct 30 20:35:38.672870 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.665772    2575 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Oct 30 20:35:38.672870 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.665776    2575 flags.go:64] FLAG: --max-open-files="1000000"
Oct 30 20:35:38.672870 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.665783    2575 flags.go:64] FLAG: --max-pods="110"
Oct 30 20:35:38.672870 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.665788    2575 flags.go:64] FLAG: --maximum-dead-containers="-1"
Oct 30 20:35:38.672870 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.665793    2575 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Oct 30 20:35:38.672870 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.665797    2575 flags.go:64] FLAG: --memory-manager-policy="None"
Oct 30 20:35:38.673521 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.665802    2575 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Oct 30 20:35:38.673521 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.665807    2575 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Oct 30 20:35:38.673521 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.665812    2575 flags.go:64] FLAG: --node-ip="0.0.0.0"
Oct 30 20:35:38.673521 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.665817    2575 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Oct 30 20:35:38.673521 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.665827    2575 flags.go:64] FLAG: --node-status-max-images="50"
Oct 30 20:35:38.673521 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.665832    2575 flags.go:64] FLAG: --node-status-update-frequency="10s"
Oct 30 20:35:38.673521 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.665836    2575 flags.go:64] FLAG: --oom-score-adj="-999"
Oct 30 20:35:38.673521 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.665842    2575 flags.go:64] FLAG: --pod-cidr=""
Oct 30 20:35:38.673521 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.665846    2575 flags.go:64] FLAG: --pod-manifest-path=""
Oct 30 20:35:38.673521 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.665851    2575 flags.go:64] FLAG: --pod-max-pids="-1"
Oct 30 20:35:38.673521 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.665855    2575 flags.go:64] FLAG: --pods-per-core="0"
Oct 30 20:35:38.673521 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.665860    2575 flags.go:64] FLAG: --port="10250"
Oct 30 20:35:38.673521 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.665864    2575 flags.go:64] FLAG: --protect-kernel-defaults="false"
Oct 30 20:35:38.673521 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.665869    2575 flags.go:64] FLAG: --provider-id="aws:///us-west-1a/i-0435ad279ec7cbbbb"
Oct 30 20:35:38.673521 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.665874    2575 flags.go:64] FLAG: --qos-reserved=""
Oct 30 20:35:38.673521 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.665879    2575 flags.go:64] FLAG: --read-only-port="10255"
Oct 30 20:35:38.673521 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.665884    2575 flags.go:64] FLAG: --register-node="true"
Oct 30 20:35:38.673521 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.665889    2575 flags.go:64] FLAG: --register-with-taints=""
Oct 30 20:35:38.673521 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.665898    2575 flags.go:64] FLAG: --registry-burst="10"
Oct 30 20:35:38.673521 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.665903    2575 flags.go:64] FLAG: --registry-qps="5"
Oct 30 20:35:38.673521 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.665907    2575 flags.go:64] FLAG: --reserved-cpus=""
Oct 30 20:35:38.673521 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.665912    2575 flags.go:64] FLAG: --reserved-memory=""
Oct 30 20:35:38.673521 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.665918    2575 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Oct 30 20:35:38.673521 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.665923    2575 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Oct 30 20:35:38.673521 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.665927    2575 flags.go:64] FLAG: --rotate-certificates="false"
Oct 30 20:35:38.673521 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.665932    2575 flags.go:64] FLAG: --rotate-server-certificates="false"
Oct 30 20:35:38.674130 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.665937    2575 flags.go:64] FLAG: --runonce="false"
Oct 30 20:35:38.674130 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.665942    2575 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Oct 30 20:35:38.674130 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.665947    2575 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Oct 30 20:35:38.674130 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.665952    2575 flags.go:64] FLAG: --seccomp-default="false"
Oct 30 20:35:38.674130 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.665957    2575 flags.go:64] FLAG: --serialize-image-pulls="true"
Oct 30 20:35:38.674130 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.665961    2575 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Oct 30 20:35:38.674130 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.665966    2575 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Oct 30 20:35:38.674130 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.665970    2575 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Oct 30 20:35:38.674130 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.665977    2575 flags.go:64] FLAG: --storage-driver-password="root"
Oct 30 20:35:38.674130 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.665982    2575 flags.go:64] FLAG: --storage-driver-secure="false"
Oct 30 20:35:38.674130 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.665986    2575 flags.go:64] FLAG: --storage-driver-table="stats"
Oct 30 20:35:38.674130 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.665991    2575 flags.go:64] FLAG: --storage-driver-user="root"
Oct 30 20:35:38.674130 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.665996    2575 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Oct 30 20:35:38.674130 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.666001    2575 flags.go:64] FLAG: --sync-frequency="1m0s"
Oct 30 20:35:38.674130 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.666006    2575 flags.go:64] FLAG: --system-cgroups=""
Oct 30 20:35:38.674130 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.666011    2575 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Oct 30 20:35:38.674130 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.666019    2575 flags.go:64] FLAG: --system-reserved-cgroup=""
Oct 30 20:35:38.674130 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.666024    2575 flags.go:64] FLAG: --tls-cert-file=""
Oct 30 20:35:38.674130 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.666028    2575 flags.go:64] FLAG: --tls-cipher-suites="[]"
Oct 30 20:35:38.674130 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.666041    2575 flags.go:64] FLAG: --tls-min-version=""
Oct 30 20:35:38.674130 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.666046    2575 flags.go:64] FLAG: --tls-private-key-file=""
Oct 30 20:35:38.674130 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.666051    2575 flags.go:64] FLAG: --topology-manager-policy="none"
Oct 30 20:35:38.674130 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.666056    2575 flags.go:64] FLAG: --topology-manager-policy-options=""
Oct 30 20:35:38.674130 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.666060    2575 flags.go:64] FLAG: --topology-manager-scope="container"
Oct 30 20:35:38.674130 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.666068    2575 flags.go:64] FLAG: --v="2"
Oct 30 20:35:38.674723 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.666075    2575 flags.go:64] FLAG: --version="false"
Oct 30 20:35:38.674723 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.666082    2575 flags.go:64] FLAG: --vmodule=""
Oct 30 20:35:38.674723 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.666088    2575 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Oct 30 20:35:38.674723 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.666093    2575 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Oct 30 20:35:38.674723 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.666328    2575 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 20:35:38.674723 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.666335    2575 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 20:35:38.674723 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.666340    2575 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 20:35:38.674723 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.666344    2575 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 20:35:38.674723 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.666348    2575 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 20:35:38.674723 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.666353    2575 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 20:35:38.674723 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.666357    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 20:35:38.674723 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.666362    2575 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 20:35:38.674723 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.666366    2575 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 20:35:38.674723 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.666370    2575 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 20:35:38.674723 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.666375    2575 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 20:35:38.674723 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.666381    2575 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 20:35:38.674723 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.666386    2575 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 20:35:38.674723 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.666391    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 20:35:38.674723 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.666395    2575 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 20:35:38.674723 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.666399    2575 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 20:35:38.674723 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.666404    2575 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 20:35:38.675207 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.666409    2575 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 20:35:38.675207 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.666413    2575 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 20:35:38.675207 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.666418    2575 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 20:35:38.675207 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.666422    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 20:35:38.675207 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.666426    2575 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 20:35:38.675207 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.666430    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 20:35:38.675207 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.666435    2575 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 20:35:38.675207 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.666439    2575 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 20:35:38.675207 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.666444    2575 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 20:35:38.675207 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.666448    2575 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 20:35:38.675207 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.666454    2575 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 20:35:38.675207 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.666458    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 20:35:38.675207 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.666465    2575 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 20:35:38.675207 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.666471    2575 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 20:35:38.675207 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.666475    2575 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 20:35:38.675207 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.666479    2575 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 20:35:38.675207 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.666483    2575 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 20:35:38.675207 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.666487    2575 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 20:35:38.675207 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.666492    2575 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 20:35:38.675207 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.666496    2575 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 20:35:38.675676 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.666500    2575 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 20:35:38.675676 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.666504    2575 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 20:35:38.675676 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.666508    2575 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 20:35:38.675676 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.666513    2575 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 20:35:38.675676 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.666518    2575 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 20:35:38.675676 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.666522    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 20:35:38.675676 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.666528    2575 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 20:35:38.675676 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.666533    2575 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 20:35:38.675676 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.666537    2575 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 20:35:38.675676 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.666541    2575 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 20:35:38.675676 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.666545    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 20:35:38.675676 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.666549    2575 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 20:35:38.675676 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.666553    2575 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 20:35:38.675676 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.666558    2575 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 20:35:38.675676 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.666562    2575 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 20:35:38.675676 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.666566    2575 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 20:35:38.675676 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.666570    2575 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 20:35:38.675676 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.666592    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 20:35:38.675676 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.666596    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 20:35:38.676144 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.666599    2575 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 20:35:38.676144 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.666604    2575 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 20:35:38.676144 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.666608    2575 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 20:35:38.676144 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.666613    2575 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 20:35:38.676144 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.666617    2575 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 20:35:38.676144 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.666621    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 20:35:38.676144 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.666626    2575 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 20:35:38.676144 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.666630    2575 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 20:35:38.676144 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.666634    2575 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 20:35:38.676144 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.666639    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 20:35:38.676144 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.666643    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 20:35:38.676144 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.666647    2575 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 20:35:38.676144 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.666651    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 20:35:38.676144 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.666655    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 20:35:38.676144 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.666659    2575 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 20:35:38.676144 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.666663    2575 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 20:35:38.676144 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.666667    2575 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 20:35:38.676144 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.666675    2575 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 20:35:38.676144 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.666682    2575 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 20:35:38.676648 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.666690    2575 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 20:35:38.676648 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.666695    2575 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 20:35:38.676648 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.666699    2575 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 20:35:38.676648 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.666703    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 20:35:38.676648 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.666708    2575 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 20:35:38.676648 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.666712    2575 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 20:35:38.676648 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.666717    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 20:35:38.676648 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.666721    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 20:35:38.676648 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.666724    2575 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 20:35:38.676648 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.666729    2575 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 20:35:38.676648 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.666733    2575 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 20:35:38.676648 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.666737    2575 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 20:35:38.676648 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.666741    2575 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 20:35:38.676648 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.666745    2575 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 20:35:38.676648 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.666749    2575 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 20:35:38.676648 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.666754    2575 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 20:35:38.676648 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.666759    2575 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 20:35:38.676648 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.666764    2575 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 20:35:38.676648 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.666768    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 20:35:38.676648 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.666772    2575 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 20:35:38.677110 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.666777    2575 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 20:35:38.677110 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.666781    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 20:35:38.677110 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.666785    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 20:35:38.677110 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.666789    2575 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 20:35:38.677110 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.666793    2575 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 20:35:38.677110 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.666797    2575 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 20:35:38.677110 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.666802    2575 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 20:35:38.677110 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.666806    2575 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 20:35:38.677110 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.666810    2575 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 20:35:38.677110 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.666814    2575 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 20:35:38.677110 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.666818    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 20:35:38.677110 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.666906    2575 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 30 20:35:38.677110 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.666977    2575 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 20:35:38.677110 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.666987    2575 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 20:35:38.677110 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.666993    2575 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 20:35:38.677110 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.666997    2575 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 20:35:38.677475 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.667002    2575 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 20:35:38.677475 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.667007    2575 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 20:35:38.677475 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.667011    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 20:35:38.677475 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.667015    2575 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 20:35:38.677475 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.667019    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 20:35:38.677475 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.667024    2575 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 20:35:38.677475 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.667028    2575 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 20:35:38.677475 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.667033    2575 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 20:35:38.677475 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.667037    2575 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 20:35:38.677475 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.667041    2575 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 20:35:38.677475 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.667045    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 20:35:38.677475 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.667051    2575 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 20:35:38.677475 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.667059    2575 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 20:35:38.677475 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.667064    2575 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 20:35:38.677475 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.667068    2575 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 20:35:38.677475 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.667073    2575 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 20:35:38.677475 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.667077    2575 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 20:35:38.677475 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.667082    2575 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 20:35:38.677475 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.667086    2575 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 20:35:38.677475 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.667090    2575 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 20:35:38.677955 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.667095    2575 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 20:35:38.677955 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.667099    2575 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 20:35:38.677955 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.667103    2575 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 20:35:38.677955 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.667107    2575 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 20:35:38.677955 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.667112    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 20:35:38.677955 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.667117    2575 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 20:35:38.677955 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.667121    2575 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 20:35:38.677955 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.667125    2575 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 20:35:38.677955 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.667131    2575 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 20:35:38.677955 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.667136    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 20:35:38.677955 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.667140    2575 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 20:35:38.677955 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.667144    2575 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 20:35:38.677955 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.667149    2575 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 20:35:38.677955 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.667153    2575 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 20:35:38.677955 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.667157    2575 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 20:35:38.677955 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.667161    2575 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 20:35:38.677955 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.667165    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 20:35:38.677955 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.667169    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 20:35:38.677955 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.667173    2575 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 20:35:38.678467 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.667177    2575 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 20:35:38.678467 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.667180    2575 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 20:35:38.678467 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.667185    2575 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 20:35:38.678467 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.667189    2575 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 20:35:38.678467 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.667193    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 20:35:38.678467 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.667199    2575 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 20:35:38.678467 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.667203    2575 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 20:35:38.678467 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.667207    2575 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 20:35:38.678467 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.667212    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 20:35:38.678467 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.667216    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 20:35:38.678467 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.667219    2575 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 20:35:38.678467 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.667224    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 20:35:38.678467 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.667227    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 20:35:38.678467 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.667232    2575 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 20:35:38.678467 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.667236    2575 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 20:35:38.678467 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.667240    2575 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 20:35:38.678467 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.667246    2575 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 20:35:38.678467 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.667252    2575 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 20:35:38.678467 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.667257    2575 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 20:35:38.678924 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.667261    2575 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 20:35:38.678924 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.667265    2575 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 20:35:38.678924 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.667269    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 20:35:38.678924 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.667276    2575 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 20:35:38.678924 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.667280    2575 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 20:35:38.678924 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.667284    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 20:35:38.678924 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.667288    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 20:35:38.678924 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.667292    2575 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 20:35:38.678924 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.667296    2575 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 20:35:38.678924 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.667300    2575 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 20:35:38.678924 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.667305    2575 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 20:35:38.678924 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.667309    2575 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 20:35:38.678924 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.667313    2575 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 20:35:38.678924 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.667317    2575 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 20:35:38.678924 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.667321    2575 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 20:35:38.678924 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.667325    2575 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 20:35:38.678924 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.667329    2575 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 20:35:38.678924 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.667333    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 20:35:38.678924 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.667339    2575 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 20:35:38.678924 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.667343    2575 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 20:35:38.679381 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.667348    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 20:35:38.679381 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.667353    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 20:35:38.679381 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.667358    2575 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 20:35:38.679381 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.667362    2575 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 20:35:38.679381 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.667366    2575 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 20:35:38.679381 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.667370    2575 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 20:35:38.679381 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.667374    2575 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 20:35:38.679381 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.667379    2575 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 20:35:38.679381 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.667382    2575 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 20:35:38.679381 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.667386    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 20:35:38.679381 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.667390    2575 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 20:35:38.679381 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.667395    2575 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 20:35:38.679381 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.667399    2575 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 20:35:38.679381 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.667403    2575 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 20:35:38.679381 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.667407    2575 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 20:35:38.679381 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.667413    2575 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 20:35:38.679381 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.667426    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 20:35:38.679381 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.667430    2575 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 20:35:38.679381 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.667438    2575 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 20:35:38.679828 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.667443    2575 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 20:35:38.679828 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.667447    2575 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 20:35:38.679828 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.667451    2575 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 20:35:38.679828 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.667455    2575 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 20:35:38.679828 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.667459    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 20:35:38.679828 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.675394    2575 server.go:525] "Kubelet version" kubeletVersion="v1.35.9"
Oct 30 20:35:38.679828 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.675408    2575 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Oct 30 20:35:38.679828 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.675424    2575 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Oct 30 20:35:38.679828 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.675428    2575 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Oct 30 20:35:38.679828 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.675483    2575 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 20:35:38.679828 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.675489    2575 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 20:35:38.679828 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.675493    2575 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 20:35:38.679828 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.675497    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 20:35:38.679828 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.675499    2575 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 20:35:38.679828 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.675502    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 20:35:38.679828 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.675505    2575 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 20:35:38.679828 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.675508    2575 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 20:35:38.679828 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.675510    2575 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 20:35:38.679828 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.675513    2575 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 20:35:38.679828 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.675516    2575 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 20:35:38.680278 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.675518    2575 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 20:35:38.680278 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.675521    2575 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 20:35:38.680278 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.675524    2575 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 20:35:38.680278 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.675526    2575 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 20:35:38.680278 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.675529    2575 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 20:35:38.680278 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.675531    2575 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 20:35:38.680278 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.675534    2575 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 20:35:38.680278 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.675536    2575 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 20:35:38.680278 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.675539    2575 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 20:35:38.680278 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.675542    2575 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 20:35:38.680278 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.675545    2575 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 20:35:38.680278 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.675547    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 20:35:38.680278 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.675550    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 20:35:38.680278 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.675552    2575 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 20:35:38.680278 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.675555    2575 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 20:35:38.680278 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.675558    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 20:35:38.680278 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.675561    2575 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 20:35:38.680278 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.675563    2575 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 20:35:38.680278 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.675566    2575 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 20:35:38.680278 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.675570    2575 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 20:35:38.680791 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.675572    2575 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 20:35:38.680791 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.675589    2575 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 20:35:38.680791 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.675592    2575 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 20:35:38.680791 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.675595    2575 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 20:35:38.680791 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.675598    2575 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 20:35:38.680791 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.675600    2575 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 20:35:38.680791 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.675603    2575 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 20:35:38.680791 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.675605    2575 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 20:35:38.680791 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.675608    2575 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 20:35:38.680791 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.675610    2575 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 20:35:38.680791 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.675613    2575 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 20:35:38.680791 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.675616    2575 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 20:35:38.680791 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.675619    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 20:35:38.680791 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.675621    2575 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 20:35:38.680791 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.675624    2575 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 20:35:38.680791 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.675626    2575 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 20:35:38.680791 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.675629    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 20:35:38.680791 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.675631    2575 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 20:35:38.680791 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.675634    2575 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 20:35:38.680791 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.675636    2575 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 20:35:38.681267 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.675639    2575 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 20:35:38.681267 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.675643    2575 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 20:35:38.681267 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.675647    2575 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 20:35:38.681267 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.675650    2575 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 20:35:38.681267 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.675653    2575 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 20:35:38.681267 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.675655    2575 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 20:35:38.681267 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.675658    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 20:35:38.681267 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.675660    2575 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 20:35:38.681267 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.675663    2575 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 20:35:38.681267 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.675665    2575 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 20:35:38.681267 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.675669    2575 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 20:35:38.681267 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.675672    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 20:35:38.681267 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.675674    2575 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 20:35:38.681267 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.675677    2575 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 20:35:38.681267 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.675679    2575 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 20:35:38.681267 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.675682    2575 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 20:35:38.681267 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.675685    2575 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 20:35:38.681267 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.675687    2575 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 20:35:38.681267 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.675690    2575 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 20:35:38.681715 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.675692    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 20:35:38.681715 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.675695    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 20:35:38.681715 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.675697    2575 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 20:35:38.681715 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.675700    2575 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 20:35:38.681715 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.675703    2575 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 20:35:38.681715 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.675705    2575 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 20:35:38.681715 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.675708    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 20:35:38.681715 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.675710    2575 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 20:35:38.681715 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.675712    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 20:35:38.681715 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.675715    2575 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 20:35:38.681715 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.675719    2575 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 20:35:38.681715 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.675723    2575 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 20:35:38.681715 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.675726    2575 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 20:35:38.681715 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.675729    2575 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 20:35:38.681715 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.675732    2575 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 20:35:38.681715 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.675734    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 20:35:38.681715 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.675737    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 20:35:38.681715 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.675740    2575 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 20:35:38.681715 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.675743    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 20:35:38.682148 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.675745    2575 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 20:35:38.682148 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.675748    2575 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 20:35:38.682148 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.675751    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 20:35:38.682148 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.675754    2575 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 20:35:38.682148 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.675756    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 20:35:38.682148 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.675759    2575 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 20:35:38.682148 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.675761    2575 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 20:35:38.682148 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.675764    2575 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 20:35:38.682148 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.675767    2575 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 20:35:38.682148 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.675769    2575 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 20:35:38.682148 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.675771    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 20:35:38.682148 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.675774    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 20:35:38.682148 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.675777    2575 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 20:35:38.682148 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.675779    2575 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 20:35:38.682148 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.675782    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 20:35:38.682148 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.675784    2575 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 20:35:38.682148 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.675787    2575 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 20:35:38.682534 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.675814    2575 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 30 20:35:38.682534 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.675960    2575 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 20:35:38.682534 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.675964    2575 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 20:35:38.682534 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.675967    2575 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 20:35:38.682534 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.675970    2575 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 20:35:38.682534 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.675973    2575 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 20:35:38.682534 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.675975    2575 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 20:35:38.682534 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.675977    2575 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 20:35:38.682534 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.675980    2575 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 20:35:38.682534 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.675982    2575 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 20:35:38.682534 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.675985    2575 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 20:35:38.682534 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.675987    2575 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 20:35:38.682534 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.675990    2575 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 20:35:38.682534 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.675993    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 20:35:38.682534 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.675995    2575 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 20:35:38.682534 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.675998    2575 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 20:35:38.683004 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676001    2575 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 20:35:38.683004 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676003    2575 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 20:35:38.683004 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676006    2575 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 20:35:38.683004 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676009    2575 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 20:35:38.683004 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676011    2575 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 20:35:38.683004 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676014    2575 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 20:35:38.683004 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676017    2575 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 20:35:38.683004 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676019    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 20:35:38.683004 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676022    2575 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 20:35:38.683004 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676024    2575 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 20:35:38.683004 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676027    2575 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 20:35:38.683004 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676029    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 20:35:38.683004 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676032    2575 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 20:35:38.683004 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676034    2575 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 20:35:38.683004 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676037    2575 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 20:35:38.683004 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676039    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 20:35:38.683004 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676042    2575 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 20:35:38.683004 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676044    2575 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 20:35:38.683004 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676047    2575 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 20:35:38.683459 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676049    2575 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 20:35:38.683459 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676052    2575 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 20:35:38.683459 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676054    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 20:35:38.683459 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676057    2575 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 20:35:38.683459 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676059    2575 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 20:35:38.683459 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676062    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 20:35:38.683459 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676064    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 20:35:38.683459 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676067    2575 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 20:35:38.683459 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676069    2575 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 20:35:38.683459 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676072    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 20:35:38.683459 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676074    2575 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 20:35:38.683459 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676079    2575 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 20:35:38.683459 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676083    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 20:35:38.683459 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676086    2575 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 20:35:38.683459 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676089    2575 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 20:35:38.683459 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676092    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 20:35:38.683459 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676094    2575 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 20:35:38.683459 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676097    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 20:35:38.683459 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676099    2575 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 20:35:38.684270 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676102    2575 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 20:35:38.684270 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676104    2575 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 20:35:38.684270 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676107    2575 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 20:35:38.684270 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676109    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 20:35:38.684270 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676112    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 20:35:38.684270 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676114    2575 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 20:35:38.684270 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676117    2575 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 20:35:38.684270 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676119    2575 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 20:35:38.684270 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676122    2575 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 20:35:38.684270 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676124    2575 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 20:35:38.684270 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676126    2575 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 20:35:38.684270 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676129    2575 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 20:35:38.684270 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676131    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 20:35:38.684270 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676134    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 20:35:38.684270 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676137    2575 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 20:35:38.684270 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676141    2575 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 20:35:38.684270 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676144    2575 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 20:35:38.684270 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676147    2575 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 20:35:38.684270 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676150    2575 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 20:35:38.684270 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676152    2575 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 20:35:38.684936 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676155    2575 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 20:35:38.684936 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676157    2575 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 20:35:38.684936 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676160    2575 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 20:35:38.684936 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676162    2575 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 20:35:38.684936 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676166    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 20:35:38.684936 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676169    2575 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 20:35:38.684936 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676171    2575 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 20:35:38.684936 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676174    2575 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 20:35:38.684936 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676176    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 20:35:38.684936 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676179    2575 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 20:35:38.684936 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676182    2575 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 20:35:38.684936 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676184    2575 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 20:35:38.684936 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676186    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 20:35:38.684936 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676189    2575 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 20:35:38.684936 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676192    2575 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 20:35:38.684936 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676194    2575 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 20:35:38.684936 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676196    2575 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 20:35:38.684936 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676199    2575 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 20:35:38.684936 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676201    2575 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 20:35:38.684936 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676204    2575 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 20:35:38.685681 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676206    2575 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 20:35:38.685681 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676209    2575 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 20:35:38.685681 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676211    2575 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 20:35:38.685681 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676214    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 20:35:38.685681 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676216    2575 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 20:35:38.685681 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676219    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 20:35:38.685681 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676221    2575 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 20:35:38.685681 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676223    2575 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 20:35:38.685681 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676226    2575 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 20:35:38.685681 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676229    2575 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 20:35:38.685681 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676231    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 20:35:38.685681 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676234    2575 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 20:35:38.685681 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676236    2575 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 20:35:38.685681 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.676259    2575 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 30 20:35:38.685681 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676290    2575 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 20:35:38.685681 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676294    2575 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 20:35:38.686056 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676297    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 20:35:38.686056 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676299    2575 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 20:35:38.686056 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676302    2575 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 20:35:38.686056 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676305    2575 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 20:35:38.686056 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676308    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 20:35:38.686056 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676311    2575 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 20:35:38.686056 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676313    2575 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 20:35:38.686056 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676316    2575 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 20:35:38.686056 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676318    2575 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 20:35:38.686056 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676321    2575 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 20:35:38.686056 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676323    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 20:35:38.686056 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676326    2575 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 20:35:38.686056 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676328    2575 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 20:35:38.686056 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676331    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 20:35:38.686056 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676334    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 20:35:38.686056 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676336    2575 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 20:35:38.686056 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676339    2575 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 20:35:38.686056 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676341    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 20:35:38.686056 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676343    2575 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 20:35:38.686630 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676347    2575 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 20:35:38.686630 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676351    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 20:35:38.686630 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676354    2575 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 20:35:38.686630 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676357    2575 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 20:35:38.686630 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676360    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 20:35:38.686630 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676363    2575 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 20:35:38.686630 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676366    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 20:35:38.686630 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676368    2575 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 20:35:38.686630 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676370    2575 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 20:35:38.686630 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676373    2575 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 20:35:38.686630 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676375    2575 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 20:35:38.686630 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676378    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 20:35:38.686630 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676380    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 20:35:38.686630 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676383    2575 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 20:35:38.686630 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676385    2575 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 20:35:38.686630 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676388    2575 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 20:35:38.686630 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676391    2575 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 20:35:38.686630 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676394    2575 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 20:35:38.686630 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676396    2575 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 20:35:38.687209 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676399    2575 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 20:35:38.687209 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676401    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 20:35:38.687209 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676403    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 20:35:38.687209 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676407    2575 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 20:35:38.687209 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676410    2575 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 20:35:38.687209 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676413    2575 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 20:35:38.687209 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676416    2575 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 20:35:38.687209 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676419    2575 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 20:35:38.687209 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676422    2575 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 20:35:38.687209 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676424    2575 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 20:35:38.687209 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676426    2575 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 20:35:38.687209 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676429    2575 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 20:35:38.687209 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676431    2575 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 20:35:38.687209 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676434    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 20:35:38.687209 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676436    2575 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 20:35:38.687209 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676438    2575 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 20:35:38.687209 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676441    2575 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 20:35:38.687209 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676443    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 20:35:38.687209 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676446    2575 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 20:35:38.687209 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676448    2575 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 20:35:38.687705 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676451    2575 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 20:35:38.687705 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676453    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 20:35:38.687705 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676456    2575 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 20:35:38.687705 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676458    2575 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 20:35:38.687705 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676461    2575 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 20:35:38.687705 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676463    2575 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 20:35:38.687705 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676466    2575 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 20:35:38.687705 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676468    2575 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 20:35:38.687705 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676471    2575 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 20:35:38.687705 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676473    2575 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 20:35:38.687705 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676476    2575 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 20:35:38.687705 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676479    2575 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 20:35:38.687705 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676481    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 20:35:38.687705 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676484    2575 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 20:35:38.687705 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676486    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 20:35:38.687705 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676488    2575 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 20:35:38.687705 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676491    2575 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 20:35:38.687705 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676493    2575 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 20:35:38.687705 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676495    2575 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 20:35:38.688128 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676498    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 20:35:38.688128 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676501    2575 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 20:35:38.688128 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676503    2575 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 20:35:38.688128 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676505    2575 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 20:35:38.688128 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676508    2575 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 20:35:38.688128 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676510    2575 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 20:35:38.688128 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676513    2575 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 20:35:38.688128 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676515    2575 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 20:35:38.688128 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676517    2575 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 20:35:38.688128 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676520    2575 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 20:35:38.688128 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676522    2575 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 20:35:38.688128 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676524    2575 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 20:35:38.688128 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676527    2575 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 20:35:38.688128 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676529    2575 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 20:35:38.688128 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676532    2575 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 20:35:38.688128 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676534    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 20:35:38.688128 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676537    2575 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 20:35:38.688128 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676539    2575 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 20:35:38.688128 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676542    2575 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 20:35:38.688128 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676544    2575 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 20:35:38.688638 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676547    2575 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 20:35:38.688638 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676549    2575 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 20:35:38.688638 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676551    2575 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 20:35:38.688638 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676554    2575 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 20:35:38.688638 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676558    2575 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 20:35:38.688638 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676561    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 20:35:38.688638 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:38.676563    2575 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 20:35:38.688638 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.676632    2575 server.go:957] "Client rotation is on, will bootstrap in background"
Oct 30 20:35:38.688638 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.678997    2575 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Oct 30 20:35:38.688638 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.680092    2575 server.go:1014] "Starting client certificate rotation"
Oct 30 20:35:38.688638 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.680184    2575 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Oct 30 20:35:38.688638 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.681079    2575 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Oct 30 20:35:38.688638 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.684653    2575 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Oct 30 20:35:38.688638 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.685766    2575 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Oct 30 20:35:38.699279 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.699261    2575 log.go:25] "Validated CRI v1 runtime API"
Oct 30 20:35:38.703123 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.703110    2575 log.go:25] "Validated CRI v1 image API"
Oct 30 20:35:38.703954 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.703933    2575 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Oct 30 20:35:38.706745 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.706726    2575 fs.go:135] Filesystem UUIDs: map[3bf89af1-6d5e-42da-8043-52c3be2250f4:/dev/nvme0n1p4 3db80099-a04e-4675-8db2-f1abb95c09d4:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2]
Oct 30 20:35:38.706792 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.706746    2575 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0}]
Oct 30 20:35:38.711955 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.711831    2575 manager.go:217] Machine: {Timestamp:2026-10-30 20:35:38.710272009 +0000 UTC m=+0.326295382 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3194913 MemoryCapacity:33164337152 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2cf7bf360a5cfd6193e1a78e891acd SystemUUID:ec2cf7bf-360a-5cfd-6193-e1a78e891acd BootID:e30efb24-91e6-4e2b-afec-baaf85d100d8 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16582168576 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6632869888 Type:vfs Inodes:819200 HasInodes:true} {Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16582168576 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:55:c9:9a:9c:c1 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:55:c9:9a:9c:c1 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:02:01:3e:2e:d0:6e Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164337152 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Oct 30 20:35:38.711955 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.711956    2575 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Oct 30 20:35:38.712061 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.712040    2575 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Oct 30 20:35:38.715192 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.715166    2575 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Oct 30 20:35:38.715375 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.715194    2575 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-142-4.us-west-1.compute.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Oct 30 20:35:38.715418 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.715378    2575 topology_manager.go:143] "Creating topology manager with none policy"
Oct 30 20:35:38.715418 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.715386    2575 container_manager_linux.go:311] "Creating device plugin manager"
Oct 30 20:35:38.715418 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.715417    2575 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Oct 30 20:35:38.715493 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.715432    2575 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Oct 30 20:35:38.716636 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.716626    2575 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager"
Oct 30 20:35:38.720769 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.720757    2575 state_mem.go:41] "Initialized" logger="CPUManager state memory"
Oct 30 20:35:38.720881 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.720872    2575 server.go:1235] "Using root directory" path="/var/lib/kubelet"
Oct 30 20:35:38.721668 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.721659    2575 kubelet.go:493] "Attempting to sync node with API server"
Oct 30 20:35:38.721699 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.721672    2575 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests"
Oct 30 20:35:38.721699 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.721683    2575 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Oct 30 20:35:38.721699 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.721693    2575 kubelet.go:405] "Adding apiserver pod source"
Oct 30 20:35:38.721772 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.721700    2575 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Oct 30 20:35:38.722016 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.722006    2575 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Oct 30 20:35:38.724373 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.724355    2575 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1"
Oct 30 20:35:38.732513 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.732490    2575 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Oct 30 20:35:38.733423 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.733410    2575 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Oct 30 20:35:38.733461 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.733441    2575 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Oct 30 20:35:38.733615 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.733604    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Oct 30 20:35:38.733649 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.733620    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Oct 30 20:35:38.733649 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.733626    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Oct 30 20:35:38.733649 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.733632    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Oct 30 20:35:38.733649 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.733638    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Oct 30 20:35:38.733649 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.733645    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Oct 30 20:35:38.734340 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.734333    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Oct 30 20:35:38.734367 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.734342    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Oct 30 20:35:38.734367 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.734349    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Oct 30 20:35:38.734367 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.734355    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Oct 30 20:35:38.734367 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.734363    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Oct 30 20:35:38.734544 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.734371    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Oct 30 20:35:38.735032 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.735022    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Oct 30 20:35:38.735032 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.735031    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Oct 30 20:35:38.738789 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.738775    2575 server.go:1263] "Started kubelet"
Oct 30 20:35:38.739223 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.738854    2575 server.go:182] "Starting to listen" address="0.0.0.0" port=10250
Oct 30 20:35:38.739223 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.738863    2575 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Oct 30 20:35:38.739223 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.738931    2575 server_v1.go:49] "podresources" method="list" useActivePods=true
Oct 30 20:35:38.739618 ip-10-0-142-4 systemd[1]: Started Kubernetes Kubelet.
Oct 30 20:35:38.740494 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.740480    2575 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Oct 30 20:35:38.741469 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.741457    2575 server.go:317] "Adding debug handlers to kubelet server"
Oct 30 20:35:38.745900 ip-10-0-142-4 kubenswrapper[2575]: E1030 20:35:38.745873    2575 kubelet.go:1679] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Oct 30 20:35:38.748485 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.748466    2575 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Oct 30 20:35:38.749804 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.749790    2575 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer"
Oct 30 20:35:38.749948 ip-10-0-142-4 kubenswrapper[2575]: E1030 20:35:38.749906    2575 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-142-4.us-west-1.compute.internal\" not found"
Oct 30 20:35:38.750593 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.750561    2575 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Oct 30 20:35:38.750593 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.750594    2575 factory.go:55] Registering systemd factory
Oct 30 20:35:38.750746 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.750604    2575 factory.go:223] Registration of the systemd container factory successfully
Oct 30 20:35:38.750746 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.750607    2575 volume_manager.go:309] "The desired_state_of_world populator starts"
Oct 30 20:35:38.750746 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.750626    2575 volume_manager.go:311] "Starting Kubelet Volume Manager"
Oct 30 20:35:38.750746 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.750613    2575 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Oct 30 20:35:38.750746 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.750721    2575 reconstruct.go:97] "Volume reconstruction finished"
Oct 30 20:35:38.750746 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.750728    2575 reconciler.go:29] "Reconciler: start to sync state"
Oct 30 20:35:38.750932 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.750866    2575 factory.go:153] Registering CRI-O factory
Oct 30 20:35:38.750932 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.750877    2575 factory.go:223] Registration of the crio container factory successfully
Oct 30 20:35:38.750932 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.750894    2575 factory.go:103] Registering Raw factory
Oct 30 20:35:38.750932 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.750907    2575 manager.go:1199] Started watching for new ooms in manager
Oct 30 20:35:38.751959 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.751940    2575 manager.go:319] Starting recovery of all containers
Oct 30 20:35:38.761719 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.761702    2575 manager.go:324] Recovery completed
Oct 30 20:35:38.768584 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.768557    2575 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 20:35:38.770743 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.770718    2575 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-4.us-west-1.compute.internal" event="NodeHasSufficientMemory"
Oct 30 20:35:38.770821 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.770760    2575 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-4.us-west-1.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 20:35:38.770821 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.770773    2575 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-4.us-west-1.compute.internal" event="NodeHasSufficientPID"
Oct 30 20:35:38.771317 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.771301    2575 cpu_manager.go:226] "Starting" policy="none"
Oct 30 20:35:38.771317 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.771313    2575 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s"
Oct 30 20:35:38.771317 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.771316    2575 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 20:35:38.771505 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.771329    2575 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory"
Oct 30 20:35:38.772637 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.772620    2575 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-4.us-west-1.compute.internal" event="NodeHasSufficientMemory"
Oct 30 20:35:38.772738 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.772655    2575 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-4.us-west-1.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 20:35:38.772738 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.772671    2575 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-4.us-west-1.compute.internal" event="NodeHasSufficientPID"
Oct 30 20:35:38.773646 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.773632    2575 policy_none.go:50] "Start"
Oct 30 20:35:38.773646 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.773647    2575 memory_manager.go:187] "Starting memorymanager" policy="None"
Oct 30 20:35:38.773740 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.773658    2575 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Oct 30 20:35:38.775668 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.775656    2575 policy_none.go:44] "Start"
Oct 30 20:35:38.829565 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.815135    2575 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"}
Oct 30 20:35:38.829565 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.817145    2575 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Oct 30 20:35:38.829565 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.817859    2575 manager.go:341] "Starting Device Plugin manager"
Oct 30 20:35:38.829565 ip-10-0-142-4 kubenswrapper[2575]: E1030 20:35:38.817897    2575 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Oct 30 20:35:38.829565 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.817910    2575 server.go:87] "Starting device plugin registration server"
Oct 30 20:35:38.829565 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.818195    2575 eviction_manager.go:194] "Eviction manager: starting control loop"
Oct 30 20:35:38.829565 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.818208    2575 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Oct 30 20:35:38.829565 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.818402    2575 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Oct 30 20:35:38.829565 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.818502    2575 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts"
Oct 30 20:35:38.829565 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.818511    2575 plugin_manager.go:121] "Starting Kubelet Plugin Manager"
Oct 30 20:35:38.829565 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.818633    2575 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Oct 30 20:35:38.829565 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.818648    2575 status_manager.go:249] "Starting to sync pod status with apiserver"
Oct 30 20:35:38.829565 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.818667    2575 kubelet.go:2521] "Starting kubelet main sync loop"
Oct 30 20:35:38.829565 ip-10-0-142-4 kubenswrapper[2575]: E1030 20:35:38.818706    2575 kubelet.go:2545] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Oct 30 20:35:38.829565 ip-10-0-142-4 kubenswrapper[2575]: E1030 20:35:38.819704    2575 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Oct 30 20:35:38.829565 ip-10-0-142-4 kubenswrapper[2575]: E1030 20:35:38.819753    2575 eviction_manager.go:297] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-142-4.us-west-1.compute.internal\" not found"
Oct 30 20:35:38.918782 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.918546    2575 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 20:35:38.918923 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.918789    2575 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-4.us-west-1.compute.internal","kube-system/kube-apiserver-proxy-ip-10-0-142-4.us-west-1.compute.internal"]
Oct 30 20:35:38.918923 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.918860    2575 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 20:35:38.921357 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.921328    2575 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-4.us-west-1.compute.internal" event="NodeHasSufficientMemory"
Oct 30 20:35:38.921357 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.921359    2575 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-4.us-west-1.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 20:35:38.921519 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.921370    2575 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-4.us-west-1.compute.internal" event="NodeHasSufficientPID"
Oct 30 20:35:38.921519 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.921328    2575 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-4.us-west-1.compute.internal" event="NodeHasSufficientMemory"
Oct 30 20:35:38.921519 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.921435    2575 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-4.us-west-1.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 20:35:38.921519 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.921447    2575 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-4.us-west-1.compute.internal" event="NodeHasSufficientPID"
Oct 30 20:35:38.921519 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.921468    2575 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-142-4.us-west-1.compute.internal"
Oct 30 20:35:38.923601 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.923588    2575 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 20:35:38.923709 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.923693    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-4.us-west-1.compute.internal"
Oct 30 20:35:38.923760 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.923725    2575 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 20:35:38.924346 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.924332    2575 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-4.us-west-1.compute.internal" event="NodeHasSufficientMemory"
Oct 30 20:35:38.924450 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.924351    2575 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-4.us-west-1.compute.internal" event="NodeHasSufficientMemory"
Oct 30 20:35:38.924450 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.924361    2575 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-4.us-west-1.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 20:35:38.924450 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.924375    2575 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-4.us-west-1.compute.internal" event="NodeHasSufficientPID"
Oct 30 20:35:38.924450 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.924382    2575 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-4.us-west-1.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 20:35:38.924450 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.924391    2575 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-4.us-west-1.compute.internal" event="NodeHasSufficientPID"
Oct 30 20:35:38.926501 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.926484    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-4.us-west-1.compute.internal"
Oct 30 20:35:38.926601 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.926516    2575 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 20:35:38.927248 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.927235    2575 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-4.us-west-1.compute.internal" event="NodeHasSufficientMemory"
Oct 30 20:35:38.927307 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.927259    2575 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-4.us-west-1.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 20:35:38.927307 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.927269    2575 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-4.us-west-1.compute.internal" event="NodeHasSufficientPID"
Oct 30 20:35:38.928651 ip-10-0-142-4 kubenswrapper[2575]: E1030 20:35:38.928629    2575 controller.go:201] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-142-4.us-west-1.compute.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Oct 30 20:35:38.928651 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.928639    2575 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-4.us-west-1.compute.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Oct 30 20:35:38.929645 ip-10-0-142-4 kubenswrapper[2575]: E1030 20:35:38.928740    2575 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-4.us-west-1.compute.internal.18e369031e5be9da  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-4.us-west-1.compute.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-142-4.us-west-1.compute.internal,},FirstTimestamp:2026-10-30 20:35:38.738747866 +0000 UTC m=+0.354771237,LastTimestamp:2026-10-30 20:35:38.738747866 +0000 UTC m=+0.354771237,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-4.us-west-1.compute.internal,}"
Oct 30 20:35:38.937263 ip-10-0-142-4 kubenswrapper[2575]: E1030 20:35:38.937231    2575 reflector.go:204] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-142-4.us-west-1.compute.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.Node"
Oct 30 20:35:38.937346 ip-10-0-142-4 kubenswrapper[2575]: E1030 20:35:38.937274    2575 reflector.go:204] "Failed to watch" err="failed to list *v1.RuntimeClass: runtimeclasses.node.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"runtimeclasses\" in API group \"node.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.RuntimeClass"
Oct 30 20:35:38.961696 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.961675    2575 reflector.go:446] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Oct 30 20:35:38.961789 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:38.961752    2575 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-r7bjx"
Oct 30 20:35:38.963217 ip-10-0-142-4 kubenswrapper[2575]: E1030 20:35:38.963196    2575 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-4.us-west-1.compute.internal\" not found" node="ip-10-0-142-4.us-west-1.compute.internal"
Oct 30 20:35:38.965218 ip-10-0-142-4 kubenswrapper[2575]: E1030 20:35:38.965202    2575 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-4.us-west-1.compute.internal\" not found" node="ip-10-0-142-4.us-west-1.compute.internal"
Oct 30 20:35:39.051640 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:39.051611    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/90d034cf7e9022b0bbb1def78b2df29c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-4.us-west-1.compute.internal\" (UID: \"90d034cf7e9022b0bbb1def78b2df29c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-4.us-west-1.compute.internal"
Oct 30 20:35:39.051840 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:39.051680    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/90d034cf7e9022b0bbb1def78b2df29c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-4.us-west-1.compute.internal\" (UID: \"90d034cf7e9022b0bbb1def78b2df29c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-4.us-west-1.compute.internal"
Oct 30 20:35:39.051840 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:39.051735    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c873d294ea5be2c96cd88ae10288f56b-config\") pod \"kube-apiserver-proxy-ip-10-0-142-4.us-west-1.compute.internal\" (UID: \"c873d294ea5be2c96cd88ae10288f56b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-4.us-west-1.compute.internal"
Oct 30 20:35:39.137422 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:39.137391    2575 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 20:35:39.148287 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:39.148261    2575 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 20:35:39.148917 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:39.148901    2575 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-142-4.us-west-1.compute.internal"
Oct 30 20:35:39.148966 ip-10-0-142-4 kubenswrapper[2575]: E1030 20:35:39.148925    2575 kubelet_node_status.go:524] "Error updating node status, will retry" err="error getting node \"ip-10-0-142-4.us-west-1.compute.internal\": node \"ip-10-0-142-4.us-west-1.compute.internal\" not found"
Oct 30 20:35:39.152219 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:39.152206    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c873d294ea5be2c96cd88ae10288f56b-config\") pod \"kube-apiserver-proxy-ip-10-0-142-4.us-west-1.compute.internal\" (UID: \"c873d294ea5be2c96cd88ae10288f56b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-4.us-west-1.compute.internal"
Oct 30 20:35:39.152263 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:39.152228    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/90d034cf7e9022b0bbb1def78b2df29c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-4.us-west-1.compute.internal\" (UID: \"90d034cf7e9022b0bbb1def78b2df29c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-4.us-west-1.compute.internal"
Oct 30 20:35:39.152263 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:39.152244    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/90d034cf7e9022b0bbb1def78b2df29c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-4.us-west-1.compute.internal\" (UID: \"90d034cf7e9022b0bbb1def78b2df29c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-4.us-west-1.compute.internal"
Oct 30 20:35:39.152351 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:39.152300    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/90d034cf7e9022b0bbb1def78b2df29c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-4.us-west-1.compute.internal\" (UID: \"90d034cf7e9022b0bbb1def78b2df29c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-4.us-west-1.compute.internal"
Oct 30 20:35:39.152351 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:39.152306    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c873d294ea5be2c96cd88ae10288f56b-config\") pod \"kube-apiserver-proxy-ip-10-0-142-4.us-west-1.compute.internal\" (UID: \"c873d294ea5be2c96cd88ae10288f56b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-4.us-west-1.compute.internal"
Oct 30 20:35:39.152351 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:39.152328    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/90d034cf7e9022b0bbb1def78b2df29c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-4.us-west-1.compute.internal\" (UID: \"90d034cf7e9022b0bbb1def78b2df29c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-4.us-west-1.compute.internal"
Oct 30 20:35:39.268614 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:39.268530    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-4.us-west-1.compute.internal"
Oct 30 20:35:39.270701 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:39.270684    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-4.us-west-1.compute.internal"
Oct 30 20:35:39.280466 ip-10-0-142-4 kubenswrapper[2575]: E1030 20:35:39.280443    2575 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-142-4.us-west-1.compute.internal\" not found"
Oct 30 20:35:39.381270 ip-10-0-142-4 kubenswrapper[2575]: E1030 20:35:39.381240    2575 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-142-4.us-west-1.compute.internal\" not found"
Oct 30 20:35:39.481469 ip-10-0-142-4 kubenswrapper[2575]: E1030 20:35:39.481432    2575 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-142-4.us-west-1.compute.internal\" not found"
Oct 30 20:35:39.582099 ip-10-0-142-4 kubenswrapper[2575]: E1030 20:35:39.582019    2575 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-142-4.us-west-1.compute.internal\" not found"
Oct 30 20:35:39.679668 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:39.679634    2575 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Oct 30 20:35:39.680168 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:39.679810    2575 reflector.go:578] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:161: Unexpected watch close - watch lasted less than a second and no items received"
Oct 30 20:35:39.680168 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:39.679849    2575 reflector.go:578] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:161: Unexpected watch close - watch lasted less than a second and no items received"
Oct 30 20:35:39.680168 ip-10-0-142-4 kubenswrapper[2575]: E1030 20:35:39.679872    2575 event.go:368] "Unable to write event (may retry after sleeping)" err="Patch \"https://a41523619245140049339d55e6c91ffd-78a63a0feb3ef4fb.elb.us-east-2.amazonaws.com:6443/api/v1/namespaces/default/events/ip-10-0-142-4.us-west-1.compute.internal.18e369032044ab24\": read tcp 10.0.142.4:57774->3.151.105.250:6443: use of closed network connection" event="&Event{ObjectMeta:{ip-10-0-142-4.us-west-1.compute.internal.18e369032044ab24  default   5095 0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-4.us-west-1.compute.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-142-4.us-west-1.compute.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-142-4.us-west-1.compute.internal,},FirstTimestamp:2026-10-30 20:35:38 +0000 UTC,LastTimestamp:2026-10-30 20:35:38.921374126 +0000 UTC m=+0.537397498,Count:3,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-4.us-west-1.compute.internal,}"
Oct 30 20:35:39.682789 ip-10-0-142-4 kubenswrapper[2575]: E1030 20:35:39.682769    2575 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-142-4.us-west-1.compute.internal\" not found"
Oct 30 20:35:39.783715 ip-10-0-142-4 kubenswrapper[2575]: E1030 20:35:39.783681    2575 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-142-4.us-west-1.compute.internal\" not found"
Oct 30 20:35:39.884269 ip-10-0-142-4 kubenswrapper[2575]: E1030 20:35:39.884192    2575 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-142-4.us-west-1.compute.internal\" not found"
Oct 30 20:35:40.963901 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:40.963877    2575 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 20:35:40.964776 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:40.964760    2575 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-4.us-west-1.compute.internal" event="NodeHasSufficientMemory"
Oct 30 20:35:40.964880 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:40.964796    2575 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-4.us-west-1.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 20:35:40.964880 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:40.964811    2575 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-4.us-west-1.compute.internal" event="NodeHasSufficientPID"
Oct 30 20:35:40.983659 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:40.983620    2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-10-29 20:30:39 +0000 UTC" deadline="2028-07-03 02:18:41.710411055 +0000 UTC"
Oct 30 20:35:40.983659 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:40.983655    2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14669h43m0.726759561s"
Oct 30 20:35:41.000290 ip-10-0-142-4 kubenswrapper[2575]: E1030 20:35:41.000265    2575 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-142-4.us-west-1.compute.internal\" not found"
Oct 30 20:35:41.100882 ip-10-0-142-4 kubenswrapper[2575]: E1030 20:35:41.100851    2575 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-142-4.us-west-1.compute.internal\" not found"
Oct 30 20:35:41.111018 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.110997    2575 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 20:35:41.201667 ip-10-0-142-4 kubenswrapper[2575]: E1030 20:35:41.201591    2575 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-142-4.us-west-1.compute.internal\" not found"
Oct 30 20:35:41.302646 ip-10-0-142-4 kubenswrapper[2575]: E1030 20:35:41.302598    2575 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-142-4.us-west-1.compute.internal\" not found"
Oct 30 20:35:41.403439 ip-10-0-142-4 kubenswrapper[2575]: E1030 20:35:41.403394    2575 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-142-4.us-west-1.compute.internal\" not found"
Oct 30 20:35:41.406500 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.406471    2575 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 20:35:41.429658 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:41.429619    2575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90d034cf7e9022b0bbb1def78b2df29c.slice/crio-a8850a60faf2eb84b7bec143e3a87c40d2a6f267b2afdc821e44ae32f6d964e7 WatchSource:0}: Error finding container a8850a60faf2eb84b7bec143e3a87c40d2a6f267b2afdc821e44ae32f6d964e7: Status 404 returned error can't find the container with id a8850a60faf2eb84b7bec143e3a87c40d2a6f267b2afdc821e44ae32f6d964e7
Oct 30 20:35:41.434609 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.434594    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 20:35:41.465882 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.465859    2575 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-4.us-west-1.compute.internal"
Oct 30 20:35:41.466021 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:41.466000    2575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc873d294ea5be2c96cd88ae10288f56b.slice/crio-b35002fc0c079bc19536911fd42a3bb47c02632dee2bf2c45bbaae6834833ba5 WatchSource:0}: Error finding container b35002fc0c079bc19536911fd42a3bb47c02632dee2bf2c45bbaae6834833ba5: Status 404 returned error can't find the container with id b35002fc0c079bc19536911fd42a3bb47c02632dee2bf2c45bbaae6834833ba5
Oct 30 20:35:41.525560 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.525536    2575 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 30 20:35:41.526480 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.526464    2575 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-4.us-west-1.compute.internal"
Oct 30 20:35:41.585974 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.585948    2575 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 30 20:35:41.598618 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.598598    2575 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 20:35:41.685477 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.685443    2575 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 20:35:41.738690 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.738614    2575 apiserver.go:52] "Watching apiserver"
Oct 30 20:35:41.765813 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.765791    2575 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Oct 30 20:35:41.839654 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.839603    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-4.us-west-1.compute.internal" event={"ID":"c873d294ea5be2c96cd88ae10288f56b","Type":"ContainerStarted","Data":"b35002fc0c079bc19536911fd42a3bb47c02632dee2bf2c45bbaae6834833ba5"}
Oct 30 20:35:41.840789 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.840761    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-4.us-west-1.compute.internal" event={"ID":"90d034cf7e9022b0bbb1def78b2df29c","Type":"ContainerStarted","Data":"a8850a60faf2eb84b7bec143e3a87c40d2a6f267b2afdc821e44ae32f6d964e7"}
Oct 30 20:35:41.841079 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.841063    2575 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Oct 30 20:35:41.841378 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.841360    2575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gqt4f","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-4.us-west-1.compute.internal","openshift-network-diagnostics/network-check-target-scs59","openshift-multus/multus-nmttt","openshift-multus/network-metrics-daemon-f45fg","openshift-ovn-kubernetes/ovnkube-node-7dh2x","kube-system/kube-apiserver-proxy-ip-10-0-142-4.us-west-1.compute.internal","openshift-cluster-node-tuning-operator/tuned-7cg9z","openshift-dns/node-resolver-82j9v","openshift-image-registry/node-ca-5mml4","openshift-multus/multus-additional-cni-plugins-n7knr","openshift-network-operator/iptables-alerter-cfbz6","kube-system/global-pull-secret-syncer-cfdhw","kube-system/konnectivity-agent-mlgfz"]
Oct 30 20:35:41.844897 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.844876    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-5mml4"
Oct 30 20:35:41.847051 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.847025    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cfdhw"
Oct 30 20:35:41.847137 ip-10-0-142-4 kubenswrapper[2575]: E1030 20:35:41.847098    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cfdhw" podUID="261f6884-299b-4971-b936-bbb3174f1b66"
Oct 30 20:35:41.849043 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.849026    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-scs59"
Oct 30 20:35:41.849126 ip-10-0-142-4 kubenswrapper[2575]: E1030 20:35:41.849084    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-scs59" podUID="fbbb7a28-caa9-4309-8d4c-a6f1c01e2b4f"
Oct 30 20:35:41.851140 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.851121    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-nmttt"
Oct 30 20:35:41.853220 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.853202    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f45fg"
Oct 30 20:35:41.853308 ip-10-0-142-4 kubenswrapper[2575]: E1030 20:35:41.853287    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f45fg" podUID="d0bb5f1b-4370-4e8d-80a8-1a7bcda13cd2"
Oct 30 20:35:41.855367 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.855350    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-7dh2x"
Oct 30 20:35:41.857691 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.857668    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-82j9v"
Oct 30 20:35:41.859931 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.859906    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-mlgfz"
Oct 30 20:35:41.862193 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.862174    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-7cg9z"
Oct 30 20:35:41.864507 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.864474    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gqt4f"
Oct 30 20:35:41.866745 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.866730    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-n7knr"
Oct 30 20:35:41.868868 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.868849    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-cfbz6"
Oct 30 20:35:41.877283 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.877260    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mpwhg\" (UniqueName: \"kubernetes.io/projected/9516abf2-c993-442c-8c5e-34480e5113d6-kube-api-access-mpwhg\") pod \"ovnkube-node-7dh2x\" (UID: \"9516abf2-c993-442c-8c5e-34480e5113d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-7dh2x"
Oct 30 20:35:41.877379 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.877298    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/be756835-3011-4186-ab61-8128121eb95b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-n7knr\" (UID: \"be756835-3011-4186-ab61-8128121eb95b\") " pod="openshift-multus/multus-additional-cni-plugins-n7knr"
Oct 30 20:35:41.877379 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.877320    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/baefcab8-b5be-4143-9b55-7a86001a4363-host-run-k8s-cni-cncf-io\") pod \"multus-nmttt\" (UID: \"baefcab8-b5be-4143-9b55-7a86001a4363\") " pod="openshift-multus/multus-nmttt"
Oct 30 20:35:41.877477 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.877386    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6e80b983-b2c0-4923-82b0-5903424cc7b0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gqt4f\" (UID: \"6e80b983-b2c0-4923-82b0-5903424cc7b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gqt4f"
Oct 30 20:35:41.877477 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.877424    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6e80b983-b2c0-4923-82b0-5903424cc7b0-registration-dir\") pod \"aws-ebs-csi-driver-node-gqt4f\" (UID: \"6e80b983-b2c0-4923-82b0-5903424cc7b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gqt4f"
Oct 30 20:35:41.877608 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.877476    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9516abf2-c993-442c-8c5e-34480e5113d6-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7dh2x\" (UID: \"9516abf2-c993-442c-8c5e-34480e5113d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-7dh2x"
Oct 30 20:35:41.877608 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.877553    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/baefcab8-b5be-4143-9b55-7a86001a4363-host-var-lib-kubelet\") pod \"multus-nmttt\" (UID: \"baefcab8-b5be-4143-9b55-7a86001a4363\") " pod="openshift-multus/multus-nmttt"
Oct 30 20:35:41.877608 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.877579    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/baefcab8-b5be-4143-9b55-7a86001a4363-hostroot\") pod \"multus-nmttt\" (UID: \"baefcab8-b5be-4143-9b55-7a86001a4363\") " pod="openshift-multus/multus-nmttt"
Oct 30 20:35:41.877608 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.877593    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/baefcab8-b5be-4143-9b55-7a86001a4363-multus-conf-dir\") pod \"multus-nmttt\" (UID: \"baefcab8-b5be-4143-9b55-7a86001a4363\") " pod="openshift-multus/multus-nmttt"
Oct 30 20:35:41.877719 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.877607    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a5b34407-cc7d-458e-aca3-cd48133834ad-etc-sysctl-conf\") pod \"tuned-7cg9z\" (UID: \"a5b34407-cc7d-458e-aca3-cd48133834ad\") " pod="openshift-cluster-node-tuning-operator/tuned-7cg9z"
Oct 30 20:35:41.877719 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.877637    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/baefcab8-b5be-4143-9b55-7a86001a4363-system-cni-dir\") pod \"multus-nmttt\" (UID: \"baefcab8-b5be-4143-9b55-7a86001a4363\") " pod="openshift-multus/multus-nmttt"
Oct 30 20:35:41.877719 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.877651    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/baefcab8-b5be-4143-9b55-7a86001a4363-multus-daemon-config\") pod \"multus-nmttt\" (UID: \"baefcab8-b5be-4143-9b55-7a86001a4363\") " pod="openshift-multus/multus-nmttt"
Oct 30 20:35:41.877719 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.877679    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5hzrc\" (UniqueName: \"kubernetes.io/projected/fbbb7a28-caa9-4309-8d4c-a6f1c01e2b4f-kube-api-access-5hzrc\") pod \"network-check-target-scs59\" (UID: \"fbbb7a28-caa9-4309-8d4c-a6f1c01e2b4f\") " pod="openshift-network-diagnostics/network-check-target-scs59"
Oct 30 20:35:41.877719 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.877700    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9516abf2-c993-442c-8c5e-34480e5113d6-env-overrides\") pod \"ovnkube-node-7dh2x\" (UID: \"9516abf2-c993-442c-8c5e-34480e5113d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-7dh2x"
Oct 30 20:35:41.877850 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.877723    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a5b34407-cc7d-458e-aca3-cd48133834ad-var-lib-kubelet\") pod \"tuned-7cg9z\" (UID: \"a5b34407-cc7d-458e-aca3-cd48133834ad\") " pod="openshift-cluster-node-tuning-operator/tuned-7cg9z"
Oct 30 20:35:41.877850 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.877743    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/be756835-3011-4186-ab61-8128121eb95b-system-cni-dir\") pod \"multus-additional-cni-plugins-n7knr\" (UID: \"be756835-3011-4186-ab61-8128121eb95b\") " pod="openshift-multus/multus-additional-cni-plugins-n7knr"
Oct 30 20:35:41.877850 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.877777    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k5wmd\" (UniqueName: \"kubernetes.io/projected/96b48bb2-933f-483d-8f15-5cca00c3d613-kube-api-access-k5wmd\") pod \"iptables-alerter-cfbz6\" (UID: \"96b48bb2-933f-483d-8f15-5cca00c3d613\") " pod="openshift-network-operator/iptables-alerter-cfbz6"
Oct 30 20:35:41.877850 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.877802    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3e93e3cc-cd26-452f-9e40-31dedb0d198b-host\") pod \"node-ca-5mml4\" (UID: \"3e93e3cc-cd26-452f-9e40-31dedb0d198b\") " pod="openshift-image-registry/node-ca-5mml4"
Oct 30 20:35:41.877850 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.877843    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/70cf9a0e-c321-438d-83a2-2034f4df9034-konnectivity-ca\") pod \"konnectivity-agent-mlgfz\" (UID: \"70cf9a0e-c321-438d-83a2-2034f4df9034\") " pod="kube-system/konnectivity-agent-mlgfz"
Oct 30 20:35:41.877984 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.877866    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/261f6884-299b-4971-b936-bbb3174f1b66-dbus\") pod \"global-pull-secret-syncer-cfdhw\" (UID: \"261f6884-299b-4971-b936-bbb3174f1b66\") " pod="kube-system/global-pull-secret-syncer-cfdhw"
Oct 30 20:35:41.877984 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.877889    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9516abf2-c993-442c-8c5e-34480e5113d6-log-socket\") pod \"ovnkube-node-7dh2x\" (UID: \"9516abf2-c993-442c-8c5e-34480e5113d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-7dh2x"
Oct 30 20:35:41.877984 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.877918    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a5b34407-cc7d-458e-aca3-cd48133834ad-etc-tuned\") pod \"tuned-7cg9z\" (UID: \"a5b34407-cc7d-458e-aca3-cd48133834ad\") " pod="openshift-cluster-node-tuning-operator/tuned-7cg9z"
Oct 30 20:35:41.877984 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.877934    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/baefcab8-b5be-4143-9b55-7a86001a4363-cnibin\") pod \"multus-nmttt\" (UID: \"baefcab8-b5be-4143-9b55-7a86001a4363\") " pod="openshift-multus/multus-nmttt"
Oct 30 20:35:41.877984 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.877957    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/baefcab8-b5be-4143-9b55-7a86001a4363-multus-socket-dir-parent\") pod \"multus-nmttt\" (UID: \"baefcab8-b5be-4143-9b55-7a86001a4363\") " pod="openshift-multus/multus-nmttt"
Oct 30 20:35:41.877984 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.877977    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a5b34407-cc7d-458e-aca3-cd48133834ad-etc-sysctl-d\") pod \"tuned-7cg9z\" (UID: \"a5b34407-cc7d-458e-aca3-cd48133834ad\") " pod="openshift-cluster-node-tuning-operator/tuned-7cg9z"
Oct 30 20:35:41.878143 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.878003    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/96b48bb2-933f-483d-8f15-5cca00c3d613-iptables-alerter-script\") pod \"iptables-alerter-cfbz6\" (UID: \"96b48bb2-933f-483d-8f15-5cca00c3d613\") " pod="openshift-network-operator/iptables-alerter-cfbz6"
Oct 30 20:35:41.878143 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.878017    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/baefcab8-b5be-4143-9b55-7a86001a4363-host-run-multus-certs\") pod \"multus-nmttt\" (UID: \"baefcab8-b5be-4143-9b55-7a86001a4363\") " pod="openshift-multus/multus-nmttt"
Oct 30 20:35:41.878143 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.878064    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1930df66-da42-4ad8-bfe0-5e92f9e07ebc-tmp-dir\") pod \"node-resolver-82j9v\" (UID: \"1930df66-da42-4ad8-bfe0-5e92f9e07ebc\") " pod="openshift-dns/node-resolver-82j9v"
Oct 30 20:35:41.878143 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.878106    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9516abf2-c993-442c-8c5e-34480e5113d6-host-run-netns\") pod \"ovnkube-node-7dh2x\" (UID: \"9516abf2-c993-442c-8c5e-34480e5113d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-7dh2x"
Oct 30 20:35:41.878143 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.878135    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9516abf2-c993-442c-8c5e-34480e5113d6-run-openvswitch\") pod \"ovnkube-node-7dh2x\" (UID: \"9516abf2-c993-442c-8c5e-34480e5113d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-7dh2x"
Oct 30 20:35:41.878331 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.878172    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9516abf2-c993-442c-8c5e-34480e5113d6-host-cni-netd\") pod \"ovnkube-node-7dh2x\" (UID: \"9516abf2-c993-442c-8c5e-34480e5113d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-7dh2x"
Oct 30 20:35:41.878331 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.878195    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a5b34407-cc7d-458e-aca3-cd48133834ad-etc-systemd\") pod \"tuned-7cg9z\" (UID: \"a5b34407-cc7d-458e-aca3-cd48133834ad\") " pod="openshift-cluster-node-tuning-operator/tuned-7cg9z"
Oct 30 20:35:41.878331 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.878217    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a5b34407-cc7d-458e-aca3-cd48133834ad-sys\") pod \"tuned-7cg9z\" (UID: \"a5b34407-cc7d-458e-aca3-cd48133834ad\") " pod="openshift-cluster-node-tuning-operator/tuned-7cg9z"
Oct 30 20:35:41.878331 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.878240    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2xx6z\" (UniqueName: \"kubernetes.io/projected/a5b34407-cc7d-458e-aca3-cd48133834ad-kube-api-access-2xx6z\") pod \"tuned-7cg9z\" (UID: \"a5b34407-cc7d-458e-aca3-cd48133834ad\") " pod="openshift-cluster-node-tuning-operator/tuned-7cg9z"
Oct 30 20:35:41.878331 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.878253    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/be756835-3011-4186-ab61-8128121eb95b-cnibin\") pod \"multus-additional-cni-plugins-n7knr\" (UID: \"be756835-3011-4186-ab61-8128121eb95b\") " pod="openshift-multus/multus-additional-cni-plugins-n7knr"
Oct 30 20:35:41.878331 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.878271    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9516abf2-c993-442c-8c5e-34480e5113d6-host-slash\") pod \"ovnkube-node-7dh2x\" (UID: \"9516abf2-c993-442c-8c5e-34480e5113d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-7dh2x"
Oct 30 20:35:41.878331 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.878311    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a5b34407-cc7d-458e-aca3-cd48133834ad-run\") pod \"tuned-7cg9z\" (UID: \"a5b34407-cc7d-458e-aca3-cd48133834ad\") " pod="openshift-cluster-node-tuning-operator/tuned-7cg9z"
Oct 30 20:35:41.878584 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.878342    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/be756835-3011-4186-ab61-8128121eb95b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-n7knr\" (UID: \"be756835-3011-4186-ab61-8128121eb95b\") " pod="openshift-multus/multus-additional-cni-plugins-n7knr"
Oct 30 20:35:41.878584 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.878369    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lgp2l\" (UniqueName: \"kubernetes.io/projected/3e93e3cc-cd26-452f-9e40-31dedb0d198b-kube-api-access-lgp2l\") pod \"node-ca-5mml4\" (UID: \"3e93e3cc-cd26-452f-9e40-31dedb0d198b\") " pod="openshift-image-registry/node-ca-5mml4"
Oct 30 20:35:41.878584 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.878405    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9516abf2-c993-442c-8c5e-34480e5113d6-run-ovn\") pod \"ovnkube-node-7dh2x\" (UID: \"9516abf2-c993-442c-8c5e-34480e5113d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-7dh2x"
Oct 30 20:35:41.878584 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.878434    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a5b34407-cc7d-458e-aca3-cd48133834ad-host\") pod \"tuned-7cg9z\" (UID: \"a5b34407-cc7d-458e-aca3-cd48133834ad\") " pod="openshift-cluster-node-tuning-operator/tuned-7cg9z"
Oct 30 20:35:41.878584 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.878459    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/baefcab8-b5be-4143-9b55-7a86001a4363-host-run-netns\") pod \"multus-nmttt\" (UID: \"baefcab8-b5be-4143-9b55-7a86001a4363\") " pod="openshift-multus/multus-nmttt"
Oct 30 20:35:41.878584 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.878485    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nsvqk\" (UniqueName: \"kubernetes.io/projected/1930df66-da42-4ad8-bfe0-5e92f9e07ebc-kube-api-access-nsvqk\") pod \"node-resolver-82j9v\" (UID: \"1930df66-da42-4ad8-bfe0-5e92f9e07ebc\") " pod="openshift-dns/node-resolver-82j9v"
Oct 30 20:35:41.878584 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.878528    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9516abf2-c993-442c-8c5e-34480e5113d6-etc-openvswitch\") pod \"ovnkube-node-7dh2x\" (UID: \"9516abf2-c993-442c-8c5e-34480e5113d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-7dh2x"
Oct 30 20:35:41.878584 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.878548    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9516abf2-c993-442c-8c5e-34480e5113d6-host-cni-bin\") pod \"ovnkube-node-7dh2x\" (UID: \"9516abf2-c993-442c-8c5e-34480e5113d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-7dh2x"
Oct 30 20:35:41.878584 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.878567    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a5b34407-cc7d-458e-aca3-cd48133834ad-etc-modprobe-d\") pod \"tuned-7cg9z\" (UID: \"a5b34407-cc7d-458e-aca3-cd48133834ad\") " pod="openshift-cluster-node-tuning-operator/tuned-7cg9z"
Oct 30 20:35:41.878945 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.878590    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/baefcab8-b5be-4143-9b55-7a86001a4363-cni-binary-copy\") pod \"multus-nmttt\" (UID: \"baefcab8-b5be-4143-9b55-7a86001a4363\") " pod="openshift-multus/multus-nmttt"
Oct 30 20:35:41.878945 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.878607    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/baefcab8-b5be-4143-9b55-7a86001a4363-host-var-lib-cni-multus\") pod \"multus-nmttt\" (UID: \"baefcab8-b5be-4143-9b55-7a86001a4363\") " pod="openshift-multus/multus-nmttt"
Oct 30 20:35:41.878945 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.878620    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5hmjh\" (UniqueName: \"kubernetes.io/projected/6e80b983-b2c0-4923-82b0-5903424cc7b0-kube-api-access-5hmjh\") pod \"aws-ebs-csi-driver-node-gqt4f\" (UID: \"6e80b983-b2c0-4923-82b0-5903424cc7b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gqt4f"
Oct 30 20:35:41.878945 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.878633    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9516abf2-c993-442c-8c5e-34480e5113d6-node-log\") pod \"ovnkube-node-7dh2x\" (UID: \"9516abf2-c993-442c-8c5e-34480e5113d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-7dh2x"
Oct 30 20:35:41.878945 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.878649    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9516abf2-c993-442c-8c5e-34480e5113d6-ovnkube-script-lib\") pod \"ovnkube-node-7dh2x\" (UID: \"9516abf2-c993-442c-8c5e-34480e5113d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-7dh2x"
Oct 30 20:35:41.878945 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.878676    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3e93e3cc-cd26-452f-9e40-31dedb0d198b-serviceca\") pod \"node-ca-5mml4\" (UID: \"3e93e3cc-cd26-452f-9e40-31dedb0d198b\") " pod="openshift-image-registry/node-ca-5mml4"
Oct 30 20:35:41.878945 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.878702    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/baefcab8-b5be-4143-9b55-7a86001a4363-etc-kubernetes\") pod \"multus-nmttt\" (UID: \"baefcab8-b5be-4143-9b55-7a86001a4363\") " pod="openshift-multus/multus-nmttt"
Oct 30 20:35:41.878945 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.878723    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6e80b983-b2c0-4923-82b0-5903424cc7b0-sys-fs\") pod \"aws-ebs-csi-driver-node-gqt4f\" (UID: \"6e80b983-b2c0-4923-82b0-5903424cc7b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gqt4f"
Oct 30 20:35:41.878945 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.878757    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9516abf2-c993-442c-8c5e-34480e5113d6-run-systemd\") pod \"ovnkube-node-7dh2x\" (UID: \"9516abf2-c993-442c-8c5e-34480e5113d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-7dh2x"
Oct 30 20:35:41.878945 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.878783    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9516abf2-c993-442c-8c5e-34480e5113d6-host-run-ovn-kubernetes\") pod \"ovnkube-node-7dh2x\" (UID: \"9516abf2-c993-442c-8c5e-34480e5113d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-7dh2x"
Oct 30 20:35:41.878945 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.878799    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9516abf2-c993-442c-8c5e-34480e5113d6-ovn-node-metrics-cert\") pod \"ovnkube-node-7dh2x\" (UID: \"9516abf2-c993-442c-8c5e-34480e5113d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-7dh2x"
Oct 30 20:35:41.878945 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.878820    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a5b34407-cc7d-458e-aca3-cd48133834ad-etc-kubernetes\") pod \"tuned-7cg9z\" (UID: \"a5b34407-cc7d-458e-aca3-cd48133834ad\") " pod="openshift-cluster-node-tuning-operator/tuned-7cg9z"
Oct 30 20:35:41.878945 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.878873    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/be756835-3011-4186-ab61-8128121eb95b-cni-binary-copy\") pod \"multus-additional-cni-plugins-n7knr\" (UID: \"be756835-3011-4186-ab61-8128121eb95b\") " pod="openshift-multus/multus-additional-cni-plugins-n7knr"
Oct 30 20:35:41.878945 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.878902    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/be756835-3011-4186-ab61-8128121eb95b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-n7knr\" (UID: \"be756835-3011-4186-ab61-8128121eb95b\") " pod="openshift-multus/multus-additional-cni-plugins-n7knr"
Oct 30 20:35:41.878945 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.878931    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a5b34407-cc7d-458e-aca3-cd48133834ad-tmp\") pod \"tuned-7cg9z\" (UID: \"a5b34407-cc7d-458e-aca3-cd48133834ad\") " pod="openshift-cluster-node-tuning-operator/tuned-7cg9z"
Oct 30 20:35:41.879425 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.878971    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6e80b983-b2c0-4923-82b0-5903424cc7b0-device-dir\") pod \"aws-ebs-csi-driver-node-gqt4f\" (UID: \"6e80b983-b2c0-4923-82b0-5903424cc7b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gqt4f"
Oct 30 20:35:41.879425 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.878997    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d0bb5f1b-4370-4e8d-80a8-1a7bcda13cd2-metrics-certs\") pod \"network-metrics-daemon-f45fg\" (UID: \"d0bb5f1b-4370-4e8d-80a8-1a7bcda13cd2\") " pod="openshift-multus/network-metrics-daemon-f45fg"
Oct 30 20:35:41.879425 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.879012    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9516abf2-c993-442c-8c5e-34480e5113d6-systemd-units\") pod \"ovnkube-node-7dh2x\" (UID: \"9516abf2-c993-442c-8c5e-34480e5113d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-7dh2x"
Oct 30 20:35:41.879425 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.879026    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8rgwr\" (UniqueName: \"kubernetes.io/projected/be756835-3011-4186-ab61-8128121eb95b-kube-api-access-8rgwr\") pod \"multus-additional-cni-plugins-n7knr\" (UID: \"be756835-3011-4186-ab61-8128121eb95b\") " pod="openshift-multus/multus-additional-cni-plugins-n7knr"
Oct 30 20:35:41.879425 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.879040    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/96b48bb2-933f-483d-8f15-5cca00c3d613-host-slash\") pod \"iptables-alerter-cfbz6\" (UID: \"96b48bb2-933f-483d-8f15-5cca00c3d613\") " pod="openshift-network-operator/iptables-alerter-cfbz6"
Oct 30 20:35:41.879425 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.879065    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/baefcab8-b5be-4143-9b55-7a86001a4363-multus-cni-dir\") pod \"multus-nmttt\" (UID: \"baefcab8-b5be-4143-9b55-7a86001a4363\") " pod="openshift-multus/multus-nmttt"
Oct 30 20:35:41.879425 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.879093    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6e80b983-b2c0-4923-82b0-5903424cc7b0-socket-dir\") pod \"aws-ebs-csi-driver-node-gqt4f\" (UID: \"6e80b983-b2c0-4923-82b0-5903424cc7b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gqt4f"
Oct 30 20:35:41.879425 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.879117    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9516abf2-c993-442c-8c5e-34480e5113d6-var-lib-openvswitch\") pod \"ovnkube-node-7dh2x\" (UID: \"9516abf2-c993-442c-8c5e-34480e5113d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-7dh2x"
Oct 30 20:35:41.879425 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.879148    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a5b34407-cc7d-458e-aca3-cd48133834ad-etc-sysconfig\") pod \"tuned-7cg9z\" (UID: \"a5b34407-cc7d-458e-aca3-cd48133834ad\") " pod="openshift-cluster-node-tuning-operator/tuned-7cg9z"
Oct 30 20:35:41.879425 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.879170    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/261f6884-299b-4971-b936-bbb3174f1b66-original-pull-secret\") pod \"global-pull-secret-syncer-cfdhw\" (UID: \"261f6884-299b-4971-b936-bbb3174f1b66\") " pod="kube-system/global-pull-secret-syncer-cfdhw"
Oct 30 20:35:41.879425 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.879199    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9516abf2-c993-442c-8c5e-34480e5113d6-host-kubelet\") pod \"ovnkube-node-7dh2x\" (UID: \"9516abf2-c993-442c-8c5e-34480e5113d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-7dh2x"
Oct 30 20:35:41.879425 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.879222    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9516abf2-c993-442c-8c5e-34480e5113d6-ovnkube-config\") pod \"ovnkube-node-7dh2x\" (UID: \"9516abf2-c993-442c-8c5e-34480e5113d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-7dh2x"
Oct 30 20:35:41.879425 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.879244    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/baefcab8-b5be-4143-9b55-7a86001a4363-host-var-lib-cni-bin\") pod \"multus-nmttt\" (UID: \"baefcab8-b5be-4143-9b55-7a86001a4363\") " pod="openshift-multus/multus-nmttt"
Oct 30 20:35:41.879425 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.879298    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/70cf9a0e-c321-438d-83a2-2034f4df9034-agent-certs\") pod \"konnectivity-agent-mlgfz\" (UID: \"70cf9a0e-c321-438d-83a2-2034f4df9034\") " pod="kube-system/konnectivity-agent-mlgfz"
Oct 30 20:35:41.879425 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.879328    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6e80b983-b2c0-4923-82b0-5903424cc7b0-etc-selinux\") pod \"aws-ebs-csi-driver-node-gqt4f\" (UID: \"6e80b983-b2c0-4923-82b0-5903424cc7b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gqt4f"
Oct 30 20:35:41.879425 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.879352    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a5b34407-cc7d-458e-aca3-cd48133834ad-lib-modules\") pod \"tuned-7cg9z\" (UID: \"a5b34407-cc7d-458e-aca3-cd48133834ad\") " pod="openshift-cluster-node-tuning-operator/tuned-7cg9z"
Oct 30 20:35:41.879860 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.879378    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2mzs4\" (UniqueName: \"kubernetes.io/projected/baefcab8-b5be-4143-9b55-7a86001a4363-kube-api-access-2mzs4\") pod \"multus-nmttt\" (UID: \"baefcab8-b5be-4143-9b55-7a86001a4363\") " pod="openshift-multus/multus-nmttt"
Oct 30 20:35:41.879860 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.879401    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1930df66-da42-4ad8-bfe0-5e92f9e07ebc-hosts-file\") pod \"node-resolver-82j9v\" (UID: \"1930df66-da42-4ad8-bfe0-5e92f9e07ebc\") " pod="openshift-dns/node-resolver-82j9v"
Oct 30 20:35:41.879860 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.879419    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/261f6884-299b-4971-b936-bbb3174f1b66-kubelet-config\") pod \"global-pull-secret-syncer-cfdhw\" (UID: \"261f6884-299b-4971-b936-bbb3174f1b66\") " pod="kube-system/global-pull-secret-syncer-cfdhw"
Oct 30 20:35:41.879860 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.879434    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dqsnt\" (UniqueName: \"kubernetes.io/projected/d0bb5f1b-4370-4e8d-80a8-1a7bcda13cd2-kube-api-access-dqsnt\") pod \"network-metrics-daemon-f45fg\" (UID: \"d0bb5f1b-4370-4e8d-80a8-1a7bcda13cd2\") " pod="openshift-multus/network-metrics-daemon-f45fg"
Oct 30 20:35:41.897236 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.897219    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-8v9jn\""
Oct 30 20:35:41.897328 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.897218    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Oct 30 20:35:41.897328 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.897222    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Oct 30 20:35:41.897328 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.897223    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Oct 30 20:35:41.903029 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.903014    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Oct 30 20:35:41.903123 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.903110    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-b4p7g\""
Oct 30 20:35:41.903165 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.903134    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Oct 30 20:35:41.903329 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.903317    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Oct 30 20:35:41.903329 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.903325    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Oct 30 20:35:41.907078 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.907063    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Oct 30 20:35:41.907325 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.907312    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Oct 30 20:35:41.907409 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.907395    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Oct 30 20:35:41.907450 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.907422    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Oct 30 20:35:41.907512 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.907487    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Oct 30 20:35:41.907549 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.907528    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-mx55q\""
Oct 30 20:35:41.907626 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.907612    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Oct 30 20:35:41.909228 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.909215    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Oct 30 20:35:41.909401 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.909390    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Oct 30 20:35:41.909544 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.909531    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-hbdn4\""
Oct 30 20:35:41.911692 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.911674    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-k65fh\""
Oct 30 20:35:41.911747 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.911717    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Oct 30 20:35:41.911747 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.911719    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Oct 30 20:35:41.913990 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.913979    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Oct 30 20:35:41.914031 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.913992    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Oct 30 20:35:41.914286 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.914275    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-l8lvp\""
Oct 30 20:35:41.942893 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.942876    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-pdv7w\""
Oct 30 20:35:41.943821 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.943805    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Oct 30 20:35:41.944114 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.944101    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-2mcfh\""
Oct 30 20:35:41.944165 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.944154    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-k4gm7\""
Oct 30 20:35:41.944393 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.944380    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Oct 30 20:35:41.944632 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.944619    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Oct 30 20:35:41.944666 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.944622    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Oct 30 20:35:41.944666 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.944648    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Oct 30 20:35:41.945217 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.945204    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Oct 30 20:35:41.945248 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.945206    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Oct 30 20:35:41.945277 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.945258    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Oct 30 20:35:41.967237 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.967218    2575 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Oct 30 20:35:41.980461 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.980441    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/261f6884-299b-4971-b936-bbb3174f1b66-dbus\") pod \"global-pull-secret-syncer-cfdhw\" (UID: \"261f6884-299b-4971-b936-bbb3174f1b66\") " pod="kube-system/global-pull-secret-syncer-cfdhw"
Oct 30 20:35:41.980543 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.980467    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9516abf2-c993-442c-8c5e-34480e5113d6-log-socket\") pod \"ovnkube-node-7dh2x\" (UID: \"9516abf2-c993-442c-8c5e-34480e5113d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-7dh2x"
Oct 30 20:35:41.980543 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.980483    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a5b34407-cc7d-458e-aca3-cd48133834ad-etc-tuned\") pod \"tuned-7cg9z\" (UID: \"a5b34407-cc7d-458e-aca3-cd48133834ad\") " pod="openshift-cluster-node-tuning-operator/tuned-7cg9z"
Oct 30 20:35:41.980543 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.980519    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/baefcab8-b5be-4143-9b55-7a86001a4363-cnibin\") pod \"multus-nmttt\" (UID: \"baefcab8-b5be-4143-9b55-7a86001a4363\") " pod="openshift-multus/multus-nmttt"
Oct 30 20:35:41.980543 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.980539    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/baefcab8-b5be-4143-9b55-7a86001a4363-multus-socket-dir-parent\") pod \"multus-nmttt\" (UID: \"baefcab8-b5be-4143-9b55-7a86001a4363\") " pod="openshift-multus/multus-nmttt"
Oct 30 20:35:41.980729 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.980558    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a5b34407-cc7d-458e-aca3-cd48133834ad-etc-sysctl-d\") pod \"tuned-7cg9z\" (UID: \"a5b34407-cc7d-458e-aca3-cd48133834ad\") " pod="openshift-cluster-node-tuning-operator/tuned-7cg9z"
Oct 30 20:35:41.980729 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.980563    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9516abf2-c993-442c-8c5e-34480e5113d6-log-socket\") pod \"ovnkube-node-7dh2x\" (UID: \"9516abf2-c993-442c-8c5e-34480e5113d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-7dh2x"
Oct 30 20:35:41.980729 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.980577    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/96b48bb2-933f-483d-8f15-5cca00c3d613-iptables-alerter-script\") pod \"iptables-alerter-cfbz6\" (UID: \"96b48bb2-933f-483d-8f15-5cca00c3d613\") " pod="openshift-network-operator/iptables-alerter-cfbz6"
Oct 30 20:35:41.980729 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.980617    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/baefcab8-b5be-4143-9b55-7a86001a4363-cnibin\") pod \"multus-nmttt\" (UID: \"baefcab8-b5be-4143-9b55-7a86001a4363\") " pod="openshift-multus/multus-nmttt"
Oct 30 20:35:41.980729 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.980616    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/baefcab8-b5be-4143-9b55-7a86001a4363-host-run-multus-certs\") pod \"multus-nmttt\" (UID: \"baefcab8-b5be-4143-9b55-7a86001a4363\") " pod="openshift-multus/multus-nmttt"
Oct 30 20:35:41.980729 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.980652    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/baefcab8-b5be-4143-9b55-7a86001a4363-host-run-multus-certs\") pod \"multus-nmttt\" (UID: \"baefcab8-b5be-4143-9b55-7a86001a4363\") " pod="openshift-multus/multus-nmttt"
Oct 30 20:35:41.980729 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.980661    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1930df66-da42-4ad8-bfe0-5e92f9e07ebc-tmp-dir\") pod \"node-resolver-82j9v\" (UID: \"1930df66-da42-4ad8-bfe0-5e92f9e07ebc\") " pod="openshift-dns/node-resolver-82j9v"
Oct 30 20:35:41.980729 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.980687    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9516abf2-c993-442c-8c5e-34480e5113d6-host-run-netns\") pod \"ovnkube-node-7dh2x\" (UID: \"9516abf2-c993-442c-8c5e-34480e5113d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-7dh2x"
Oct 30 20:35:41.980729 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.980697    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/261f6884-299b-4971-b936-bbb3174f1b66-dbus\") pod \"global-pull-secret-syncer-cfdhw\" (UID: \"261f6884-299b-4971-b936-bbb3174f1b66\") " pod="kube-system/global-pull-secret-syncer-cfdhw"
Oct 30 20:35:41.980729 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.980708    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/baefcab8-b5be-4143-9b55-7a86001a4363-multus-socket-dir-parent\") pod \"multus-nmttt\" (UID: \"baefcab8-b5be-4143-9b55-7a86001a4363\") " pod="openshift-multus/multus-nmttt"
Oct 30 20:35:41.980729 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.980697    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a5b34407-cc7d-458e-aca3-cd48133834ad-etc-sysctl-d\") pod \"tuned-7cg9z\" (UID: \"a5b34407-cc7d-458e-aca3-cd48133834ad\") " pod="openshift-cluster-node-tuning-operator/tuned-7cg9z"
Oct 30 20:35:41.980729 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.980723    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9516abf2-c993-442c-8c5e-34480e5113d6-host-run-netns\") pod \"ovnkube-node-7dh2x\" (UID: \"9516abf2-c993-442c-8c5e-34480e5113d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-7dh2x"
Oct 30 20:35:41.980729 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.980730    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9516abf2-c993-442c-8c5e-34480e5113d6-run-openvswitch\") pod \"ovnkube-node-7dh2x\" (UID: \"9516abf2-c993-442c-8c5e-34480e5113d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-7dh2x"
Oct 30 20:35:41.981174 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.980753    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9516abf2-c993-442c-8c5e-34480e5113d6-host-cni-netd\") pod \"ovnkube-node-7dh2x\" (UID: \"9516abf2-c993-442c-8c5e-34480e5113d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-7dh2x"
Oct 30 20:35:41.981174 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.980774    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9516abf2-c993-442c-8c5e-34480e5113d6-run-openvswitch\") pod \"ovnkube-node-7dh2x\" (UID: \"9516abf2-c993-442c-8c5e-34480e5113d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-7dh2x"
Oct 30 20:35:41.981174 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.980777    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a5b34407-cc7d-458e-aca3-cd48133834ad-etc-systemd\") pod \"tuned-7cg9z\" (UID: \"a5b34407-cc7d-458e-aca3-cd48133834ad\") " pod="openshift-cluster-node-tuning-operator/tuned-7cg9z"
Oct 30 20:35:41.981174 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.980810    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a5b34407-cc7d-458e-aca3-cd48133834ad-etc-systemd\") pod \"tuned-7cg9z\" (UID: \"a5b34407-cc7d-458e-aca3-cd48133834ad\") " pod="openshift-cluster-node-tuning-operator/tuned-7cg9z"
Oct 30 20:35:41.981174 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.980830    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a5b34407-cc7d-458e-aca3-cd48133834ad-sys\") pod \"tuned-7cg9z\" (UID: \"a5b34407-cc7d-458e-aca3-cd48133834ad\") " pod="openshift-cluster-node-tuning-operator/tuned-7cg9z"
Oct 30 20:35:41.981174 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.980849    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2xx6z\" (UniqueName: \"kubernetes.io/projected/a5b34407-cc7d-458e-aca3-cd48133834ad-kube-api-access-2xx6z\") pod \"tuned-7cg9z\" (UID: \"a5b34407-cc7d-458e-aca3-cd48133834ad\") " pod="openshift-cluster-node-tuning-operator/tuned-7cg9z"
Oct 30 20:35:41.981174 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.980864    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/be756835-3011-4186-ab61-8128121eb95b-cnibin\") pod \"multus-additional-cni-plugins-n7knr\" (UID: \"be756835-3011-4186-ab61-8128121eb95b\") " pod="openshift-multus/multus-additional-cni-plugins-n7knr"
Oct 30 20:35:41.981174 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.980803    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9516abf2-c993-442c-8c5e-34480e5113d6-host-cni-netd\") pod \"ovnkube-node-7dh2x\" (UID: \"9516abf2-c993-442c-8c5e-34480e5113d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-7dh2x"
Oct 30 20:35:41.981174 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.980882    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9516abf2-c993-442c-8c5e-34480e5113d6-host-slash\") pod \"ovnkube-node-7dh2x\" (UID: \"9516abf2-c993-442c-8c5e-34480e5113d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-7dh2x"
Oct 30 20:35:41.981174 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.980905    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a5b34407-cc7d-458e-aca3-cd48133834ad-run\") pod \"tuned-7cg9z\" (UID: \"a5b34407-cc7d-458e-aca3-cd48133834ad\") " pod="openshift-cluster-node-tuning-operator/tuned-7cg9z"
Oct 30 20:35:41.981174 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.980919    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/be756835-3011-4186-ab61-8128121eb95b-cnibin\") pod \"multus-additional-cni-plugins-n7knr\" (UID: \"be756835-3011-4186-ab61-8128121eb95b\") " pod="openshift-multus/multus-additional-cni-plugins-n7knr"
Oct 30 20:35:41.981174 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.980931    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/be756835-3011-4186-ab61-8128121eb95b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-n7knr\" (UID: \"be756835-3011-4186-ab61-8128121eb95b\") " pod="openshift-multus/multus-additional-cni-plugins-n7knr"
Oct 30 20:35:41.981174 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.980941    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9516abf2-c993-442c-8c5e-34480e5113d6-host-slash\") pod \"ovnkube-node-7dh2x\" (UID: \"9516abf2-c993-442c-8c5e-34480e5113d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-7dh2x"
Oct 30 20:35:41.981174 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.980961    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lgp2l\" (UniqueName: \"kubernetes.io/projected/3e93e3cc-cd26-452f-9e40-31dedb0d198b-kube-api-access-lgp2l\") pod \"node-ca-5mml4\" (UID: \"3e93e3cc-cd26-452f-9e40-31dedb0d198b\") " pod="openshift-image-registry/node-ca-5mml4"
Oct 30 20:35:41.981174 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.980966    2575 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Oct 30 20:35:41.981174 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.980982    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a5b34407-cc7d-458e-aca3-cd48133834ad-run\") pod \"tuned-7cg9z\" (UID: \"a5b34407-cc7d-458e-aca3-cd48133834ad\") " pod="openshift-cluster-node-tuning-operator/tuned-7cg9z"
Oct 30 20:35:41.981174 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.980985    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9516abf2-c993-442c-8c5e-34480e5113d6-run-ovn\") pod \"ovnkube-node-7dh2x\" (UID: \"9516abf2-c993-442c-8c5e-34480e5113d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-7dh2x"
Oct 30 20:35:41.981174 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.981017    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a5b34407-cc7d-458e-aca3-cd48133834ad-host\") pod \"tuned-7cg9z\" (UID: \"a5b34407-cc7d-458e-aca3-cd48133834ad\") " pod="openshift-cluster-node-tuning-operator/tuned-7cg9z"
Oct 30 20:35:41.981892 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.981039    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/baefcab8-b5be-4143-9b55-7a86001a4363-host-run-netns\") pod \"multus-nmttt\" (UID: \"baefcab8-b5be-4143-9b55-7a86001a4363\") " pod="openshift-multus/multus-nmttt"
Oct 30 20:35:41.981892 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.981020    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9516abf2-c993-442c-8c5e-34480e5113d6-run-ovn\") pod \"ovnkube-node-7dh2x\" (UID: \"9516abf2-c993-442c-8c5e-34480e5113d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-7dh2x"
Oct 30 20:35:41.981892 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.981067    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nsvqk\" (UniqueName: \"kubernetes.io/projected/1930df66-da42-4ad8-bfe0-5e92f9e07ebc-kube-api-access-nsvqk\") pod \"node-resolver-82j9v\" (UID: \"1930df66-da42-4ad8-bfe0-5e92f9e07ebc\") " pod="openshift-dns/node-resolver-82j9v"
Oct 30 20:35:41.981892 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.981085    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a5b34407-cc7d-458e-aca3-cd48133834ad-host\") pod \"tuned-7cg9z\" (UID: \"a5b34407-cc7d-458e-aca3-cd48133834ad\") " pod="openshift-cluster-node-tuning-operator/tuned-7cg9z"
Oct 30 20:35:41.981892 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.981094    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9516abf2-c993-442c-8c5e-34480e5113d6-etc-openvswitch\") pod \"ovnkube-node-7dh2x\" (UID: \"9516abf2-c993-442c-8c5e-34480e5113d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-7dh2x"
Oct 30 20:35:41.981892 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.981088    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/baefcab8-b5be-4143-9b55-7a86001a4363-host-run-netns\") pod \"multus-nmttt\" (UID: \"baefcab8-b5be-4143-9b55-7a86001a4363\") " pod="openshift-multus/multus-nmttt"
Oct 30 20:35:41.981892 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.981115    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9516abf2-c993-442c-8c5e-34480e5113d6-host-cni-bin\") pod \"ovnkube-node-7dh2x\" (UID: \"9516abf2-c993-442c-8c5e-34480e5113d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-7dh2x"
Oct 30 20:35:41.981892 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.981136    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9516abf2-c993-442c-8c5e-34480e5113d6-host-cni-bin\") pod \"ovnkube-node-7dh2x\" (UID: \"9516abf2-c993-442c-8c5e-34480e5113d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-7dh2x"
Oct 30 20:35:41.981892 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.981151    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a5b34407-cc7d-458e-aca3-cd48133834ad-etc-modprobe-d\") pod \"tuned-7cg9z\" (UID: \"a5b34407-cc7d-458e-aca3-cd48133834ad\") " pod="openshift-cluster-node-tuning-operator/tuned-7cg9z"
Oct 30 20:35:41.981892 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.981090    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a5b34407-cc7d-458e-aca3-cd48133834ad-sys\") pod \"tuned-7cg9z\" (UID: \"a5b34407-cc7d-458e-aca3-cd48133834ad\") " pod="openshift-cluster-node-tuning-operator/tuned-7cg9z"
Oct 30 20:35:41.981892 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.981159    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9516abf2-c993-442c-8c5e-34480e5113d6-etc-openvswitch\") pod \"ovnkube-node-7dh2x\" (UID: \"9516abf2-c993-442c-8c5e-34480e5113d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-7dh2x"
Oct 30 20:35:41.981892 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.981176    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/baefcab8-b5be-4143-9b55-7a86001a4363-cni-binary-copy\") pod \"multus-nmttt\" (UID: \"baefcab8-b5be-4143-9b55-7a86001a4363\") " pod="openshift-multus/multus-nmttt"
Oct 30 20:35:41.981892 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.981209    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/baefcab8-b5be-4143-9b55-7a86001a4363-host-var-lib-cni-multus\") pod \"multus-nmttt\" (UID: \"baefcab8-b5be-4143-9b55-7a86001a4363\") " pod="openshift-multus/multus-nmttt"
Oct 30 20:35:41.981892 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.981227    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5hmjh\" (UniqueName: \"kubernetes.io/projected/6e80b983-b2c0-4923-82b0-5903424cc7b0-kube-api-access-5hmjh\") pod \"aws-ebs-csi-driver-node-gqt4f\" (UID: \"6e80b983-b2c0-4923-82b0-5903424cc7b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gqt4f"
Oct 30 20:35:41.981892 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.981231    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a5b34407-cc7d-458e-aca3-cd48133834ad-etc-modprobe-d\") pod \"tuned-7cg9z\" (UID: \"a5b34407-cc7d-458e-aca3-cd48133834ad\") " pod="openshift-cluster-node-tuning-operator/tuned-7cg9z"
Oct 30 20:35:41.981892 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.981256    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9516abf2-c993-442c-8c5e-34480e5113d6-node-log\") pod \"ovnkube-node-7dh2x\" (UID: \"9516abf2-c993-442c-8c5e-34480e5113d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-7dh2x"
Oct 30 20:35:41.981892 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.981358    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9516abf2-c993-442c-8c5e-34480e5113d6-ovnkube-script-lib\") pod \"ovnkube-node-7dh2x\" (UID: \"9516abf2-c993-442c-8c5e-34480e5113d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-7dh2x"
Oct 30 20:35:41.981892 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.981385    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3e93e3cc-cd26-452f-9e40-31dedb0d198b-serviceca\") pod \"node-ca-5mml4\" (UID: \"3e93e3cc-cd26-452f-9e40-31dedb0d198b\") " pod="openshift-image-registry/node-ca-5mml4"
Oct 30 20:35:41.982706 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.981413    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/baefcab8-b5be-4143-9b55-7a86001a4363-etc-kubernetes\") pod \"multus-nmttt\" (UID: \"baefcab8-b5be-4143-9b55-7a86001a4363\") " pod="openshift-multus/multus-nmttt"
Oct 30 20:35:41.982706 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.981445    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6e80b983-b2c0-4923-82b0-5903424cc7b0-sys-fs\") pod \"aws-ebs-csi-driver-node-gqt4f\" (UID: \"6e80b983-b2c0-4923-82b0-5903424cc7b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gqt4f"
Oct 30 20:35:41.982706 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.981473    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9516abf2-c993-442c-8c5e-34480e5113d6-run-systemd\") pod \"ovnkube-node-7dh2x\" (UID: \"9516abf2-c993-442c-8c5e-34480e5113d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-7dh2x"
Oct 30 20:35:41.982706 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.981510    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9516abf2-c993-442c-8c5e-34480e5113d6-host-run-ovn-kubernetes\") pod \"ovnkube-node-7dh2x\" (UID: \"9516abf2-c993-442c-8c5e-34480e5113d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-7dh2x"
Oct 30 20:35:41.982706 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.981536    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9516abf2-c993-442c-8c5e-34480e5113d6-ovn-node-metrics-cert\") pod \"ovnkube-node-7dh2x\" (UID: \"9516abf2-c993-442c-8c5e-34480e5113d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-7dh2x"
Oct 30 20:35:41.982706 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.981561    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a5b34407-cc7d-458e-aca3-cd48133834ad-etc-kubernetes\") pod \"tuned-7cg9z\" (UID: \"a5b34407-cc7d-458e-aca3-cd48133834ad\") " pod="openshift-cluster-node-tuning-operator/tuned-7cg9z"
Oct 30 20:35:41.982706 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.981583    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/be756835-3011-4186-ab61-8128121eb95b-cni-binary-copy\") pod \"multus-additional-cni-plugins-n7knr\" (UID: \"be756835-3011-4186-ab61-8128121eb95b\") " pod="openshift-multus/multus-additional-cni-plugins-n7knr"
Oct 30 20:35:41.982706 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.981606    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/be756835-3011-4186-ab61-8128121eb95b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-n7knr\" (UID: \"be756835-3011-4186-ab61-8128121eb95b\") " pod="openshift-multus/multus-additional-cni-plugins-n7knr"
Oct 30 20:35:41.982706 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.981626    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a5b34407-cc7d-458e-aca3-cd48133834ad-tmp\") pod \"tuned-7cg9z\" (UID: \"a5b34407-cc7d-458e-aca3-cd48133834ad\") " pod="openshift-cluster-node-tuning-operator/tuned-7cg9z"
Oct 30 20:35:41.982706 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.981647    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6e80b983-b2c0-4923-82b0-5903424cc7b0-device-dir\") pod \"aws-ebs-csi-driver-node-gqt4f\" (UID: \"6e80b983-b2c0-4923-82b0-5903424cc7b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gqt4f"
Oct 30 20:35:41.982706 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.981674    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d0bb5f1b-4370-4e8d-80a8-1a7bcda13cd2-metrics-certs\") pod \"network-metrics-daemon-f45fg\" (UID: \"d0bb5f1b-4370-4e8d-80a8-1a7bcda13cd2\") " pod="openshift-multus/network-metrics-daemon-f45fg"
Oct 30 20:35:41.982706 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.981698    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9516abf2-c993-442c-8c5e-34480e5113d6-systemd-units\") pod \"ovnkube-node-7dh2x\" (UID: \"9516abf2-c993-442c-8c5e-34480e5113d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-7dh2x"
Oct 30 20:35:41.982706 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.981745    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8rgwr\" (UniqueName: \"kubernetes.io/projected/be756835-3011-4186-ab61-8128121eb95b-kube-api-access-8rgwr\") pod \"multus-additional-cni-plugins-n7knr\" (UID: \"be756835-3011-4186-ab61-8128121eb95b\") " pod="openshift-multus/multus-additional-cni-plugins-n7knr"
Oct 30 20:35:41.982706 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.981768    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/96b48bb2-933f-483d-8f15-5cca00c3d613-host-slash\") pod \"iptables-alerter-cfbz6\" (UID: \"96b48bb2-933f-483d-8f15-5cca00c3d613\") " pod="openshift-network-operator/iptables-alerter-cfbz6"
Oct 30 20:35:41.982706 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.981791    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/baefcab8-b5be-4143-9b55-7a86001a4363-multus-cni-dir\") pod \"multus-nmttt\" (UID: \"baefcab8-b5be-4143-9b55-7a86001a4363\") " pod="openshift-multus/multus-nmttt"
Oct 30 20:35:41.982706 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.981816    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6e80b983-b2c0-4923-82b0-5903424cc7b0-socket-dir\") pod \"aws-ebs-csi-driver-node-gqt4f\" (UID: \"6e80b983-b2c0-4923-82b0-5903424cc7b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gqt4f"
Oct 30 20:35:41.982706 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.981848    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9516abf2-c993-442c-8c5e-34480e5113d6-var-lib-openvswitch\") pod \"ovnkube-node-7dh2x\" (UID: \"9516abf2-c993-442c-8c5e-34480e5113d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-7dh2x"
Oct 30 20:35:41.983448 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.981879    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a5b34407-cc7d-458e-aca3-cd48133834ad-etc-sysconfig\") pod \"tuned-7cg9z\" (UID: \"a5b34407-cc7d-458e-aca3-cd48133834ad\") " pod="openshift-cluster-node-tuning-operator/tuned-7cg9z"
Oct 30 20:35:41.983448 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.981910    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/261f6884-299b-4971-b936-bbb3174f1b66-original-pull-secret\") pod \"global-pull-secret-syncer-cfdhw\" (UID: \"261f6884-299b-4971-b936-bbb3174f1b66\") " pod="kube-system/global-pull-secret-syncer-cfdhw"
Oct 30 20:35:41.983448 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.981938    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9516abf2-c993-442c-8c5e-34480e5113d6-host-kubelet\") pod \"ovnkube-node-7dh2x\" (UID: \"9516abf2-c993-442c-8c5e-34480e5113d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-7dh2x"
Oct 30 20:35:41.983448 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.981962    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9516abf2-c993-442c-8c5e-34480e5113d6-ovnkube-config\") pod \"ovnkube-node-7dh2x\" (UID: \"9516abf2-c993-442c-8c5e-34480e5113d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-7dh2x"
Oct 30 20:35:41.983448 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.982010    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/baefcab8-b5be-4143-9b55-7a86001a4363-host-var-lib-cni-bin\") pod \"multus-nmttt\" (UID: \"baefcab8-b5be-4143-9b55-7a86001a4363\") " pod="openshift-multus/multus-nmttt"
Oct 30 20:35:41.983448 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.981363    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/baefcab8-b5be-4143-9b55-7a86001a4363-host-var-lib-cni-multus\") pod \"multus-nmttt\" (UID: \"baefcab8-b5be-4143-9b55-7a86001a4363\") " pod="openshift-multus/multus-nmttt"
Oct 30 20:35:41.983448 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.982035    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/70cf9a0e-c321-438d-83a2-2034f4df9034-agent-certs\") pod \"konnectivity-agent-mlgfz\" (UID: \"70cf9a0e-c321-438d-83a2-2034f4df9034\") " pod="kube-system/konnectivity-agent-mlgfz"
Oct 30 20:35:41.983448 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.982077    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6e80b983-b2c0-4923-82b0-5903424cc7b0-etc-selinux\") pod \"aws-ebs-csi-driver-node-gqt4f\" (UID: \"6e80b983-b2c0-4923-82b0-5903424cc7b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gqt4f"
Oct 30 20:35:41.983448 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.982101    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3e93e3cc-cd26-452f-9e40-31dedb0d198b-serviceca\") pod \"node-ca-5mml4\" (UID: \"3e93e3cc-cd26-452f-9e40-31dedb0d198b\") " pod="openshift-image-registry/node-ca-5mml4"
Oct 30 20:35:41.983448 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.982112    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/96b48bb2-933f-483d-8f15-5cca00c3d613-iptables-alerter-script\") pod \"iptables-alerter-cfbz6\" (UID: \"96b48bb2-933f-483d-8f15-5cca00c3d613\") " pod="openshift-network-operator/iptables-alerter-cfbz6"
Oct 30 20:35:41.983448 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.982122    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a5b34407-cc7d-458e-aca3-cd48133834ad-lib-modules\") pod \"tuned-7cg9z\" (UID: \"a5b34407-cc7d-458e-aca3-cd48133834ad\") " pod="openshift-cluster-node-tuning-operator/tuned-7cg9z"
Oct 30 20:35:41.983448 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.982151    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2mzs4\" (UniqueName: \"kubernetes.io/projected/baefcab8-b5be-4143-9b55-7a86001a4363-kube-api-access-2mzs4\") pod \"multus-nmttt\" (UID: \"baefcab8-b5be-4143-9b55-7a86001a4363\") " pod="openshift-multus/multus-nmttt"
Oct 30 20:35:41.983448 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.982162    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/baefcab8-b5be-4143-9b55-7a86001a4363-cni-binary-copy\") pod \"multus-nmttt\" (UID: \"baefcab8-b5be-4143-9b55-7a86001a4363\") " pod="openshift-multus/multus-nmttt"
Oct 30 20:35:41.983448 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.981673    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9516abf2-c993-442c-8c5e-34480e5113d6-node-log\") pod \"ovnkube-node-7dh2x\" (UID: \"9516abf2-c993-442c-8c5e-34480e5113d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-7dh2x"
Oct 30 20:35:41.983448 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.982182    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1930df66-da42-4ad8-bfe0-5e92f9e07ebc-hosts-file\") pod \"node-resolver-82j9v\" (UID: \"1930df66-da42-4ad8-bfe0-5e92f9e07ebc\") " pod="openshift-dns/node-resolver-82j9v"
Oct 30 20:35:41.983448 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.982193    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/be756835-3011-4186-ab61-8128121eb95b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-n7knr\" (UID: \"be756835-3011-4186-ab61-8128121eb95b\") " pod="openshift-multus/multus-additional-cni-plugins-n7knr"
Oct 30 20:35:41.983448 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.982217    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6e80b983-b2c0-4923-82b0-5903424cc7b0-sys-fs\") pod \"aws-ebs-csi-driver-node-gqt4f\" (UID: \"6e80b983-b2c0-4923-82b0-5903424cc7b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gqt4f"
Oct 30 20:35:41.983448 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.982213    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/baefcab8-b5be-4143-9b55-7a86001a4363-etc-kubernetes\") pod \"multus-nmttt\" (UID: \"baefcab8-b5be-4143-9b55-7a86001a4363\") " pod="openshift-multus/multus-nmttt"
Oct 30 20:35:41.984079 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.981699    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1930df66-da42-4ad8-bfe0-5e92f9e07ebc-tmp-dir\") pod \"node-resolver-82j9v\" (UID: \"1930df66-da42-4ad8-bfe0-5e92f9e07ebc\") " pod="openshift-dns/node-resolver-82j9v"
Oct 30 20:35:41.984079 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.982286    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/261f6884-299b-4971-b936-bbb3174f1b66-kubelet-config\") pod \"global-pull-secret-syncer-cfdhw\" (UID: \"261f6884-299b-4971-b936-bbb3174f1b66\") " pod="kube-system/global-pull-secret-syncer-cfdhw"
Oct 30 20:35:41.984079 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.982360    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6e80b983-b2c0-4923-82b0-5903424cc7b0-device-dir\") pod \"aws-ebs-csi-driver-node-gqt4f\" (UID: \"6e80b983-b2c0-4923-82b0-5903424cc7b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gqt4f"
Oct 30 20:35:41.984079 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.982405    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/baefcab8-b5be-4143-9b55-7a86001a4363-multus-cni-dir\") pod \"multus-nmttt\" (UID: \"baefcab8-b5be-4143-9b55-7a86001a4363\") " pod="openshift-multus/multus-nmttt"
Oct 30 20:35:41.984079 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.982447    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/be756835-3011-4186-ab61-8128121eb95b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-n7knr\" (UID: \"be756835-3011-4186-ab61-8128121eb95b\") " pod="openshift-multus/multus-additional-cni-plugins-n7knr"
Oct 30 20:35:41.984079 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.982534    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6e80b983-b2c0-4923-82b0-5903424cc7b0-socket-dir\") pod \"aws-ebs-csi-driver-node-gqt4f\" (UID: \"6e80b983-b2c0-4923-82b0-5903424cc7b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gqt4f"
Oct 30 20:35:41.984079 ip-10-0-142-4 kubenswrapper[2575]: E1030 20:35:41.982548    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 20:35:41.984079 ip-10-0-142-4 kubenswrapper[2575]: E1030 20:35:41.982617    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/261f6884-299b-4971-b936-bbb3174f1b66-original-pull-secret podName:261f6884-299b-4971-b936-bbb3174f1b66 nodeName:}" failed. No retries permitted until 2026-10-30 20:35:42.482598694 +0000 UTC m=+3.082707280 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/261f6884-299b-4971-b936-bbb3174f1b66-original-pull-secret") pod "global-pull-secret-syncer-cfdhw" (UID: "261f6884-299b-4971-b936-bbb3174f1b66") : object "kube-system"/"original-pull-secret" not registered
Oct 30 20:35:41.984079 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.982662    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9516abf2-c993-442c-8c5e-34480e5113d6-ovnkube-script-lib\") pod \"ovnkube-node-7dh2x\" (UID: \"9516abf2-c993-442c-8c5e-34480e5113d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-7dh2x"
Oct 30 20:35:41.984079 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.982669    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9516abf2-c993-442c-8c5e-34480e5113d6-var-lib-openvswitch\") pod \"ovnkube-node-7dh2x\" (UID: \"9516abf2-c993-442c-8c5e-34480e5113d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-7dh2x"
Oct 30 20:35:41.984079 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.982718    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a5b34407-cc7d-458e-aca3-cd48133834ad-etc-sysconfig\") pod \"tuned-7cg9z\" (UID: \"a5b34407-cc7d-458e-aca3-cd48133834ad\") " pod="openshift-cluster-node-tuning-operator/tuned-7cg9z"
Oct 30 20:35:41.984079 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.982742    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9516abf2-c993-442c-8c5e-34480e5113d6-host-run-ovn-kubernetes\") pod \"ovnkube-node-7dh2x\" (UID: \"9516abf2-c993-442c-8c5e-34480e5113d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-7dh2x"
Oct 30 20:35:41.984079 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.982772    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1930df66-da42-4ad8-bfe0-5e92f9e07ebc-hosts-file\") pod \"node-resolver-82j9v\" (UID: \"1930df66-da42-4ad8-bfe0-5e92f9e07ebc\") " pod="openshift-dns/node-resolver-82j9v"
Oct 30 20:35:41.984079 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.982795    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9516abf2-c993-442c-8c5e-34480e5113d6-run-systemd\") pod \"ovnkube-node-7dh2x\" (UID: \"9516abf2-c993-442c-8c5e-34480e5113d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-7dh2x"
Oct 30 20:35:41.984079 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.982808    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/96b48bb2-933f-483d-8f15-5cca00c3d613-host-slash\") pod \"iptables-alerter-cfbz6\" (UID: \"96b48bb2-933f-483d-8f15-5cca00c3d613\") " pod="openshift-network-operator/iptables-alerter-cfbz6"
Oct 30 20:35:41.984079 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.982838    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9516abf2-c993-442c-8c5e-34480e5113d6-systemd-units\") pod \"ovnkube-node-7dh2x\" (UID: \"9516abf2-c993-442c-8c5e-34480e5113d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-7dh2x"
Oct 30 20:35:41.984079 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.982873    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6e80b983-b2c0-4923-82b0-5903424cc7b0-etc-selinux\") pod \"aws-ebs-csi-driver-node-gqt4f\" (UID: \"6e80b983-b2c0-4923-82b0-5903424cc7b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gqt4f"
Oct 30 20:35:41.984079 ip-10-0-142-4 kubenswrapper[2575]: E1030 20:35:41.982922    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 20:35:41.984916 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.982927    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/be756835-3011-4186-ab61-8128121eb95b-cni-binary-copy\") pod \"multus-additional-cni-plugins-n7knr\" (UID: \"be756835-3011-4186-ab61-8128121eb95b\") " pod="openshift-multus/multus-additional-cni-plugins-n7knr"
Oct 30 20:35:41.984916 ip-10-0-142-4 kubenswrapper[2575]: E1030 20:35:41.982979    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0bb5f1b-4370-4e8d-80a8-1a7bcda13cd2-metrics-certs podName:d0bb5f1b-4370-4e8d-80a8-1a7bcda13cd2 nodeName:}" failed. No retries permitted until 2026-10-30 20:35:42.482947641 +0000 UTC m=+3.083056225 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d0bb5f1b-4370-4e8d-80a8-1a7bcda13cd2-metrics-certs") pod "network-metrics-daemon-f45fg" (UID: "d0bb5f1b-4370-4e8d-80a8-1a7bcda13cd2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 20:35:41.984916 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.982995    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a5b34407-cc7d-458e-aca3-cd48133834ad-etc-kubernetes\") pod \"tuned-7cg9z\" (UID: \"a5b34407-cc7d-458e-aca3-cd48133834ad\") " pod="openshift-cluster-node-tuning-operator/tuned-7cg9z"
Oct 30 20:35:41.984916 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.983007    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a5b34407-cc7d-458e-aca3-cd48133834ad-lib-modules\") pod \"tuned-7cg9z\" (UID: \"a5b34407-cc7d-458e-aca3-cd48133834ad\") " pod="openshift-cluster-node-tuning-operator/tuned-7cg9z"
Oct 30 20:35:41.984916 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.983017    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dqsnt\" (UniqueName: \"kubernetes.io/projected/d0bb5f1b-4370-4e8d-80a8-1a7bcda13cd2-kube-api-access-dqsnt\") pod \"network-metrics-daemon-f45fg\" (UID: \"d0bb5f1b-4370-4e8d-80a8-1a7bcda13cd2\") " pod="openshift-multus/network-metrics-daemon-f45fg"
Oct 30 20:35:41.984916 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.983168    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/261f6884-299b-4971-b936-bbb3174f1b66-kubelet-config\") pod \"global-pull-secret-syncer-cfdhw\" (UID: \"261f6884-299b-4971-b936-bbb3174f1b66\") " pod="kube-system/global-pull-secret-syncer-cfdhw"
Oct 30 20:35:41.984916 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.983224    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9516abf2-c993-442c-8c5e-34480e5113d6-host-kubelet\") pod \"ovnkube-node-7dh2x\" (UID: \"9516abf2-c993-442c-8c5e-34480e5113d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-7dh2x"
Oct 30 20:35:41.984916 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.983368    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/baefcab8-b5be-4143-9b55-7a86001a4363-host-var-lib-cni-bin\") pod \"multus-nmttt\" (UID: \"baefcab8-b5be-4143-9b55-7a86001a4363\") " pod="openshift-multus/multus-nmttt"
Oct 30 20:35:41.984916 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.983396    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mpwhg\" (UniqueName: \"kubernetes.io/projected/9516abf2-c993-442c-8c5e-34480e5113d6-kube-api-access-mpwhg\") pod \"ovnkube-node-7dh2x\" (UID: \"9516abf2-c993-442c-8c5e-34480e5113d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-7dh2x"
Oct 30 20:35:41.984916 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.983662    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9516abf2-c993-442c-8c5e-34480e5113d6-ovnkube-config\") pod \"ovnkube-node-7dh2x\" (UID: \"9516abf2-c993-442c-8c5e-34480e5113d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-7dh2x"
Oct 30 20:35:41.984916 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.983896    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/be756835-3011-4186-ab61-8128121eb95b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-n7knr\" (UID: \"be756835-3011-4186-ab61-8128121eb95b\") " pod="openshift-multus/multus-additional-cni-plugins-n7knr"
Oct 30 20:35:41.984916 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.983927    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/baefcab8-b5be-4143-9b55-7a86001a4363-host-run-k8s-cni-cncf-io\") pod \"multus-nmttt\" (UID: \"baefcab8-b5be-4143-9b55-7a86001a4363\") " pod="openshift-multus/multus-nmttt"
Oct 30 20:35:41.984916 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.983952    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6e80b983-b2c0-4923-82b0-5903424cc7b0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gqt4f\" (UID: \"6e80b983-b2c0-4923-82b0-5903424cc7b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gqt4f"
Oct 30 20:35:41.984916 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.984000    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/baefcab8-b5be-4143-9b55-7a86001a4363-host-run-k8s-cni-cncf-io\") pod \"multus-nmttt\" (UID: \"baefcab8-b5be-4143-9b55-7a86001a4363\") " pod="openshift-multus/multus-nmttt"
Oct 30 20:35:41.984916 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.984002    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6e80b983-b2c0-4923-82b0-5903424cc7b0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gqt4f\" (UID: \"6e80b983-b2c0-4923-82b0-5903424cc7b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gqt4f"
Oct 30 20:35:41.984916 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.984021    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6e80b983-b2c0-4923-82b0-5903424cc7b0-registration-dir\") pod \"aws-ebs-csi-driver-node-gqt4f\" (UID: \"6e80b983-b2c0-4923-82b0-5903424cc7b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gqt4f"
Oct 30 20:35:41.985458 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.984062    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6e80b983-b2c0-4923-82b0-5903424cc7b0-registration-dir\") pod \"aws-ebs-csi-driver-node-gqt4f\" (UID: \"6e80b983-b2c0-4923-82b0-5903424cc7b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gqt4f"
Oct 30 20:35:41.985458 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.984093    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9516abf2-c993-442c-8c5e-34480e5113d6-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7dh2x\" (UID: \"9516abf2-c993-442c-8c5e-34480e5113d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-7dh2x"
Oct 30 20:35:41.985458 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.984119    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/baefcab8-b5be-4143-9b55-7a86001a4363-host-var-lib-kubelet\") pod \"multus-nmttt\" (UID: \"baefcab8-b5be-4143-9b55-7a86001a4363\") " pod="openshift-multus/multus-nmttt"
Oct 30 20:35:41.985458 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.984146    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/baefcab8-b5be-4143-9b55-7a86001a4363-hostroot\") pod \"multus-nmttt\" (UID: \"baefcab8-b5be-4143-9b55-7a86001a4363\") " pod="openshift-multus/multus-nmttt"
Oct 30 20:35:41.985458 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.984170    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/baefcab8-b5be-4143-9b55-7a86001a4363-multus-conf-dir\") pod \"multus-nmttt\" (UID: \"baefcab8-b5be-4143-9b55-7a86001a4363\") " pod="openshift-multus/multus-nmttt"
Oct 30 20:35:41.985458 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.984187    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9516abf2-c993-442c-8c5e-34480e5113d6-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7dh2x\" (UID: \"9516abf2-c993-442c-8c5e-34480e5113d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-7dh2x"
Oct 30 20:35:41.985458 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.984194    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a5b34407-cc7d-458e-aca3-cd48133834ad-etc-sysctl-conf\") pod \"tuned-7cg9z\" (UID: \"a5b34407-cc7d-458e-aca3-cd48133834ad\") " pod="openshift-cluster-node-tuning-operator/tuned-7cg9z"
Oct 30 20:35:41.985458 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.984232    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/baefcab8-b5be-4143-9b55-7a86001a4363-system-cni-dir\") pod \"multus-nmttt\" (UID: \"baefcab8-b5be-4143-9b55-7a86001a4363\") " pod="openshift-multus/multus-nmttt"
Oct 30 20:35:41.985458 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.984255    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/baefcab8-b5be-4143-9b55-7a86001a4363-multus-daemon-config\") pod \"multus-nmttt\" (UID: \"baefcab8-b5be-4143-9b55-7a86001a4363\") " pod="openshift-multus/multus-nmttt"
Oct 30 20:35:41.985458 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.984295    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5hzrc\" (UniqueName: \"kubernetes.io/projected/fbbb7a28-caa9-4309-8d4c-a6f1c01e2b4f-kube-api-access-5hzrc\") pod \"network-check-target-scs59\" (UID: \"fbbb7a28-caa9-4309-8d4c-a6f1c01e2b4f\") " pod="openshift-network-diagnostics/network-check-target-scs59"
Oct 30 20:35:41.985458 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.984301    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a5b34407-cc7d-458e-aca3-cd48133834ad-etc-sysctl-conf\") pod \"tuned-7cg9z\" (UID: \"a5b34407-cc7d-458e-aca3-cd48133834ad\") " pod="openshift-cluster-node-tuning-operator/tuned-7cg9z"
Oct 30 20:35:41.985458 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.984326    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9516abf2-c993-442c-8c5e-34480e5113d6-env-overrides\") pod \"ovnkube-node-7dh2x\" (UID: \"9516abf2-c993-442c-8c5e-34480e5113d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-7dh2x"
Oct 30 20:35:41.985458 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.984353    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/baefcab8-b5be-4143-9b55-7a86001a4363-host-var-lib-kubelet\") pod \"multus-nmttt\" (UID: \"baefcab8-b5be-4143-9b55-7a86001a4363\") " pod="openshift-multus/multus-nmttt"
Oct 30 20:35:41.985458 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.984351    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a5b34407-cc7d-458e-aca3-cd48133834ad-var-lib-kubelet\") pod \"tuned-7cg9z\" (UID: \"a5b34407-cc7d-458e-aca3-cd48133834ad\") " pod="openshift-cluster-node-tuning-operator/tuned-7cg9z"
Oct 30 20:35:41.985458 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.984381    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/be756835-3011-4186-ab61-8128121eb95b-system-cni-dir\") pod \"multus-additional-cni-plugins-n7knr\" (UID: \"be756835-3011-4186-ab61-8128121eb95b\") " pod="openshift-multus/multus-additional-cni-plugins-n7knr"
Oct 30 20:35:41.985458 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.984394    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/baefcab8-b5be-4143-9b55-7a86001a4363-hostroot\") pod \"multus-nmttt\" (UID: \"baefcab8-b5be-4143-9b55-7a86001a4363\") " pod="openshift-multus/multus-nmttt"
Oct 30 20:35:41.985458 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.984414    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k5wmd\" (UniqueName: \"kubernetes.io/projected/96b48bb2-933f-483d-8f15-5cca00c3d613-kube-api-access-k5wmd\") pod \"iptables-alerter-cfbz6\" (UID: \"96b48bb2-933f-483d-8f15-5cca00c3d613\") " pod="openshift-network-operator/iptables-alerter-cfbz6"
Oct 30 20:35:41.985951 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.984432    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/baefcab8-b5be-4143-9b55-7a86001a4363-multus-conf-dir\") pod \"multus-nmttt\" (UID: \"baefcab8-b5be-4143-9b55-7a86001a4363\") " pod="openshift-multus/multus-nmttt"
Oct 30 20:35:41.985951 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.984440    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/be756835-3011-4186-ab61-8128121eb95b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-n7knr\" (UID: \"be756835-3011-4186-ab61-8128121eb95b\") " pod="openshift-multus/multus-additional-cni-plugins-n7knr"
Oct 30 20:35:41.985951 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.984503    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/baefcab8-b5be-4143-9b55-7a86001a4363-system-cni-dir\") pod \"multus-nmttt\" (UID: \"baefcab8-b5be-4143-9b55-7a86001a4363\") " pod="openshift-multus/multus-nmttt"
Oct 30 20:35:41.985951 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.984572    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a5b34407-cc7d-458e-aca3-cd48133834ad-var-lib-kubelet\") pod \"tuned-7cg9z\" (UID: \"a5b34407-cc7d-458e-aca3-cd48133834ad\") " pod="openshift-cluster-node-tuning-operator/tuned-7cg9z"
Oct 30 20:35:41.985951 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.984438    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3e93e3cc-cd26-452f-9e40-31dedb0d198b-host\") pod \"node-ca-5mml4\" (UID: \"3e93e3cc-cd26-452f-9e40-31dedb0d198b\") " pod="openshift-image-registry/node-ca-5mml4"
Oct 30 20:35:41.985951 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.984823    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/70cf9a0e-c321-438d-83a2-2034f4df9034-konnectivity-ca\") pod \"konnectivity-agent-mlgfz\" (UID: \"70cf9a0e-c321-438d-83a2-2034f4df9034\") " pod="kube-system/konnectivity-agent-mlgfz"
Oct 30 20:35:41.985951 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.984944    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9516abf2-c993-442c-8c5e-34480e5113d6-env-overrides\") pod \"ovnkube-node-7dh2x\" (UID: \"9516abf2-c993-442c-8c5e-34480e5113d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-7dh2x"
Oct 30 20:35:41.985951 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.985081    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a5b34407-cc7d-458e-aca3-cd48133834ad-tmp\") pod \"tuned-7cg9z\" (UID: \"a5b34407-cc7d-458e-aca3-cd48133834ad\") " pod="openshift-cluster-node-tuning-operator/tuned-7cg9z"
Oct 30 20:35:41.985951 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.985098    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/baefcab8-b5be-4143-9b55-7a86001a4363-multus-daemon-config\") pod \"multus-nmttt\" (UID: \"baefcab8-b5be-4143-9b55-7a86001a4363\") " pod="openshift-multus/multus-nmttt"
Oct 30 20:35:41.985951 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.985148    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3e93e3cc-cd26-452f-9e40-31dedb0d198b-host\") pod \"node-ca-5mml4\" (UID: \"3e93e3cc-cd26-452f-9e40-31dedb0d198b\") " pod="openshift-image-registry/node-ca-5mml4"
Oct 30 20:35:41.985951 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.985164    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/be756835-3011-4186-ab61-8128121eb95b-system-cni-dir\") pod \"multus-additional-cni-plugins-n7knr\" (UID: \"be756835-3011-4186-ab61-8128121eb95b\") " pod="openshift-multus/multus-additional-cni-plugins-n7knr"
Oct 30 20:35:41.985951 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.985861    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a5b34407-cc7d-458e-aca3-cd48133834ad-etc-tuned\") pod \"tuned-7cg9z\" (UID: \"a5b34407-cc7d-458e-aca3-cd48133834ad\") " pod="openshift-cluster-node-tuning-operator/tuned-7cg9z"
Oct 30 20:35:41.986323 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.985952    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9516abf2-c993-442c-8c5e-34480e5113d6-ovn-node-metrics-cert\") pod \"ovnkube-node-7dh2x\" (UID: \"9516abf2-c993-442c-8c5e-34480e5113d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-7dh2x"
Oct 30 20:35:41.986323 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.986031    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/70cf9a0e-c321-438d-83a2-2034f4df9034-konnectivity-ca\") pod \"konnectivity-agent-mlgfz\" (UID: \"70cf9a0e-c321-438d-83a2-2034f4df9034\") " pod="kube-system/konnectivity-agent-mlgfz"
Oct 30 20:35:41.986323 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.986066    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/70cf9a0e-c321-438d-83a2-2034f4df9034-agent-certs\") pod \"konnectivity-agent-mlgfz\" (UID: \"70cf9a0e-c321-438d-83a2-2034f4df9034\") " pod="kube-system/konnectivity-agent-mlgfz"
Oct 30 20:35:41.994450 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.994411    2575 reflector.go:446] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Oct 30 20:35:41.994520 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:41.994447    2575 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-dm8j4"
Oct 30 20:35:42.042098 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:42.042070    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2xx6z\" (UniqueName: \"kubernetes.io/projected/a5b34407-cc7d-458e-aca3-cd48133834ad-kube-api-access-2xx6z\") pod \"tuned-7cg9z\" (UID: \"a5b34407-cc7d-458e-aca3-cd48133834ad\") " pod="openshift-cluster-node-tuning-operator/tuned-7cg9z"
Oct 30 20:35:42.042197 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:42.042071    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nsvqk\" (UniqueName: \"kubernetes.io/projected/1930df66-da42-4ad8-bfe0-5e92f9e07ebc-kube-api-access-nsvqk\") pod \"node-resolver-82j9v\" (UID: \"1930df66-da42-4ad8-bfe0-5e92f9e07ebc\") " pod="openshift-dns/node-resolver-82j9v"
Oct 30 20:35:42.042197 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:42.042156    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5hmjh\" (UniqueName: \"kubernetes.io/projected/6e80b983-b2c0-4923-82b0-5903424cc7b0-kube-api-access-5hmjh\") pod \"aws-ebs-csi-driver-node-gqt4f\" (UID: \"6e80b983-b2c0-4923-82b0-5903424cc7b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gqt4f"
Oct 30 20:35:42.042404 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:42.042388    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lgp2l\" (UniqueName: \"kubernetes.io/projected/3e93e3cc-cd26-452f-9e40-31dedb0d198b-kube-api-access-lgp2l\") pod \"node-ca-5mml4\" (UID: \"3e93e3cc-cd26-452f-9e40-31dedb0d198b\") " pod="openshift-image-registry/node-ca-5mml4"
Oct 30 20:35:42.044785 ip-10-0-142-4 kubenswrapper[2575]: E1030 20:35:42.044767    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 20:35:42.044838 ip-10-0-142-4 kubenswrapper[2575]: E1030 20:35:42.044791    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 20:35:42.044838 ip-10-0-142-4 kubenswrapper[2575]: E1030 20:35:42.044806    2575 projected.go:196] Error preparing data for projected volume kube-api-access-5hzrc for pod openshift-network-diagnostics/network-check-target-scs59: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 20:35:42.044941 ip-10-0-142-4 kubenswrapper[2575]: E1030 20:35:42.044866    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fbbb7a28-caa9-4309-8d4c-a6f1c01e2b4f-kube-api-access-5hzrc podName:fbbb7a28-caa9-4309-8d4c-a6f1c01e2b4f nodeName:}" failed. No retries permitted until 2026-10-30 20:35:42.544847062 +0000 UTC m=+3.144955660 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-5hzrc" (UniqueName: "kubernetes.io/projected/fbbb7a28-caa9-4309-8d4c-a6f1c01e2b4f-kube-api-access-5hzrc") pod "network-check-target-scs59" (UID: "fbbb7a28-caa9-4309-8d4c-a6f1c01e2b4f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 20:35:42.046561 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:42.046537    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dqsnt\" (UniqueName: \"kubernetes.io/projected/d0bb5f1b-4370-4e8d-80a8-1a7bcda13cd2-kube-api-access-dqsnt\") pod \"network-metrics-daemon-f45fg\" (UID: \"d0bb5f1b-4370-4e8d-80a8-1a7bcda13cd2\") " pod="openshift-multus/network-metrics-daemon-f45fg"
Oct 30 20:35:42.046930 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:42.046906    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8rgwr\" (UniqueName: \"kubernetes.io/projected/be756835-3011-4186-ab61-8128121eb95b-kube-api-access-8rgwr\") pod \"multus-additional-cni-plugins-n7knr\" (UID: \"be756835-3011-4186-ab61-8128121eb95b\") " pod="openshift-multus/multus-additional-cni-plugins-n7knr"
Oct 30 20:35:42.047011 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:42.046952    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k5wmd\" (UniqueName: \"kubernetes.io/projected/96b48bb2-933f-483d-8f15-5cca00c3d613-kube-api-access-k5wmd\") pod \"iptables-alerter-cfbz6\" (UID: \"96b48bb2-933f-483d-8f15-5cca00c3d613\") " pod="openshift-network-operator/iptables-alerter-cfbz6"
Oct 30 20:35:42.047047 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:42.047029    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mpwhg\" (UniqueName: \"kubernetes.io/projected/9516abf2-c993-442c-8c5e-34480e5113d6-kube-api-access-mpwhg\") pod \"ovnkube-node-7dh2x\" (UID: \"9516abf2-c993-442c-8c5e-34480e5113d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-7dh2x"
Oct 30 20:35:42.047626 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:42.047611    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2mzs4\" (UniqueName: \"kubernetes.io/projected/baefcab8-b5be-4143-9b55-7a86001a4363-kube-api-access-2mzs4\") pod \"multus-nmttt\" (UID: \"baefcab8-b5be-4143-9b55-7a86001a4363\") " pod="openshift-multus/multus-nmttt"
Oct 30 20:35:42.155153 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:42.155120    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-5mml4"
Oct 30 20:35:42.162226 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:42.162208    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-nmttt"
Oct 30 20:35:42.164600 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:42.164570    2575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e93e3cc_cd26_452f_9e40_31dedb0d198b.slice/crio-cb23cc723de5be6af2fc64091cb07db9c271725f551b9cab69fb3d95c8409b5b WatchSource:0}: Error finding container cb23cc723de5be6af2fc64091cb07db9c271725f551b9cab69fb3d95c8409b5b: Status 404 returned error can't find the container with id cb23cc723de5be6af2fc64091cb07db9c271725f551b9cab69fb3d95c8409b5b
Oct 30 20:35:42.170611 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:42.170590    2575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbaefcab8_b5be_4143_9b55_7a86001a4363.slice/crio-94c8ec3a6d28d8efdc4f15bd77859491ab247f0ec203675910f682727fd2b092 WatchSource:0}: Error finding container 94c8ec3a6d28d8efdc4f15bd77859491ab247f0ec203675910f682727fd2b092: Status 404 returned error can't find the container with id 94c8ec3a6d28d8efdc4f15bd77859491ab247f0ec203675910f682727fd2b092
Oct 30 20:35:42.183576 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:42.183555    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-82j9v"
Oct 30 20:35:42.183665 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:42.183648    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-mlgfz"
Oct 30 20:35:42.188282 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:42.188261    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-7dh2x"
Oct 30 20:35:42.190272 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:42.190257    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-7cg9z"
Oct 30 20:35:42.195532 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:42.195516    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gqt4f"
Oct 30 20:35:42.200568 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:42.200543    2575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70cf9a0e_c321_438d_83a2_2034f4df9034.slice/crio-e41ace44984f7abef841724acbb3a604f1ebc9284ddcb7a97293fc2b1b3c9370 WatchSource:0}: Error finding container e41ace44984f7abef841724acbb3a604f1ebc9284ddcb7a97293fc2b1b3c9370: Status 404 returned error can't find the container with id e41ace44984f7abef841724acbb3a604f1ebc9284ddcb7a97293fc2b1b3c9370
Oct 30 20:35:42.202755 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:42.202739    2575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9516abf2_c993_442c_8c5e_34480e5113d6.slice/crio-66b241cc94d491086d396fbc6f39735da06053708d42b7e61d6a3f6ff942c903 WatchSource:0}: Error finding container 66b241cc94d491086d396fbc6f39735da06053708d42b7e61d6a3f6ff942c903: Status 404 returned error can't find the container with id 66b241cc94d491086d396fbc6f39735da06053708d42b7e61d6a3f6ff942c903
Oct 30 20:35:42.203406 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:42.203385    2575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5b34407_cc7d_458e_aca3_cd48133834ad.slice/crio-36bf1ab52870c2031cd00ee4236e2efbbb0e8a1eadcfdb40f3ff1dd4072cfa17 WatchSource:0}: Error finding container 36bf1ab52870c2031cd00ee4236e2efbbb0e8a1eadcfdb40f3ff1dd4072cfa17: Status 404 returned error can't find the container with id 36bf1ab52870c2031cd00ee4236e2efbbb0e8a1eadcfdb40f3ff1dd4072cfa17
Oct 30 20:35:42.206926 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:42.206909    2575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e80b983_b2c0_4923_82b0_5903424cc7b0.slice/crio-05b7334d3b1aed4a60161ebecd95a531695bd0161a0269c238115a0b5e8f0a61 WatchSource:0}: Error finding container 05b7334d3b1aed4a60161ebecd95a531695bd0161a0269c238115a0b5e8f0a61: Status 404 returned error can't find the container with id 05b7334d3b1aed4a60161ebecd95a531695bd0161a0269c238115a0b5e8f0a61
Oct 30 20:35:42.207821 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:42.207800    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-cfbz6"
Oct 30 20:35:42.212644 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:42.212632    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-n7knr"
Oct 30 20:35:42.216158 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:42.216140    2575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96b48bb2_933f_483d_8f15_5cca00c3d613.slice/crio-9912dd54318f6360ea8f18bfd779d5c99a9068cbb1fb6a120f408a135c5db269 WatchSource:0}: Error finding container 9912dd54318f6360ea8f18bfd779d5c99a9068cbb1fb6a120f408a135c5db269: Status 404 returned error can't find the container with id 9912dd54318f6360ea8f18bfd779d5c99a9068cbb1fb6a120f408a135c5db269
Oct 30 20:35:42.221215 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:35:42.221197    2575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe756835_3011_4186_ab61_8128121eb95b.slice/crio-9ddc9d5b1efe543a047b8463a2863120a4bbec7638f4b6667eb82785a14d1d63 WatchSource:0}: Error finding container 9ddc9d5b1efe543a047b8463a2863120a4bbec7638f4b6667eb82785a14d1d63: Status 404 returned error can't find the container with id 9ddc9d5b1efe543a047b8463a2863120a4bbec7638f4b6667eb82785a14d1d63
Oct 30 20:35:42.489421 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:42.489333    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d0bb5f1b-4370-4e8d-80a8-1a7bcda13cd2-metrics-certs\") pod \"network-metrics-daemon-f45fg\" (UID: \"d0bb5f1b-4370-4e8d-80a8-1a7bcda13cd2\") " pod="openshift-multus/network-metrics-daemon-f45fg"
Oct 30 20:35:42.489421 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:42.489391    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/261f6884-299b-4971-b936-bbb3174f1b66-original-pull-secret\") pod \"global-pull-secret-syncer-cfdhw\" (UID: \"261f6884-299b-4971-b936-bbb3174f1b66\") " pod="kube-system/global-pull-secret-syncer-cfdhw"
Oct 30 20:35:42.489659 ip-10-0-142-4 kubenswrapper[2575]: E1030 20:35:42.489518    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 20:35:42.489659 ip-10-0-142-4 kubenswrapper[2575]: E1030 20:35:42.489557    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 20:35:42.489659 ip-10-0-142-4 kubenswrapper[2575]: E1030 20:35:42.489593    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0bb5f1b-4370-4e8d-80a8-1a7bcda13cd2-metrics-certs podName:d0bb5f1b-4370-4e8d-80a8-1a7bcda13cd2 nodeName:}" failed. No retries permitted until 2026-10-30 20:35:43.489573354 +0000 UTC m=+4.089681941 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d0bb5f1b-4370-4e8d-80a8-1a7bcda13cd2-metrics-certs") pod "network-metrics-daemon-f45fg" (UID: "d0bb5f1b-4370-4e8d-80a8-1a7bcda13cd2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 20:35:42.489659 ip-10-0-142-4 kubenswrapper[2575]: E1030 20:35:42.489618    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/261f6884-299b-4971-b936-bbb3174f1b66-original-pull-secret podName:261f6884-299b-4971-b936-bbb3174f1b66 nodeName:}" failed. No retries permitted until 2026-10-30 20:35:43.489599754 +0000 UTC m=+4.089708358 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/261f6884-299b-4971-b936-bbb3174f1b66-original-pull-secret") pod "global-pull-secret-syncer-cfdhw" (UID: "261f6884-299b-4971-b936-bbb3174f1b66") : object "kube-system"/"original-pull-secret" not registered
Oct 30 20:35:42.590369 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:42.590327    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5hzrc\" (UniqueName: \"kubernetes.io/projected/fbbb7a28-caa9-4309-8d4c-a6f1c01e2b4f-kube-api-access-5hzrc\") pod \"network-check-target-scs59\" (UID: \"fbbb7a28-caa9-4309-8d4c-a6f1c01e2b4f\") " pod="openshift-network-diagnostics/network-check-target-scs59"
Oct 30 20:35:42.590614 ip-10-0-142-4 kubenswrapper[2575]: E1030 20:35:42.590484    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 20:35:42.590614 ip-10-0-142-4 kubenswrapper[2575]: E1030 20:35:42.590515    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 20:35:42.590614 ip-10-0-142-4 kubenswrapper[2575]: E1030 20:35:42.590526    2575 projected.go:196] Error preparing data for projected volume kube-api-access-5hzrc for pod openshift-network-diagnostics/network-check-target-scs59: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 20:35:42.590614 ip-10-0-142-4 kubenswrapper[2575]: E1030 20:35:42.590585    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fbbb7a28-caa9-4309-8d4c-a6f1c01e2b4f-kube-api-access-5hzrc podName:fbbb7a28-caa9-4309-8d4c-a6f1c01e2b4f nodeName:}" failed. No retries permitted until 2026-10-30 20:35:43.590567956 +0000 UTC m=+4.190676542 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-5hzrc" (UniqueName: "kubernetes.io/projected/fbbb7a28-caa9-4309-8d4c-a6f1c01e2b4f-kube-api-access-5hzrc") pod "network-check-target-scs59" (UID: "fbbb7a28-caa9-4309-8d4c-a6f1c01e2b4f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 20:35:42.843321 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:42.843235    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-cfbz6" event={"ID":"96b48bb2-933f-483d-8f15-5cca00c3d613","Type":"ContainerStarted","Data":"9912dd54318f6360ea8f18bfd779d5c99a9068cbb1fb6a120f408a135c5db269"}
Oct 30 20:35:42.844480 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:42.844449    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gqt4f" event={"ID":"6e80b983-b2c0-4923-82b0-5903424cc7b0","Type":"ContainerStarted","Data":"05b7334d3b1aed4a60161ebecd95a531695bd0161a0269c238115a0b5e8f0a61"}
Oct 30 20:35:42.845609 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:42.845579    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-mlgfz" event={"ID":"70cf9a0e-c321-438d-83a2-2034f4df9034","Type":"ContainerStarted","Data":"e41ace44984f7abef841724acbb3a604f1ebc9284ddcb7a97293fc2b1b3c9370"}
Oct 30 20:35:42.846743 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:42.846715    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-nmttt" event={"ID":"baefcab8-b5be-4143-9b55-7a86001a4363","Type":"ContainerStarted","Data":"94c8ec3a6d28d8efdc4f15bd77859491ab247f0ec203675910f682727fd2b092"}
Oct 30 20:35:42.847863 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:42.847840    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-n7knr" event={"ID":"be756835-3011-4186-ab61-8128121eb95b","Type":"ContainerStarted","Data":"9ddc9d5b1efe543a047b8463a2863120a4bbec7638f4b6667eb82785a14d1d63"}
Oct 30 20:35:42.848987 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:42.848964    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-7cg9z" event={"ID":"a5b34407-cc7d-458e-aca3-cd48133834ad","Type":"ContainerStarted","Data":"36bf1ab52870c2031cd00ee4236e2efbbb0e8a1eadcfdb40f3ff1dd4072cfa17"}
Oct 30 20:35:42.850164 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:42.850142    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7dh2x" event={"ID":"9516abf2-c993-442c-8c5e-34480e5113d6","Type":"ContainerStarted","Data":"66b241cc94d491086d396fbc6f39735da06053708d42b7e61d6a3f6ff942c903"}
Oct 30 20:35:42.851336 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:42.851313    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-82j9v" event={"ID":"1930df66-da42-4ad8-bfe0-5e92f9e07ebc","Type":"ContainerStarted","Data":"cf33830f727725a5f1fca4eeae90258aecec92185c47dcb59c465e2a23ceb778"}
Oct 30 20:35:42.852352 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:42.852332    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-5mml4" event={"ID":"3e93e3cc-cd26-452f-9e40-31dedb0d198b","Type":"ContainerStarted","Data":"cb23cc723de5be6af2fc64091cb07db9c271725f551b9cab69fb3d95c8409b5b"}
Oct 30 20:35:42.998600 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:42.998562    2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-10-29 20:30:41 +0000 UTC" deadline="2028-03-26 09:24:26.062960546 +0000 UTC"
Oct 30 20:35:42.998600 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:42.998590    2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12300h48m43.064374192s"
Oct 30 20:35:43.496305 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:43.496255    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d0bb5f1b-4370-4e8d-80a8-1a7bcda13cd2-metrics-certs\") pod \"network-metrics-daemon-f45fg\" (UID: \"d0bb5f1b-4370-4e8d-80a8-1a7bcda13cd2\") " pod="openshift-multus/network-metrics-daemon-f45fg"
Oct 30 20:35:43.496469 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:43.496322    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/261f6884-299b-4971-b936-bbb3174f1b66-original-pull-secret\") pod \"global-pull-secret-syncer-cfdhw\" (UID: \"261f6884-299b-4971-b936-bbb3174f1b66\") " pod="kube-system/global-pull-secret-syncer-cfdhw"
Oct 30 20:35:43.496787 ip-10-0-142-4 kubenswrapper[2575]: E1030 20:35:43.496550    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 20:35:43.496787 ip-10-0-142-4 kubenswrapper[2575]: E1030 20:35:43.496623    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/261f6884-299b-4971-b936-bbb3174f1b66-original-pull-secret podName:261f6884-299b-4971-b936-bbb3174f1b66 nodeName:}" failed. No retries permitted until 2026-10-30 20:35:45.496603651 +0000 UTC m=+6.096712236 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/261f6884-299b-4971-b936-bbb3174f1b66-original-pull-secret") pod "global-pull-secret-syncer-cfdhw" (UID: "261f6884-299b-4971-b936-bbb3174f1b66") : object "kube-system"/"original-pull-secret" not registered
Oct 30 20:35:43.496787 ip-10-0-142-4 kubenswrapper[2575]: E1030 20:35:43.496709    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 20:35:43.496787 ip-10-0-142-4 kubenswrapper[2575]: E1030 20:35:43.496745    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0bb5f1b-4370-4e8d-80a8-1a7bcda13cd2-metrics-certs podName:d0bb5f1b-4370-4e8d-80a8-1a7bcda13cd2 nodeName:}" failed. No retries permitted until 2026-10-30 20:35:45.496734093 +0000 UTC m=+6.096842681 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d0bb5f1b-4370-4e8d-80a8-1a7bcda13cd2-metrics-certs") pod "network-metrics-daemon-f45fg" (UID: "d0bb5f1b-4370-4e8d-80a8-1a7bcda13cd2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 20:35:43.597482 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:43.597129    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5hzrc\" (UniqueName: \"kubernetes.io/projected/fbbb7a28-caa9-4309-8d4c-a6f1c01e2b4f-kube-api-access-5hzrc\") pod \"network-check-target-scs59\" (UID: \"fbbb7a28-caa9-4309-8d4c-a6f1c01e2b4f\") " pod="openshift-network-diagnostics/network-check-target-scs59"
Oct 30 20:35:43.597482 ip-10-0-142-4 kubenswrapper[2575]: E1030 20:35:43.597274    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 20:35:43.597482 ip-10-0-142-4 kubenswrapper[2575]: E1030 20:35:43.597291    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 20:35:43.597482 ip-10-0-142-4 kubenswrapper[2575]: E1030 20:35:43.597313    2575 projected.go:196] Error preparing data for projected volume kube-api-access-5hzrc for pod openshift-network-diagnostics/network-check-target-scs59: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 20:35:43.597482 ip-10-0-142-4 kubenswrapper[2575]: E1030 20:35:43.597363    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fbbb7a28-caa9-4309-8d4c-a6f1c01e2b4f-kube-api-access-5hzrc podName:fbbb7a28-caa9-4309-8d4c-a6f1c01e2b4f nodeName:}" failed. No retries permitted until 2026-10-30 20:35:45.597350307 +0000 UTC m=+6.197458890 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-5hzrc" (UniqueName: "kubernetes.io/projected/fbbb7a28-caa9-4309-8d4c-a6f1c01e2b4f-kube-api-access-5hzrc") pod "network-check-target-scs59" (UID: "fbbb7a28-caa9-4309-8d4c-a6f1c01e2b4f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 20:35:43.837134 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:43.835884    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cfdhw"
Oct 30 20:35:43.837134 ip-10-0-142-4 kubenswrapper[2575]: E1030 20:35:43.836013    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cfdhw" podUID="261f6884-299b-4971-b936-bbb3174f1b66"
Oct 30 20:35:43.837134 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:43.836079    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-scs59"
Oct 30 20:35:43.837134 ip-10-0-142-4 kubenswrapper[2575]: E1030 20:35:43.836120    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-scs59" podUID="fbbb7a28-caa9-4309-8d4c-a6f1c01e2b4f"
Oct 30 20:35:43.837134 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:43.836226    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f45fg"
Oct 30 20:35:43.837134 ip-10-0-142-4 kubenswrapper[2575]: E1030 20:35:43.836278    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f45fg" podUID="d0bb5f1b-4370-4e8d-80a8-1a7bcda13cd2"
Oct 30 20:35:43.999789 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:43.999248    2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-10-29 20:30:41 +0000 UTC" deadline="2028-08-12 20:19:05.360204928 +0000 UTC"
Oct 30 20:35:43.999789 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:43.999302    2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15647h43m21.360905755s"
Oct 30 20:35:44.883642 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:44.882485    2575 generic.go:356] "Generic (PLEG): container finished" podID="90d034cf7e9022b0bbb1def78b2df29c" containerID="82c5d80b914884eae5bab667cadd51ecf79a4e6878a2e91e8392fe8e720e031c" exitCode=0
Oct 30 20:35:44.883642 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:44.883631    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-4.us-west-1.compute.internal" event={"ID":"90d034cf7e9022b0bbb1def78b2df29c","Type":"ContainerDied","Data":"82c5d80b914884eae5bab667cadd51ecf79a4e6878a2e91e8392fe8e720e031c"}
Oct 30 20:35:45.515026 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:45.515000    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d0bb5f1b-4370-4e8d-80a8-1a7bcda13cd2-metrics-certs\") pod \"network-metrics-daemon-f45fg\" (UID: \"d0bb5f1b-4370-4e8d-80a8-1a7bcda13cd2\") " pod="openshift-multus/network-metrics-daemon-f45fg"
Oct 30 20:35:45.515438 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:45.515044    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/261f6884-299b-4971-b936-bbb3174f1b66-original-pull-secret\") pod \"global-pull-secret-syncer-cfdhw\" (UID: \"261f6884-299b-4971-b936-bbb3174f1b66\") " pod="kube-system/global-pull-secret-syncer-cfdhw"
Oct 30 20:35:45.515438 ip-10-0-142-4 kubenswrapper[2575]: E1030 20:35:45.515192    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 20:35:45.515438 ip-10-0-142-4 kubenswrapper[2575]: E1030 20:35:45.515248    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/261f6884-299b-4971-b936-bbb3174f1b66-original-pull-secret podName:261f6884-299b-4971-b936-bbb3174f1b66 nodeName:}" failed. No retries permitted until 2026-10-30 20:35:49.515231231 +0000 UTC m=+10.115339815 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/261f6884-299b-4971-b936-bbb3174f1b66-original-pull-secret") pod "global-pull-secret-syncer-cfdhw" (UID: "261f6884-299b-4971-b936-bbb3174f1b66") : object "kube-system"/"original-pull-secret" not registered
Oct 30 20:35:45.515438 ip-10-0-142-4 kubenswrapper[2575]: E1030 20:35:45.515326    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 20:35:45.515438 ip-10-0-142-4 kubenswrapper[2575]: E1030 20:35:45.515358    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0bb5f1b-4370-4e8d-80a8-1a7bcda13cd2-metrics-certs podName:d0bb5f1b-4370-4e8d-80a8-1a7bcda13cd2 nodeName:}" failed. No retries permitted until 2026-10-30 20:35:49.515348094 +0000 UTC m=+10.115456677 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d0bb5f1b-4370-4e8d-80a8-1a7bcda13cd2-metrics-certs") pod "network-metrics-daemon-f45fg" (UID: "d0bb5f1b-4370-4e8d-80a8-1a7bcda13cd2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 20:35:45.616104 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:45.616061    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5hzrc\" (UniqueName: \"kubernetes.io/projected/fbbb7a28-caa9-4309-8d4c-a6f1c01e2b4f-kube-api-access-5hzrc\") pod \"network-check-target-scs59\" (UID: \"fbbb7a28-caa9-4309-8d4c-a6f1c01e2b4f\") " pod="openshift-network-diagnostics/network-check-target-scs59"
Oct 30 20:35:45.616266 ip-10-0-142-4 kubenswrapper[2575]: E1030 20:35:45.616235    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 20:35:45.616266 ip-10-0-142-4 kubenswrapper[2575]: E1030 20:35:45.616261    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 20:35:45.616363 ip-10-0-142-4 kubenswrapper[2575]: E1030 20:35:45.616274    2575 projected.go:196] Error preparing data for projected volume kube-api-access-5hzrc for pod openshift-network-diagnostics/network-check-target-scs59: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 20:35:45.616363 ip-10-0-142-4 kubenswrapper[2575]: E1030 20:35:45.616335    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fbbb7a28-caa9-4309-8d4c-a6f1c01e2b4f-kube-api-access-5hzrc podName:fbbb7a28-caa9-4309-8d4c-a6f1c01e2b4f nodeName:}" failed. No retries permitted until 2026-10-30 20:35:49.616316725 +0000 UTC m=+10.216425324 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-5hzrc" (UniqueName: "kubernetes.io/projected/fbbb7a28-caa9-4309-8d4c-a6f1c01e2b4f-kube-api-access-5hzrc") pod "network-check-target-scs59" (UID: "fbbb7a28-caa9-4309-8d4c-a6f1c01e2b4f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 20:35:45.836648 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:45.836617    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cfdhw"
Oct 30 20:35:45.836783 ip-10-0-142-4 kubenswrapper[2575]: E1030 20:35:45.836761    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cfdhw" podUID="261f6884-299b-4971-b936-bbb3174f1b66"
Oct 30 20:35:45.836851 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:45.836832    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-scs59"
Oct 30 20:35:45.836941 ip-10-0-142-4 kubenswrapper[2575]: E1030 20:35:45.836901    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-scs59" podUID="fbbb7a28-caa9-4309-8d4c-a6f1c01e2b4f"
Oct 30 20:35:45.837001 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:45.836988    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f45fg"
Oct 30 20:35:45.837101 ip-10-0-142-4 kubenswrapper[2575]: E1030 20:35:45.837083    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f45fg" podUID="d0bb5f1b-4370-4e8d-80a8-1a7bcda13cd2"
Oct 30 20:35:45.890517 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:45.890005    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-4.us-west-1.compute.internal" event={"ID":"90d034cf7e9022b0bbb1def78b2df29c","Type":"ContainerStarted","Data":"eddc381540fdf4872bc75e07cb5330e0bbebe0a0ec5f4e8c76d5a6b1b219a7d3"}
Oct 30 20:35:45.896756 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:45.896023    2575 generic.go:356] "Generic (PLEG): container finished" podID="be756835-3011-4186-ab61-8128121eb95b" containerID="c1fb5b79e346b3a0c68d03a035c29ca3317c9678a2b2c652efd3d971e18129c5" exitCode=0
Oct 30 20:35:45.896756 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:45.896111    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-n7knr" event={"ID":"be756835-3011-4186-ab61-8128121eb95b","Type":"ContainerDied","Data":"c1fb5b79e346b3a0c68d03a035c29ca3317c9678a2b2c652efd3d971e18129c5"}
Oct 30 20:35:45.904121 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:45.903725    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-4.us-west-1.compute.internal" event={"ID":"c873d294ea5be2c96cd88ae10288f56b","Type":"ContainerStarted","Data":"b5dfa70af39bb34a3c293ebbed76a72c4088a290ebb5153dcff39768f63eb6c5"}
Oct 30 20:35:46.130319 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:46.129329    2575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-4.us-west-1.compute.internal" podStartSLOduration=5.129309493 podStartE2EDuration="5.129309493s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 20:35:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:35:46.006377581 +0000 UTC m=+6.606486188" watchObservedRunningTime="2026-10-30 20:35:46.129309493 +0000 UTC m=+6.729418099"
Oct 30 20:35:46.244684 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:46.244623    2575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-4.us-west-1.compute.internal" podStartSLOduration=5.2446047159999996 podStartE2EDuration="5.244604716s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 20:35:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:35:46.243586943 +0000 UTC m=+6.843695549" watchObservedRunningTime="2026-10-30 20:35:46.244604716 +0000 UTC m=+6.844713324"
Oct 30 20:35:46.910405 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:46.910303    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-mlgfz" event={"ID":"70cf9a0e-c321-438d-83a2-2034f4df9034","Type":"ContainerStarted","Data":"c56c430a0c8e6abc6e1e580a654861800a6f1a5ca239ff5c98dc36ebcddfbfe6"}
Oct 30 20:35:47.836938 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:47.836866    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cfdhw"
Oct 30 20:35:47.837107 ip-10-0-142-4 kubenswrapper[2575]: E1030 20:35:47.837000    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cfdhw" podUID="261f6884-299b-4971-b936-bbb3174f1b66"
Oct 30 20:35:47.837107 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:47.837063    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-scs59"
Oct 30 20:35:47.837214 ip-10-0-142-4 kubenswrapper[2575]: E1030 20:35:47.837126    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-scs59" podUID="fbbb7a28-caa9-4309-8d4c-a6f1c01e2b4f"
Oct 30 20:35:47.837214 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:47.837184    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f45fg"
Oct 30 20:35:47.837315 ip-10-0-142-4 kubenswrapper[2575]: E1030 20:35:47.837257    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f45fg" podUID="d0bb5f1b-4370-4e8d-80a8-1a7bcda13cd2"
Oct 30 20:35:47.916192 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:47.916079    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-5mml4" event={"ID":"3e93e3cc-cd26-452f-9e40-31dedb0d198b","Type":"ContainerStarted","Data":"f221daa4c64297cbdda26bcb5da875412ec075db706fe5e14539558eeb2299d5"}
Oct 30 20:35:48.040220 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:48.040158    2575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-image-registry/node-ca-5mml4" podStartSLOduration=2.777061273 podStartE2EDuration="8.040139814s" totalImagesPullingTime="5.263078541s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 20:35:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:35:48.039651798 +0000 UTC m=+8.639760404" watchObservedRunningTime="2026-10-30 20:35:48.040139814 +0000 UTC m=+8.640248415"
Oct 30 20:35:48.040521 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:48.040461    2575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/konnectivity-agent-mlgfz" podStartSLOduration=3.6335485800000002 podStartE2EDuration="8.040450724s" totalImagesPullingTime="4.406902144s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:35:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:35:47.027882692 +0000 UTC m=+7.627991298" watchObservedRunningTime="2026-10-30 20:35:48.040450724 +0000 UTC m=+8.640559330"
Oct 30 20:35:48.920543 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:48.920353    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gqt4f" event={"ID":"6e80b983-b2c0-4923-82b0-5903424cc7b0","Type":"ContainerStarted","Data":"e83744e8cfed8389545912622ceabf7894dff496b0d1fdbd6869843fd919ca93"}
Oct 30 20:35:49.548431 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:49.548392    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d0bb5f1b-4370-4e8d-80a8-1a7bcda13cd2-metrics-certs\") pod \"network-metrics-daemon-f45fg\" (UID: \"d0bb5f1b-4370-4e8d-80a8-1a7bcda13cd2\") " pod="openshift-multus/network-metrics-daemon-f45fg"
Oct 30 20:35:49.548619 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:49.548447    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/261f6884-299b-4971-b936-bbb3174f1b66-original-pull-secret\") pod \"global-pull-secret-syncer-cfdhw\" (UID: \"261f6884-299b-4971-b936-bbb3174f1b66\") " pod="kube-system/global-pull-secret-syncer-cfdhw"
Oct 30 20:35:49.548619 ip-10-0-142-4 kubenswrapper[2575]: E1030 20:35:49.548565    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 20:35:49.548619 ip-10-0-142-4 kubenswrapper[2575]: E1030 20:35:49.548585    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 20:35:49.548768 ip-10-0-142-4 kubenswrapper[2575]: E1030 20:35:49.548636    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0bb5f1b-4370-4e8d-80a8-1a7bcda13cd2-metrics-certs podName:d0bb5f1b-4370-4e8d-80a8-1a7bcda13cd2 nodeName:}" failed. No retries permitted until 2026-10-30 20:35:57.548616921 +0000 UTC m=+18.148725520 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d0bb5f1b-4370-4e8d-80a8-1a7bcda13cd2-metrics-certs") pod "network-metrics-daemon-f45fg" (UID: "d0bb5f1b-4370-4e8d-80a8-1a7bcda13cd2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 20:35:49.548768 ip-10-0-142-4 kubenswrapper[2575]: E1030 20:35:49.548655    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/261f6884-299b-4971-b936-bbb3174f1b66-original-pull-secret podName:261f6884-299b-4971-b936-bbb3174f1b66 nodeName:}" failed. No retries permitted until 2026-10-30 20:35:57.548646286 +0000 UTC m=+18.148754872 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/261f6884-299b-4971-b936-bbb3174f1b66-original-pull-secret") pod "global-pull-secret-syncer-cfdhw" (UID: "261f6884-299b-4971-b936-bbb3174f1b66") : object "kube-system"/"original-pull-secret" not registered
Oct 30 20:35:49.650097 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:49.649747    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5hzrc\" (UniqueName: \"kubernetes.io/projected/fbbb7a28-caa9-4309-8d4c-a6f1c01e2b4f-kube-api-access-5hzrc\") pod \"network-check-target-scs59\" (UID: \"fbbb7a28-caa9-4309-8d4c-a6f1c01e2b4f\") " pod="openshift-network-diagnostics/network-check-target-scs59"
Oct 30 20:35:49.650097 ip-10-0-142-4 kubenswrapper[2575]: E1030 20:35:49.649966    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 20:35:49.650097 ip-10-0-142-4 kubenswrapper[2575]: E1030 20:35:49.649985    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 20:35:49.650097 ip-10-0-142-4 kubenswrapper[2575]: E1030 20:35:49.649998    2575 projected.go:196] Error preparing data for projected volume kube-api-access-5hzrc for pod openshift-network-diagnostics/network-check-target-scs59: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 20:35:49.650097 ip-10-0-142-4 kubenswrapper[2575]: E1030 20:35:49.650059    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fbbb7a28-caa9-4309-8d4c-a6f1c01e2b4f-kube-api-access-5hzrc podName:fbbb7a28-caa9-4309-8d4c-a6f1c01e2b4f nodeName:}" failed. No retries permitted until 2026-10-30 20:35:57.650039905 +0000 UTC m=+18.250148511 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-5hzrc" (UniqueName: "kubernetes.io/projected/fbbb7a28-caa9-4309-8d4c-a6f1c01e2b4f-kube-api-access-5hzrc") pod "network-check-target-scs59" (UID: "fbbb7a28-caa9-4309-8d4c-a6f1c01e2b4f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 20:35:49.839223 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:49.838770    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cfdhw"
Oct 30 20:35:49.839223 ip-10-0-142-4 kubenswrapper[2575]: E1030 20:35:49.838890    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cfdhw" podUID="261f6884-299b-4971-b936-bbb3174f1b66"
Oct 30 20:35:49.839223 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:49.838952    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-scs59"
Oct 30 20:35:49.839223 ip-10-0-142-4 kubenswrapper[2575]: E1030 20:35:49.839014    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-scs59" podUID="fbbb7a28-caa9-4309-8d4c-a6f1c01e2b4f"
Oct 30 20:35:49.839223 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:49.839058    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f45fg"
Oct 30 20:35:49.839223 ip-10-0-142-4 kubenswrapper[2575]: E1030 20:35:49.839128    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f45fg" podUID="d0bb5f1b-4370-4e8d-80a8-1a7bcda13cd2"
Oct 30 20:35:49.924660 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:49.924614    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-nmttt" event={"ID":"baefcab8-b5be-4143-9b55-7a86001a4363","Type":"ContainerStarted","Data":"3548496cdca320812d787d78900f894d67fa73ecaa50a8eec42c1bd7bd4a1e3a"}
Oct 30 20:35:50.583358 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:50.583081    2575 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Oct 30 20:35:50.839577 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:50.839460    2575 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-10-30T20:35:50.583277072Z","UUID":"e1a4ee15-fba6-4dfd-9506-174e77dbf953","Handler":null,"Name":"","Endpoint":""}
Oct 30 20:35:50.843438 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:50.843416    2575 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Oct 30 20:35:50.843602 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:50.843449    2575 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Oct 30 20:35:50.928595 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:50.928552    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gqt4f" event={"ID":"6e80b983-b2c0-4923-82b0-5903424cc7b0","Type":"ContainerStarted","Data":"3d73a962c8a8ffc19b03a23304c1e40c77cc2ce02bc5042a0e5c4f47d49310d4"}
Oct 30 20:35:50.930739 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:50.930675    2575 generic.go:356] "Generic (PLEG): container finished" podID="be756835-3011-4186-ab61-8128121eb95b" containerID="3db7dcc0c617301a0ad07c22fcfa2488b1b309ebb35eb320b5101da397909998" exitCode=0
Oct 30 20:35:50.930879 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:50.930757    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-n7knr" event={"ID":"be756835-3011-4186-ab61-8128121eb95b","Type":"ContainerDied","Data":"3db7dcc0c617301a0ad07c22fcfa2488b1b309ebb35eb320b5101da397909998"}
Oct 30 20:35:50.932873 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:50.932845    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-82j9v" event={"ID":"1930df66-da42-4ad8-bfe0-5e92f9e07ebc","Type":"ContainerStarted","Data":"56abe308e524503dc1e6fd2563950d57e6320da7a8f8a6eea419e6f1e488656b"}
Oct 30 20:35:51.055856 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:51.055794    2575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-nmttt" podStartSLOduration=3.41328043 podStartE2EDuration="11.055775367s" totalImagesPullingTime="7.642494937s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 20:35:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:35:50.044360881 +0000 UTC m=+10.644469500" watchObservedRunningTime="2026-10-30 20:35:51.055775367 +0000 UTC m=+11.655883973"
Oct 30 20:35:51.170659 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:51.170613    2575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-dns/node-resolver-82j9v" podStartSLOduration=2.92561749 podStartE2EDuration="11.170600134s" totalImagesPullingTime="8.244982644s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 20:35:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:35:51.170425397 +0000 UTC m=+11.770534001" watchObservedRunningTime="2026-10-30 20:35:51.170600134 +0000 UTC m=+11.770708739"
Oct 30 20:35:51.249182 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:51.249108    2575 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-mlgfz"
Oct 30 20:35:51.250047 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:51.250029    2575 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-mlgfz"
Oct 30 20:35:51.835194 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:51.835159    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cfdhw"
Oct 30 20:35:51.835194 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:51.835203    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f45fg"
Oct 30 20:35:51.835418 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:51.835167    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-scs59"
Oct 30 20:35:51.835418 ip-10-0-142-4 kubenswrapper[2575]: E1030 20:35:51.835312    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cfdhw" podUID="261f6884-299b-4971-b936-bbb3174f1b66"
Oct 30 20:35:51.835418 ip-10-0-142-4 kubenswrapper[2575]: E1030 20:35:51.835391    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f45fg" podUID="d0bb5f1b-4370-4e8d-80a8-1a7bcda13cd2"
Oct 30 20:35:51.835588 ip-10-0-142-4 kubenswrapper[2575]: E1030 20:35:51.835475    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-scs59" podUID="fbbb7a28-caa9-4309-8d4c-a6f1c01e2b4f"
Oct 30 20:35:51.937617 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:51.937534    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-cfbz6" event={"ID":"96b48bb2-933f-483d-8f15-5cca00c3d613","Type":"ContainerStarted","Data":"5e3e30fa4e98f2535550c795c12262d031fd0c275bf5b892c0116587f978e973"}
Oct 30 20:35:52.051928 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:52.051874    2575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-cfbz6" podStartSLOduration=4.194814979 podStartE2EDuration="12.051856768s" totalImagesPullingTime="7.857041789s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 20:35:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:35:52.051514426 +0000 UTC m=+12.651623032" watchObservedRunningTime="2026-10-30 20:35:52.051856768 +0000 UTC m=+12.651965375"
Oct 30 20:35:52.941651 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:52.941611    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gqt4f" event={"ID":"6e80b983-b2c0-4923-82b0-5903424cc7b0","Type":"ContainerStarted","Data":"f05d6fe2d8baffd36335da0bcd3da1995a9e6573843f104fa7fbad88db9ec26f"}
Oct 30 20:35:52.943817 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:52.943786    2575 generic.go:356] "Generic (PLEG): container finished" podID="be756835-3011-4186-ab61-8128121eb95b" containerID="93da85c4e9059383dccbe060d67b20da3ddd165e99fe7343beed8ac18d7dfa41" exitCode=0
Oct 30 20:35:52.943930 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:52.943818    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-n7knr" event={"ID":"be756835-3011-4186-ab61-8128121eb95b","Type":"ContainerDied","Data":"93da85c4e9059383dccbe060d67b20da3ddd165e99fe7343beed8ac18d7dfa41"}
Oct 30 20:35:52.945148 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:52.945125    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-7cg9z" event={"ID":"a5b34407-cc7d-458e-aca3-cd48133834ad","Type":"ContainerStarted","Data":"9af6ba1a5d05b72e990496c73d79ffb302ff1aef6336d07eb077b4d3d28a1fee"}
Oct 30 20:35:53.059563 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:53.059506    2575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gqt4f" podStartSLOduration=3.6820148 podStartE2EDuration="13.059474187s" totalImagesPullingTime="9.377459387s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 20:35:40 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:35:53.058887357 +0000 UTC m=+13.658995956" watchObservedRunningTime="2026-10-30 20:35:53.059474187 +0000 UTC m=+13.659582796"
Oct 30 20:35:53.179805 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:53.179756    2575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-7cg9z" podStartSLOduration=3.21377123 podStartE2EDuration="13.17974233s" totalImagesPullingTime="9.9659711s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 20:35:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:35:53.17937404 +0000 UTC m=+13.779482655" watchObservedRunningTime="2026-10-30 20:35:53.17974233 +0000 UTC m=+13.779850962"
Oct 30 20:35:53.835170 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:53.835136    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-scs59"
Oct 30 20:35:53.835331 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:53.835138    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cfdhw"
Oct 30 20:35:53.835331 ip-10-0-142-4 kubenswrapper[2575]: E1030 20:35:53.835240    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-scs59" podUID="fbbb7a28-caa9-4309-8d4c-a6f1c01e2b4f"
Oct 30 20:35:53.835331 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:53.835254    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f45fg"
Oct 30 20:35:53.835437 ip-10-0-142-4 kubenswrapper[2575]: E1030 20:35:53.835333    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cfdhw" podUID="261f6884-299b-4971-b936-bbb3174f1b66"
Oct 30 20:35:53.835437 ip-10-0-142-4 kubenswrapper[2575]: E1030 20:35:53.835371    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f45fg" podUID="d0bb5f1b-4370-4e8d-80a8-1a7bcda13cd2"
Oct 30 20:35:54.951828 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:54.951539    2575 generic.go:356] "Generic (PLEG): container finished" podID="be756835-3011-4186-ab61-8128121eb95b" containerID="12c15dc397ed4323ad15507a4ce2a20ce80f3c1343fedef7121aaa983a693f49" exitCode=0
Oct 30 20:35:54.951828 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:54.951611    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-n7knr" event={"ID":"be756835-3011-4186-ab61-8128121eb95b","Type":"ContainerDied","Data":"12c15dc397ed4323ad15507a4ce2a20ce80f3c1343fedef7121aaa983a693f49"}
Oct 30 20:35:55.835874 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:55.835841    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-scs59"
Oct 30 20:35:55.836048 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:55.835897    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cfdhw"
Oct 30 20:35:55.836048 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:55.835913    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f45fg"
Oct 30 20:35:55.836048 ip-10-0-142-4 kubenswrapper[2575]: E1030 20:35:55.835997    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f45fg" podUID="d0bb5f1b-4370-4e8d-80a8-1a7bcda13cd2"
Oct 30 20:35:55.836167 ip-10-0-142-4 kubenswrapper[2575]: E1030 20:35:55.836072    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cfdhw" podUID="261f6884-299b-4971-b936-bbb3174f1b66"
Oct 30 20:35:55.836197 ip-10-0-142-4 kubenswrapper[2575]: E1030 20:35:55.836168    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-scs59" podUID="fbbb7a28-caa9-4309-8d4c-a6f1c01e2b4f"
Oct 30 20:35:57.613535 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:57.613465    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d0bb5f1b-4370-4e8d-80a8-1a7bcda13cd2-metrics-certs\") pod \"network-metrics-daemon-f45fg\" (UID: \"d0bb5f1b-4370-4e8d-80a8-1a7bcda13cd2\") " pod="openshift-multus/network-metrics-daemon-f45fg"
Oct 30 20:35:57.613982 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:57.613558    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/261f6884-299b-4971-b936-bbb3174f1b66-original-pull-secret\") pod \"global-pull-secret-syncer-cfdhw\" (UID: \"261f6884-299b-4971-b936-bbb3174f1b66\") " pod="kube-system/global-pull-secret-syncer-cfdhw"
Oct 30 20:35:57.613982 ip-10-0-142-4 kubenswrapper[2575]: E1030 20:35:57.613622    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 20:35:57.613982 ip-10-0-142-4 kubenswrapper[2575]: E1030 20:35:57.613694    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0bb5f1b-4370-4e8d-80a8-1a7bcda13cd2-metrics-certs podName:d0bb5f1b-4370-4e8d-80a8-1a7bcda13cd2 nodeName:}" failed. No retries permitted until 2026-10-30 20:36:13.613675935 +0000 UTC m=+34.213784530 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d0bb5f1b-4370-4e8d-80a8-1a7bcda13cd2-metrics-certs") pod "network-metrics-daemon-f45fg" (UID: "d0bb5f1b-4370-4e8d-80a8-1a7bcda13cd2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 20:35:57.613982 ip-10-0-142-4 kubenswrapper[2575]: E1030 20:35:57.613713    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 20:35:57.613982 ip-10-0-142-4 kubenswrapper[2575]: E1030 20:35:57.613781    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/261f6884-299b-4971-b936-bbb3174f1b66-original-pull-secret podName:261f6884-299b-4971-b936-bbb3174f1b66 nodeName:}" failed. No retries permitted until 2026-10-30 20:36:13.613762662 +0000 UTC m=+34.213871249 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/261f6884-299b-4971-b936-bbb3174f1b66-original-pull-secret") pod "global-pull-secret-syncer-cfdhw" (UID: "261f6884-299b-4971-b936-bbb3174f1b66") : object "kube-system"/"original-pull-secret" not registered
Oct 30 20:35:57.714501 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:57.714452    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5hzrc\" (UniqueName: \"kubernetes.io/projected/fbbb7a28-caa9-4309-8d4c-a6f1c01e2b4f-kube-api-access-5hzrc\") pod \"network-check-target-scs59\" (UID: \"fbbb7a28-caa9-4309-8d4c-a6f1c01e2b4f\") " pod="openshift-network-diagnostics/network-check-target-scs59"
Oct 30 20:35:57.714665 ip-10-0-142-4 kubenswrapper[2575]: E1030 20:35:57.714628    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 20:35:57.714665 ip-10-0-142-4 kubenswrapper[2575]: E1030 20:35:57.714667    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 20:35:57.714844 ip-10-0-142-4 kubenswrapper[2575]: E1030 20:35:57.714679    2575 projected.go:196] Error preparing data for projected volume kube-api-access-5hzrc for pod openshift-network-diagnostics/network-check-target-scs59: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 20:35:57.714844 ip-10-0-142-4 kubenswrapper[2575]: E1030 20:35:57.714739    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fbbb7a28-caa9-4309-8d4c-a6f1c01e2b4f-kube-api-access-5hzrc podName:fbbb7a28-caa9-4309-8d4c-a6f1c01e2b4f nodeName:}" failed. No retries permitted until 2026-10-30 20:36:13.714721465 +0000 UTC m=+34.314830049 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-5hzrc" (UniqueName: "kubernetes.io/projected/fbbb7a28-caa9-4309-8d4c-a6f1c01e2b4f-kube-api-access-5hzrc") pod "network-check-target-scs59" (UID: "fbbb7a28-caa9-4309-8d4c-a6f1c01e2b4f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 20:35:57.834929 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:57.834897    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f45fg"
Oct 30 20:35:57.835095 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:57.834947    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-scs59"
Oct 30 20:35:57.835095 ip-10-0-142-4 kubenswrapper[2575]: E1030 20:35:57.835042    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f45fg" podUID="d0bb5f1b-4370-4e8d-80a8-1a7bcda13cd2"
Oct 30 20:35:57.835095 ip-10-0-142-4 kubenswrapper[2575]: E1030 20:35:57.835080    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-scs59" podUID="fbbb7a28-caa9-4309-8d4c-a6f1c01e2b4f"
Oct 30 20:35:57.835255 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:57.835120    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cfdhw"
Oct 30 20:35:57.835255 ip-10-0-142-4 kubenswrapper[2575]: E1030 20:35:57.835187    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cfdhw" podUID="261f6884-299b-4971-b936-bbb3174f1b66"
Oct 30 20:35:58.963329 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:58.963293    2575 generic.go:356] "Generic (PLEG): container finished" podID="be756835-3011-4186-ab61-8128121eb95b" containerID="0e8537ae577c792102ece9c167d12d39f4db8bc9ca3ef9cb05982811c93917a5" exitCode=0
Oct 30 20:35:58.963805 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:58.963346    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-n7knr" event={"ID":"be756835-3011-4186-ab61-8128121eb95b","Type":"ContainerDied","Data":"0e8537ae577c792102ece9c167d12d39f4db8bc9ca3ef9cb05982811c93917a5"}
Oct 30 20:35:59.836204 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:59.836016    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cfdhw"
Oct 30 20:35:59.836376 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:59.836085    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f45fg"
Oct 30 20:35:59.836376 ip-10-0-142-4 kubenswrapper[2575]: E1030 20:35:59.836287    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cfdhw" podUID="261f6884-299b-4971-b936-bbb3174f1b66"
Oct 30 20:35:59.836376 ip-10-0-142-4 kubenswrapper[2575]: E1030 20:35:59.836355    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f45fg" podUID="d0bb5f1b-4370-4e8d-80a8-1a7bcda13cd2"
Oct 30 20:35:59.836376 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:59.836114    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-scs59"
Oct 30 20:35:59.836526 ip-10-0-142-4 kubenswrapper[2575]: E1030 20:35:59.836420    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-scs59" podUID="fbbb7a28-caa9-4309-8d4c-a6f1c01e2b4f"
Oct 30 20:35:59.968424 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:59.968341    2575 generic.go:356] "Generic (PLEG): container finished" podID="be756835-3011-4186-ab61-8128121eb95b" containerID="02ffae324b88ac357a103a6d6a7c5dd9090898637c85630136ae2d18fe4460a5" exitCode=0
Oct 30 20:35:59.969023 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:59.968425    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-n7knr" event={"ID":"be756835-3011-4186-ab61-8128121eb95b","Type":"ContainerDied","Data":"02ffae324b88ac357a103a6d6a7c5dd9090898637c85630136ae2d18fe4460a5"}
Oct 30 20:35:59.971387 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:59.971342    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7dh2x" event={"ID":"9516abf2-c993-442c-8c5e-34480e5113d6","Type":"ContainerStarted","Data":"b290222d32e6df8aad5821a7e285034cf73b233a3a9376c7e48b21a727f08ac0"}
Oct 30 20:35:59.971449 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:59.971400    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7dh2x" event={"ID":"9516abf2-c993-442c-8c5e-34480e5113d6","Type":"ContainerStarted","Data":"a65752f7795ce65c01ec810a56f2a5c502fca5d34d0c372fdafe85a8afa5cd6a"}
Oct 30 20:35:59.971449 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:59.971437    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7dh2x" event={"ID":"9516abf2-c993-442c-8c5e-34480e5113d6","Type":"ContainerStarted","Data":"95e828252aae187ec64eb24f46b8d401cb153fab2772899043cec6869a888f3a"}
Oct 30 20:35:59.971571 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:59.971465    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7dh2x" event={"ID":"9516abf2-c993-442c-8c5e-34480e5113d6","Type":"ContainerStarted","Data":"aa5244f8510cfb7f491799e81c60f68e35bf2a409723661fc3d218b72b51a1c6"}
Oct 30 20:35:59.971571 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:59.971507    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7dh2x" event={"ID":"9516abf2-c993-442c-8c5e-34480e5113d6","Type":"ContainerStarted","Data":"97841f4e439370ce4cbbbf96a2287c7cdc27e2534a9498c716662067487389be"}
Oct 30 20:35:59.971571 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:35:59.971547    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7dh2x" event={"ID":"9516abf2-c993-442c-8c5e-34480e5113d6","Type":"ContainerStarted","Data":"2aa035234cfdec3d4cedceb477a7f5878c492e0c7add4b8439b3307f8a1e2a67"}
Oct 30 20:36:00.976410 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:36:00.976364    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-n7knr" event={"ID":"be756835-3011-4186-ab61-8128121eb95b","Type":"ContainerStarted","Data":"a9e6f6f7395335f83c9cff2202360b2376d26748e2975fbb4f459a53c390577d"}
Oct 30 20:36:01.097562 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:36:01.097512    2575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-n7knr" podStartSLOduration=7.385680071 podStartE2EDuration="21.097485805s" totalImagesPullingTime="13.711805734s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 20:35:40 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:36:01.097448496 +0000 UTC m=+21.697557101" watchObservedRunningTime="2026-10-30 20:36:01.097485805 +0000 UTC m=+21.697594410"
Oct 30 20:36:01.835612 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:36:01.835582    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cfdhw"
Oct 30 20:36:01.835761 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:36:01.835624    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f45fg"
Oct 30 20:36:01.835761 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:36:01.835591    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-scs59"
Oct 30 20:36:01.835761 ip-10-0-142-4 kubenswrapper[2575]: E1030 20:36:01.835693    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cfdhw" podUID="261f6884-299b-4971-b936-bbb3174f1b66"
Oct 30 20:36:01.835936 ip-10-0-142-4 kubenswrapper[2575]: E1030 20:36:01.835790    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-scs59" podUID="fbbb7a28-caa9-4309-8d4c-a6f1c01e2b4f"
Oct 30 20:36:01.835936 ip-10-0-142-4 kubenswrapper[2575]: E1030 20:36:01.835896    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f45fg" podUID="d0bb5f1b-4370-4e8d-80a8-1a7bcda13cd2"
Oct 30 20:36:01.982196 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:36:01.982159    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7dh2x" event={"ID":"9516abf2-c993-442c-8c5e-34480e5113d6","Type":"ContainerStarted","Data":"e73d2190426128295938a46d326c125afc1061077f948e8aacb7dd4501b05c8a"}
Oct 30 20:36:03.835873 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:36:03.835850    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cfdhw"
Oct 30 20:36:03.836409 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:36:03.835869    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-scs59"
Oct 30 20:36:03.836409 ip-10-0-142-4 kubenswrapper[2575]: E1030 20:36:03.835975    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cfdhw" podUID="261f6884-299b-4971-b936-bbb3174f1b66"
Oct 30 20:36:03.836409 ip-10-0-142-4 kubenswrapper[2575]: E1030 20:36:03.836035    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-scs59" podUID="fbbb7a28-caa9-4309-8d4c-a6f1c01e2b4f"
Oct 30 20:36:03.836409 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:36:03.836102    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f45fg"
Oct 30 20:36:03.836409 ip-10-0-142-4 kubenswrapper[2575]: E1030 20:36:03.836210    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f45fg" podUID="d0bb5f1b-4370-4e8d-80a8-1a7bcda13cd2"
Oct 30 20:36:03.989590 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:36:03.989545    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7dh2x" event={"ID":"9516abf2-c993-442c-8c5e-34480e5113d6","Type":"ContainerStarted","Data":"791822f8488220ad958e4c1ec7e64ad8fa7b938d530fdae9550f48474e8ed729"}
Oct 30 20:36:03.989946 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:36:03.989925    2575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-7dh2x"
Oct 30 20:36:03.990184 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:36:03.990000    2575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-7dh2x"
Oct 30 20:36:04.005140 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:36:04.005108    2575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7dh2x"
Oct 30 20:36:04.005469 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:36:04.005455    2575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7dh2x"
Oct 30 20:36:04.264563 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:36:04.264518    2575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-7dh2x" podStartSLOduration=7.048788243 podStartE2EDuration="24.264505752s" totalImagesPullingTime="17.215717509s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 20:35:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:36:04.26403867 +0000 UTC m=+24.864147275" watchObservedRunningTime="2026-10-30 20:36:04.264505752 +0000 UTC m=+24.864614347"
Oct 30 20:36:04.991440 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:36:04.991414    2575 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Oct 30 20:36:05.324248 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:36:05.324155    2575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-7dh2x"
Oct 30 20:36:05.834749 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:36:05.834725    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-scs59"
Oct 30 20:36:05.834749 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:36:05.834736    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f45fg"
Oct 30 20:36:05.834939 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:36:05.834725    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cfdhw"
Oct 30 20:36:05.834939 ip-10-0-142-4 kubenswrapper[2575]: E1030 20:36:05.834825    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-scs59" podUID="fbbb7a28-caa9-4309-8d4c-a6f1c01e2b4f"
Oct 30 20:36:05.834939 ip-10-0-142-4 kubenswrapper[2575]: E1030 20:36:05.834927    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cfdhw" podUID="261f6884-299b-4971-b936-bbb3174f1b66"
Oct 30 20:36:05.835042 ip-10-0-142-4 kubenswrapper[2575]: E1030 20:36:05.835023    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f45fg" podUID="d0bb5f1b-4370-4e8d-80a8-1a7bcda13cd2"
Oct 30 20:36:06.560476 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:36:06.560400    2575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-cfdhw"]
Oct 30 20:36:06.560900 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:36:06.560585    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cfdhw"
Oct 30 20:36:06.560900 ip-10-0-142-4 kubenswrapper[2575]: E1030 20:36:06.560690    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cfdhw" podUID="261f6884-299b-4971-b936-bbb3174f1b66"
Oct 30 20:36:06.563576 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:36:06.563557    2575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-scs59"]
Oct 30 20:36:06.563690 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:36:06.563638    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-scs59"
Oct 30 20:36:06.563792 ip-10-0-142-4 kubenswrapper[2575]: E1030 20:36:06.563768    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-scs59" podUID="fbbb7a28-caa9-4309-8d4c-a6f1c01e2b4f"
Oct 30 20:36:06.609998 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:36:06.609972    2575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-f45fg"]
Oct 30 20:36:06.610135 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:36:06.610073    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f45fg"
Oct 30 20:36:06.610171 ip-10-0-142-4 kubenswrapper[2575]: E1030 20:36:06.610152    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f45fg" podUID="d0bb5f1b-4370-4e8d-80a8-1a7bcda13cd2"
Oct 30 20:36:07.838768 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:36:07.838740    2575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-mlgfz"
Oct 30 20:36:07.839266 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:36:07.838857    2575 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Oct 30 20:36:07.839388 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:36:07.839368    2575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-mlgfz"
Oct 30 20:36:08.835638 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:36:08.835575    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f45fg"
Oct 30 20:36:08.835638 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:36:08.835606    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-scs59"
Oct 30 20:36:08.835638 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:36:08.835611    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cfdhw"
Oct 30 20:36:08.835835 ip-10-0-142-4 kubenswrapper[2575]: E1030 20:36:08.835679    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f45fg" podUID="d0bb5f1b-4370-4e8d-80a8-1a7bcda13cd2"
Oct 30 20:36:08.835835 ip-10-0-142-4 kubenswrapper[2575]: E1030 20:36:08.835753    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-scs59" podUID="fbbb7a28-caa9-4309-8d4c-a6f1c01e2b4f"
Oct 30 20:36:08.835835 ip-10-0-142-4 kubenswrapper[2575]: E1030 20:36:08.835807    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cfdhw" podUID="261f6884-299b-4971-b936-bbb3174f1b66"
Oct 30 20:36:10.835479 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:36:10.835442    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-scs59"
Oct 30 20:36:10.835881 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:36:10.835453    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f45fg"
Oct 30 20:36:10.835881 ip-10-0-142-4 kubenswrapper[2575]: E1030 20:36:10.835569    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-scs59" podUID="fbbb7a28-caa9-4309-8d4c-a6f1c01e2b4f"
Oct 30 20:36:10.835881 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:36:10.835460    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cfdhw"
Oct 30 20:36:10.835881 ip-10-0-142-4 kubenswrapper[2575]: E1030 20:36:10.835647    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f45fg" podUID="d0bb5f1b-4370-4e8d-80a8-1a7bcda13cd2"
Oct 30 20:36:10.835881 ip-10-0-142-4 kubenswrapper[2575]: E1030 20:36:10.835700    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cfdhw" podUID="261f6884-299b-4971-b936-bbb3174f1b66"
Oct 30 20:36:11.752905 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:36:11.752830    2575 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-4.us-west-1.compute.internal" event="NodeReady"
Oct 30 20:36:11.753042 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:36:11.752950    2575 kubelet_node_status.go:477] "Fast updating node status as it just became ready"
Oct 30 20:36:12.571563 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:36:12.571524    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlgfz_70cf9a0e-c321-438d-83a2-2034f4df9034/konnectivity-agent/0.log" limit=1024
Oct 30 20:36:12.829660 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:36:12.829584    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlgfz_70cf9a0e-c321-438d-83a2-2034f4df9034/konnectivity-agent/0.log" limit=1024
Oct 30 20:36:12.835450 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:36:12.835427    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f45fg"
Oct 30 20:36:12.835563 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:36:12.835547    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cfdhw"
Oct 30 20:36:12.835599 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:36:12.835576    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-scs59"
Oct 30 20:36:12.887752 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:36:12.887731    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Oct 30 20:36:12.888230 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:36:12.888216    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Oct 30 20:36:12.937598 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:36:12.937571    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-x2fjq\""
Oct 30 20:36:12.937598 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:36:12.937589    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-hqxsv\""
Oct 30 20:36:12.937777 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:36:12.937621    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Oct 30 20:36:12.937777 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:36:12.937638    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Oct 30 20:36:12.937777 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:36:12.937646    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-csvtm\""
Oct 30 20:36:13.038383 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:36:13.038347    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mlgfz_70cf9a0e-c321-438d-83a2-2034f4df9034/konnectivity-agent/0.log" limit=1024
Oct 30 20:36:13.264777 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:36:13.264756    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-82j9v_1930df66-da42-4ad8-bfe0-5e92f9e07ebc/dns-node-resolver/0.log"
Oct 30 20:36:13.622055 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:36:13.621969    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d0bb5f1b-4370-4e8d-80a8-1a7bcda13cd2-metrics-certs\") pod \"network-metrics-daemon-f45fg\" (UID: \"d0bb5f1b-4370-4e8d-80a8-1a7bcda13cd2\") " pod="openshift-multus/network-metrics-daemon-f45fg"
Oct 30 20:36:13.622055 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:36:13.622012    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/261f6884-299b-4971-b936-bbb3174f1b66-original-pull-secret\") pod \"global-pull-secret-syncer-cfdhw\" (UID: \"261f6884-299b-4971-b936-bbb3174f1b66\") " pod="kube-system/global-pull-secret-syncer-cfdhw"
Oct 30 20:36:13.622584 ip-10-0-142-4 kubenswrapper[2575]: E1030 20:36:13.622113    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Oct 30 20:36:13.622584 ip-10-0-142-4 kubenswrapper[2575]: E1030 20:36:13.622168    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0bb5f1b-4370-4e8d-80a8-1a7bcda13cd2-metrics-certs podName:d0bb5f1b-4370-4e8d-80a8-1a7bcda13cd2 nodeName:}" failed. No retries permitted until 2026-10-30 20:36:45.622155098 +0000 UTC m=+66.222263697 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d0bb5f1b-4370-4e8d-80a8-1a7bcda13cd2-metrics-certs") pod "network-metrics-daemon-f45fg" (UID: "d0bb5f1b-4370-4e8d-80a8-1a7bcda13cd2") : secret "metrics-daemon-secret" not found
Oct 30 20:36:13.625846 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:36:13.625727    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/261f6884-299b-4971-b936-bbb3174f1b66-original-pull-secret\") pod \"global-pull-secret-syncer-cfdhw\" (UID: \"261f6884-299b-4971-b936-bbb3174f1b66\") " pod="kube-system/global-pull-secret-syncer-cfdhw"
Oct 30 20:36:13.722863 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:36:13.722817    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5hzrc\" (UniqueName: \"kubernetes.io/projected/fbbb7a28-caa9-4309-8d4c-a6f1c01e2b4f-kube-api-access-5hzrc\") pod \"network-check-target-scs59\" (UID: \"fbbb7a28-caa9-4309-8d4c-a6f1c01e2b4f\") " pod="openshift-network-diagnostics/network-check-target-scs59"
Oct 30 20:36:13.725603 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:36:13.725573    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5hzrc\" (UniqueName: \"kubernetes.io/projected/fbbb7a28-caa9-4309-8d4c-a6f1c01e2b4f-kube-api-access-5hzrc\") pod \"network-check-target-scs59\" (UID: \"fbbb7a28-caa9-4309-8d4c-a6f1c01e2b4f\") " pod="openshift-network-diagnostics/network-check-target-scs59"
Oct 30 20:36:13.805836 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:36:13.805801    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-scs59"
Oct 30 20:36:13.820627 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:36:13.820601    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cfdhw"
Oct 30 20:36:14.053826 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:36:14.053796    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-5mml4_3e93e3cc-cd26-452f-9e40-31dedb0d198b/node-ca/0.log"
Oct 30 20:36:14.261823 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:36:14.261792    2575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-scs59"]
Oct 30 20:36:14.264736 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:36:14.264713    2575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfbbb7a28_caa9_4309_8d4c_a6f1c01e2b4f.slice/crio-c2cadbb60ff7a7ad87fdce1d691d40951aa52b80342df998b85123d68b238a56 WatchSource:0}: Error finding container c2cadbb60ff7a7ad87fdce1d691d40951aa52b80342df998b85123d68b238a56: Status 404 returned error can't find the container with id c2cadbb60ff7a7ad87fdce1d691d40951aa52b80342df998b85123d68b238a56
Oct 30 20:36:14.311937 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:36:14.311907    2575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-cfdhw"]
Oct 30 20:36:14.315154 ip-10-0-142-4 kubenswrapper[2575]: W1030 20:36:14.315119    2575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod261f6884_299b_4971_b936_bbb3174f1b66.slice/crio-ec4cff47dd20e2b59dd680ec049caf92107e598f2b21b186a98167e55f6d23d4 WatchSource:0}: Error finding container ec4cff47dd20e2b59dd680ec049caf92107e598f2b21b186a98167e55f6d23d4: Status 404 returned error can't find the container with id ec4cff47dd20e2b59dd680ec049caf92107e598f2b21b186a98167e55f6d23d4
Oct 30 20:36:15.016753 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:36:15.016714    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-scs59" event={"ID":"fbbb7a28-caa9-4309-8d4c-a6f1c01e2b4f","Type":"ContainerStarted","Data":"c2cadbb60ff7a7ad87fdce1d691d40951aa52b80342df998b85123d68b238a56"}
Oct 30 20:36:15.017888 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:36:15.017862    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-cfdhw" event={"ID":"261f6884-299b-4971-b936-bbb3174f1b66","Type":"ContainerStarted","Data":"ec4cff47dd20e2b59dd680ec049caf92107e598f2b21b186a98167e55f6d23d4"}
Oct 30 20:36:20.032711 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:36:20.032468    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-scs59" event={"ID":"fbbb7a28-caa9-4309-8d4c-a6f1c01e2b4f","Type":"ContainerStarted","Data":"87cb196acb56edb625499be0d5f8ddd646dcd4d8885ec21824094ef476a3a7be"}
Oct 30 20:36:20.033096 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:36:20.032780    2575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-scs59"
Oct 30 20:36:20.148063 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:36:20.148009    2575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-scs59" podStartSLOduration=35.108713651 podStartE2EDuration="40.147996926s" totalImagesPullingTime="5.039283275s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:35:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:36:20.147770387 +0000 UTC m=+40.747878994" watchObservedRunningTime="2026-10-30 20:36:20.147996926 +0000 UTC m=+40.748105531"
Oct 30 20:36:21.037951 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:36:21.037917    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-cfdhw" event={"ID":"261f6884-299b-4971-b936-bbb3174f1b66","Type":"ContainerStarted","Data":"c732e8335e63f519ecdffc44e54f4d0ce6a63de306df8e00ba33c44b3ca9595f"}
Oct 30 20:36:21.152551 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:36:21.152446    2575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-cfdhw" podStartSLOduration=34.589426212 podStartE2EDuration="41.152431893s" totalImagesPullingTime="6.563005681s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 20:35:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:36:21.15205002 +0000 UTC m=+41.752158625" watchObservedRunningTime="2026-10-30 20:36:21.152431893 +0000 UTC m=+41.752540497"
Oct 30 20:36:21.176921 ip-10-0-142-4 kubenswrapper[2575]: I1030 20:36:21.176888    2575 dynamic_cafile_content.go:175] "Shutting down controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Oct 30 20:36:21.177084 ip-10-0-142-4 systemd[1]: Stopping Kubernetes Kubelet...
Oct 30 20:36:21.188090 ip-10-0-142-4 systemd[1]: kubelet.service: Deactivated successfully.
Oct 30 20:36:21.188255 ip-10-0-142-4 systemd[1]: Stopped Kubernetes Kubelet.
Oct 30 20:36:21.188414 ip-10-0-142-4 systemd[1]: kubelet.service: Consumed 2.158s CPU time.
Oct 30 20:36:21.202122 ip-10-0-142-4 systemd[1]: Starting Kubernetes Kubelet...
Oct 30 20:36:21.325783 ip-10-0-142-4 kubenswrapper[4060]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 30 20:36:21.325783 ip-10-0-142-4 kubenswrapper[4060]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Oct 30 20:36:21.325783 ip-10-0-142-4 kubenswrapper[4060]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 30 20:36:21.325783 ip-10-0-142-4 kubenswrapper[4060]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 30 20:36:21.327966 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.327869    4060 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 20:36:21.327966 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.327965    4060 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 20:36:21.327966 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.327969    4060 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 20:36:21.328064 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.327972    4060 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 20:36:21.328064 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.327976    4060 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 20:36:21.328064 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.327979    4060 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 20:36:21.328064 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.327981    4060 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 20:36:21.328064 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.327984    4060 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 20:36:21.328064 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.327987    4060 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 20:36:21.328064 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.327989    4060 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 20:36:21.328064 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.327992    4060 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 20:36:21.328064 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.327995    4060 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 20:36:21.328064 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.327997    4060 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 20:36:21.328064 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.328000    4060 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 20:36:21.328064 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.328002    4060 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 20:36:21.328064 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.328006    4060 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 20:36:21.328064 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.328008    4060 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 20:36:21.328064 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.328010    4060 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 20:36:21.328064 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.328013    4060 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 20:36:21.328064 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.328016    4060 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 20:36:21.328064 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.328020    4060 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 20:36:21.328064 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.328022    4060 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 20:36:21.328064 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.328025    4060 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 20:36:21.328600 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.328028    4060 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 20:36:21.328600 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.328030    4060 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 20:36:21.328600 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.328033    4060 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 20:36:21.328600 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.328036    4060 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 20:36:21.328600 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.328039    4060 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 20:36:21.328600 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.328042    4060 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 20:36:21.328600 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.328044    4060 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 20:36:21.328600 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.328049    4060 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 20:36:21.328600 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.328053    4060 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 20:36:21.328600 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.328056    4060 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 20:36:21.328600 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.328060    4060 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 20:36:21.328600 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.328063    4060 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 20:36:21.328600 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.328066    4060 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 20:36:21.328600 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.328070    4060 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 20:36:21.328600 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.328073    4060 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 20:36:21.328600 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.328076    4060 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 20:36:21.328600 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.328079    4060 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 20:36:21.328600 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.328081    4060 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 20:36:21.328600 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.328084    4060 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 20:36:21.329053 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.328086    4060 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 20:36:21.329053 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.328089    4060 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 20:36:21.329053 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.328091    4060 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 20:36:21.329053 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.328094    4060 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 20:36:21.329053 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.328096    4060 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 20:36:21.329053 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.328099    4060 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 20:36:21.329053 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.328101    4060 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 20:36:21.329053 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.328104    4060 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 20:36:21.329053 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.328106    4060 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 20:36:21.329053 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.328109    4060 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 20:36:21.329053 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.328112    4060 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 20:36:21.329053 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.328114    4060 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 20:36:21.329053 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.328118    4060 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 20:36:21.329053 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.328120    4060 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 20:36:21.329053 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.328123    4060 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 20:36:21.329053 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.328126    4060 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 20:36:21.329053 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.328128    4060 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 20:36:21.329053 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.328131    4060 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 20:36:21.329053 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.328133    4060 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 20:36:21.329053 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.328159    4060 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 20:36:21.329549 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.328163    4060 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 20:36:21.329549 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.328166    4060 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 20:36:21.329549 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.328169    4060 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 20:36:21.329549 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.328172    4060 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 20:36:21.329549 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.328175    4060 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 20:36:21.329549 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.328178    4060 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 20:36:21.329549 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.328181    4060 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 20:36:21.329549 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.328183    4060 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 20:36:21.329549 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.328185    4060 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 20:36:21.329549 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.328188    4060 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 20:36:21.329549 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.328191    4060 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 20:36:21.329549 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.328194    4060 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 20:36:21.329549 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.328197    4060 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 20:36:21.329549 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.328199    4060 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 20:36:21.329549 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.328201    4060 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 20:36:21.329549 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.328204    4060 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 20:36:21.329549 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.328207    4060 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 20:36:21.329549 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.328209    4060 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 20:36:21.329549 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.328212    4060 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 20:36:21.329549 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.328214    4060 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 20:36:21.330022 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.328217    4060 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 20:36:21.330022 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.328220    4060 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 20:36:21.330022 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.328222    4060 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 20:36:21.330022 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.328225    4060 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 20:36:21.330022 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.328227    4060 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 20:36:21.330022 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.328230    4060 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 20:36:21.330022 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.328232    4060 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 20:36:21.330022 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.328235    4060 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 20:36:21.330022 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.328237    4060 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 20:36:21.330022 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.328240    4060 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 20:36:21.330022 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.328242    4060 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 20:36:21.330022 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.328245    4060 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 20:36:21.330022 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.328247    4060 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 20:36:21.330022 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.328250    4060 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 20:36:21.330022 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.328252    4060 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 20:36:21.330022 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.328255    4060 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 20:36:21.330022 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.328257    4060 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 20:36:21.330022 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.328260    4060 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 20:36:21.330022 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.328263    4060 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 20:36:21.330022 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.328265    4060 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 20:36:21.330510 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.328268    4060 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 20:36:21.330510 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.328270    4060 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 20:36:21.330510 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.328273    4060 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 20:36:21.330510 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.328278    4060 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 20:36:21.330510 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.329104    4060 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 20:36:21.330510 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.329113    4060 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 20:36:21.330510 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.329116    4060 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 20:36:21.330510 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.329119    4060 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 20:36:21.330510 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.329122    4060 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 20:36:21.330510 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.329125    4060 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 20:36:21.330510 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.329128    4060 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 20:36:21.330510 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.329131    4060 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 20:36:21.330510 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.329134    4060 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 20:36:21.330510 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.329136    4060 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 20:36:21.330510 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.329139    4060 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 20:36:21.330510 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.329141    4060 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 20:36:21.330510 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.329144    4060 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 20:36:21.330510 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.329147    4060 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 20:36:21.330510 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.329150    4060 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 20:36:21.330985 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.329152    4060 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 20:36:21.330985 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.329155    4060 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 20:36:21.330985 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.329157    4060 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 20:36:21.330985 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.329160    4060 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 20:36:21.330985 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.329162    4060 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 20:36:21.330985 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.329165    4060 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 20:36:21.330985 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.329168    4060 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 20:36:21.330985 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.329170    4060 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 20:36:21.330985 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.329173    4060 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 20:36:21.330985 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.329175    4060 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 20:36:21.330985 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.329178    4060 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 20:36:21.330985 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.329180    4060 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 20:36:21.330985 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.329184    4060 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 20:36:21.330985 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.329186    4060 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 20:36:21.330985 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.329189    4060 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 20:36:21.330985 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.329192    4060 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 20:36:21.330985 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.329194    4060 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 20:36:21.330985 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.329197    4060 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 20:36:21.330985 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.329200    4060 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 20:36:21.330985 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.329202    4060 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 20:36:21.331456 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.329205    4060 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 20:36:21.331456 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.329207    4060 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 20:36:21.331456 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.329210    4060 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 20:36:21.331456 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.329212    4060 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 20:36:21.331456 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.329215    4060 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 20:36:21.331456 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.329218    4060 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 20:36:21.331456 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.329221    4060 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 20:36:21.331456 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.329223    4060 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 20:36:21.331456 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.329226    4060 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 20:36:21.331456 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.329228    4060 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 20:36:21.331456 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.329230    4060 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 20:36:21.331456 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.329233    4060 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 20:36:21.331456 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.329235    4060 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 20:36:21.331456 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.329238    4060 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 20:36:21.331456 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.329241    4060 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 20:36:21.331456 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.329243    4060 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 20:36:21.331456 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.329246    4060 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 20:36:21.331456 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.329248    4060 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 20:36:21.331456 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.329252    4060 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 20:36:21.331931 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.329256    4060 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 20:36:21.331931 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.329259    4060 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 20:36:21.331931 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.329262    4060 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 20:36:21.331931 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.329265    4060 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 20:36:21.331931 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.329269    4060 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 20:36:21.331931 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.329271    4060 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 20:36:21.331931 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.329274    4060 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 20:36:21.331931 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.329277    4060 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 20:36:21.331931 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.329279    4060 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 20:36:21.331931 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.329282    4060 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 20:36:21.331931 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.329284    4060 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 20:36:21.331931 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.329287    4060 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 20:36:21.331931 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.329289    4060 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 20:36:21.331931 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.329292    4060 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 20:36:21.331931 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.329294    4060 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 20:36:21.331931 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.329297    4060 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 20:36:21.331931 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.329300    4060 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 20:36:21.331931 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.329303    4060 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 20:36:21.331931 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.329305    4060 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 20:36:21.331931 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.329308    4060 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 20:36:21.332423 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.329310    4060 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 20:36:21.332423 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.329313    4060 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 20:36:21.332423 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.329315    4060 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 20:36:21.332423 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.329318    4060 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 20:36:21.332423 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.329320    4060 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 20:36:21.332423 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.329322    4060 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 20:36:21.332423 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.329325    4060 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 20:36:21.332423 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.329327    4060 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 20:36:21.332423 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.329330    4060 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 20:36:21.332423 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.329333    4060 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 20:36:21.332423 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.329335    4060 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 20:36:21.332423 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.329338    4060 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 20:36:21.332423 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.329341    4060 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 20:36:21.332423 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.329344    4060 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 20:36:21.332423 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.329346    4060 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 20:36:21.332423 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.329349    4060 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 20:36:21.332423 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.329351    4060 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 20:36:21.332423 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.329354    4060 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 20:36:21.332423 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.329356    4060 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 20:36:21.333083 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.329359    4060 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 20:36:21.333083 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.329362    4060 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 20:36:21.333083 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.329364    4060 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 20:36:21.333083 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.329367    4060 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 20:36:21.333083 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.329369    4060 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 20:36:21.333083 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.329372    4060 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 20:36:21.333083 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.329375    4060 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 20:36:21.333083 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.329377    4060 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 20:36:21.333083 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.329381    4060 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 20:36:21.333083 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.329385    4060 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 20:36:21.333083 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.329388    4060 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 20:36:21.333083 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.329391    4060 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 20:36:21.333083 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.329393    4060 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 20:36:21.333083 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.329890    4060 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 20:36:21.333083 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.329896    4060 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 20:36:21.333083 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.329899    4060 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 20:36:21.333083 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.329902    4060 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 20:36:21.333083 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.329904    4060 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 20:36:21.333083 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.329907    4060 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 20:36:21.333083 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.329910    4060 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 20:36:21.333578 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.329912    4060 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 20:36:21.333578 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.329915    4060 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 20:36:21.333578 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.329918    4060 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 20:36:21.333578 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.329921    4060 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 20:36:21.333578 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.329923    4060 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 20:36:21.333578 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.329926    4060 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 20:36:21.333578 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.329929    4060 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 20:36:21.333578 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.329931    4060 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 20:36:21.333578 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.329934    4060 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 20:36:21.333578 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.329936    4060 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 20:36:21.333578 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.329939    4060 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 20:36:21.333578 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.329941    4060 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 20:36:21.333578 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.329944    4060 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 20:36:21.333578 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.329947    4060 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 20:36:21.333578 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.329950    4060 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 20:36:21.333578 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.329952    4060 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 20:36:21.333578 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.329954    4060 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 20:36:21.333578 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.329957    4060 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 20:36:21.333578 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.329960    4060 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 20:36:21.333578 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.329963    4060 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 20:36:21.334088 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.329967    4060 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 20:36:21.334088 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.329970    4060 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 20:36:21.334088 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.329973    4060 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 20:36:21.334088 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.329976    4060 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 20:36:21.334088 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.329979    4060 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 20:36:21.334088 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.329981    4060 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 20:36:21.334088 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.329984    4060 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 20:36:21.334088 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.329987    4060 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 20:36:21.334088 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.329990    4060 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 20:36:21.334088 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.329992    4060 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 20:36:21.334088 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.329995    4060 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 20:36:21.334088 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.329998    4060 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 20:36:21.334088 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.330000    4060 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 20:36:21.334088 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.330003    4060 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 20:36:21.334088 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.330005    4060 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 20:36:21.334088 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.330008    4060 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 20:36:21.334088 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.330011    4060 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 20:36:21.334088 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.330013    4060 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 20:36:21.334088 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.330016    4060 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 20:36:21.334557 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.330018    4060 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 20:36:21.334557 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.330021    4060 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 20:36:21.334557 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.330024    4060 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 20:36:21.334557 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.330028    4060 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 20:36:21.334557 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.330031    4060 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 20:36:21.334557 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.330034    4060 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 20:36:21.334557 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.330036    4060 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 20:36:21.334557 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.330039    4060 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 20:36:21.334557 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.330042    4060 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 20:36:21.334557 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.330044    4060 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 20:36:21.334557 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.330047    4060 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 20:36:21.334557 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.330049    4060 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 20:36:21.334557 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.330052    4060 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 20:36:21.334557 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.330054    4060 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 20:36:21.334557 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.330057    4060 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 20:36:21.334557 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.330060    4060 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 20:36:21.334557 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.330062    4060 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 20:36:21.334557 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.330068    4060 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 20:36:21.334557 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.330071    4060 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 20:36:21.335035 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.330073    4060 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 20:36:21.335035 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.330075    4060 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 20:36:21.335035 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.330078    4060 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 20:36:21.335035 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.330080    4060 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 20:36:21.335035 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.330083    4060 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 20:36:21.335035 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.330085    4060 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 20:36:21.335035 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.330088    4060 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 20:36:21.335035 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.330090    4060 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 20:36:21.335035 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.330093    4060 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 20:36:21.335035 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.330096    4060 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 20:36:21.335035 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.330098    4060 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 20:36:21.335035 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.330101    4060 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 20:36:21.335035 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.330104    4060 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 20:36:21.335035 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.330106    4060 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 20:36:21.335035 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.330109    4060 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 20:36:21.335035 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.330111    4060 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 20:36:21.335035 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.330114    4060 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 20:36:21.335035 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.330116    4060 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 20:36:21.335035 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.330119    4060 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 20:36:21.335035 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.330122    4060 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 20:36:21.335550 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.330124    4060 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 20:36:21.335550 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.330127    4060 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 20:36:21.335550 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.330129    4060 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 20:36:21.335550 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.330132    4060 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 20:36:21.335550 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.330134    4060 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 20:36:21.335550 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.330140    4060 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 20:36:21.335550 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.330142    4060 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 20:36:21.335550 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.330145    4060 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 20:36:21.335550 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.330148    4060 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 20:36:21.335550 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.330151    4060 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 20:36:21.335550 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.330153    4060 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 20:36:21.335550 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.330156    4060 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 20:36:21.335550 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.330158    4060 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 20:36:21.335550 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.330163    4060 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 20:36:21.335550 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.330165    4060 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 20:36:21.335550 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.330168    4060 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 20:36:21.335550 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.330171    4060 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 20:36:21.335550 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.330173    4060 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 20:36:21.335550 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.330176    4060 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 20:36:21.336010 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.330178    4060 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 20:36:21.336010 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.330181    4060 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 20:36:21.336010 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.330272    4060 flags.go:64] FLAG: --address="0.0.0.0"
Oct 30 20:36:21.336010 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.330279    4060 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Oct 30 20:36:21.336010 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.330286    4060 flags.go:64] FLAG: --anonymous-auth="true"
Oct 30 20:36:21.336010 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.330291    4060 flags.go:64] FLAG: --application-metrics-count-limit="100"
Oct 30 20:36:21.336010 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.330295    4060 flags.go:64] FLAG: --authentication-token-webhook="false"
Oct 30 20:36:21.336010 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.330298    4060 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Oct 30 20:36:21.336010 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.330305    4060 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Oct 30 20:36:21.336010 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.330309    4060 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Oct 30 20:36:21.336010 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.330312    4060 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Oct 30 20:36:21.336010 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.330315    4060 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Oct 30 20:36:21.336010 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.330319    4060 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Oct 30 20:36:21.336010 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.330322    4060 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Oct 30 20:36:21.336010 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.330325    4060 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Oct 30 20:36:21.336010 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.330328    4060 flags.go:64] FLAG: --cgroup-root=""
Oct 30 20:36:21.336010 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.330331    4060 flags.go:64] FLAG: --cgroups-per-qos="true"
Oct 30 20:36:21.336010 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.330334    4060 flags.go:64] FLAG: --client-ca-file=""
Oct 30 20:36:21.336010 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.330337    4060 flags.go:64] FLAG: --cloud-provider="external"
Oct 30 20:36:21.336010 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.330341    4060 flags.go:64] FLAG: --cluster-dns="[]"
Oct 30 20:36:21.336010 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.330346    4060 flags.go:64] FLAG: --cluster-domain=""
Oct 30 20:36:21.336010 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.330348    4060 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Oct 30 20:36:21.336010 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.330352    4060 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Oct 30 20:36:21.336010 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.330355    4060 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Oct 30 20:36:21.336589 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.330358    4060 flags.go:64] FLAG: --container-log-max-files="5"
Oct 30 20:36:21.336589 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.330362    4060 flags.go:64] FLAG: --container-log-max-size="10Mi"
Oct 30 20:36:21.336589 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.330365    4060 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Oct 30 20:36:21.336589 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.330369    4060 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Oct 30 20:36:21.336589 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.330372    4060 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Oct 30 20:36:21.336589 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.330375    4060 flags.go:64] FLAG: --contention-profiling="false"
Oct 30 20:36:21.336589 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.330378    4060 flags.go:64] FLAG: --cpu-cfs-quota="true"
Oct 30 20:36:21.336589 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.330381    4060 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Oct 30 20:36:21.336589 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.330384    4060 flags.go:64] FLAG: --cpu-manager-policy="none"
Oct 30 20:36:21.336589 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.330388    4060 flags.go:64] FLAG: --cpu-manager-policy-options=""
Oct 30 20:36:21.336589 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.330395    4060 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Oct 30 20:36:21.336589 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.330400    4060 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Oct 30 20:36:21.336589 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.330405    4060 flags.go:64] FLAG: --enable-debugging-handlers="true"
Oct 30 20:36:21.336589 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.330408    4060 flags.go:64] FLAG: --enable-load-reader="false"
Oct 30 20:36:21.336589 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.330413    4060 flags.go:64] FLAG: --enable-server="true"
Oct 30 20:36:21.336589 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.330417    4060 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Oct 30 20:36:21.336589 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.330424    4060 flags.go:64] FLAG: --event-burst="100"
Oct 30 20:36:21.336589 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.330427    4060 flags.go:64] FLAG: --event-qps="50"
Oct 30 20:36:21.336589 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.330431    4060 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Oct 30 20:36:21.336589 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.330434    4060 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Oct 30 20:36:21.336589 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.330437    4060 flags.go:64] FLAG: --eviction-hard=""
Oct 30 20:36:21.336589 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.330442    4060 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Oct 30 20:36:21.336589 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.330444    4060 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Oct 30 20:36:21.336589 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.330447    4060 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Oct 30 20:36:21.336589 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.330451    4060 flags.go:64] FLAG: --eviction-soft=""
Oct 30 20:36:21.337582 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.330454    4060 flags.go:64] FLAG: --eviction-soft-grace-period=""
Oct 30 20:36:21.337582 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.330457    4060 flags.go:64] FLAG: --exit-on-lock-contention="false"
Oct 30 20:36:21.337582 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.330460    4060 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Oct 30 20:36:21.337582 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.330463    4060 flags.go:64] FLAG: --experimental-mounter-path=""
Oct 30 20:36:21.337582 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.330466    4060 flags.go:64] FLAG: --fail-cgroupv1="true"
Oct 30 20:36:21.337582 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.330469    4060 flags.go:64] FLAG: --fail-swap-on="true"
Oct 30 20:36:21.337582 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.330472    4060 flags.go:64] FLAG: --feature-gates=""
Oct 30 20:36:21.337582 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.330476    4060 flags.go:64] FLAG: --file-check-frequency="20s"
Oct 30 20:36:21.337582 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.330479    4060 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Oct 30 20:36:21.337582 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.330482    4060 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Oct 30 20:36:21.337582 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.330485    4060 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Oct 30 20:36:21.337582 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.330501    4060 flags.go:64] FLAG: --healthz-port="10248"
Oct 30 20:36:21.337582 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.330505    4060 flags.go:64] FLAG: --help="false"
Oct 30 20:36:21.337582 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.330507    4060 flags.go:64] FLAG: --hostname-override="ip-10-0-142-4.us-west-1.compute.internal"
Oct 30 20:36:21.337582 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.330511    4060 flags.go:64] FLAG: --housekeeping-interval="10s"
Oct 30 20:36:21.337582 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.330514    4060 flags.go:64] FLAG: --http-check-frequency="20s"
Oct 30 20:36:21.337582 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.330517    4060 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Oct 30 20:36:21.337582 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.330520    4060 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Oct 30 20:36:21.337582 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.330524    4060 flags.go:64] FLAG: --image-gc-high-threshold="85"
Oct 30 20:36:21.337582 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.330527    4060 flags.go:64] FLAG: --image-gc-low-threshold="80"
Oct 30 20:36:21.337582 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.330530    4060 flags.go:64] FLAG: --image-service-endpoint=""
Oct 30 20:36:21.337582 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.330532    4060 flags.go:64] FLAG: --kernel-memcg-notification="false"
Oct 30 20:36:21.337582 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.330535    4060 flags.go:64] FLAG: --kube-api-burst="100"
Oct 30 20:36:21.338187 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.330538    4060 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Oct 30 20:36:21.338187 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.330541    4060 flags.go:64] FLAG: --kube-api-qps="50"
Oct 30 20:36:21.338187 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.330544    4060 flags.go:64] FLAG: --kube-reserved=""
Oct 30 20:36:21.338187 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.330547    4060 flags.go:64] FLAG: --kube-reserved-cgroup=""
Oct 30 20:36:21.338187 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.330550    4060 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Oct 30 20:36:21.338187 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.330553    4060 flags.go:64] FLAG: --kubelet-cgroups=""
Oct 30 20:36:21.338187 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.330556    4060 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Oct 30 20:36:21.338187 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.330559    4060 flags.go:64] FLAG: --lock-file=""
Oct 30 20:36:21.338187 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.330561    4060 flags.go:64] FLAG: --log-cadvisor-usage="false"
Oct 30 20:36:21.338187 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.330565    4060 flags.go:64] FLAG: --log-flush-frequency="5s"
Oct 30 20:36:21.338187 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.330568    4060 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Oct 30 20:36:21.338187 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.330573    4060 flags.go:64] FLAG: --log-json-split-stream="false"
Oct 30 20:36:21.338187 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.330576    4060 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Oct 30 20:36:21.338187 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.330580    4060 flags.go:64] FLAG: --log-text-split-stream="false"
Oct 30 20:36:21.338187 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.330583    4060 flags.go:64] FLAG: --logging-format="text"
Oct 30 20:36:21.338187 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.330586    4060 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Oct 30 20:36:21.338187 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.330589    4060 flags.go:64] FLAG: --make-iptables-util-chains="true"
Oct 30 20:36:21.338187 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.330592    4060 flags.go:64] FLAG: --manifest-url=""
Oct 30 20:36:21.338187 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.330594    4060 flags.go:64] FLAG: --manifest-url-header=""
Oct 30 20:36:21.338187 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.330599    4060 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Oct 30 20:36:21.338187 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.330602    4060 flags.go:64] FLAG: --max-open-files="1000000"
Oct 30 20:36:21.338187 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.330605    4060 flags.go:64] FLAG: --max-pods="110"
Oct 30 20:36:21.338187 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.330608    4060 flags.go:64] FLAG: --maximum-dead-containers="-1"
Oct 30 20:36:21.338187 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.330611    4060 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Oct 30 20:36:21.338187 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.330614    4060 flags.go:64] FLAG: --memory-manager-policy="None"
Oct 30 20:36:21.338792 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.330617    4060 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Oct 30 20:36:21.338792 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.330626    4060 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Oct 30 20:36:21.338792 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.330631    4060 flags.go:64] FLAG: --node-ip="0.0.0.0"
Oct 30 20:36:21.338792 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.330635    4060 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Oct 30 20:36:21.338792 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.330644    4060 flags.go:64] FLAG: --node-status-max-images="50"
Oct 30 20:36:21.338792 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.330648    4060 flags.go:64] FLAG: --node-status-update-frequency="10s"
Oct 30 20:36:21.338792 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.330653    4060 flags.go:64] FLAG: --oom-score-adj="-999"
Oct 30 20:36:21.338792 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.330658    4060 flags.go:64] FLAG: --pod-cidr=""
Oct 30 20:36:21.338792 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.330662    4060 flags.go:64] FLAG: --pod-manifest-path=""
Oct 30 20:36:21.338792 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.330667    4060 flags.go:64] FLAG: --pod-max-pids="-1"
Oct 30 20:36:21.338792 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.330696    4060 flags.go:64] FLAG: --pods-per-core="0"
Oct 30 20:36:21.338792 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.330702    4060 flags.go:64] FLAG: --port="10250"
Oct 30 20:36:21.338792 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.330707    4060 flags.go:64] FLAG: --protect-kernel-defaults="false"
Oct 30 20:36:21.338792 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.330712    4060 flags.go:64] FLAG: --provider-id="aws:///us-west-1a/i-0435ad279ec7cbbbb"
Oct 30 20:36:21.338792 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.330717    4060 flags.go:64] FLAG: --qos-reserved=""
Oct 30 20:36:21.338792 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.330722    4060 flags.go:64] FLAG: --read-only-port="10255"
Oct 30 20:36:21.338792 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.330727    4060 flags.go:64] FLAG: --register-node="true"
Oct 30 20:36:21.338792 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.330732    4060 flags.go:64] FLAG: --register-with-taints=""
Oct 30 20:36:21.338792 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.330739    4060 flags.go:64] FLAG: --registry-burst="10"
Oct 30 20:36:21.338792 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.330743    4060 flags.go:64] FLAG: --registry-qps="5"
Oct 30 20:36:21.338792 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.330748    4060 flags.go:64] FLAG: --reserved-cpus=""
Oct 30 20:36:21.338792 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.330753    4060 flags.go:64] FLAG: --reserved-memory=""
Oct 30 20:36:21.338792 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.330759    4060 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Oct 30 20:36:21.338792 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.330764    4060 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Oct 30 20:36:21.338792 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.330769    4060 flags.go:64] FLAG: --rotate-certificates="false"
Oct 30 20:36:21.338792 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.330773    4060 flags.go:64] FLAG: --rotate-server-certificates="false"
Oct 30 20:36:21.339457 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.330777    4060 flags.go:64] FLAG: --runonce="false"
Oct 30 20:36:21.339457 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.330782    4060 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Oct 30 20:36:21.339457 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.330787    4060 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Oct 30 20:36:21.339457 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.330792    4060 flags.go:64] FLAG: --seccomp-default="false"
Oct 30 20:36:21.339457 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.330796    4060 flags.go:64] FLAG: --serialize-image-pulls="true"
Oct 30 20:36:21.339457 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.330801    4060 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Oct 30 20:36:21.339457 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.330806    4060 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Oct 30 20:36:21.339457 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.330813    4060 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Oct 30 20:36:21.339457 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.330818    4060 flags.go:64] FLAG: --storage-driver-password="root"
Oct 30 20:36:21.339457 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.330823    4060 flags.go:64] FLAG: --storage-driver-secure="false"
Oct 30 20:36:21.339457 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.330828    4060 flags.go:64] FLAG: --storage-driver-table="stats"
Oct 30 20:36:21.339457 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.330840    4060 flags.go:64] FLAG: --storage-driver-user="root"
Oct 30 20:36:21.339457 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.330845    4060 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Oct 30 20:36:21.339457 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.330850    4060 flags.go:64] FLAG: --sync-frequency="1m0s"
Oct 30 20:36:21.339457 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.330855    4060 flags.go:64] FLAG: --system-cgroups=""
Oct 30 20:36:21.339457 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.330860    4060 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Oct 30 20:36:21.339457 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.330868    4060 flags.go:64] FLAG: --system-reserved-cgroup=""
Oct 30 20:36:21.339457 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.330872    4060 flags.go:64] FLAG: --tls-cert-file=""
Oct 30 20:36:21.339457 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.330876    4060 flags.go:64] FLAG: --tls-cipher-suites="[]"
Oct 30 20:36:21.339457 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.330882    4060 flags.go:64] FLAG: --tls-min-version=""
Oct 30 20:36:21.339457 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.330887    4060 flags.go:64] FLAG: --tls-private-key-file=""
Oct 30 20:36:21.339457 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.330892    4060 flags.go:64] FLAG: --topology-manager-policy="none"
Oct 30 20:36:21.339457 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.330896    4060 flags.go:64] FLAG: --topology-manager-policy-options=""
Oct 30 20:36:21.339457 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.330901    4060 flags.go:64] FLAG: --topology-manager-scope="container"
Oct 30 20:36:21.339457 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.330906    4060 flags.go:64] FLAG: --v="2"
Oct 30 20:36:21.340069 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.330913    4060 flags.go:64] FLAG: --version="false"
Oct 30 20:36:21.340069 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.330919    4060 flags.go:64] FLAG: --vmodule=""
Oct 30 20:36:21.340069 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.330925    4060 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Oct 30 20:36:21.340069 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.330931    4060 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Oct 30 20:36:21.340069 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331137    4060 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 20:36:21.340069 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331144    4060 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 20:36:21.340069 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331149    4060 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 20:36:21.340069 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331153    4060 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 20:36:21.340069 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331157    4060 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 20:36:21.340069 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331161    4060 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 20:36:21.340069 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331165    4060 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 20:36:21.340069 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331171    4060 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 20:36:21.340069 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331176    4060 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 20:36:21.340069 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331181    4060 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 20:36:21.340069 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331188    4060 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 20:36:21.340069 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331193    4060 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 20:36:21.340069 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331198    4060 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 20:36:21.340069 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331202    4060 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 20:36:21.340069 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331208    4060 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 20:36:21.340069 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331212    4060 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 20:36:21.340579 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331216    4060 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 20:36:21.340579 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331220    4060 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 20:36:21.340579 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331224    4060 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 20:36:21.340579 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331229    4060 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 20:36:21.340579 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331233    4060 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 20:36:21.340579 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331237    4060 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 20:36:21.340579 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331241    4060 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 20:36:21.340579 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331246    4060 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 20:36:21.340579 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331250    4060 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 20:36:21.340579 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331254    4060 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 20:36:21.340579 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331257    4060 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 20:36:21.340579 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331261    4060 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 20:36:21.340579 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331265    4060 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 20:36:21.340579 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331269    4060 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 20:36:21.340579 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331273    4060 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 20:36:21.340579 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331277    4060 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 20:36:21.340579 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331281    4060 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 20:36:21.340579 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331286    4060 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 20:36:21.340579 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331290    4060 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 20:36:21.340579 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331294    4060 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 20:36:21.341056 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331298    4060 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 20:36:21.341056 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331302    4060 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 20:36:21.341056 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331306    4060 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 20:36:21.341056 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331310    4060 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 20:36:21.341056 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331314    4060 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 20:36:21.341056 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331318    4060 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 20:36:21.341056 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331324    4060 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 20:36:21.341056 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331328    4060 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 20:36:21.341056 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331333    4060 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 20:36:21.341056 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331337    4060 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 20:36:21.341056 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331342    4060 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 20:36:21.341056 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331346    4060 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 20:36:21.341056 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331350    4060 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 20:36:21.341056 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331355    4060 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 20:36:21.341056 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331359    4060 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 20:36:21.341056 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331364    4060 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 20:36:21.341056 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331368    4060 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 20:36:21.341056 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331372    4060 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 20:36:21.341056 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331376    4060 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 20:36:21.341056 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331380    4060 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 20:36:21.341560 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331384    4060 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 20:36:21.341560 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331388    4060 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 20:36:21.341560 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331392    4060 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 20:36:21.341560 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331396    4060 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 20:36:21.341560 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331400    4060 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 20:36:21.341560 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331404    4060 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 20:36:21.341560 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331409    4060 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 20:36:21.341560 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331412    4060 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 20:36:21.341560 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331416    4060 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 20:36:21.341560 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331421    4060 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 20:36:21.341560 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331425    4060 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 20:36:21.341560 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331429    4060 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 20:36:21.341560 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331435    4060 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 20:36:21.341560 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331442    4060 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 20:36:21.341560 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331446    4060 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 20:36:21.341560 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331450    4060 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 20:36:21.341560 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331454    4060 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 20:36:21.341560 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331458    4060 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 20:36:21.341560 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331464    4060 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 20:36:21.342002 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331469    4060 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 20:36:21.342002 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331473    4060 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 20:36:21.342002 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331477    4060 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 20:36:21.342002 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331483    4060 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 20:36:21.342002 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331487    4060 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 20:36:21.342002 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331515    4060 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 20:36:21.342002 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331519    4060 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 20:36:21.342002 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331523    4060 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 20:36:21.342002 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331528    4060 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 20:36:21.342002 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331532    4060 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 20:36:21.342002 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331536    4060 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 20:36:21.342002 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331540    4060 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 20:36:21.342002 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331544    4060 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 20:36:21.342002 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331548    4060 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 20:36:21.342002 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331552    4060 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 20:36:21.342002 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331556    4060 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 20:36:21.342002 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331560    4060 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 20:36:21.342002 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331564    4060 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 20:36:21.342002 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331568    4060 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 20:36:21.342002 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331572    4060 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 20:36:21.342462 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331576    4060 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 20:36:21.342462 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331581    4060 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 20:36:21.342462 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331585    4060 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 20:36:21.342462 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331590    4060 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 20:36:21.342462 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331594    4060 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 20:36:21.342462 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331598    4060 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 20:36:21.342462 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331603    4060 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 20:36:21.342462 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331607    4060 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 20:36:21.342462 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331611    4060 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 20:36:21.342462 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331615    4060 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 20:36:21.342462 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331619    4060 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 20:36:21.342462 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.331662    4060 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 30 20:36:21.342462 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331713    4060 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 20:36:21.342462 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331719    4060 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 20:36:21.342462 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331724    4060 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 20:36:21.342827 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331730    4060 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 20:36:21.342827 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331736    4060 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 20:36:21.342827 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331741    4060 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 20:36:21.342827 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331745    4060 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 20:36:21.342827 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331749    4060 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 20:36:21.342827 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331753    4060 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 20:36:21.342827 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331758    4060 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 20:36:21.342827 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331762    4060 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 20:36:21.342827 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331766    4060 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 20:36:21.342827 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331772    4060 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 20:36:21.342827 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331778    4060 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 20:36:21.342827 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331783    4060 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 20:36:21.342827 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331787    4060 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 20:36:21.342827 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331790    4060 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 20:36:21.342827 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331794    4060 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 20:36:21.342827 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331797    4060 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 20:36:21.342827 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331800    4060 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 20:36:21.342827 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331803    4060 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 20:36:21.342827 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331806    4060 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 20:36:21.342827 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331808    4060 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 20:36:21.343418 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331811    4060 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 20:36:21.343418 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331814    4060 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 20:36:21.343418 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331818    4060 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 20:36:21.343418 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331820    4060 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 20:36:21.343418 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331823    4060 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 20:36:21.343418 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331825    4060 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 20:36:21.343418 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331828    4060 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 20:36:21.343418 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331830    4060 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 20:36:21.343418 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331834    4060 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 20:36:21.343418 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331837    4060 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 20:36:21.343418 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331839    4060 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 20:36:21.343418 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331842    4060 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 20:36:21.343418 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331844    4060 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 20:36:21.343418 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331848    4060 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 20:36:21.343418 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331851    4060 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 20:36:21.343418 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331853    4060 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 20:36:21.343418 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331856    4060 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 20:36:21.343418 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331859    4060 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 20:36:21.343418 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331861    4060 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 20:36:21.343877 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331864    4060 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 20:36:21.343877 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331867    4060 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 20:36:21.343877 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331869    4060 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 20:36:21.343877 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331871    4060 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 20:36:21.343877 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331874    4060 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 20:36:21.343877 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331877    4060 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 20:36:21.343877 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331879    4060 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 20:36:21.343877 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331882    4060 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 20:36:21.343877 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331884    4060 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 20:36:21.343877 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331887    4060 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 20:36:21.343877 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331889    4060 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 20:36:21.343877 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331892    4060 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 20:36:21.343877 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331894    4060 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 20:36:21.343877 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331897    4060 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 20:36:21.343877 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331900    4060 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 20:36:21.343877 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331904    4060 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 20:36:21.343877 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331907    4060 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 20:36:21.343877 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331910    4060 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 20:36:21.343877 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331912    4060 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 20:36:21.344349 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331916    4060 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 20:36:21.344349 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331918    4060 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 20:36:21.344349 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331922    4060 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 20:36:21.344349 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331925    4060 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 20:36:21.344349 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331927    4060 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 20:36:21.344349 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331930    4060 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 20:36:21.344349 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331932    4060 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 20:36:21.344349 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331936    4060 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 20:36:21.344349 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331939    4060 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 20:36:21.344349 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331942    4060 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 20:36:21.344349 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331945    4060 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 20:36:21.344349 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331948    4060 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 20:36:21.344349 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331950    4060 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 20:36:21.344349 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331953    4060 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 20:36:21.344349 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331955    4060 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 20:36:21.344349 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331958    4060 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 20:36:21.344349 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331961    4060 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 20:36:21.344349 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331963    4060 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 20:36:21.344349 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331966    4060 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 20:36:21.344822 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331968    4060 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 20:36:21.344822 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331971    4060 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 20:36:21.344822 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331973    4060 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 20:36:21.344822 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331976    4060 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 20:36:21.344822 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331978    4060 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 20:36:21.344822 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331981    4060 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 20:36:21.344822 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331983    4060 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 20:36:21.344822 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331986    4060 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 20:36:21.344822 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331988    4060 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 20:36:21.344822 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331991    4060 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 20:36:21.344822 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331993    4060 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 20:36:21.344822 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331996    4060 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 20:36:21.344822 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.331998    4060 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 20:36:21.344822 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.332001    4060 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 20:36:21.344822 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.332004    4060 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 20:36:21.344822 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.332008    4060 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 20:36:21.344822 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.332010    4060 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 20:36:21.344822 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.332013    4060 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 20:36:21.344822 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.332015    4060 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 20:36:21.344822 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.332018    4060 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 20:36:21.345290 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.332022    4060 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 20:36:21.345290 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.332025    4060 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 20:36:21.345290 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.332028    4060 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 20:36:21.345290 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.332030    4060 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 20:36:21.345290 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.332033    4060 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 20:36:21.345290 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.332035    4060 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 20:36:21.345290 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.337414    4060 server.go:525] "Kubelet version" kubeletVersion="v1.35.9"
Oct 30 20:36:21.345290 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.337435    4060 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Oct 30 20:36:21.345290 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.337459    4060 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Oct 30 20:36:21.345290 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.337466    4060 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Oct 30 20:36:21.345290 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.337648    4060 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 20:36:21.345290 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.337657    4060 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 20:36:21.345290 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.337664    4060 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 20:36:21.345290 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.337670    4060 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 20:36:21.345290 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.337674    4060 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 20:36:21.345290 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.337684    4060 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 20:36:21.345290 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.337688    4060 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 20:36:21.345290 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.337693    4060 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 20:36:21.345290 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.337697    4060 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 20:36:21.345290 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.337701    4060 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 20:36:21.345986 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.337705    4060 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 20:36:21.345986 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.337710    4060 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 20:36:21.345986 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.337714    4060 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 20:36:21.345986 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.337719    4060 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 20:36:21.345986 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.337723    4060 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 20:36:21.345986 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.337729    4060 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 20:36:21.345986 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.337735    4060 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 20:36:21.345986 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.337740    4060 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 20:36:21.345986 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.337749    4060 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 20:36:21.345986 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.337753    4060 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 20:36:21.345986 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.337757    4060 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 20:36:21.345986 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.337761    4060 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 20:36:21.345986 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.337781    4060 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 20:36:21.345986 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.337818    4060 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 20:36:21.345986 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.337824    4060 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 20:36:21.345986 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.337829    4060 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 20:36:21.345986 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.337977    4060 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 20:36:21.345986 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.337989    4060 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 20:36:21.345986 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.337994    4060 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 20:36:21.346436 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.337999    4060 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 20:36:21.346436 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338003    4060 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 20:36:21.346436 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338007    4060 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 20:36:21.346436 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338010    4060 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 20:36:21.346436 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338013    4060 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 20:36:21.346436 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338017    4060 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 20:36:21.346436 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338020    4060 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 20:36:21.346436 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338023    4060 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 20:36:21.346436 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338025    4060 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 20:36:21.346436 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338028    4060 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 20:36:21.346436 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338031    4060 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 20:36:21.346436 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338034    4060 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 20:36:21.346436 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338037    4060 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 20:36:21.346436 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338039    4060 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 20:36:21.346436 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338042    4060 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 20:36:21.346436 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338044    4060 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 20:36:21.346436 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338047    4060 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 20:36:21.346436 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338050    4060 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 20:36:21.346436 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338052    4060 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 20:36:21.346436 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338055    4060 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 20:36:21.346928 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338057    4060 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 20:36:21.346928 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338060    4060 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 20:36:21.346928 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338062    4060 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 20:36:21.346928 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338065    4060 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 20:36:21.346928 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338067    4060 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 20:36:21.346928 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338070    4060 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 20:36:21.346928 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338073    4060 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 20:36:21.346928 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338076    4060 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 20:36:21.346928 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338079    4060 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 20:36:21.346928 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338083    4060 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 20:36:21.346928 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338086    4060 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 20:36:21.346928 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338089    4060 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 20:36:21.346928 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338091    4060 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 20:36:21.346928 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338095    4060 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 20:36:21.346928 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338098    4060 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 20:36:21.346928 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338102    4060 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 20:36:21.346928 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338107    4060 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 20:36:21.346928 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338110    4060 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 20:36:21.346928 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338113    4060 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 20:36:21.347382 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338116    4060 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 20:36:21.347382 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338119    4060 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 20:36:21.347382 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338121    4060 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 20:36:21.347382 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338124    4060 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 20:36:21.347382 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338129    4060 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 20:36:21.347382 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338132    4060 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 20:36:21.347382 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338134    4060 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 20:36:21.347382 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338137    4060 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 20:36:21.347382 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338139    4060 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 20:36:21.347382 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338142    4060 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 20:36:21.347382 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338144    4060 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 20:36:21.347382 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338147    4060 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 20:36:21.347382 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338149    4060 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 20:36:21.347382 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338152    4060 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 20:36:21.347382 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338155    4060 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 20:36:21.347382 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338157    4060 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 20:36:21.347382 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338160    4060 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 20:36:21.347382 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338163    4060 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 20:36:21.347382 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338165    4060 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 20:36:21.347830 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338168    4060 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 20:36:21.347830 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338171    4060 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 20:36:21.347830 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338173    4060 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 20:36:21.347830 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338176    4060 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 20:36:21.347830 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338179    4060 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 20:36:21.347830 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338181    4060 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 20:36:21.347830 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338184    4060 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 20:36:21.347830 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338188    4060 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 20:36:21.347830 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338190    4060 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 20:36:21.347830 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338193    4060 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 20:36:21.347830 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338196    4060 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 20:36:21.347830 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338199    4060 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 20:36:21.347830 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338202    4060 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 20:36:21.347830 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338205    4060 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 20:36:21.347830 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338208    4060 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 20:36:21.347830 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338210    4060 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 20:36:21.347830 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338213    4060 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 20:36:21.347830 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338215    4060 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 20:36:21.347830 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338218    4060 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 20:36:21.348267 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.338253    4060 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 30 20:36:21.348267 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338397    4060 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 20:36:21.348267 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338401    4060 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 20:36:21.348267 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338404    4060 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 20:36:21.348267 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338407    4060 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 20:36:21.348267 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338410    4060 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 20:36:21.348267 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338412    4060 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 20:36:21.348267 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338415    4060 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 20:36:21.348267 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338420    4060 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 20:36:21.348267 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338423    4060 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 20:36:21.348267 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338425    4060 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 20:36:21.348267 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338428    4060 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 20:36:21.348267 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338431    4060 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 20:36:21.348267 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338434    4060 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 20:36:21.348267 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338437    4060 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 20:36:21.348267 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338440    4060 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 20:36:21.348664 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338442    4060 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 20:36:21.348664 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338445    4060 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 20:36:21.348664 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338448    4060 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 20:36:21.348664 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338451    4060 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 20:36:21.348664 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338453    4060 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 20:36:21.348664 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338456    4060 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 20:36:21.348664 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338459    4060 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 20:36:21.348664 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338461    4060 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 20:36:21.348664 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338464    4060 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 20:36:21.348664 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338467    4060 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 20:36:21.348664 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338469    4060 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 20:36:21.348664 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338472    4060 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 20:36:21.348664 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338474    4060 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 20:36:21.348664 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338477    4060 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 20:36:21.348664 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338479    4060 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 20:36:21.348664 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338482    4060 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 20:36:21.348664 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338485    4060 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 20:36:21.348664 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338505    4060 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 20:36:21.348664 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338509    4060 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 20:36:21.348664 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338512    4060 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 20:36:21.349147 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338514    4060 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 20:36:21.349147 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338517    4060 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 20:36:21.349147 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338520    4060 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 20:36:21.349147 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338523    4060 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 20:36:21.349147 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338528    4060 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 20:36:21.349147 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338531    4060 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 20:36:21.349147 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338533    4060 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 20:36:21.349147 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338536    4060 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 20:36:21.349147 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338538    4060 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 20:36:21.349147 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338541    4060 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 20:36:21.349147 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338543    4060 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 20:36:21.349147 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338546    4060 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 20:36:21.349147 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338548    4060 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 20:36:21.349147 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338551    4060 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 20:36:21.349147 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338553    4060 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 20:36:21.349147 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338564    4060 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 20:36:21.349147 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338567    4060 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 20:36:21.349147 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338569    4060 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 20:36:21.349147 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338573    4060 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 20:36:21.349699 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338575    4060 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 20:36:21.349699 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338578    4060 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 20:36:21.349699 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338581    4060 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 20:36:21.349699 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338584    4060 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 20:36:21.349699 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338587    4060 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 20:36:21.349699 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338589    4060 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 20:36:21.349699 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338592    4060 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 20:36:21.349699 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338594    4060 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 20:36:21.349699 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338597    4060 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 20:36:21.349699 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338599    4060 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 20:36:21.349699 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338602    4060 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 20:36:21.349699 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338604    4060 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 20:36:21.349699 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338607    4060 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 20:36:21.349699 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338609    4060 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 20:36:21.349699 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338612    4060 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 20:36:21.349699 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338615    4060 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 20:36:21.349699 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338617    4060 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 20:36:21.349699 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338621    4060 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 20:36:21.349699 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338624    4060 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 20:36:21.349699 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338627    4060 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 20:36:21.350164 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338630    4060 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 20:36:21.350164 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338632    4060 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 20:36:21.350164 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338635    4060 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 20:36:21.350164 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338638    4060 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 20:36:21.350164 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338640    4060 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 20:36:21.350164 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338643    4060 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 20:36:21.350164 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338646    4060 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 20:36:21.350164 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338648    4060 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 20:36:21.350164 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338651    4060 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 20:36:21.350164 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338654    4060 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 20:36:21.350164 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338656    4060 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 20:36:21.350164 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338659    4060 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 20:36:21.350164 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338661    4060 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 20:36:21.350164 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338664    4060 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 20:36:21.350164 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338666    4060 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 20:36:21.350164 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338669    4060 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 20:36:21.350164 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338672    4060 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 20:36:21.350164 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338676    4060 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 20:36:21.350164 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338679    4060 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 20:36:21.350627 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338682    4060 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 20:36:21.350627 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338685    4060 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 20:36:21.350627 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338687    4060 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 20:36:21.350627 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338690    4060 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 20:36:21.350627 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338692    4060 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 20:36:21.350627 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338695    4060 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 20:36:21.350627 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338697    4060 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 20:36:21.350627 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338700    4060 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 20:36:21.350627 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338703    4060 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 20:36:21.350627 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338706    4060 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 20:36:21.350627 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338710    4060 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 20:36:21.350627 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338714    4060 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 20:36:21.350627 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338716    4060 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 20:36:21.350627 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.338741    4060 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 30 20:36:21.350627 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338773    4060 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 20:36:21.350982 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338777    4060 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 20:36:21.350982 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338781    4060 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 20:36:21.350982 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338784    4060 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 20:36:21.350982 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338787    4060 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 20:36:21.350982 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338789    4060 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 20:36:21.350982 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338792    4060 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 20:36:21.350982 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338795    4060 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 20:36:21.350982 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338798    4060 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 20:36:21.350982 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338801    4060 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 20:36:21.350982 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338804    4060 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 20:36:21.350982 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338806    4060 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 20:36:21.350982 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338809    4060 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 20:36:21.350982 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338812    4060 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 20:36:21.350982 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338814    4060 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 20:36:21.350982 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338817    4060 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 20:36:21.350982 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338819    4060 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 20:36:21.350982 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338822    4060 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 20:36:21.350982 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338824    4060 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 20:36:21.350982 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338827    4060 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 20:36:21.350982 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338831    4060 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 20:36:21.351501 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338841    4060 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 20:36:21.351501 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338845    4060 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 20:36:21.351501 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338848    4060 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 20:36:21.351501 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338851    4060 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 20:36:21.351501 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338853    4060 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 20:36:21.351501 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338856    4060 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 20:36:21.351501 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338858    4060 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 20:36:21.351501 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338861    4060 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 20:36:21.351501 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338864    4060 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 20:36:21.351501 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338868    4060 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 20:36:21.351501 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338872    4060 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 20:36:21.351501 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338875    4060 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 20:36:21.351501 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338878    4060 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 20:36:21.351501 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338880    4060 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 20:36:21.351501 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338882    4060 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 20:36:21.351501 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338886    4060 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 20:36:21.351501 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338888    4060 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 20:36:21.351501 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338891    4060 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 20:36:21.351501 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338893    4060 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 20:36:21.351954 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338896    4060 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 20:36:21.351954 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338898    4060 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 20:36:21.351954 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338906    4060 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 20:36:21.351954 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338909    4060 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 20:36:21.351954 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338912    4060 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 20:36:21.351954 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338914    4060 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 20:36:21.351954 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338917    4060 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 20:36:21.351954 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338919    4060 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 20:36:21.351954 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338922    4060 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 20:36:21.351954 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338924    4060 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 20:36:21.351954 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338927    4060 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 20:36:21.351954 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338929    4060 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 20:36:21.351954 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338932    4060 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 20:36:21.351954 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338934    4060 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 20:36:21.351954 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338937    4060 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 20:36:21.351954 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338939    4060 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 20:36:21.351954 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338942    4060 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 20:36:21.351954 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338944    4060 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 20:36:21.351954 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338947    4060 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 20:36:21.352387 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338950    4060 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 20:36:21.352387 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338953    4060 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 20:36:21.352387 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338956    4060 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 20:36:21.352387 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338958    4060 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 20:36:21.352387 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338961    4060 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 20:36:21.352387 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338965    4060 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 20:36:21.352387 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338968    4060 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 20:36:21.352387 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338970    4060 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 20:36:21.352387 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338973    4060 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 20:36:21.352387 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338975    4060 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 20:36:21.352387 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338978    4060 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 20:36:21.352387 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338981    4060 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 20:36:21.352387 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338983    4060 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 20:36:21.352387 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338986    4060 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 20:36:21.352387 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338988    4060 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 20:36:21.352387 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338990    4060 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 20:36:21.352387 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338993    4060 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 20:36:21.352387 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338995    4060 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 20:36:21.352387 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.338998    4060 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 20:36:21.352387 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.339000    4060 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 20:36:21.352869 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.339003    4060 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 20:36:21.352869 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.339005    4060 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 20:36:21.352869 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.339008    4060 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 20:36:21.352869 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.339010    4060 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 20:36:21.352869 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.339012    4060 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 20:36:21.352869 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.339015    4060 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 20:36:21.352869 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.339017    4060 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 20:36:21.352869 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.339020    4060 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 20:36:21.352869 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.339022    4060 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 20:36:21.352869 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.339025    4060 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 20:36:21.352869 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.339027    4060 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 20:36:21.352869 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.339030    4060 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 20:36:21.352869 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.339032    4060 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 20:36:21.352869 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.339035    4060 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 20:36:21.352869 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.339038    4060 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 20:36:21.352869 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.339041    4060 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 20:36:21.352869 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.339044    4060 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 20:36:21.352869 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.339047    4060 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 20:36:21.352869 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.339049    4060 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 20:36:21.353314 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.339052    4060 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 20:36:21.353314 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.339054    4060 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 20:36:21.353314 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.339057    4060 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 20:36:21.353314 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.339059    4060 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 20:36:21.353314 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.339062    4060 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 20:36:21.353314 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.339064    4060 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 20:36:21.353314 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.339066    4060 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 20:36:21.353314 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:21.339069    4060 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 20:36:21.353314 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.339146    4060 server.go:957] "Client rotation is on, will bootstrap in background"
Oct 30 20:36:21.353314 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.340150    4060 bootstrap.go:85] "Current kubeconfig file contents are still valid, no bootstrap necessary"
Oct 30 20:36:21.353314 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.340208    4060 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-client-current.pem"
Oct 30 20:36:21.353314 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.340377    4060 server.go:1014] "Starting client certificate rotation"
Oct 30 20:36:21.353314 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.340517    4060 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Oct 30 20:36:21.353314 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.340554    4060 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-10-29 20:30:39 +0000 UTC" deadline="2028-05-04 09:47:46.124830629 +0000 UTC"
Oct 30 20:36:21.353314 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.340588    4060 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13237h11m24.784244362s"
Oct 30 20:36:21.353314 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.340897    4060 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Oct 30 20:36:21.366711 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.366683    4060 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Oct 30 20:36:21.368328 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.368309    4060 log.go:25] "Validated CRI v1 runtime API"
Oct 30 20:36:21.369853 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.369838    4060 log.go:25] "Validated CRI v1 image API"
Oct 30 20:36:21.370588 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.370575    4060 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Oct 30 20:36:21.371962 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.371931    4060 fs.go:135] Filesystem UUIDs: map[3bf89af1-6d5e-42da-8043-52c3be2250f4:/dev/nvme0n1p4 3db80099-a04e-4675-8db2-f1abb95c09d4:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2]
Oct 30 20:36:21.372120 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.371958    4060 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/05b7334d3b1aed4a60161ebecd95a531695bd0161a0269c238115a0b5e8f0a61/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/05b7334d3b1aed4a60161ebecd95a531695bd0161a0269c238115a0b5e8f0a61/userdata/shm major:0 minor:90 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/66b241cc94d491086d396fbc6f39735da06053708d42b7e61d6a3f6ff942c903/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/66b241cc94d491086d396fbc6f39735da06053708d42b7e61d6a3f6ff942c903/userdata/shm major:0 minor:82 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/94c8ec3a6d28d8efdc4f15bd77859491ab247f0ec203675910f682727fd2b092/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/94c8ec3a6d28d8efdc4f15bd77859491ab247f0ec203675910f682727fd2b092/userdata/shm major:0 minor:72 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/9912dd54318f6360ea8f18bfd779d5c99a9068cbb1fb6a120f408a135c5db269/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/9912dd54318f6360ea8f18bfd779d5c99a9068cbb1fb6a120f408a135c5db269/userdata/shm major:0 minor:94 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/9ddc9d5b1efe543a047b8463a2863120a4bbec7638f4b6667eb82785a14d1d63/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/9ddc9d5b1efe543a047b8463a2863120a4bbec7638f4b6667eb82785a14d1d63/userdata/shm major:0 minor:98 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/a8850a60faf2eb84b7bec143e3a87c40d2a6f267b2afdc821e44ae32f6d964e7/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/a8850a60faf2eb84b7bec143e3a87c40d2a6f267b2afdc821e44ae32f6d964e7/userdata/shm major:0 minor:47 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/b35002fc0c079bc19536911fd42a3bb47c02632dee2bf2c45bbaae6834833ba5/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/b35002fc0c079bc19536911fd42a3bb47c02632dee2bf2c45bbaae6834833ba5/userdata/shm major:0 minor:51 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/c2cadbb60ff7a7ad87fdce1d691d40951aa52b80342df998b85123d68b238a56/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/c2cadbb60ff7a7ad87fdce1d691d40951aa52b80342df998b85123d68b238a56/userdata/shm major:0 minor:201 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/cb23cc723de5be6af2fc64091cb07db9c271725f551b9cab69fb3d95c8409b5b/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/cb23cc723de5be6af2fc64091cb07db9c271725f551b9cab69fb3d95c8409b5b/userdata/shm major:0 minor:68 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/cf33830f727725a5f1fca4eeae90258aecec92185c47dcb59c465e2a23ceb778/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/cf33830f727725a5f1fca4eeae90258aecec92185c47dcb59c465e2a23ceb778/userdata/shm major:0 minor:76 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/e41ace44984f7abef841724acbb3a604f1ebc9284ddcb7a97293fc2b1b3c9370/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/e41ace44984f7abef841724acbb3a604f1ebc9284ddcb7a97293fc2b1b3c9370/userdata/shm major:0 minor:80 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/ec4cff47dd20e2b59dd680ec049caf92107e598f2b21b186a98167e55f6d23d4/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/ec4cff47dd20e2b59dd680ec049caf92107e598f2b21b186a98167e55f6d23d4/userdata/shm major:0 minor:203 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/1930df66-da42-4ad8-bfe0-5e92f9e07ebc/volumes/kubernetes.io~projected/kube-api-access-nsvqk:{mountpoint:/var/lib/kubelet/pods/1930df66-da42-4ad8-bfe0-5e92f9e07ebc/volumes/kubernetes.io~projected/kube-api-access-nsvqk major:0 minor:61 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/261f6884-299b-4971-b936-bbb3174f1b66/volumes/kubernetes.io~secret/original-pull-secret:{mountpoint:/var/lib/kubelet/pods/261f6884-299b-4971-b936-bbb3174f1b66/volumes/kubernetes.io~secret/original-pull-secret major:0 minor:45 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/3e93e3cc-cd26-452f-9e40-31dedb0d198b/volumes/kubernetes.io~projected/kube-api-access-lgp2l:{mountpoint:/var/lib/kubelet/pods/3e93e3cc-cd26-452f-9e40-31dedb0d198b/volumes/kubernetes.io~projected/kube-api-access-lgp2l major:0 minor:62 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/6e80b983-b2c0-4923-82b0-5903424cc7b0/volumes/kubernetes.io~projected/kube-api-access-5hmjh:{mountpoint:/var/lib/kubelet/pods/6e80b983-b2c0-4923-82b0-5903424cc7b0/volumes/kubernetes.io~projected/kube-api-access-5hmjh major:0 minor:59 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/70cf9a0e-c321-438d-83a2-2034f4df9034/volumes/kubernetes.io~secret/agent-certs:{mountpoint:/var/lib/kubelet/pods/70cf9a0e-c321-438d-83a2-2034f4df9034/volumes/kubernetes.io~secret/agent-certs major:0 minor:58 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/9516abf2-c993-442c-8c5e-34480e5113d6/volume-subpaths/run-systemd/ovnkube-controller/6:{mountpoint:/var/lib/kubelet/pods/9516abf2-c993-442c-8c5e-34480e5113d6/volume-subpaths/run-systemd/ovnkube-controller/6 major:0 minor:26 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/9516abf2-c993-442c-8c5e-34480e5113d6/volumes/kubernetes.io~projected/kube-api-access-mpwhg:{mountpoint:/var/lib/kubelet/pods/9516abf2-c993-442c-8c5e-34480e5113d6/volumes/kubernetes.io~projected/kube-api-access-mpwhg major:0 minor:64 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/9516abf2-c993-442c-8c5e-34480e5113d6/volumes/kubernetes.io~secret/ovn-node-metrics-cert:{mountpoint:/var/lib/kubelet/pods/9516abf2-c993-442c-8c5e-34480e5113d6/volumes/kubernetes.io~secret/ovn-node-metrics-cert major:0 minor:55 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/96b48bb2-933f-483d-8f15-5cca00c3d613/volumes/kubernetes.io~projected/kube-api-access-k5wmd:{mountpoint:/var/lib/kubelet/pods/96b48bb2-933f-483d-8f15-5cca00c3d613/volumes/kubernetes.io~projected/kube-api-access-k5wmd major:0 minor:66 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/a5b34407-cc7d-458e-aca3-cd48133834ad/volumes/kubernetes.io~empty-dir/etc-tuned:{mountpoint:/var/lib/kubelet/pods/a5b34407-cc7d-458e-aca3-cd48133834ad/volumes/kubernetes.io~empty-dir/etc-tuned major:0 minor:57 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/a5b34407-cc7d-458e-aca3-cd48133834ad/volumes/kubernetes.io~empty-dir/tmp:{mountpoint:/var/lib/kubelet/pods/a5b34407-cc7d-458e-aca3-cd48133834ad/volumes/kubernetes.io~empty-dir/tmp major:0 minor:56 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/a5b34407-cc7d-458e-aca3-cd48133834ad/volumes/kubernetes.io~projected/kube-api-access-2xx6z:{mountpoint:/var/lib/kubelet/pods/a5b34407-cc7d-458e-aca3-cd48133834ad/volumes/kubernetes.io~projected/kube-api-access-2xx6z major:0 minor:60 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/baefcab8-b5be-4143-9b55-7a86001a4363/volumes/kubernetes.io~projected/kube-api-access-2mzs4:{mountpoint:/var/lib/kubelet/pods/baefcab8-b5be-4143-9b55-7a86001a4363/volumes/kubernetes.io~projected/kube-api-access-2mzs4 major:0 minor:67 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/be756835-3011-4186-ab61-8128121eb95b/volumes/kubernetes.io~projected/kube-api-access-8rgwr:{mountpoint:/var/lib/kubelet/pods/be756835-3011-4186-ab61-8128121eb95b/volumes/kubernetes.io~projected/kube-api-access-8rgwr major:0 minor:65 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d0bb5f1b-4370-4e8d-80a8-1a7bcda13cd2/volumes/kubernetes.io~projected/kube-api-access-dqsnt:{mountpoint:/var/lib/kubelet/pods/d0bb5f1b-4370-4e8d-80a8-1a7bcda13cd2/volumes/kubernetes.io~projected/kube-api-access-dqsnt major:0 minor:63 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/fbbb7a28-caa9-4309-8d4c-a6f1c01e2b4f/volumes/kubernetes.io~projected/kube-api-access-5hzrc:{mountpoint:/var/lib/kubelet/pods/fbbb7a28-caa9-4309-8d4c-a6f1c01e2b4f/volumes/kubernetes.io~projected/kube-api-access-5hzrc major:0 minor:197 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0} overlay_0-100:{mountpoint:/var/lib/containers/storage/overlay/23a94c07bd10792753c166eaf5a5e21899b11529a2dc2bd997d4462b8a9e6de9/merged major:0 minor:100 fsType:overlay blockSize:0} overlay_0-102:{mountpoint:/var/lib/containers/storage/overlay/e9e118ad9edd8528625436677868a92c5ff5b5ddc15de7606572c1d3a4409c13/merged major:0 minor:102 fsType:overlay blockSize:0} overlay_0-104:{mountpoint:/var/lib/containers/storage/overlay/b55bc29ec7ed374b35d389a653e401103d9d49c69b10d58d9d48e0ac13bc6577/merged major:0 minor:104 fsType:overlay blockSize:0} overlay_0-109:{mountpoint:/var/lib/containers/storage/overlay/9e4df2f38ef2105d7b26765beb1b5cf246c715862fc1e1871ad6991cf78c45d4/merged major:0 minor:109 fsType:overlay blockSize:0} overlay_0-110:{mountpoint:/var/lib/containers/storage/overlay/d2562a7357315407ca72731b57a1d362e4bd77f517596c679e6255eca769158a/merged major:0 minor:110 fsType:overlay blockSize:0} overlay_0-119:{mountpoint:/var/lib/containers/storage/overlay/d83040bb61d48275d4c94ecbc570c028d872fca7229498b17fa5f83a88e2437e/merged major:0 minor:119 fsType:overlay blockSize:0} overlay_0-124:{mountpoint:/var/lib/containers/storage/overlay/c385d67a4271d9186349f4ce0dbc72b56c9b082adb40be45463c7516689ece0f/merged major:0 minor:124 fsType:overlay blockSize:0} overlay_0-127:{mountpoint:/var/lib/containers/storage/overlay/05c450d0c091b1abde196585b8814d98b425328509cf067b089e45edd4f36a13/merged major:0 minor:127 fsType:overlay blockSize:0} overlay_0-132:{mountpoint:/var/lib/containers/storage/overlay/10b0700da584cfe41cf14f31288fd1317901e062de64c07da35d01f60a1fe95a/merged major:0 minor:132 fsType:overlay blockSize:0} overlay_0-134:{mountpoint:/var/lib/containers/storage/overlay/5561a8eadc3154066680701d5442795db479e34105c6ef8a7fa0bdb587bccdfe/merged major:0 minor:134 fsType:overlay blockSize:0} overlay_0-144:{mountpoint:/var/lib/containers/storage/overlay/6e8a9c7caca48dec2da15404b96aba81ca7a451b2bad2f58ce3b6c6d55b800cc/merged major:0 minor:144 fsType:overlay blockSize:0} overlay_0-146:{mountpoint:/var/lib/containers/storage/overlay/68e40d9bde3b2eee9f8c38389f252c8b64d76d83e7a067a22ff36cb994945a85/merged major:0 minor:146 fsType:overlay blockSize:0} overlay_0-152:{mountpoint:/var/lib/containers/storage/overlay/34f0c04049985b0f396d39c80214cd27c7cc2252d982a4d4f356cffd1c03dab3/merged major:0 minor:152 fsType:overlay blockSize:0} overlay_0-154:{mountpoint:/var/lib/containers/storage/overlay/78c666607d2a43586a25eca82a2cb4b1b44aba923fabc105850802bcbd479171/merged major:0 minor:154 fsType:overlay blockSize:0} overlay_0-162:{mountpoint:/var/lib/containers/storage/overlay/99c58857914ac216f6d5a7482df6c238a38d481f99388a0b65b9e6cca1599ba9/merged major:0 minor:162 fsType:overlay blockSize:0} overlay_0-167:{mountpoint:/var/lib/containers/storage/overlay/d9528a80c093e13a52909175240ce8fe08615dc7ac838c39c10fe8cba38d7a87/merged major:0 minor:167 fsType:overlay blockSize:0} overlay_0-172:{mountpoint:/var/lib/containers/storage/overlay/7a22164cfaf335c747cd4b171f0e906168cc2a1b2130f793ded6d7690422468f/merged major:0 minor:172 fsType:overlay blockSize:0} overlay_0-177:{mountpoint:/var/lib/containers/storage/overlay/627c058e2d5cc1f11360d00111af23feaffabddeccfce4a66fa78e09f071ab8a/merged major:0 minor:177 fsType:overlay blockSize:0} overlay_0-182:{mountpoint:/var/lib/containers/storage/overlay/32c21aef88e22b171481d330971f445030057a5cb768d17289ccf5822ccad8d1/merged major:0 minor:182 fsType:overlay blockSize:0} overlay_0-187:{mountpoint:/var/lib/containers/storage/overlay/d3f7b6040611d93d830a20f4a58b59ff2df5865f63ba8f21900c382b1cb37383/merged major:0 minor:187 fsType:overlay blockSize:0} overlay_0-192:{mountpoint:/var/lib/containers/storage/overlay/42ca4ad00a5e8809733924d17f66ab3c2b25883c553028f833efc4c5d4180bc8/merged major:0 minor:192 fsType:overlay blockSize:0} overlay_0-205:{mountpoint:/var/lib/containers/storage/overlay/c56dfc988426e9f26f8e7533f71ed8f32bfdba68890a76ea2563e7d3aae6e454/merged major:0 minor:205 fsType:overlay blockSize:0} overlay_0-207:{mountpoint:/var/lib/containers/storage/overlay/66b873945f69094b0c7d930e83c14a000866c1b660f1cab51cc5b32376fbe1ca/merged major:0 minor:207 fsType:overlay blockSize:0} overlay_0-209:{mountpoint:/var/lib/containers/storage/overlay/7028a39f3e2c72ca1d43a2daf550003c55c88aa64adeccbd06751583c4ebd6f7/merged major:0 minor:209 fsType:overlay blockSize:0} overlay_0-211:{mountpoint:/var/lib/containers/storage/overlay/caadc0acc95fa7005b3e46fe26a8471ee59a3da70228200dc30a7109b0c0f28d/merged major:0 minor:211 fsType:overlay blockSize:0} overlay_0-49:{mountpoint:/var/lib/containers/storage/overlay/a3a689f0152394bbc16e447c50f86c75a4356efd13f5510f06467b09c2d3d803/merged major:0 minor:49 fsType:overlay blockSize:0} overlay_0-53:{mountpoint:/var/lib/containers/storage/overlay/f2ee30b7bc8bb0b821404305471a8c493e307e1900cd778a49e23743a354133b/merged major:0 minor:53 fsType:overlay blockSize:0} overlay_0-70:{mountpoint:/var/lib/containers/storage/overlay/d594c2ad1b6689418492e993a25bf1a3f04eabdd1524f8472c6d2a22f5ccb040/merged major:0 minor:70 fsType:overlay blockSize:0} overlay_0-74:{mountpoint:/var/lib/containers/storage/overlay/83de0904bb183bdb9a733f6d6e982c5e23ecb53242639f0f78292f8f2b2d0721/merged major:0 minor:74 fsType:overlay blockSize:0} overlay_0-78:{mountpoint:/var/lib/containers/storage/overlay/df49e752abadf96ebb514c6284a717485c814c1e858d80d277acc647465360da/merged major:0 minor:78 fsType:overlay blockSize:0} overlay_0-83:{mountpoint:/var/lib/containers/storage/overlay/cf3001cab25f6f33c969c345a4910bc6cd1dcc77b81ded0283a6d90922369623/merged major:0 minor:83 fsType:overlay blockSize:0} overlay_0-86:{mountpoint:/var/lib/containers/storage/overlay/4737316640e603eabba2dda7b2151af2de2315c1c2177db68fd0df5239320ed3/merged major:0 minor:86 fsType:overlay blockSize:0} overlay_0-88:{mountpoint:/var/lib/containers/storage/overlay/5726089ffd977fa570aad9e87dbcfd7724d15a08716e1a18cb77866676df916a/merged major:0 minor:88 fsType:overlay blockSize:0} overlay_0-92:{mountpoint:/var/lib/containers/storage/overlay/d96721c0f714e466b8bd02188cc2f6e405eb7bb234ee27613ef2fac9dea80502/merged major:0 minor:92 fsType:overlay blockSize:0} overlay_0-96:{mountpoint:/var/lib/containers/storage/overlay/55f07536b1895dca8c3903679686635027064da631e87575c5aa3c190c975584/merged major:0 minor:96 fsType:overlay blockSize:0}]
Oct 30 20:36:21.377881 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.377678    4060 manager.go:217] Machine: {Timestamp:2026-10-30 20:36:21.377195785 +0000 UTC m=+0.134194072 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3199951 MemoryCapacity:33164337152 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2cf7bf360a5cfd6193e1a78e891acd SystemUUID:ec2cf7bf-360a-5cfd-6193-e1a78e891acd BootID:e30efb24-91e6-4e2b-afec-baaf85d100d8 Filesystems:[{Device:/var/lib/kubelet/pods/a5b34407-cc7d-458e-aca3-cd48133834ad/volumes/kubernetes.io~empty-dir/tmp DeviceMajor:0 DeviceMinor:56 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-92 DeviceMajor:0 DeviceMinor:92 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-102 DeviceMajor:0 DeviceMinor:102 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-127 DeviceMajor:0 DeviceMinor:127 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-119 DeviceMajor:0 DeviceMinor:119 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/fbbb7a28-caa9-4309-8d4c-a6f1c01e2b4f/volumes/kubernetes.io~projected/kube-api-access-5hzrc DeviceMajor:0 DeviceMinor:197 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-86 DeviceMajor:0 DeviceMinor:86 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-104 DeviceMajor:0 DeviceMinor:104 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-144 DeviceMajor:0 DeviceMinor:144 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-192 DeviceMajor:0 DeviceMinor:192 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16582168576 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-109 DeviceMajor:0 DeviceMinor:109 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-124 DeviceMajor:0 DeviceMinor:124 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-209 DeviceMajor:0 DeviceMinor:209 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6632869888 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/run/containers/storage/overlay-containers/9ddc9d5b1efe543a047b8463a2863120a4bbec7638f4b6667eb82785a14d1d63/userdata/shm DeviceMajor:0 DeviceMinor:98 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16582168576 Type:vfs Inodes:1048576 HasInodes:true} {Device:/run/containers/storage/overlay-containers/b35002fc0c079bc19536911fd42a3bb47c02632dee2bf2c45bbaae6834833ba5/userdata/shm DeviceMajor:0 DeviceMinor:51 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/be756835-3011-4186-ab61-8128121eb95b/volumes/kubernetes.io~projected/kube-api-access-8rgwr DeviceMajor:0 DeviceMinor:65 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/baefcab8-b5be-4143-9b55-7a86001a4363/volumes/kubernetes.io~projected/kube-api-access-2mzs4 DeviceMajor:0 DeviceMinor:67 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-83 DeviceMajor:0 DeviceMinor:83 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-134 DeviceMajor:0 DeviceMinor:134 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-53 DeviceMajor:0 DeviceMinor:53 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/9516abf2-c993-442c-8c5e-34480e5113d6/volumes/kubernetes.io~projected/kube-api-access-mpwhg DeviceMajor:0 DeviceMinor:64 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-205 DeviceMajor:0 DeviceMinor:205 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/1930df66-da42-4ad8-bfe0-5e92f9e07ebc/volumes/kubernetes.io~projected/kube-api-access-nsvqk DeviceMajor:0 DeviceMinor:61 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/3e93e3cc-cd26-452f-9e40-31dedb0d198b/volumes/kubernetes.io~projected/kube-api-access-lgp2l DeviceMajor:0 DeviceMinor:62 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/d0bb5f1b-4370-4e8d-80a8-1a7bcda13cd2/volumes/kubernetes.io~projected/kube-api-access-dqsnt DeviceMajor:0 DeviceMinor:63 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/cf33830f727725a5f1fca4eeae90258aecec92185c47dcb59c465e2a23ceb778/userdata/shm DeviceMajor:0 DeviceMinor:76 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:overlay_0-172 DeviceMajor:0 DeviceMinor:172 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-187 DeviceMajor:0 DeviceMinor:187 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/261f6884-299b-4971-b936-bbb3174f1b66/volumes/kubernetes.io~secret/original-pull-secret DeviceMajor:0 DeviceMinor:45 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-211 DeviceMajor:0 DeviceMinor:211 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/70cf9a0e-c321-438d-83a2-2034f4df9034/volumes/kubernetes.io~secret/agent-certs DeviceMajor:0 DeviceMinor:58 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/96b48bb2-933f-483d-8f15-5cca00c3d613/volumes/kubernetes.io~projected/kube-api-access-k5wmd DeviceMajor:0 DeviceMinor:66 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/9516abf2-c993-442c-8c5e-34480e5113d6/volumes/kubernetes.io~secret/ovn-node-metrics-cert DeviceMajor:0 DeviceMinor:55 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-74 DeviceMajor:0 DeviceMinor:74 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/66b241cc94d491086d396fbc6f39735da06053708d42b7e61d6a3f6ff942c903/userdata/shm DeviceMajor:0 DeviceMinor:82 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-100 DeviceMajor:0 DeviceMinor:100 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-152 DeviceMajor:0 DeviceMinor:152 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/c2cadbb60ff7a7ad87fdce1d691d40951aa52b80342df998b85123d68b238a56/userdata/shm DeviceMajor:0 DeviceMinor:201 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/6e80b983-b2c0-4923-82b0-5903424cc7b0/volumes/kubernetes.io~projected/kube-api-access-5hmjh DeviceMajor:0 DeviceMinor:59 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/a5b34407-cc7d-458e-aca3-cd48133834ad/volumes/kubernetes.io~projected/kube-api-access-2xx6z DeviceMajor:0 DeviceMinor:60 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-88 DeviceMajor:0 DeviceMinor:88 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-146 DeviceMajor:0 DeviceMinor:146 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-182 DeviceMajor:0 DeviceMinor:182 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/9912dd54318f6360ea8f18bfd779d5c99a9068cbb1fb6a120f408a135c5db269/userdata/shm DeviceMajor:0 DeviceMinor:94 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-110 DeviceMajor:0 DeviceMinor:110 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-167 DeviceMajor:0 DeviceMinor:167 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/94c8ec3a6d28d8efdc4f15bd77859491ab247f0ec203675910f682727fd2b092/userdata/shm DeviceMajor:0 DeviceMinor:72 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/a5b34407-cc7d-458e-aca3-cd48133834ad/volumes/kubernetes.io~empty-dir/etc-tuned DeviceMajor:0 DeviceMinor:57 Capacity:31985737728 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-70 DeviceMajor:0 DeviceMinor:70 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-132 DeviceMajor:0 DeviceMinor:132 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-162 DeviceMajor:0 DeviceMinor:162 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/9516abf2-c993-442c-8c5e-34480e5113d6/volume-subpaths/run-systemd/ovnkube-controller/6 DeviceMajor:0 DeviceMinor:26 Capacity:6632869888 Type:vfs Inodes:819200 HasInodes:true} {Device:overlay_0-207 DeviceMajor:0 DeviceMinor:207 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-49 DeviceMajor:0 DeviceMinor:49 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/e41ace44984f7abef841724acbb3a604f1ebc9284ddcb7a97293fc2b1b3c9370/userdata/shm DeviceMajor:0 DeviceMinor:80 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/05b7334d3b1aed4a60161ebecd95a531695bd0161a0269c238115a0b5e8f0a61/userdata/shm DeviceMajor:0 DeviceMinor:90 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-96 DeviceMajor:0 DeviceMinor:96 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-154 DeviceMajor:0 DeviceMinor:154 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-177 DeviceMajor:0 DeviceMinor:177 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/ec4cff47dd20e2b59dd680ec049caf92107e598f2b21b186a98167e55f6d23d4/userdata/shm DeviceMajor:0 DeviceMinor:203 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/a8850a60faf2eb84b7bec143e3a87c40d2a6f267b2afdc821e44ae32f6d964e7/userdata/shm DeviceMajor:0 DeviceMinor:47 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/cb23cc723de5be6af2fc64091cb07db9c271725f551b9cab69fb3d95c8409b5b/userdata/shm DeviceMajor:0 DeviceMinor:68 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-78 DeviceMajor:0 DeviceMinor:78 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:55:c9:9a:9c:c1 Speed:0 Mtu:9001} {Name:br-int MacAddress:de:99:a4:39:f3:de Speed:0 Mtu:8901} {Name:c2cadbb60ff7a7a MacAddress:9a:6e:23:a6:52:e9 Speed:10000 Mtu:8901} {Name:ec4cff47dd20e2b MacAddress:42:0f:f3:99:11:aa Speed:10000 Mtu:8901} {Name:ens5 MacAddress:02:55:c9:9a:9c:c1 Speed:0 Mtu:9001} {Name:genev_sys_6081 MacAddress:3a:da:65:bd:d9:4b Speed:0 Mtu:65000} {Name:ovn-k8s-mp0 MacAddress:0a:58:0a:85:00:02 Speed:0 Mtu:8901} {Name:ovs-system MacAddress:02:01:3e:2e:d0:6e Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164337152 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Oct 30 20:36:21.377881 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.377882    4060 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Oct 30 20:36:21.378143 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.378048    4060 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Oct 30 20:36:21.379291 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.378696    4060 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Oct 30 20:36:21.379291 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.378725    4060 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-142-4.us-west-1.compute.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Oct 30 20:36:21.379291 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.379074    4060 topology_manager.go:143] "Creating topology manager with none policy"
Oct 30 20:36:21.379291 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.379087    4060 container_manager_linux.go:311] "Creating device plugin manager"
Oct 30 20:36:21.379291 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.379100    4060 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Oct 30 20:36:21.379291 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.379127    4060 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Oct 30 20:36:21.379291 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.379246    4060 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager"
Oct 30 20:36:21.379813 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.379796    4060 state_mem.go:41] "Initialized" logger="CPUManager state memory"
Oct 30 20:36:21.379931 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.379922    4060 server.go:1235] "Using root directory" path="/var/lib/kubelet"
Oct 30 20:36:21.379969 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.379962    4060 kubelet.go:493] "Attempting to sync node with API server"
Oct 30 20:36:21.379996 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.379978    4060 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests"
Oct 30 20:36:21.379996 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.379988    4060 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Oct 30 20:36:21.380048 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.379998    4060 kubelet.go:405] "Adding apiserver pod source"
Oct 30 20:36:21.380048 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.380006    4060 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Oct 30 20:36:21.380643 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.380621    4060 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint"
Oct 30 20:36:21.380643 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.380640    4060 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Oct 30 20:36:21.381099 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.381083    4060 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1"
Oct 30 20:36:21.382755 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.382743    4060 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint"
Oct 30 20:36:21.382794 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.382755    4060 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Oct 30 20:36:21.382869 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.382859    4060 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-server-current.pem"
Oct 30 20:36:21.383063 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.383052    4060 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Oct 30 20:36:21.383094 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.383081    4060 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Oct 30 20:36:21.383204 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.383195    4060 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Oct 30 20:36:21.383231 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.383209    4060 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Oct 30 20:36:21.383231 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.383215    4060 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Oct 30 20:36:21.383231 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.383221    4060 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Oct 30 20:36:21.383231 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.383227    4060 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Oct 30 20:36:21.383231 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.383232    4060 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Oct 30 20:36:21.383393 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.383237    4060 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Oct 30 20:36:21.383393 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.383243    4060 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Oct 30 20:36:21.383393 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.383250    4060 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Oct 30 20:36:21.383393 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.383255    4060 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Oct 30 20:36:21.383393 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.383264    4060 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Oct 30 20:36:21.383393 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.383273    4060 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Oct 30 20:36:21.383393 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.383296    4060 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Oct 30 20:36:21.383393 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.383302    4060 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Oct 30 20:36:21.386565 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.386552    4060 server.go:1263] "Started kubelet"
Oct 30 20:36:21.386637 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.386610    4060 server.go:182] "Starting to listen" address="0.0.0.0" port=10250
Oct 30 20:36:21.387228 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.386739    4060 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Oct 30 20:36:21.387228 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.386860    4060 server_v1.go:49] "podresources" method="list" useActivePods=true
Oct 30 20:36:21.387228 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.387179    4060 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Oct 30 20:36:21.387297 ip-10-0-142-4 systemd[1]: Started Kubernetes Kubelet.
Oct 30 20:36:21.388001 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.387971    4060 server.go:317] "Adding debug handlers to kubelet server"
Oct 30 20:36:21.390133 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.390116    4060 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer"
Oct 30 20:36:21.390245 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.390133    4060 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Oct 30 20:36:21.390368 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.390353    4060 volume_manager.go:309] "The desired_state_of_world populator starts"
Oct 30 20:36:21.390368 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.390367    4060 volume_manager.go:311] "Starting Kubelet Volume Manager"
Oct 30 20:36:21.390552 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.390319    4060 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-10-29 20:30:41 +0000 UTC" deadline="2028-07-11 03:23:34.416167744 +0000 UTC"
Oct 30 20:36:21.390552 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.390485    4060 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14862h47m13.025687568s"
Oct 30 20:36:21.390552 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.390531    4060 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Oct 30 20:36:21.390552 ip-10-0-142-4 kubenswrapper[4060]: E1030 20:36:21.390540    4060 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-142-4.us-west-1.compute.internal\" not found"
Oct 30 20:36:21.393734 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.392577    4060 factory.go:55] Registering systemd factory
Oct 30 20:36:21.393734 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.392607    4060 factory.go:223] Registration of the systemd container factory successfully
Oct 30 20:36:21.393734 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.393467    4060 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="96b48bb2-933f-483d-8f15-5cca00c3d613" volumeName="kubernetes.io/configmap/96b48bb2-933f-483d-8f15-5cca00c3d613-iptables-alerter-script" seLinuxMountContext=""
Oct 30 20:36:21.393734 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.393537    4060 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a5b34407-cc7d-458e-aca3-cd48133834ad" volumeName="kubernetes.io/empty-dir/a5b34407-cc7d-458e-aca3-cd48133834ad-etc-tuned" seLinuxMountContext=""
Oct 30 20:36:21.393734 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.393555    4060 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="baefcab8-b5be-4143-9b55-7a86001a4363" volumeName="kubernetes.io/configmap/baefcab8-b5be-4143-9b55-7a86001a4363-multus-daemon-config" seLinuxMountContext=""
Oct 30 20:36:21.393734 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.393574    4060 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="be756835-3011-4186-ab61-8128121eb95b" volumeName="kubernetes.io/configmap/be756835-3011-4186-ab61-8128121eb95b-cni-sysctl-allowlist" seLinuxMountContext=""
Oct 30 20:36:21.393734 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.393586    4060 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="be756835-3011-4186-ab61-8128121eb95b" volumeName="kubernetes.io/configmap/be756835-3011-4186-ab61-8128121eb95b-cni-binary-copy" seLinuxMountContext=""
Oct 30 20:36:21.393734 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.393602    4060 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="fbbb7a28-caa9-4309-8d4c-a6f1c01e2b4f" volumeName="kubernetes.io/projected/fbbb7a28-caa9-4309-8d4c-a6f1c01e2b4f-kube-api-access-5hzrc" seLinuxMountContext=""
Oct 30 20:36:21.393734 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.393615    4060 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="261f6884-299b-4971-b936-bbb3174f1b66" volumeName="kubernetes.io/secret/261f6884-299b-4971-b936-bbb3174f1b66-original-pull-secret" seLinuxMountContext=""
Oct 30 20:36:21.393734 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.393626    4060 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3e93e3cc-cd26-452f-9e40-31dedb0d198b" volumeName="kubernetes.io/configmap/3e93e3cc-cd26-452f-9e40-31dedb0d198b-serviceca" seLinuxMountContext=""
Oct 30 20:36:21.393734 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.393646    4060 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="70cf9a0e-c321-438d-83a2-2034f4df9034" volumeName="kubernetes.io/secret/70cf9a0e-c321-438d-83a2-2034f4df9034-agent-certs" seLinuxMountContext=""
Oct 30 20:36:21.393734 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.393657    4060 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9516abf2-c993-442c-8c5e-34480e5113d6" volumeName="kubernetes.io/configmap/9516abf2-c993-442c-8c5e-34480e5113d6-ovnkube-script-lib" seLinuxMountContext=""
Oct 30 20:36:21.393734 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.393674    4060 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9516abf2-c993-442c-8c5e-34480e5113d6" volumeName="kubernetes.io/configmap/9516abf2-c993-442c-8c5e-34480e5113d6-env-overrides" seLinuxMountContext=""
Oct 30 20:36:21.393734 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.393686    4060 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9516abf2-c993-442c-8c5e-34480e5113d6" volumeName="kubernetes.io/projected/9516abf2-c993-442c-8c5e-34480e5113d6-kube-api-access-mpwhg" seLinuxMountContext=""
Oct 30 20:36:21.393734 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.393702    4060 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9516abf2-c993-442c-8c5e-34480e5113d6" volumeName="kubernetes.io/secret/9516abf2-c993-442c-8c5e-34480e5113d6-ovn-node-metrics-cert" seLinuxMountContext=""
Oct 30 20:36:21.393734 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.393713    4060 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="be756835-3011-4186-ab61-8128121eb95b" volumeName="kubernetes.io/configmap/be756835-3011-4186-ab61-8128121eb95b-whereabouts-flatfile-configmap" seLinuxMountContext=""
Oct 30 20:36:21.393734 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.393735    4060 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1930df66-da42-4ad8-bfe0-5e92f9e07ebc" volumeName="kubernetes.io/empty-dir/1930df66-da42-4ad8-bfe0-5e92f9e07ebc-tmp-dir" seLinuxMountContext=""
Oct 30 20:36:21.393734 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.393746    4060 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a5b34407-cc7d-458e-aca3-cd48133834ad" volumeName="kubernetes.io/empty-dir/a5b34407-cc7d-458e-aca3-cd48133834ad-tmp" seLinuxMountContext=""
Oct 30 20:36:21.394639 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.393758    4060 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="be756835-3011-4186-ab61-8128121eb95b" volumeName="kubernetes.io/projected/be756835-3011-4186-ab61-8128121eb95b-kube-api-access-8rgwr" seLinuxMountContext=""
Oct 30 20:36:21.394639 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.393775    4060 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d0bb5f1b-4370-4e8d-80a8-1a7bcda13cd2" volumeName="kubernetes.io/projected/d0bb5f1b-4370-4e8d-80a8-1a7bcda13cd2-kube-api-access-dqsnt" seLinuxMountContext=""
Oct 30 20:36:21.394639 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.393788    4060 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3e93e3cc-cd26-452f-9e40-31dedb0d198b" volumeName="kubernetes.io/projected/3e93e3cc-cd26-452f-9e40-31dedb0d198b-kube-api-access-lgp2l" seLinuxMountContext=""
Oct 30 20:36:21.394639 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.393803    4060 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6e80b983-b2c0-4923-82b0-5903424cc7b0" volumeName="kubernetes.io/projected/6e80b983-b2c0-4923-82b0-5903424cc7b0-kube-api-access-5hmjh" seLinuxMountContext=""
Oct 30 20:36:21.394639 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.393814    4060 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="70cf9a0e-c321-438d-83a2-2034f4df9034" volumeName="kubernetes.io/configmap/70cf9a0e-c321-438d-83a2-2034f4df9034-konnectivity-ca" seLinuxMountContext=""
Oct 30 20:36:21.394639 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.393826    4060 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9516abf2-c993-442c-8c5e-34480e5113d6" volumeName="kubernetes.io/configmap/9516abf2-c993-442c-8c5e-34480e5113d6-ovnkube-config" seLinuxMountContext=""
Oct 30 20:36:21.394639 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.393841    4060 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="96b48bb2-933f-483d-8f15-5cca00c3d613" volumeName="kubernetes.io/projected/96b48bb2-933f-483d-8f15-5cca00c3d613-kube-api-access-k5wmd" seLinuxMountContext=""
Oct 30 20:36:21.394639 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.393854    4060 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a5b34407-cc7d-458e-aca3-cd48133834ad" volumeName="kubernetes.io/projected/a5b34407-cc7d-458e-aca3-cd48133834ad-kube-api-access-2xx6z" seLinuxMountContext=""
Oct 30 20:36:21.394639 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.393872    4060 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="baefcab8-b5be-4143-9b55-7a86001a4363" volumeName="kubernetes.io/configmap/baefcab8-b5be-4143-9b55-7a86001a4363-cni-binary-copy" seLinuxMountContext=""
Oct 30 20:36:21.394639 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.393884    4060 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="baefcab8-b5be-4143-9b55-7a86001a4363" volumeName="kubernetes.io/projected/baefcab8-b5be-4143-9b55-7a86001a4363-kube-api-access-2mzs4" seLinuxMountContext=""
Oct 30 20:36:21.394639 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.393895    4060 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1930df66-da42-4ad8-bfe0-5e92f9e07ebc" volumeName="kubernetes.io/projected/1930df66-da42-4ad8-bfe0-5e92f9e07ebc-kube-api-access-nsvqk" seLinuxMountContext=""
Oct 30 20:36:21.394639 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.393907    4060 reconstruct.go:97] "Volume reconstruction finished"
Oct 30 20:36:21.394639 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.393920    4060 reconciler.go:29] "Reconciler: start to sync state"
Oct 30 20:36:21.397030 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.395081    4060 factory.go:153] Registering CRI-O factory
Oct 30 20:36:21.397030 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.395101    4060 factory.go:223] Registration of the crio container factory successfully
Oct 30 20:36:21.397030 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.395157    4060 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Oct 30 20:36:21.397030 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.395180    4060 factory.go:103] Registering Raw factory
Oct 30 20:36:21.397030 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.395202    4060 manager.go:1199] Started watching for new ooms in manager
Oct 30 20:36:21.397030 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.395581    4060 manager.go:319] Starting recovery of all containers
Oct 30 20:36:21.419348 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.419262    4060 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Oct 30 20:36:21.420667 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.420642    4060 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Oct 30 20:36:21.420667 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.420665    4060 status_manager.go:249] "Starting to sync pod status with apiserver"
Oct 30 20:36:21.420826 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.420683    4060 kubelet.go:2521] "Starting kubelet main sync loop"
Oct 30 20:36:21.420826 ip-10-0-142-4 kubenswrapper[4060]: E1030 20:36:21.420715    4060 kubelet.go:2545] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]"
Oct 30 20:36:21.442443 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.442411    4060 generic.go:356] "Generic (PLEG): container finished" podID="be756835-3011-4186-ab61-8128121eb95b" containerID="02ffae324b88ac357a103a6d6a7c5dd9090898637c85630136ae2d18fe4460a5" exitCode=0
Oct 30 20:36:21.442443 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.442441    4060 generic.go:356] "Generic (PLEG): container finished" podID="be756835-3011-4186-ab61-8128121eb95b" containerID="0e8537ae577c792102ece9c167d12d39f4db8bc9ca3ef9cb05982811c93917a5" exitCode=0
Oct 30 20:36:21.442443 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.442450    4060 generic.go:356] "Generic (PLEG): container finished" podID="be756835-3011-4186-ab61-8128121eb95b" containerID="12c15dc397ed4323ad15507a4ce2a20ce80f3c1343fedef7121aaa983a693f49" exitCode=0
Oct 30 20:36:21.442678 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.442457    4060 generic.go:356] "Generic (PLEG): container finished" podID="be756835-3011-4186-ab61-8128121eb95b" containerID="93da85c4e9059383dccbe060d67b20da3ddd165e99fe7343beed8ac18d7dfa41" exitCode=0
Oct 30 20:36:21.442678 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.442464    4060 generic.go:356] "Generic (PLEG): container finished" podID="be756835-3011-4186-ab61-8128121eb95b" containerID="3db7dcc0c617301a0ad07c22fcfa2488b1b309ebb35eb320b5101da397909998" exitCode=0
Oct 30 20:36:21.442678 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.442470    4060 generic.go:356] "Generic (PLEG): container finished" podID="be756835-3011-4186-ab61-8128121eb95b" containerID="c1fb5b79e346b3a0c68d03a035c29ca3317c9678a2b2c652efd3d971e18129c5" exitCode=0
Oct 30 20:36:21.448246 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.448217    4060 generic.go:356] "Generic (PLEG): container finished" podID="90d034cf7e9022b0bbb1def78b2df29c" containerID="82c5d80b914884eae5bab667cadd51ecf79a4e6878a2e91e8392fe8e720e031c" exitCode=0
Oct 30 20:36:21.455327 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.455308    4060 manager.go:324] Recovery completed
Oct 30 20:36:21.468411 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.468391    4060 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 20:36:21.469863 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.469842    4060 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-4.us-west-1.compute.internal" event="NodeHasSufficientMemory"
Oct 30 20:36:21.469969 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.469879    4060 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-4.us-west-1.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 20:36:21.469969 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.469891    4060 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-4.us-west-1.compute.internal" event="NodeHasSufficientPID"
Oct 30 20:36:21.471146 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.471131    4060 cpu_manager.go:226] "Starting" policy="none"
Oct 30 20:36:21.471146 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.471144    4060 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s"
Oct 30 20:36:21.471232 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.471149    4060 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 20:36:21.471232 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.471160    4060 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory"
Oct 30 20:36:21.471294 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.471271    4060 state_mem.go:94] "Updated default CPUSet" logger="CPUManager state checkpoint.CPUManager state memory" cpuSet=""
Oct 30 20:36:21.471294 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.471282    4060 state_mem.go:102] "Updated CPUSet assignments" logger="CPUManager state checkpoint.CPUManager state memory" assignments={}
Oct 30 20:36:21.471362 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.471299    4060 state_checkpoint.go:142] "restored state from checkpoint" logger="CPUManager state checkpoint"
Oct 30 20:36:21.471362 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.471305    4060 state_checkpoint.go:143] "defaultCPUSet" logger="CPUManager state checkpoint" defaultCpuSet=""
Oct 30 20:36:21.471362 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.471310    4060 policy_none.go:50] "Start"
Oct 30 20:36:21.471362 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.471318    4060 memory_manager.go:187] "Starting memorymanager" policy="None"
Oct 30 20:36:21.471362 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.471326    4060 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Oct 30 20:36:21.472119 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.472103    4060 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-4.us-west-1.compute.internal" event="NodeHasSufficientMemory"
Oct 30 20:36:21.472192 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.472130    4060 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-4.us-west-1.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 20:36:21.472192 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.472140    4060 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-4.us-west-1.compute.internal" event="NodeHasSufficientPID"
Oct 30 20:36:21.474829 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.474816    4060 state_mem.go:77] "Updated machine memory state" logger="Memory Manager state checkpoint"
Oct 30 20:36:21.474873 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.474830    4060 state_checkpoint.go:85] "State checkpoint: restored state from checkpoint" logger="Memory Manager state checkpoint"
Oct 30 20:36:21.474873 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.474844    4060 policy_none.go:44] "Start"
Oct 30 20:36:21.478747 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.478717    4060 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"}
Oct 30 20:36:21.481765 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.481753    4060 manager.go:341] "Starting Device Plugin manager"
Oct 30 20:36:21.481818 ip-10-0-142-4 kubenswrapper[4060]: E1030 20:36:21.481778    4060 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Oct 30 20:36:21.481818 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.481786    4060 server.go:87] "Starting device plugin registration server"
Oct 30 20:36:21.482088 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.482075    4060 eviction_manager.go:194] "Eviction manager: starting control loop"
Oct 30 20:36:21.482134 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.482092    4060 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Oct 30 20:36:21.482195 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.482174    4060 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Oct 30 20:36:21.482332 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.482289    4060 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Oct 30 20:36:21.482399 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.482335    4060 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts"
Oct 30 20:36:21.482399 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.482342    4060 plugin_manager.go:121] "Starting Kubelet Plugin Manager"
Oct 30 20:36:21.482486 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.482407    4060 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-10-30T20:36:21.482323579Z","UUID":"87b95fe7-553f-4605-b3e9-21b1e58a32bd","Handler":null,"Name":"","Endpoint":""}
Oct 30 20:36:21.483628 ip-10-0-142-4 kubenswrapper[4060]: E1030 20:36:21.483611    4060 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Oct 30 20:36:21.483750 ip-10-0-142-4 kubenswrapper[4060]: E1030 20:36:21.483735    4060 eviction_manager.go:297] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-142-4.us-west-1.compute.internal\" not found"
Oct 30 20:36:21.483817 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.483774    4060 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Oct 30 20:36:21.483861 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.483821    4060 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Oct 30 20:36:21.522084 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.521591    4060 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-4.us-west-1.compute.internal","kube-system/kube-apiserver-proxy-ip-10-0-142-4.us-west-1.compute.internal"]
Oct 30 20:36:21.522206 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.522172    4060 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 20:36:21.523247 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.523231    4060 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-4.us-west-1.compute.internal" event="NodeHasSufficientMemory"
Oct 30 20:36:21.523302 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.523259    4060 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-4.us-west-1.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 20:36:21.523302 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.523271    4060 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-4.us-west-1.compute.internal" event="NodeHasSufficientPID"
Oct 30 20:36:21.523520 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.523510    4060 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 20:36:21.523661 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.523646    4060 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 20:36:21.524502 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.524473    4060 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-4.us-west-1.compute.internal" event="NodeHasSufficientMemory"
Oct 30 20:36:21.524591 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.524511    4060 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-4.us-west-1.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 20:36:21.524591 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.524522    4060 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-4.us-west-1.compute.internal" event="NodeHasSufficientPID"
Oct 30 20:36:21.524591 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.524477    4060 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-4.us-west-1.compute.internal" event="NodeHasSufficientMemory"
Oct 30 20:36:21.524667 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.524609    4060 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-4.us-west-1.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 20:36:21.524667 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.524621    4060 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-4.us-west-1.compute.internal" event="NodeHasSufficientPID"
Oct 30 20:36:21.524667 ip-10-0-142-4 kubenswrapper[4060]: E1030 20:36:21.524649    4060 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-4.us-west-1.compute.internal\" not found" node="ip-10-0-142-4.us-west-1.compute.internal"
Oct 30 20:36:21.524867 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.524839    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-4.us-west-1.compute.internal" event={"ID":"c873d294ea5be2c96cd88ae10288f56b","Type":"ContainerStarted","Data":"b5dfa70af39bb34a3c293ebbed76a72c4088a290ebb5153dcff39768f63eb6c5"}
Oct 30 20:36:21.524897 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.524874    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-4.us-west-1.compute.internal" event={"ID":"c873d294ea5be2c96cd88ae10288f56b","Type":"ContainerStarted","Data":"b35002fc0c079bc19536911fd42a3bb47c02632dee2bf2c45bbaae6834833ba5"}
Oct 30 20:36:21.524897 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.524887    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-4.us-west-1.compute.internal" event={"ID":"90d034cf7e9022b0bbb1def78b2df29c","Type":"ContainerStarted","Data":"eddc381540fdf4872bc75e07cb5330e0bbebe0a0ec5f4e8c76d5a6b1b219a7d3"}
Oct 30 20:36:21.524951 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.524898    4060 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 20:36:21.524980 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.524899    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-4.us-west-1.compute.internal" event={"ID":"90d034cf7e9022b0bbb1def78b2df29c","Type":"ContainerDied","Data":"82c5d80b914884eae5bab667cadd51ecf79a4e6878a2e91e8392fe8e720e031c"}
Oct 30 20:36:21.525019 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.524987    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-4.us-west-1.compute.internal" event={"ID":"90d034cf7e9022b0bbb1def78b2df29c","Type":"ContainerStarted","Data":"a8850a60faf2eb84b7bec143e3a87c40d2a6f267b2afdc821e44ae32f6d964e7"}
Oct 30 20:36:21.525813 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.525799    4060 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-4.us-west-1.compute.internal" event="NodeHasSufficientMemory"
Oct 30 20:36:21.525863 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.525826    4060 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-4.us-west-1.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 20:36:21.525863 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.525839    4060 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-4.us-west-1.compute.internal" event="NodeHasSufficientPID"
Oct 30 20:36:21.525969 ip-10-0-142-4 kubenswrapper[4060]: E1030 20:36:21.525951    4060 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-4.us-west-1.compute.internal\" not found" node="ip-10-0-142-4.us-west-1.compute.internal"
Oct 30 20:36:21.582200 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.582167    4060 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 20:36:21.583941 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.583919    4060 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-4.us-west-1.compute.internal" event="NodeHasSufficientMemory"
Oct 30 20:36:21.584043 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.583953    4060 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-4.us-west-1.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 20:36:21.584043 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.583966    4060 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-4.us-west-1.compute.internal" event="NodeHasSufficientPID"
Oct 30 20:36:21.584043 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.583986    4060 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-142-4.us-west-1.compute.internal"
Oct 30 20:36:21.592819 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.592796    4060 reconstruct.go:205] "DevicePaths of reconstructed volumes updated"
Oct 30 20:36:21.633993 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.633958    4060 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 20:36:21.634139 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.634124    4060 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 20:36:21.640626 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.640603    4060 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 20:36:21.690810 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.690705    4060 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 20:36:21.692522 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.692467    4060 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-4.us-west-1.compute.internal"
Oct 30 20:36:21.693026 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.693008    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c873d294ea5be2c96cd88ae10288f56b-config\") pod \"kube-apiserver-proxy-ip-10-0-142-4.us-west-1.compute.internal\" (UID: \"c873d294ea5be2c96cd88ae10288f56b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-4.us-west-1.compute.internal"
Oct 30 20:36:21.693087 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.693034    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/90d034cf7e9022b0bbb1def78b2df29c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-4.us-west-1.compute.internal\" (UID: \"90d034cf7e9022b0bbb1def78b2df29c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-4.us-west-1.compute.internal"
Oct 30 20:36:21.693087 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.693055    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/90d034cf7e9022b0bbb1def78b2df29c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-4.us-west-1.compute.internal\" (UID: \"90d034cf7e9022b0bbb1def78b2df29c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-4.us-west-1.compute.internal"
Oct 30 20:36:21.742699 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.742670    4060 kubelet_node_status.go:126] "Node was previously registered" node="ip-10-0-142-4.us-west-1.compute.internal"
Oct 30 20:36:21.742820 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.742744    4060 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-142-4.us-west-1.compute.internal"
Oct 30 20:36:21.743364 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.743342    4060 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-4.us-west-1.compute.internal" event="NodeNotReady"
Oct 30 20:36:21.743454 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.743374    4060 setters.go:546] "Node became not ready" node="ip-10-0-142-4.us-west-1.compute.internal" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-10-30T20:36:21Z","lastTransitionTime":"2026-10-30T20:36:21Z","reason":"KubeletNotReady","message":"CSINode is not yet initialized"}
Oct 30 20:36:21.743454 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.743420    4060 nodeinfomanager.go:471] existing CSINode "ip-10-0-142-4.us-west-1.compute.internal" is owned by different node (oldNodeID="0aa51052-fa7e-47e4-991e-1c34d5ac8677", newNodeID=""), cleaning up...
Oct 30 20:36:21.753838 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.753794    4060 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 30 20:36:21.753939 ip-10-0-142-4 kubenswrapper[4060]: E1030 20:36:21.753862    4060 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-142-4.us-west-1.compute.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-4.us-west-1.compute.internal"
Oct 30 20:36:21.753939 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.753875    4060 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-4.us-west-1.compute.internal"
Oct 30 20:36:21.793227 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.793193    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/90d034cf7e9022b0bbb1def78b2df29c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-4.us-west-1.compute.internal\" (UID: \"90d034cf7e9022b0bbb1def78b2df29c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-4.us-west-1.compute.internal"
Oct 30 20:36:21.793352 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.793236    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/90d034cf7e9022b0bbb1def78b2df29c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-4.us-west-1.compute.internal\" (UID: \"90d034cf7e9022b0bbb1def78b2df29c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-4.us-west-1.compute.internal"
Oct 30 20:36:21.793352 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.793259    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c873d294ea5be2c96cd88ae10288f56b-config\") pod \"kube-apiserver-proxy-ip-10-0-142-4.us-west-1.compute.internal\" (UID: \"c873d294ea5be2c96cd88ae10288f56b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-4.us-west-1.compute.internal"
Oct 30 20:36:21.793352 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.793297    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/90d034cf7e9022b0bbb1def78b2df29c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-4.us-west-1.compute.internal\" (UID: \"90d034cf7e9022b0bbb1def78b2df29c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-4.us-west-1.compute.internal"
Oct 30 20:36:21.793352 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.793312    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/90d034cf7e9022b0bbb1def78b2df29c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-4.us-west-1.compute.internal\" (UID: \"90d034cf7e9022b0bbb1def78b2df29c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-4.us-west-1.compute.internal"
Oct 30 20:36:21.793352 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.793313    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c873d294ea5be2c96cd88ae10288f56b-config\") pod \"kube-apiserver-proxy-ip-10-0-142-4.us-west-1.compute.internal\" (UID: \"c873d294ea5be2c96cd88ae10288f56b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-4.us-west-1.compute.internal"
Oct 30 20:36:21.814681 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:21.814657    4060 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 30 20:36:21.814794 ip-10-0-142-4 kubenswrapper[4060]: E1030 20:36:21.814699    4060 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-142-4.us-west-1.compute.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-4.us-west-1.compute.internal"
Oct 30 20:36:22.381148 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.381113    4060 apiserver.go:52] "Watching apiserver"
Oct 30 20:36:22.451054 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.451031    4060 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-4.us-west-1.compute.internal"
Oct 30 20:36:22.451223 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.451170    4060 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-4.us-west-1.compute.internal"
Oct 30 20:36:22.492598 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.492564    4060 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Oct 30 20:36:22.492962 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.492941    4060 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gqt4f","openshift-multus/multus-additional-cni-plugins-n7knr","openshift-dns/node-resolver-82j9v","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-4.us-west-1.compute.internal","kube-system/konnectivity-agent-mlgfz","openshift-multus/multus-nmttt","openshift-multus/network-metrics-daemon-f45fg","openshift-network-diagnostics/network-check-target-scs59","openshift-network-operator/iptables-alerter-cfbz6","kube-system/global-pull-secret-syncer-cfdhw","openshift-cluster-node-tuning-operator/tuned-7cg9z","openshift-image-registry/node-ca-5mml4","openshift-ovn-kubernetes/ovnkube-node-7dh2x","kube-system/kube-apiserver-proxy-ip-10-0-142-4.us-west-1.compute.internal"]
Oct 30 20:36:22.495218 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.495196    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f45fg"
Oct 30 20:36:22.511694 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.511671    4060 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 30 20:36:22.511787 ip-10-0-142-4 kubenswrapper[4060]: E1030 20:36:22.511719    4060 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-142-4.us-west-1.compute.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-4.us-west-1.compute.internal"
Oct 30 20:36:22.512453 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.512441    4060 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 30 20:36:22.512523 ip-10-0-142-4 kubenswrapper[4060]: E1030 20:36:22.512469    4060 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-142-4.us-west-1.compute.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-4.us-west-1.compute.internal"
Oct 30 20:36:22.546579 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.546546    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-x2fjq\""
Oct 30 20:36:22.546723 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.546667    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Oct 30 20:36:22.546723 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.546687    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Oct 30 20:36:22.546723 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.546695    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Oct 30 20:36:22.546723 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.546710    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Oct 30 20:36:22.546908 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.546759    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Oct 30 20:36:22.546908 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.546782    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-mx55q\""
Oct 30 20:36:22.592564 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.592531    4060 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Oct 30 20:36:22.597996 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.597970    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/baefcab8-b5be-4143-9b55-7a86001a4363-host-run-netns\") pod \"multus-nmttt\" (UID: \"baefcab8-b5be-4143-9b55-7a86001a4363\") " pod="openshift-multus/multus-nmttt"
Oct 30 20:36:22.598124 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.598006    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6e80b983-b2c0-4923-82b0-5903424cc7b0-registration-dir\") pod \"aws-ebs-csi-driver-node-gqt4f\" (UID: \"6e80b983-b2c0-4923-82b0-5903424cc7b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gqt4f"
Oct 30 20:36:22.598124 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.598037    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lgp2l\" (UniqueName: \"kubernetes.io/projected/3e93e3cc-cd26-452f-9e40-31dedb0d198b-kube-api-access-lgp2l\") pod \"node-ca-5mml4\" (UID: \"3e93e3cc-cd26-452f-9e40-31dedb0d198b\") " pod="openshift-image-registry/node-ca-5mml4"
Oct 30 20:36:22.598124 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.598084    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6e80b983-b2c0-4923-82b0-5903424cc7b0-device-dir\") pod \"aws-ebs-csi-driver-node-gqt4f\" (UID: \"6e80b983-b2c0-4923-82b0-5903424cc7b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gqt4f"
Oct 30 20:36:22.598124 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.598122    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9516abf2-c993-442c-8c5e-34480e5113d6-ovnkube-config\") pod \"ovnkube-node-7dh2x\" (UID: \"9516abf2-c993-442c-8c5e-34480e5113d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-7dh2x"
Oct 30 20:36:22.598401 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.598383    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5hzrc\" (UniqueName: \"kubernetes.io/projected/fbbb7a28-caa9-4309-8d4c-a6f1c01e2b4f-kube-api-access-5hzrc\") pod \"network-check-target-scs59\" (UID: \"fbbb7a28-caa9-4309-8d4c-a6f1c01e2b4f\") " pod="openshift-network-diagnostics/network-check-target-scs59"
Oct 30 20:36:22.598462 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.598412    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/be756835-3011-4186-ab61-8128121eb95b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-n7knr\" (UID: \"be756835-3011-4186-ab61-8128121eb95b\") " pod="openshift-multus/multus-additional-cni-plugins-n7knr"
Oct 30 20:36:22.598462 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.598430    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a5b34407-cc7d-458e-aca3-cd48133834ad-etc-sysctl-d\") pod \"tuned-7cg9z\" (UID: \"a5b34407-cc7d-458e-aca3-cd48133834ad\") " pod="openshift-cluster-node-tuning-operator/tuned-7cg9z"
Oct 30 20:36:22.598462 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.598444    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a5b34407-cc7d-458e-aca3-cd48133834ad-tmp\") pod \"tuned-7cg9z\" (UID: \"a5b34407-cc7d-458e-aca3-cd48133834ad\") " pod="openshift-cluster-node-tuning-operator/tuned-7cg9z"
Oct 30 20:36:22.598628 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.598483    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9516abf2-c993-442c-8c5e-34480e5113d6-etc-openvswitch\") pod \"ovnkube-node-7dh2x\" (UID: \"9516abf2-c993-442c-8c5e-34480e5113d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-7dh2x"
Oct 30 20:36:22.598628 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.598523    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9516abf2-c993-442c-8c5e-34480e5113d6-host-cni-bin\") pod \"ovnkube-node-7dh2x\" (UID: \"9516abf2-c993-442c-8c5e-34480e5113d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-7dh2x"
Oct 30 20:36:22.598628 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.598534    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a5b34407-cc7d-458e-aca3-cd48133834ad-tmp\") pod \"tuned-7cg9z\" (UID: \"a5b34407-cc7d-458e-aca3-cd48133834ad\") " pod="openshift-cluster-node-tuning-operator/tuned-7cg9z"
Oct 30 20:36:22.598628 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.598563    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9516abf2-c993-442c-8c5e-34480e5113d6-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7dh2x\" (UID: \"9516abf2-c993-442c-8c5e-34480e5113d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-7dh2x"
Oct 30 20:36:22.598628 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.598581    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/70cf9a0e-c321-438d-83a2-2034f4df9034-konnectivity-ca\") pod \"konnectivity-agent-mlgfz\" (UID: \"70cf9a0e-c321-438d-83a2-2034f4df9034\") " pod="kube-system/konnectivity-agent-mlgfz"
Oct 30 20:36:22.598628 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.598596    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/96b48bb2-933f-483d-8f15-5cca00c3d613-host-slash\") pod \"iptables-alerter-cfbz6\" (UID: \"96b48bb2-933f-483d-8f15-5cca00c3d613\") " pod="openshift-network-operator/iptables-alerter-cfbz6"
Oct 30 20:36:22.598856 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.598636    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/be756835-3011-4186-ab61-8128121eb95b-cni-binary-copy\") pod \"multus-additional-cni-plugins-n7knr\" (UID: \"be756835-3011-4186-ab61-8128121eb95b\") " pod="openshift-multus/multus-additional-cni-plugins-n7knr"
Oct 30 20:36:22.598856 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.598654    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a5b34407-cc7d-458e-aca3-cd48133834ad-etc-kubernetes\") pod \"tuned-7cg9z\" (UID: \"a5b34407-cc7d-458e-aca3-cd48133834ad\") " pod="openshift-cluster-node-tuning-operator/tuned-7cg9z"
Oct 30 20:36:22.598856 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.598670    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a5b34407-cc7d-458e-aca3-cd48133834ad-etc-tuned\") pod \"tuned-7cg9z\" (UID: \"a5b34407-cc7d-458e-aca3-cd48133834ad\") " pod="openshift-cluster-node-tuning-operator/tuned-7cg9z"
Oct 30 20:36:22.598856 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.598678    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9516abf2-c993-442c-8c5e-34480e5113d6-ovnkube-config\") pod \"ovnkube-node-7dh2x\" (UID: \"9516abf2-c993-442c-8c5e-34480e5113d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-7dh2x"
Oct 30 20:36:22.598856 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.598694    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3e93e3cc-cd26-452f-9e40-31dedb0d198b-serviceca\") pod \"node-ca-5mml4\" (UID: \"3e93e3cc-cd26-452f-9e40-31dedb0d198b\") " pod="openshift-image-registry/node-ca-5mml4"
Oct 30 20:36:22.598856 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.598727    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a5b34407-cc7d-458e-aca3-cd48133834ad-sys\") pod \"tuned-7cg9z\" (UID: \"a5b34407-cc7d-458e-aca3-cd48133834ad\") " pod="openshift-cluster-node-tuning-operator/tuned-7cg9z"
Oct 30 20:36:22.598856 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.598789    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/baefcab8-b5be-4143-9b55-7a86001a4363-multus-cni-dir\") pod \"multus-nmttt\" (UID: \"baefcab8-b5be-4143-9b55-7a86001a4363\") " pod="openshift-multus/multus-nmttt"
Oct 30 20:36:22.598856 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.598800    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a5b34407-cc7d-458e-aca3-cd48133834ad-etc-tuned\") pod \"tuned-7cg9z\" (UID: \"a5b34407-cc7d-458e-aca3-cd48133834ad\") " pod="openshift-cluster-node-tuning-operator/tuned-7cg9z"
Oct 30 20:36:22.598856 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.598832    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3e93e3cc-cd26-452f-9e40-31dedb0d198b-host\") pod \"node-ca-5mml4\" (UID: \"3e93e3cc-cd26-452f-9e40-31dedb0d198b\") " pod="openshift-image-registry/node-ca-5mml4"
Oct 30 20:36:22.598856 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.598860    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9516abf2-c993-442c-8c5e-34480e5113d6-log-socket\") pod \"ovnkube-node-7dh2x\" (UID: \"9516abf2-c993-442c-8c5e-34480e5113d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-7dh2x"
Oct 30 20:36:22.599248 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.598877    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9516abf2-c993-442c-8c5e-34480e5113d6-host-run-ovn-kubernetes\") pod \"ovnkube-node-7dh2x\" (UID: \"9516abf2-c993-442c-8c5e-34480e5113d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-7dh2x"
Oct 30 20:36:22.599248 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.598912    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1930df66-da42-4ad8-bfe0-5e92f9e07ebc-tmp-dir\") pod \"node-resolver-82j9v\" (UID: \"1930df66-da42-4ad8-bfe0-5e92f9e07ebc\") " pod="openshift-dns/node-resolver-82j9v"
Oct 30 20:36:22.599248 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.598943    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9516abf2-c993-442c-8c5e-34480e5113d6-node-log\") pod \"ovnkube-node-7dh2x\" (UID: \"9516abf2-c993-442c-8c5e-34480e5113d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-7dh2x"
Oct 30 20:36:22.599248 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.598989    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a5b34407-cc7d-458e-aca3-cd48133834ad-etc-systemd\") pod \"tuned-7cg9z\" (UID: \"a5b34407-cc7d-458e-aca3-cd48133834ad\") " pod="openshift-cluster-node-tuning-operator/tuned-7cg9z"
Oct 30 20:36:22.599248 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.599009    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1930df66-da42-4ad8-bfe0-5e92f9e07ebc-tmp-dir\") pod \"node-resolver-82j9v\" (UID: \"1930df66-da42-4ad8-bfe0-5e92f9e07ebc\") " pod="openshift-dns/node-resolver-82j9v"
Oct 30 20:36:22.599248 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.599043    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a5b34407-cc7d-458e-aca3-cd48133834ad-run\") pod \"tuned-7cg9z\" (UID: \"a5b34407-cc7d-458e-aca3-cd48133834ad\") " pod="openshift-cluster-node-tuning-operator/tuned-7cg9z"
Oct 30 20:36:22.599248 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.599076    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6e80b983-b2c0-4923-82b0-5903424cc7b0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gqt4f\" (UID: \"6e80b983-b2c0-4923-82b0-5903424cc7b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gqt4f"
Oct 30 20:36:22.599248 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.599093    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/baefcab8-b5be-4143-9b55-7a86001a4363-cni-binary-copy\") pod \"multus-nmttt\" (UID: \"baefcab8-b5be-4143-9b55-7a86001a4363\") " pod="openshift-multus/multus-nmttt"
Oct 30 20:36:22.599248 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.599157    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/baefcab8-b5be-4143-9b55-7a86001a4363-host-run-k8s-cni-cncf-io\") pod \"multus-nmttt\" (UID: \"baefcab8-b5be-4143-9b55-7a86001a4363\") " pod="openshift-multus/multus-nmttt"
Oct 30 20:36:22.599248 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.599182    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/baefcab8-b5be-4143-9b55-7a86001a4363-host-var-lib-cni-bin\") pod \"multus-nmttt\" (UID: \"baefcab8-b5be-4143-9b55-7a86001a4363\") " pod="openshift-multus/multus-nmttt"
Oct 30 20:36:22.599248 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.599204    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/baefcab8-b5be-4143-9b55-7a86001a4363-hostroot\") pod \"multus-nmttt\" (UID: \"baefcab8-b5be-4143-9b55-7a86001a4363\") " pod="openshift-multus/multus-nmttt"
Oct 30 20:36:22.599248 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.599236    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/baefcab8-b5be-4143-9b55-7a86001a4363-multus-daemon-config\") pod \"multus-nmttt\" (UID: \"baefcab8-b5be-4143-9b55-7a86001a4363\") " pod="openshift-multus/multus-nmttt"
Oct 30 20:36:22.599693 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.599273    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/96b48bb2-933f-483d-8f15-5cca00c3d613-iptables-alerter-script\") pod \"iptables-alerter-cfbz6\" (UID: \"96b48bb2-933f-483d-8f15-5cca00c3d613\") " pod="openshift-network-operator/iptables-alerter-cfbz6"
Oct 30 20:36:22.599693 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.599338    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6e80b983-b2c0-4923-82b0-5903424cc7b0-etc-selinux\") pod \"aws-ebs-csi-driver-node-gqt4f\" (UID: \"6e80b983-b2c0-4923-82b0-5903424cc7b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gqt4f"
Oct 30 20:36:22.599693 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.599376    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/baefcab8-b5be-4143-9b55-7a86001a4363-multus-socket-dir-parent\") pod \"multus-nmttt\" (UID: \"baefcab8-b5be-4143-9b55-7a86001a4363\") " pod="openshift-multus/multus-nmttt"
Oct 30 20:36:22.599693 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.599393    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k5wmd\" (UniqueName: \"kubernetes.io/projected/96b48bb2-933f-483d-8f15-5cca00c3d613-kube-api-access-k5wmd\") pod \"iptables-alerter-cfbz6\" (UID: \"96b48bb2-933f-483d-8f15-5cca00c3d613\") " pod="openshift-network-operator/iptables-alerter-cfbz6"
Oct 30 20:36:22.599693 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.599425    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/261f6884-299b-4971-b936-bbb3174f1b66-dbus\") pod \"global-pull-secret-syncer-cfdhw\" (UID: \"261f6884-299b-4971-b936-bbb3174f1b66\") " pod="kube-system/global-pull-secret-syncer-cfdhw"
Oct 30 20:36:22.599693 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.599511    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9516abf2-c993-442c-8c5e-34480e5113d6-systemd-units\") pod \"ovnkube-node-7dh2x\" (UID: \"9516abf2-c993-442c-8c5e-34480e5113d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-7dh2x"
Oct 30 20:36:22.599693 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.599528    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mpwhg\" (UniqueName: \"kubernetes.io/projected/9516abf2-c993-442c-8c5e-34480e5113d6-kube-api-access-mpwhg\") pod \"ovnkube-node-7dh2x\" (UID: \"9516abf2-c993-442c-8c5e-34480e5113d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-7dh2x"
Oct 30 20:36:22.599693 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.599558    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1930df66-da42-4ad8-bfe0-5e92f9e07ebc-hosts-file\") pod \"node-resolver-82j9v\" (UID: \"1930df66-da42-4ad8-bfe0-5e92f9e07ebc\") " pod="openshift-dns/node-resolver-82j9v"
Oct 30 20:36:22.599693 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.599584    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/be756835-3011-4186-ab61-8128121eb95b-cnibin\") pod \"multus-additional-cni-plugins-n7knr\" (UID: \"be756835-3011-4186-ab61-8128121eb95b\") " pod="openshift-multus/multus-additional-cni-plugins-n7knr"
Oct 30 20:36:22.599693 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.599658    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/be756835-3011-4186-ab61-8128121eb95b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-n7knr\" (UID: \"be756835-3011-4186-ab61-8128121eb95b\") " pod="openshift-multus/multus-additional-cni-plugins-n7knr"
Oct 30 20:36:22.599693 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.599681    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6e80b983-b2c0-4923-82b0-5903424cc7b0-socket-dir\") pod \"aws-ebs-csi-driver-node-gqt4f\" (UID: \"6e80b983-b2c0-4923-82b0-5903424cc7b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gqt4f"
Oct 30 20:36:22.600112 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.599709    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9516abf2-c993-442c-8c5e-34480e5113d6-host-kubelet\") pod \"ovnkube-node-7dh2x\" (UID: \"9516abf2-c993-442c-8c5e-34480e5113d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-7dh2x"
Oct 30 20:36:22.600112 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.599733    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9516abf2-c993-442c-8c5e-34480e5113d6-run-systemd\") pod \"ovnkube-node-7dh2x\" (UID: \"9516abf2-c993-442c-8c5e-34480e5113d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-7dh2x"
Oct 30 20:36:22.600112 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.599764    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9516abf2-c993-442c-8c5e-34480e5113d6-ovnkube-script-lib\") pod \"ovnkube-node-7dh2x\" (UID: \"9516abf2-c993-442c-8c5e-34480e5113d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-7dh2x"
Oct 30 20:36:22.600112 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.599838    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/baefcab8-b5be-4143-9b55-7a86001a4363-host-var-lib-cni-multus\") pod \"multus-nmttt\" (UID: \"baefcab8-b5be-4143-9b55-7a86001a4363\") " pod="openshift-multus/multus-nmttt"
Oct 30 20:36:22.600112 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.599871    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/baefcab8-b5be-4143-9b55-7a86001a4363-host-var-lib-kubelet\") pod \"multus-nmttt\" (UID: \"baefcab8-b5be-4143-9b55-7a86001a4363\") " pod="openshift-multus/multus-nmttt"
Oct 30 20:36:22.600112 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.599895    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/baefcab8-b5be-4143-9b55-7a86001a4363-multus-conf-dir\") pod \"multus-nmttt\" (UID: \"baefcab8-b5be-4143-9b55-7a86001a4363\") " pod="openshift-multus/multus-nmttt"
Oct 30 20:36:22.600112 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.599913    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6e80b983-b2c0-4923-82b0-5903424cc7b0-sys-fs\") pod \"aws-ebs-csi-driver-node-gqt4f\" (UID: \"6e80b983-b2c0-4923-82b0-5903424cc7b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gqt4f"
Oct 30 20:36:22.600112 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.599913    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9516abf2-c993-442c-8c5e-34480e5113d6-ovnkube-script-lib\") pod \"ovnkube-node-7dh2x\" (UID: \"9516abf2-c993-442c-8c5e-34480e5113d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-7dh2x"
Oct 30 20:36:22.600112 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.599937    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9516abf2-c993-442c-8c5e-34480e5113d6-env-overrides\") pod \"ovnkube-node-7dh2x\" (UID: \"9516abf2-c993-442c-8c5e-34480e5113d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-7dh2x"
Oct 30 20:36:22.600112 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.599953    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nsvqk\" (UniqueName: \"kubernetes.io/projected/1930df66-da42-4ad8-bfe0-5e92f9e07ebc-kube-api-access-nsvqk\") pod \"node-resolver-82j9v\" (UID: \"1930df66-da42-4ad8-bfe0-5e92f9e07ebc\") " pod="openshift-dns/node-resolver-82j9v"
Oct 30 20:36:22.600112 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.599979    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a5b34407-cc7d-458e-aca3-cd48133834ad-etc-sysctl-conf\") pod \"tuned-7cg9z\" (UID: \"a5b34407-cc7d-458e-aca3-cd48133834ad\") " pod="openshift-cluster-node-tuning-operator/tuned-7cg9z"
Oct 30 20:36:22.600112 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.600011    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/70cf9a0e-c321-438d-83a2-2034f4df9034-agent-certs\") pod \"konnectivity-agent-mlgfz\" (UID: \"70cf9a0e-c321-438d-83a2-2034f4df9034\") " pod="kube-system/konnectivity-agent-mlgfz"
Oct 30 20:36:22.600112 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.600037    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2mzs4\" (UniqueName: \"kubernetes.io/projected/baefcab8-b5be-4143-9b55-7a86001a4363-kube-api-access-2mzs4\") pod \"multus-nmttt\" (UID: \"baefcab8-b5be-4143-9b55-7a86001a4363\") " pod="openshift-multus/multus-nmttt"
Oct 30 20:36:22.600112 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.600079    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d0bb5f1b-4370-4e8d-80a8-1a7bcda13cd2-metrics-certs\") pod \"network-metrics-daemon-f45fg\" (UID: \"d0bb5f1b-4370-4e8d-80a8-1a7bcda13cd2\") " pod="openshift-multus/network-metrics-daemon-f45fg"
Oct 30 20:36:22.600112 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.600096    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5hmjh\" (UniqueName: \"kubernetes.io/projected/6e80b983-b2c0-4923-82b0-5903424cc7b0-kube-api-access-5hmjh\") pod \"aws-ebs-csi-driver-node-gqt4f\" (UID: \"6e80b983-b2c0-4923-82b0-5903424cc7b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gqt4f"
Oct 30 20:36:22.600112 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.600112    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8rgwr\" (UniqueName: \"kubernetes.io/projected/be756835-3011-4186-ab61-8128121eb95b-kube-api-access-8rgwr\") pod \"multus-additional-cni-plugins-n7knr\" (UID: \"be756835-3011-4186-ab61-8128121eb95b\") " pod="openshift-multus/multus-additional-cni-plugins-n7knr"
Oct 30 20:36:22.600662 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.600150    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a5b34407-cc7d-458e-aca3-cd48133834ad-lib-modules\") pod \"tuned-7cg9z\" (UID: \"a5b34407-cc7d-458e-aca3-cd48133834ad\") " pod="openshift-cluster-node-tuning-operator/tuned-7cg9z"
Oct 30 20:36:22.600662 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.600241    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a5b34407-cc7d-458e-aca3-cd48133834ad-var-lib-kubelet\") pod \"tuned-7cg9z\" (UID: \"a5b34407-cc7d-458e-aca3-cd48133834ad\") " pod="openshift-cluster-node-tuning-operator/tuned-7cg9z"
Oct 30 20:36:22.600662 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.600273    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/baefcab8-b5be-4143-9b55-7a86001a4363-system-cni-dir\") pod \"multus-nmttt\" (UID: \"baefcab8-b5be-4143-9b55-7a86001a4363\") " pod="openshift-multus/multus-nmttt"
Oct 30 20:36:22.600662 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.600300    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/baefcab8-b5be-4143-9b55-7a86001a4363-etc-kubernetes\") pod \"multus-nmttt\" (UID: \"baefcab8-b5be-4143-9b55-7a86001a4363\") " pod="openshift-multus/multus-nmttt"
Oct 30 20:36:22.600662 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.600333    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/261f6884-299b-4971-b936-bbb3174f1b66-kubelet-config\") pod \"global-pull-secret-syncer-cfdhw\" (UID: \"261f6884-299b-4971-b936-bbb3174f1b66\") " pod="kube-system/global-pull-secret-syncer-cfdhw"
Oct 30 20:36:22.600662 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.600392    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9516abf2-c993-442c-8c5e-34480e5113d6-run-openvswitch\") pod \"ovnkube-node-7dh2x\" (UID: \"9516abf2-c993-442c-8c5e-34480e5113d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-7dh2x"
Oct 30 20:36:22.600662 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.600421    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9516abf2-c993-442c-8c5e-34480e5113d6-run-ovn\") pod \"ovnkube-node-7dh2x\" (UID: \"9516abf2-c993-442c-8c5e-34480e5113d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-7dh2x"
Oct 30 20:36:22.600662 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.600445    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9516abf2-c993-442c-8c5e-34480e5113d6-host-cni-netd\") pod \"ovnkube-node-7dh2x\" (UID: \"9516abf2-c993-442c-8c5e-34480e5113d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-7dh2x"
Oct 30 20:36:22.600662 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.600475    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a5b34407-cc7d-458e-aca3-cd48133834ad-host\") pod \"tuned-7cg9z\" (UID: \"a5b34407-cc7d-458e-aca3-cd48133834ad\") " pod="openshift-cluster-node-tuning-operator/tuned-7cg9z"
Oct 30 20:36:22.600662 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.600535    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/baefcab8-b5be-4143-9b55-7a86001a4363-host-run-multus-certs\") pod \"multus-nmttt\" (UID: \"baefcab8-b5be-4143-9b55-7a86001a4363\") " pod="openshift-multus/multus-nmttt"
Oct 30 20:36:22.600662 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.600561    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dqsnt\" (UniqueName: \"kubernetes.io/projected/d0bb5f1b-4370-4e8d-80a8-1a7bcda13cd2-kube-api-access-dqsnt\") pod \"network-metrics-daemon-f45fg\" (UID: \"d0bb5f1b-4370-4e8d-80a8-1a7bcda13cd2\") " pod="openshift-multus/network-metrics-daemon-f45fg"
Oct 30 20:36:22.600662 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.600581    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/261f6884-299b-4971-b936-bbb3174f1b66-original-pull-secret\") pod \"global-pull-secret-syncer-cfdhw\" (UID: \"261f6884-299b-4971-b936-bbb3174f1b66\") " pod="kube-system/global-pull-secret-syncer-cfdhw"
Oct 30 20:36:22.601070 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.600675    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9516abf2-c993-442c-8c5e-34480e5113d6-host-slash\") pod \"ovnkube-node-7dh2x\" (UID: \"9516abf2-c993-442c-8c5e-34480e5113d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-7dh2x"
Oct 30 20:36:22.601070 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.600693    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9516abf2-c993-442c-8c5e-34480e5113d6-host-run-netns\") pod \"ovnkube-node-7dh2x\" (UID: \"9516abf2-c993-442c-8c5e-34480e5113d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-7dh2x"
Oct 30 20:36:22.601070 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.600731    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/be756835-3011-4186-ab61-8128121eb95b-system-cni-dir\") pod \"multus-additional-cni-plugins-n7knr\" (UID: \"be756835-3011-4186-ab61-8128121eb95b\") " pod="openshift-multus/multus-additional-cni-plugins-n7knr"
Oct 30 20:36:22.601070 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.600762    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/be756835-3011-4186-ab61-8128121eb95b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-n7knr\" (UID: \"be756835-3011-4186-ab61-8128121eb95b\") " pod="openshift-multus/multus-additional-cni-plugins-n7knr"
Oct 30 20:36:22.601070 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.600794    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/baefcab8-b5be-4143-9b55-7a86001a4363-cnibin\") pod \"multus-nmttt\" (UID: \"baefcab8-b5be-4143-9b55-7a86001a4363\") " pod="openshift-multus/multus-nmttt"
Oct 30 20:36:22.601070 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.600841    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9516abf2-c993-442c-8c5e-34480e5113d6-var-lib-openvswitch\") pod \"ovnkube-node-7dh2x\" (UID: \"9516abf2-c993-442c-8c5e-34480e5113d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-7dh2x"
Oct 30 20:36:22.601070 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.600866    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9516abf2-c993-442c-8c5e-34480e5113d6-ovn-node-metrics-cert\") pod \"ovnkube-node-7dh2x\" (UID: \"9516abf2-c993-442c-8c5e-34480e5113d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-7dh2x"
Oct 30 20:36:22.601070 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.600890    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a5b34407-cc7d-458e-aca3-cd48133834ad-etc-modprobe-d\") pod \"tuned-7cg9z\" (UID: \"a5b34407-cc7d-458e-aca3-cd48133834ad\") " pod="openshift-cluster-node-tuning-operator/tuned-7cg9z"
Oct 30 20:36:22.601070 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.600892    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/261f6884-299b-4971-b936-bbb3174f1b66-original-pull-secret\") pod \"global-pull-secret-syncer-cfdhw\" (UID: \"261f6884-299b-4971-b936-bbb3174f1b66\") " pod="kube-system/global-pull-secret-syncer-cfdhw"
Oct 30 20:36:22.601070 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.600905    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a5b34407-cc7d-458e-aca3-cd48133834ad-etc-sysconfig\") pod \"tuned-7cg9z\" (UID: \"a5b34407-cc7d-458e-aca3-cd48133834ad\") " pod="openshift-cluster-node-tuning-operator/tuned-7cg9z"
Oct 30 20:36:22.601070 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.600933    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2xx6z\" (UniqueName: \"kubernetes.io/projected/a5b34407-cc7d-458e-aca3-cd48133834ad-kube-api-access-2xx6z\") pod \"tuned-7cg9z\" (UID: \"a5b34407-cc7d-458e-aca3-cd48133834ad\") " pod="openshift-cluster-node-tuning-operator/tuned-7cg9z"
Oct 30 20:36:22.609757 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.609739    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Oct 30 20:36:22.609853 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.609763    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Oct 30 20:36:22.609853 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.609825    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Oct 30 20:36:22.610283 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.610270    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Oct 30 20:36:22.610349 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.610308    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Oct 30 20:36:22.610592 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.610577    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Oct 30 20:36:22.610664 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.610599    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Oct 30 20:36:22.610664 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.610597    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Oct 30 20:36:22.610664 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.610635    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Oct 30 20:36:22.610664 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.610659    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Oct 30 20:36:22.610907 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.610661    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Oct 30 20:36:22.610907 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.610662    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Oct 30 20:36:22.610907 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.610671    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Oct 30 20:36:22.610907 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.610692    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Oct 30 20:36:22.610907 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.610705    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Oct 30 20:36:22.610907 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.610703    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Oct 30 20:36:22.610907 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.610738    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Oct 30 20:36:22.610907 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.610781    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Oct 30 20:36:22.610907 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.610798    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Oct 30 20:36:22.610907 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.610802    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Oct 30 20:36:22.610907 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.610821    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Oct 30 20:36:22.610907 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.610830    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Oct 30 20:36:22.619298 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.619275    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/70cf9a0e-c321-438d-83a2-2034f4df9034-konnectivity-ca\") pod \"konnectivity-agent-mlgfz\" (UID: \"70cf9a0e-c321-438d-83a2-2034f4df9034\") " pod="kube-system/konnectivity-agent-mlgfz"
Oct 30 20:36:22.619298 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.619277    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/be756835-3011-4186-ab61-8128121eb95b-cni-binary-copy\") pod \"multus-additional-cni-plugins-n7knr\" (UID: \"be756835-3011-4186-ab61-8128121eb95b\") " pod="openshift-multus/multus-additional-cni-plugins-n7knr"
Oct 30 20:36:22.619424 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.619276    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/be756835-3011-4186-ab61-8128121eb95b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-n7knr\" (UID: \"be756835-3011-4186-ab61-8128121eb95b\") " pod="openshift-multus/multus-additional-cni-plugins-n7knr"
Oct 30 20:36:22.619424 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.619421    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/baefcab8-b5be-4143-9b55-7a86001a4363-cni-binary-copy\") pod \"multus-nmttt\" (UID: \"baefcab8-b5be-4143-9b55-7a86001a4363\") " pod="openshift-multus/multus-nmttt"
Oct 30 20:36:22.619541 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.619450    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/baefcab8-b5be-4143-9b55-7a86001a4363-multus-daemon-config\") pod \"multus-nmttt\" (UID: \"baefcab8-b5be-4143-9b55-7a86001a4363\") " pod="openshift-multus/multus-nmttt"
Oct 30 20:36:22.619599 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.619591    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/96b48bb2-933f-483d-8f15-5cca00c3d613-iptables-alerter-script\") pod \"iptables-alerter-cfbz6\" (UID: \"96b48bb2-933f-483d-8f15-5cca00c3d613\") " pod="openshift-network-operator/iptables-alerter-cfbz6"
Oct 30 20:36:22.619739 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.619719    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3e93e3cc-cd26-452f-9e40-31dedb0d198b-serviceca\") pod \"node-ca-5mml4\" (UID: \"3e93e3cc-cd26-452f-9e40-31dedb0d198b\") " pod="openshift-image-registry/node-ca-5mml4"
Oct 30 20:36:22.619898 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.619880    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/be756835-3011-4186-ab61-8128121eb95b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-n7knr\" (UID: \"be756835-3011-4186-ab61-8128121eb95b\") " pod="openshift-multus/multus-additional-cni-plugins-n7knr"
Oct 30 20:36:22.620317 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.620305    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9516abf2-c993-442c-8c5e-34480e5113d6-env-overrides\") pod \"ovnkube-node-7dh2x\" (UID: \"9516abf2-c993-442c-8c5e-34480e5113d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-7dh2x"
Oct 30 20:36:22.646935 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.646879    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-2mcfh\""
Oct 30 20:36:22.647060 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.647044    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Oct 30 20:36:22.647121 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.647064    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-pdv7w\""
Oct 30 20:36:22.647121 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.647075    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Oct 30 20:36:22.647121 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.647080    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-hbdn4\""
Oct 30 20:36:22.647121 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.647067    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Oct 30 20:36:22.647121 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.647094    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Oct 30 20:36:22.647295 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.647119    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-b4p7g\""
Oct 30 20:36:22.647295 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.647187    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-8v9jn\""
Oct 30 20:36:22.647295 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.647242    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-k65fh\""
Oct 30 20:36:22.647385 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.647299    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-csvtm\""
Oct 30 20:36:22.647385 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.647357    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-l8lvp\""
Oct 30 20:36:22.647450 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.647410    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-hqxsv\""
Oct 30 20:36:22.647450 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.647447    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-k4gm7\""
Oct 30 20:36:22.650402 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.650387    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/70cf9a0e-c321-438d-83a2-2034f4df9034-agent-certs\") pod \"konnectivity-agent-mlgfz\" (UID: \"70cf9a0e-c321-438d-83a2-2034f4df9034\") " pod="kube-system/konnectivity-agent-mlgfz"
Oct 30 20:36:22.651648 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.651632    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9516abf2-c993-442c-8c5e-34480e5113d6-ovn-node-metrics-cert\") pod \"ovnkube-node-7dh2x\" (UID: \"9516abf2-c993-442c-8c5e-34480e5113d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-7dh2x"
Oct 30 20:36:22.656983 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.656964    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lgp2l\" (UniqueName: \"kubernetes.io/projected/3e93e3cc-cd26-452f-9e40-31dedb0d198b-kube-api-access-lgp2l\") pod \"node-ca-5mml4\" (UID: \"3e93e3cc-cd26-452f-9e40-31dedb0d198b\") " pod="openshift-image-registry/node-ca-5mml4"
Oct 30 20:36:22.657100 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.657083    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5hzrc\" (UniqueName: \"kubernetes.io/projected/fbbb7a28-caa9-4309-8d4c-a6f1c01e2b4f-kube-api-access-5hzrc\") pod \"network-check-target-scs59\" (UID: \"fbbb7a28-caa9-4309-8d4c-a6f1c01e2b4f\") " pod="openshift-network-diagnostics/network-check-target-scs59"
Oct 30 20:36:22.657913 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.657895    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k5wmd\" (UniqueName: \"kubernetes.io/projected/96b48bb2-933f-483d-8f15-5cca00c3d613-kube-api-access-k5wmd\") pod \"iptables-alerter-cfbz6\" (UID: \"96b48bb2-933f-483d-8f15-5cca00c3d613\") " pod="openshift-network-operator/iptables-alerter-cfbz6"
Oct 30 20:36:22.658071 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.658050    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nsvqk\" (UniqueName: \"kubernetes.io/projected/1930df66-da42-4ad8-bfe0-5e92f9e07ebc-kube-api-access-nsvqk\") pod \"node-resolver-82j9v\" (UID: \"1930df66-da42-4ad8-bfe0-5e92f9e07ebc\") " pod="openshift-dns/node-resolver-82j9v"
Oct 30 20:36:22.658208 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.658192    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2mzs4\" (UniqueName: \"kubernetes.io/projected/baefcab8-b5be-4143-9b55-7a86001a4363-kube-api-access-2mzs4\") pod \"multus-nmttt\" (UID: \"baefcab8-b5be-4143-9b55-7a86001a4363\") " pod="openshift-multus/multus-nmttt"
Oct 30 20:36:22.658259 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.658209    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mpwhg\" (UniqueName: \"kubernetes.io/projected/9516abf2-c993-442c-8c5e-34480e5113d6-kube-api-access-mpwhg\") pod \"ovnkube-node-7dh2x\" (UID: \"9516abf2-c993-442c-8c5e-34480e5113d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-7dh2x"
Oct 30 20:36:22.659398 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.659383    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2xx6z\" (UniqueName: \"kubernetes.io/projected/a5b34407-cc7d-458e-aca3-cd48133834ad-kube-api-access-2xx6z\") pod \"tuned-7cg9z\" (UID: \"a5b34407-cc7d-458e-aca3-cd48133834ad\") " pod="openshift-cluster-node-tuning-operator/tuned-7cg9z"
Oct 30 20:36:22.661148 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.661131    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8rgwr\" (UniqueName: \"kubernetes.io/projected/be756835-3011-4186-ab61-8128121eb95b-kube-api-access-8rgwr\") pod \"multus-additional-cni-plugins-n7knr\" (UID: \"be756835-3011-4186-ab61-8128121eb95b\") " pod="openshift-multus/multus-additional-cni-plugins-n7knr"
Oct 30 20:36:22.661990 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.661974    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dqsnt\" (UniqueName: \"kubernetes.io/projected/d0bb5f1b-4370-4e8d-80a8-1a7bcda13cd2-kube-api-access-dqsnt\") pod \"network-metrics-daemon-f45fg\" (UID: \"d0bb5f1b-4370-4e8d-80a8-1a7bcda13cd2\") " pod="openshift-multus/network-metrics-daemon-f45fg"
Oct 30 20:36:22.662273 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.662258    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5hmjh\" (UniqueName: \"kubernetes.io/projected/6e80b983-b2c0-4923-82b0-5903424cc7b0-kube-api-access-5hmjh\") pod \"aws-ebs-csi-driver-node-gqt4f\" (UID: \"6e80b983-b2c0-4923-82b0-5903424cc7b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gqt4f"
Oct 30 20:36:22.701806 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.701771    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/baefcab8-b5be-4143-9b55-7a86001a4363-host-run-multus-certs\") pod \"multus-nmttt\" (UID: \"baefcab8-b5be-4143-9b55-7a86001a4363\") " pod="openshift-multus/multus-nmttt"
Oct 30 20:36:22.701943 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.701811    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9516abf2-c993-442c-8c5e-34480e5113d6-host-slash\") pod \"ovnkube-node-7dh2x\" (UID: \"9516abf2-c993-442c-8c5e-34480e5113d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-7dh2x"
Oct 30 20:36:22.701943 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.701838    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9516abf2-c993-442c-8c5e-34480e5113d6-host-run-netns\") pod \"ovnkube-node-7dh2x\" (UID: \"9516abf2-c993-442c-8c5e-34480e5113d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-7dh2x"
Oct 30 20:36:22.701943 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.701858    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/be756835-3011-4186-ab61-8128121eb95b-system-cni-dir\") pod \"multus-additional-cni-plugins-n7knr\" (UID: \"be756835-3011-4186-ab61-8128121eb95b\") " pod="openshift-multus/multus-additional-cni-plugins-n7knr"
Oct 30 20:36:22.701943 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.701879    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/be756835-3011-4186-ab61-8128121eb95b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-n7knr\" (UID: \"be756835-3011-4186-ab61-8128121eb95b\") " pod="openshift-multus/multus-additional-cni-plugins-n7knr"
Oct 30 20:36:22.701943 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.701894    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/baefcab8-b5be-4143-9b55-7a86001a4363-host-run-multus-certs\") pod \"multus-nmttt\" (UID: \"baefcab8-b5be-4143-9b55-7a86001a4363\") " pod="openshift-multus/multus-nmttt"
Oct 30 20:36:22.701943 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.701906    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9516abf2-c993-442c-8c5e-34480e5113d6-host-run-netns\") pod \"ovnkube-node-7dh2x\" (UID: \"9516abf2-c993-442c-8c5e-34480e5113d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-7dh2x"
Oct 30 20:36:22.701943 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.701917    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/baefcab8-b5be-4143-9b55-7a86001a4363-cnibin\") pod \"multus-nmttt\" (UID: \"baefcab8-b5be-4143-9b55-7a86001a4363\") " pod="openshift-multus/multus-nmttt"
Oct 30 20:36:22.701943 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.701942    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/be756835-3011-4186-ab61-8128121eb95b-system-cni-dir\") pod \"multus-additional-cni-plugins-n7knr\" (UID: \"be756835-3011-4186-ab61-8128121eb95b\") " pod="openshift-multus/multus-additional-cni-plugins-n7knr"
Oct 30 20:36:22.702330 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.701894    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9516abf2-c993-442c-8c5e-34480e5113d6-host-slash\") pod \"ovnkube-node-7dh2x\" (UID: \"9516abf2-c993-442c-8c5e-34480e5113d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-7dh2x"
Oct 30 20:36:22.702330 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.701964    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/be756835-3011-4186-ab61-8128121eb95b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-n7knr\" (UID: \"be756835-3011-4186-ab61-8128121eb95b\") " pod="openshift-multus/multus-additional-cni-plugins-n7knr"
Oct 30 20:36:22.702330 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.701966    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9516abf2-c993-442c-8c5e-34480e5113d6-var-lib-openvswitch\") pod \"ovnkube-node-7dh2x\" (UID: \"9516abf2-c993-442c-8c5e-34480e5113d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-7dh2x"
Oct 30 20:36:22.702330 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.701996    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a5b34407-cc7d-458e-aca3-cd48133834ad-etc-modprobe-d\") pod \"tuned-7cg9z\" (UID: \"a5b34407-cc7d-458e-aca3-cd48133834ad\") " pod="openshift-cluster-node-tuning-operator/tuned-7cg9z"
Oct 30 20:36:22.702330 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.701991    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9516abf2-c993-442c-8c5e-34480e5113d6-var-lib-openvswitch\") pod \"ovnkube-node-7dh2x\" (UID: \"9516abf2-c993-442c-8c5e-34480e5113d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-7dh2x"
Oct 30 20:36:22.702330 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.702011    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a5b34407-cc7d-458e-aca3-cd48133834ad-etc-sysconfig\") pod \"tuned-7cg9z\" (UID: \"a5b34407-cc7d-458e-aca3-cd48133834ad\") " pod="openshift-cluster-node-tuning-operator/tuned-7cg9z"
Oct 30 20:36:22.702330 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.701968    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/baefcab8-b5be-4143-9b55-7a86001a4363-cnibin\") pod \"multus-nmttt\" (UID: \"baefcab8-b5be-4143-9b55-7a86001a4363\") " pod="openshift-multus/multus-nmttt"
Oct 30 20:36:22.702330 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.702065    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a5b34407-cc7d-458e-aca3-cd48133834ad-etc-sysconfig\") pod \"tuned-7cg9z\" (UID: \"a5b34407-cc7d-458e-aca3-cd48133834ad\") " pod="openshift-cluster-node-tuning-operator/tuned-7cg9z"
Oct 30 20:36:22.702330 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.702095    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/baefcab8-b5be-4143-9b55-7a86001a4363-host-run-netns\") pod \"multus-nmttt\" (UID: \"baefcab8-b5be-4143-9b55-7a86001a4363\") " pod="openshift-multus/multus-nmttt"
Oct 30 20:36:22.702330 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.702165    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6e80b983-b2c0-4923-82b0-5903424cc7b0-registration-dir\") pod \"aws-ebs-csi-driver-node-gqt4f\" (UID: \"6e80b983-b2c0-4923-82b0-5903424cc7b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gqt4f"
Oct 30 20:36:22.702330 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.702178    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/baefcab8-b5be-4143-9b55-7a86001a4363-host-run-netns\") pod \"multus-nmttt\" (UID: \"baefcab8-b5be-4143-9b55-7a86001a4363\") " pod="openshift-multus/multus-nmttt"
Oct 30 20:36:22.702330 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.702205    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a5b34407-cc7d-458e-aca3-cd48133834ad-etc-modprobe-d\") pod \"tuned-7cg9z\" (UID: \"a5b34407-cc7d-458e-aca3-cd48133834ad\") " pod="openshift-cluster-node-tuning-operator/tuned-7cg9z"
Oct 30 20:36:22.702330 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.702241    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6e80b983-b2c0-4923-82b0-5903424cc7b0-device-dir\") pod \"aws-ebs-csi-driver-node-gqt4f\" (UID: \"6e80b983-b2c0-4923-82b0-5903424cc7b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gqt4f"
Oct 30 20:36:22.702330 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.702252    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6e80b983-b2c0-4923-82b0-5903424cc7b0-registration-dir\") pod \"aws-ebs-csi-driver-node-gqt4f\" (UID: \"6e80b983-b2c0-4923-82b0-5903424cc7b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gqt4f"
Oct 30 20:36:22.702330 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.702293    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6e80b983-b2c0-4923-82b0-5903424cc7b0-device-dir\") pod \"aws-ebs-csi-driver-node-gqt4f\" (UID: \"6e80b983-b2c0-4923-82b0-5903424cc7b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gqt4f"
Oct 30 20:36:22.702330 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.702297    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a5b34407-cc7d-458e-aca3-cd48133834ad-etc-sysctl-d\") pod \"tuned-7cg9z\" (UID: \"a5b34407-cc7d-458e-aca3-cd48133834ad\") " pod="openshift-cluster-node-tuning-operator/tuned-7cg9z"
Oct 30 20:36:22.702330 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.702315    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9516abf2-c993-442c-8c5e-34480e5113d6-etc-openvswitch\") pod \"ovnkube-node-7dh2x\" (UID: \"9516abf2-c993-442c-8c5e-34480e5113d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-7dh2x"
Oct 30 20:36:22.702330 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.702330    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9516abf2-c993-442c-8c5e-34480e5113d6-host-cni-bin\") pod \"ovnkube-node-7dh2x\" (UID: \"9516abf2-c993-442c-8c5e-34480e5113d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-7dh2x"
Oct 30 20:36:22.702970 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.702347    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9516abf2-c993-442c-8c5e-34480e5113d6-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7dh2x\" (UID: \"9516abf2-c993-442c-8c5e-34480e5113d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-7dh2x"
Oct 30 20:36:22.702970 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.702365    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/96b48bb2-933f-483d-8f15-5cca00c3d613-host-slash\") pod \"iptables-alerter-cfbz6\" (UID: \"96b48bb2-933f-483d-8f15-5cca00c3d613\") " pod="openshift-network-operator/iptables-alerter-cfbz6"
Oct 30 20:36:22.702970 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.702378    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a5b34407-cc7d-458e-aca3-cd48133834ad-etc-kubernetes\") pod \"tuned-7cg9z\" (UID: \"a5b34407-cc7d-458e-aca3-cd48133834ad\") " pod="openshift-cluster-node-tuning-operator/tuned-7cg9z"
Oct 30 20:36:22.702970 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.702395    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a5b34407-cc7d-458e-aca3-cd48133834ad-sys\") pod \"tuned-7cg9z\" (UID: \"a5b34407-cc7d-458e-aca3-cd48133834ad\") " pod="openshift-cluster-node-tuning-operator/tuned-7cg9z"
Oct 30 20:36:22.702970 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.702408    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/baefcab8-b5be-4143-9b55-7a86001a4363-multus-cni-dir\") pod \"multus-nmttt\" (UID: \"baefcab8-b5be-4143-9b55-7a86001a4363\") " pod="openshift-multus/multus-nmttt"
Oct 30 20:36:22.702970 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.702407    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9516abf2-c993-442c-8c5e-34480e5113d6-etc-openvswitch\") pod \"ovnkube-node-7dh2x\" (UID: \"9516abf2-c993-442c-8c5e-34480e5113d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-7dh2x"
Oct 30 20:36:22.702970 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.702378    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a5b34407-cc7d-458e-aca3-cd48133834ad-etc-sysctl-d\") pod \"tuned-7cg9z\" (UID: \"a5b34407-cc7d-458e-aca3-cd48133834ad\") " pod="openshift-cluster-node-tuning-operator/tuned-7cg9z"
Oct 30 20:36:22.702970 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.702416    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/96b48bb2-933f-483d-8f15-5cca00c3d613-host-slash\") pod \"iptables-alerter-cfbz6\" (UID: \"96b48bb2-933f-483d-8f15-5cca00c3d613\") " pod="openshift-network-operator/iptables-alerter-cfbz6"
Oct 30 20:36:22.702970 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.702412    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9516abf2-c993-442c-8c5e-34480e5113d6-host-cni-bin\") pod \"ovnkube-node-7dh2x\" (UID: \"9516abf2-c993-442c-8c5e-34480e5113d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-7dh2x"
Oct 30 20:36:22.702970 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.702427    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3e93e3cc-cd26-452f-9e40-31dedb0d198b-host\") pod \"node-ca-5mml4\" (UID: \"3e93e3cc-cd26-452f-9e40-31dedb0d198b\") " pod="openshift-image-registry/node-ca-5mml4"
Oct 30 20:36:22.702970 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.702431    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9516abf2-c993-442c-8c5e-34480e5113d6-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7dh2x\" (UID: \"9516abf2-c993-442c-8c5e-34480e5113d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-7dh2x"
Oct 30 20:36:22.702970 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.702453    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9516abf2-c993-442c-8c5e-34480e5113d6-log-socket\") pod \"ovnkube-node-7dh2x\" (UID: \"9516abf2-c993-442c-8c5e-34480e5113d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-7dh2x"
Oct 30 20:36:22.702970 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.702456    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a5b34407-cc7d-458e-aca3-cd48133834ad-sys\") pod \"tuned-7cg9z\" (UID: \"a5b34407-cc7d-458e-aca3-cd48133834ad\") " pod="openshift-cluster-node-tuning-operator/tuned-7cg9z"
Oct 30 20:36:22.702970 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.702465    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/baefcab8-b5be-4143-9b55-7a86001a4363-multus-cni-dir\") pod \"multus-nmttt\" (UID: \"baefcab8-b5be-4143-9b55-7a86001a4363\") " pod="openshift-multus/multus-nmttt"
Oct 30 20:36:22.702970 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.702466    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3e93e3cc-cd26-452f-9e40-31dedb0d198b-host\") pod \"node-ca-5mml4\" (UID: \"3e93e3cc-cd26-452f-9e40-31dedb0d198b\") " pod="openshift-image-registry/node-ca-5mml4"
Oct 30 20:36:22.702970 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.702468    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9516abf2-c993-442c-8c5e-34480e5113d6-host-run-ovn-kubernetes\") pod \"ovnkube-node-7dh2x\" (UID: \"9516abf2-c993-442c-8c5e-34480e5113d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-7dh2x"
Oct 30 20:36:22.702970 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.702477    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a5b34407-cc7d-458e-aca3-cd48133834ad-etc-kubernetes\") pod \"tuned-7cg9z\" (UID: \"a5b34407-cc7d-458e-aca3-cd48133834ad\") " pod="openshift-cluster-node-tuning-operator/tuned-7cg9z"
Oct 30 20:36:22.702970 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.702513    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9516abf2-c993-442c-8c5e-34480e5113d6-host-run-ovn-kubernetes\") pod \"ovnkube-node-7dh2x\" (UID: \"9516abf2-c993-442c-8c5e-34480e5113d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-7dh2x"
Oct 30 20:36:22.702970 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.702514    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9516abf2-c993-442c-8c5e-34480e5113d6-log-socket\") pod \"ovnkube-node-7dh2x\" (UID: \"9516abf2-c993-442c-8c5e-34480e5113d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-7dh2x"
Oct 30 20:36:22.702970 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.702519    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9516abf2-c993-442c-8c5e-34480e5113d6-node-log\") pod \"ovnkube-node-7dh2x\" (UID: \"9516abf2-c993-442c-8c5e-34480e5113d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-7dh2x"
Oct 30 20:36:22.702970 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.702544    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9516abf2-c993-442c-8c5e-34480e5113d6-node-log\") pod \"ovnkube-node-7dh2x\" (UID: \"9516abf2-c993-442c-8c5e-34480e5113d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-7dh2x"
Oct 30 20:36:22.702970 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.702559    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a5b34407-cc7d-458e-aca3-cd48133834ad-etc-systemd\") pod \"tuned-7cg9z\" (UID: \"a5b34407-cc7d-458e-aca3-cd48133834ad\") " pod="openshift-cluster-node-tuning-operator/tuned-7cg9z"
Oct 30 20:36:22.702970 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.702575    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a5b34407-cc7d-458e-aca3-cd48133834ad-run\") pod \"tuned-7cg9z\" (UID: \"a5b34407-cc7d-458e-aca3-cd48133834ad\") " pod="openshift-cluster-node-tuning-operator/tuned-7cg9z"
Oct 30 20:36:22.702970 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.702589    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6e80b983-b2c0-4923-82b0-5903424cc7b0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gqt4f\" (UID: \"6e80b983-b2c0-4923-82b0-5903424cc7b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gqt4f"
Oct 30 20:36:22.702970 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.702604    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/baefcab8-b5be-4143-9b55-7a86001a4363-host-run-k8s-cni-cncf-io\") pod \"multus-nmttt\" (UID: \"baefcab8-b5be-4143-9b55-7a86001a4363\") " pod="openshift-multus/multus-nmttt"
Oct 30 20:36:22.702970 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.702617    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/baefcab8-b5be-4143-9b55-7a86001a4363-host-var-lib-cni-bin\") pod \"multus-nmttt\" (UID: \"baefcab8-b5be-4143-9b55-7a86001a4363\") " pod="openshift-multus/multus-nmttt"
Oct 30 20:36:22.702970 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.702625    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a5b34407-cc7d-458e-aca3-cd48133834ad-run\") pod \"tuned-7cg9z\" (UID: \"a5b34407-cc7d-458e-aca3-cd48133834ad\") " pod="openshift-cluster-node-tuning-operator/tuned-7cg9z"
Oct 30 20:36:22.702970 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.702654    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/baefcab8-b5be-4143-9b55-7a86001a4363-hostroot\") pod \"multus-nmttt\" (UID: \"baefcab8-b5be-4143-9b55-7a86001a4363\") " pod="openshift-multus/multus-nmttt"
Oct 30 20:36:22.702970 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.702600    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a5b34407-cc7d-458e-aca3-cd48133834ad-etc-systemd\") pod \"tuned-7cg9z\" (UID: \"a5b34407-cc7d-458e-aca3-cd48133834ad\") " pod="openshift-cluster-node-tuning-operator/tuned-7cg9z"
Oct 30 20:36:22.702970 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.702632    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/baefcab8-b5be-4143-9b55-7a86001a4363-hostroot\") pod \"multus-nmttt\" (UID: \"baefcab8-b5be-4143-9b55-7a86001a4363\") " pod="openshift-multus/multus-nmttt"
Oct 30 20:36:22.702970 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.702669    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/baefcab8-b5be-4143-9b55-7a86001a4363-host-var-lib-cni-bin\") pod \"multus-nmttt\" (UID: \"baefcab8-b5be-4143-9b55-7a86001a4363\") " pod="openshift-multus/multus-nmttt"
Oct 30 20:36:22.702970 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.702629    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6e80b983-b2c0-4923-82b0-5903424cc7b0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gqt4f\" (UID: \"6e80b983-b2c0-4923-82b0-5903424cc7b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gqt4f"
Oct 30 20:36:22.702970 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.702686    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/baefcab8-b5be-4143-9b55-7a86001a4363-host-run-k8s-cni-cncf-io\") pod \"multus-nmttt\" (UID: \"baefcab8-b5be-4143-9b55-7a86001a4363\") " pod="openshift-multus/multus-nmttt"
Oct 30 20:36:22.702970 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.702683    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6e80b983-b2c0-4923-82b0-5903424cc7b0-etc-selinux\") pod \"aws-ebs-csi-driver-node-gqt4f\" (UID: \"6e80b983-b2c0-4923-82b0-5903424cc7b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gqt4f"
Oct 30 20:36:22.702970 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.702709    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6e80b983-b2c0-4923-82b0-5903424cc7b0-etc-selinux\") pod \"aws-ebs-csi-driver-node-gqt4f\" (UID: \"6e80b983-b2c0-4923-82b0-5903424cc7b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gqt4f"
Oct 30 20:36:22.702970 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.702721    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/baefcab8-b5be-4143-9b55-7a86001a4363-multus-socket-dir-parent\") pod \"multus-nmttt\" (UID: \"baefcab8-b5be-4143-9b55-7a86001a4363\") " pod="openshift-multus/multus-nmttt"
Oct 30 20:36:22.702970 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.702737    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/261f6884-299b-4971-b936-bbb3174f1b66-dbus\") pod \"global-pull-secret-syncer-cfdhw\" (UID: \"261f6884-299b-4971-b936-bbb3174f1b66\") " pod="kube-system/global-pull-secret-syncer-cfdhw"
Oct 30 20:36:22.702970 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.702750    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9516abf2-c993-442c-8c5e-34480e5113d6-systemd-units\") pod \"ovnkube-node-7dh2x\" (UID: \"9516abf2-c993-442c-8c5e-34480e5113d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-7dh2x"
Oct 30 20:36:22.702970 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.702765    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1930df66-da42-4ad8-bfe0-5e92f9e07ebc-hosts-file\") pod \"node-resolver-82j9v\" (UID: \"1930df66-da42-4ad8-bfe0-5e92f9e07ebc\") " pod="openshift-dns/node-resolver-82j9v"
Oct 30 20:36:22.702970 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.702780    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/be756835-3011-4186-ab61-8128121eb95b-cnibin\") pod \"multus-additional-cni-plugins-n7knr\" (UID: \"be756835-3011-4186-ab61-8128121eb95b\") " pod="openshift-multus/multus-additional-cni-plugins-n7knr"
Oct 30 20:36:22.702970 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.702788    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/261f6884-299b-4971-b936-bbb3174f1b66-dbus\") pod \"global-pull-secret-syncer-cfdhw\" (UID: \"261f6884-299b-4971-b936-bbb3174f1b66\") " pod="kube-system/global-pull-secret-syncer-cfdhw"
Oct 30 20:36:22.702970 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.702797    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9516abf2-c993-442c-8c5e-34480e5113d6-systemd-units\") pod \"ovnkube-node-7dh2x\" (UID: \"9516abf2-c993-442c-8c5e-34480e5113d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-7dh2x"
Oct 30 20:36:22.702970 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.702801    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6e80b983-b2c0-4923-82b0-5903424cc7b0-socket-dir\") pod \"aws-ebs-csi-driver-node-gqt4f\" (UID: \"6e80b983-b2c0-4923-82b0-5903424cc7b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gqt4f"
Oct 30 20:36:22.702970 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.702825    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/baefcab8-b5be-4143-9b55-7a86001a4363-multus-socket-dir-parent\") pod \"multus-nmttt\" (UID: \"baefcab8-b5be-4143-9b55-7a86001a4363\") " pod="openshift-multus/multus-nmttt"
Oct 30 20:36:22.702970 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.702825    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9516abf2-c993-442c-8c5e-34480e5113d6-host-kubelet\") pod \"ovnkube-node-7dh2x\" (UID: \"9516abf2-c993-442c-8c5e-34480e5113d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-7dh2x"
Oct 30 20:36:22.702970 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.702830    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1930df66-da42-4ad8-bfe0-5e92f9e07ebc-hosts-file\") pod \"node-resolver-82j9v\" (UID: \"1930df66-da42-4ad8-bfe0-5e92f9e07ebc\") " pod="openshift-dns/node-resolver-82j9v"
Oct 30 20:36:22.702970 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.702842    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/be756835-3011-4186-ab61-8128121eb95b-cnibin\") pod \"multus-additional-cni-plugins-n7knr\" (UID: \"be756835-3011-4186-ab61-8128121eb95b\") " pod="openshift-multus/multus-additional-cni-plugins-n7knr"
Oct 30 20:36:22.702970 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.702870    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6e80b983-b2c0-4923-82b0-5903424cc7b0-socket-dir\") pod \"aws-ebs-csi-driver-node-gqt4f\" (UID: \"6e80b983-b2c0-4923-82b0-5903424cc7b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gqt4f"
Oct 30 20:36:22.702970 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.702871    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9516abf2-c993-442c-8c5e-34480e5113d6-host-kubelet\") pod \"ovnkube-node-7dh2x\" (UID: \"9516abf2-c993-442c-8c5e-34480e5113d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-7dh2x"
Oct 30 20:36:22.702970 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.702893    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9516abf2-c993-442c-8c5e-34480e5113d6-run-systemd\") pod \"ovnkube-node-7dh2x\" (UID: \"9516abf2-c993-442c-8c5e-34480e5113d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-7dh2x"
Oct 30 20:36:22.702970 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.702911    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/baefcab8-b5be-4143-9b55-7a86001a4363-host-var-lib-cni-multus\") pod \"multus-nmttt\" (UID: \"baefcab8-b5be-4143-9b55-7a86001a4363\") " pod="openshift-multus/multus-nmttt"
Oct 30 20:36:22.702970 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.702928    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/baefcab8-b5be-4143-9b55-7a86001a4363-host-var-lib-kubelet\") pod \"multus-nmttt\" (UID: \"baefcab8-b5be-4143-9b55-7a86001a4363\") " pod="openshift-multus/multus-nmttt"
Oct 30 20:36:22.702970 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.702941    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9516abf2-c993-442c-8c5e-34480e5113d6-run-systemd\") pod \"ovnkube-node-7dh2x\" (UID: \"9516abf2-c993-442c-8c5e-34480e5113d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-7dh2x"
Oct 30 20:36:22.702970 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.702953    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/baefcab8-b5be-4143-9b55-7a86001a4363-multus-conf-dir\") pod \"multus-nmttt\" (UID: \"baefcab8-b5be-4143-9b55-7a86001a4363\") " pod="openshift-multus/multus-nmttt"
Oct 30 20:36:22.702970 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.702966    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/baefcab8-b5be-4143-9b55-7a86001a4363-host-var-lib-kubelet\") pod \"multus-nmttt\" (UID: \"baefcab8-b5be-4143-9b55-7a86001a4363\") " pod="openshift-multus/multus-nmttt"
Oct 30 20:36:22.702970 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.702978    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6e80b983-b2c0-4923-82b0-5903424cc7b0-sys-fs\") pod \"aws-ebs-csi-driver-node-gqt4f\" (UID: \"6e80b983-b2c0-4923-82b0-5903424cc7b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gqt4f"
Oct 30 20:36:22.702970 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.703002    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a5b34407-cc7d-458e-aca3-cd48133834ad-etc-sysctl-conf\") pod \"tuned-7cg9z\" (UID: \"a5b34407-cc7d-458e-aca3-cd48133834ad\") " pod="openshift-cluster-node-tuning-operator/tuned-7cg9z"
Oct 30 20:36:22.704560 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.703024    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/baefcab8-b5be-4143-9b55-7a86001a4363-multus-conf-dir\") pod \"multus-nmttt\" (UID: \"baefcab8-b5be-4143-9b55-7a86001a4363\") " pod="openshift-multus/multus-nmttt"
Oct 30 20:36:22.704560 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.703028    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d0bb5f1b-4370-4e8d-80a8-1a7bcda13cd2-metrics-certs\") pod \"network-metrics-daemon-f45fg\" (UID: \"d0bb5f1b-4370-4e8d-80a8-1a7bcda13cd2\") " pod="openshift-multus/network-metrics-daemon-f45fg"
Oct 30 20:36:22.704560 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.703045    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6e80b983-b2c0-4923-82b0-5903424cc7b0-sys-fs\") pod \"aws-ebs-csi-driver-node-gqt4f\" (UID: \"6e80b983-b2c0-4923-82b0-5903424cc7b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gqt4f"
Oct 30 20:36:22.704560 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.703002    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/baefcab8-b5be-4143-9b55-7a86001a4363-host-var-lib-cni-multus\") pod \"multus-nmttt\" (UID: \"baefcab8-b5be-4143-9b55-7a86001a4363\") " pod="openshift-multus/multus-nmttt"
Oct 30 20:36:22.704560 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.703056    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a5b34407-cc7d-458e-aca3-cd48133834ad-lib-modules\") pod \"tuned-7cg9z\" (UID: \"a5b34407-cc7d-458e-aca3-cd48133834ad\") " pod="openshift-cluster-node-tuning-operator/tuned-7cg9z"
Oct 30 20:36:22.704560 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.703078    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a5b34407-cc7d-458e-aca3-cd48133834ad-var-lib-kubelet\") pod \"tuned-7cg9z\" (UID: \"a5b34407-cc7d-458e-aca3-cd48133834ad\") " pod="openshift-cluster-node-tuning-operator/tuned-7cg9z"
Oct 30 20:36:22.704560 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.703093    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/baefcab8-b5be-4143-9b55-7a86001a4363-system-cni-dir\") pod \"multus-nmttt\" (UID: \"baefcab8-b5be-4143-9b55-7a86001a4363\") " pod="openshift-multus/multus-nmttt"
Oct 30 20:36:22.704560 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.703105    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a5b34407-cc7d-458e-aca3-cd48133834ad-etc-sysctl-conf\") pod \"tuned-7cg9z\" (UID: \"a5b34407-cc7d-458e-aca3-cd48133834ad\") " pod="openshift-cluster-node-tuning-operator/tuned-7cg9z"
Oct 30 20:36:22.704560 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.703106    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/baefcab8-b5be-4143-9b55-7a86001a4363-etc-kubernetes\") pod \"multus-nmttt\" (UID: \"baefcab8-b5be-4143-9b55-7a86001a4363\") " pod="openshift-multus/multus-nmttt"
Oct 30 20:36:22.704560 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.703131    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/baefcab8-b5be-4143-9b55-7a86001a4363-etc-kubernetes\") pod \"multus-nmttt\" (UID: \"baefcab8-b5be-4143-9b55-7a86001a4363\") " pod="openshift-multus/multus-nmttt"
Oct 30 20:36:22.704560 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.703139    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/261f6884-299b-4971-b936-bbb3174f1b66-kubelet-config\") pod \"global-pull-secret-syncer-cfdhw\" (UID: \"261f6884-299b-4971-b936-bbb3174f1b66\") " pod="kube-system/global-pull-secret-syncer-cfdhw"
Oct 30 20:36:22.704560 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.703144    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a5b34407-cc7d-458e-aca3-cd48133834ad-var-lib-kubelet\") pod \"tuned-7cg9z\" (UID: \"a5b34407-cc7d-458e-aca3-cd48133834ad\") " pod="openshift-cluster-node-tuning-operator/tuned-7cg9z"
Oct 30 20:36:22.704560 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.703165    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9516abf2-c993-442c-8c5e-34480e5113d6-run-openvswitch\") pod \"ovnkube-node-7dh2x\" (UID: \"9516abf2-c993-442c-8c5e-34480e5113d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-7dh2x"
Oct 30 20:36:22.704560 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.703175    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/261f6884-299b-4971-b936-bbb3174f1b66-kubelet-config\") pod \"global-pull-secret-syncer-cfdhw\" (UID: \"261f6884-299b-4971-b936-bbb3174f1b66\") " pod="kube-system/global-pull-secret-syncer-cfdhw"
Oct 30 20:36:22.704560 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.703183    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a5b34407-cc7d-458e-aca3-cd48133834ad-lib-modules\") pod \"tuned-7cg9z\" (UID: \"a5b34407-cc7d-458e-aca3-cd48133834ad\") " pod="openshift-cluster-node-tuning-operator/tuned-7cg9z"
Oct 30 20:36:22.704560 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.703189    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9516abf2-c993-442c-8c5e-34480e5113d6-run-ovn\") pod \"ovnkube-node-7dh2x\" (UID: \"9516abf2-c993-442c-8c5e-34480e5113d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-7dh2x"
Oct 30 20:36:22.704560 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.703192    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9516abf2-c993-442c-8c5e-34480e5113d6-run-openvswitch\") pod \"ovnkube-node-7dh2x\" (UID: \"9516abf2-c993-442c-8c5e-34480e5113d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-7dh2x"
Oct 30 20:36:22.704560 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.703166    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/baefcab8-b5be-4143-9b55-7a86001a4363-system-cni-dir\") pod \"multus-nmttt\" (UID: \"baefcab8-b5be-4143-9b55-7a86001a4363\") " pod="openshift-multus/multus-nmttt"
Oct 30 20:36:22.704560 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.703217    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9516abf2-c993-442c-8c5e-34480e5113d6-host-cni-netd\") pod \"ovnkube-node-7dh2x\" (UID: \"9516abf2-c993-442c-8c5e-34480e5113d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-7dh2x"
Oct 30 20:36:22.704560 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.703239    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a5b34407-cc7d-458e-aca3-cd48133834ad-host\") pod \"tuned-7cg9z\" (UID: \"a5b34407-cc7d-458e-aca3-cd48133834ad\") " pod="openshift-cluster-node-tuning-operator/tuned-7cg9z"
Oct 30 20:36:22.704560 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.703221    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9516abf2-c993-442c-8c5e-34480e5113d6-run-ovn\") pod \"ovnkube-node-7dh2x\" (UID: \"9516abf2-c993-442c-8c5e-34480e5113d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-7dh2x"
Oct 30 20:36:22.704560 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.703258    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9516abf2-c993-442c-8c5e-34480e5113d6-host-cni-netd\") pod \"ovnkube-node-7dh2x\" (UID: \"9516abf2-c993-442c-8c5e-34480e5113d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-7dh2x"
Oct 30 20:36:22.704560 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.703278    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a5b34407-cc7d-458e-aca3-cd48133834ad-host\") pod \"tuned-7cg9z\" (UID: \"a5b34407-cc7d-458e-aca3-cd48133834ad\") " pod="openshift-cluster-node-tuning-operator/tuned-7cg9z"
Oct 30 20:36:22.704560 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.703330    4060 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Oct 30 20:36:22.705589 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.705575    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d0bb5f1b-4370-4e8d-80a8-1a7bcda13cd2-metrics-certs\") pod \"network-metrics-daemon-f45fg\" (UID: \"d0bb5f1b-4370-4e8d-80a8-1a7bcda13cd2\") " pod="openshift-multus/network-metrics-daemon-f45fg"
Oct 30 20:36:22.796050 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:22.796022    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f45fg"
Oct 30 20:36:23.228444 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:23.228262    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-f45fg"]
Oct 30 20:36:23.232522 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:23.232464    4060 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0bb5f1b_4370_4e8d_80a8_1a7bcda13cd2.slice/crio-77a6294ba5c1057f55acfc625cd8376a97f28d65c69b6ca826775bf2c79c1868 WatchSource:0}: Error finding container 77a6294ba5c1057f55acfc625cd8376a97f28d65c69b6ca826775bf2c79c1868: Status 404 returned error can't find the container with id 77a6294ba5c1057f55acfc625cd8376a97f28d65c69b6ca826775bf2c79c1868
Oct 30 20:36:23.234655 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:23.234627    4060 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 20:36:23.454596 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:23.454556    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-f45fg" event={"ID":"d0bb5f1b-4370-4e8d-80a8-1a7bcda13cd2","Type":"ContainerStarted","Data":"77a6294ba5c1057f55acfc625cd8376a97f28d65c69b6ca826775bf2c79c1868"}
Oct 30 20:36:23.704738 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:23.704710    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7dh2x"
Oct 30 20:36:25.460569 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:25.460379    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-f45fg" event={"ID":"d0bb5f1b-4370-4e8d-80a8-1a7bcda13cd2","Type":"ContainerStarted","Data":"24e10b046c8deba908b9fed33f493f1ebdc94563f84935e8f531a65e0f96ca2a"}
Oct 30 20:36:25.461015 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:25.460582    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-f45fg" event={"ID":"d0bb5f1b-4370-4e8d-80a8-1a7bcda13cd2","Type":"ContainerStarted","Data":"3e5c5113f61b9b441a7e113aa29bb5b9b392a210e8b44f79684e03e7c64822dc"}
Oct 30 20:36:28.034782 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:28.034757    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7dh2x"
Oct 30 20:36:28.035139 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:28.034944    4060 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Oct 30 20:36:28.702546 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:28.702514    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7dh2x"
Oct 30 20:36:29.408257 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:29.408222    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-scs59"
Oct 30 20:36:32.035614 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:32.035585    4060 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-4.us-west-1.compute.internal" event="NodeReady"
Oct 30 20:36:33.862890 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:33.862860    4060 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console/console-5dddfcd9fc-ltgv9"]
Oct 30 20:36:33.864555 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:33.864538    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5dddfcd9fc-ltgv9"
Oct 30 20:36:33.876873 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:33.876854    4060 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-6dd789c8b7-7dvr6"]
Oct 30 20:36:33.878288 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:33.878274    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6dd789c8b7-7dvr6"
Oct 30 20:36:33.934911 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:33.934875    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Oct 30 20:36:33.934911 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:33.934883    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Oct 30 20:36:33.935078 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:33.934912    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Oct 30 20:36:33.935115 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:33.935078    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Oct 30 20:36:33.935356 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:33.935339    4060 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-v2f4x"]
Oct 30 20:36:33.937143 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:33.937129    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-v2f4x"
Oct 30 20:36:33.937697 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:33.937677    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Oct 30 20:36:33.937697 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:33.937686    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-ckz4s\""
Oct 30 20:36:33.937864 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:33.937740    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Oct 30 20:36:33.965846 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:33.965809    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9f9d9f58-7252-4b1b-96ac-3a8b77b7f038-console-oauth-config\") pod \"console-5dddfcd9fc-ltgv9\" (UID: \"9f9d9f58-7252-4b1b-96ac-3a8b77b7f038\") " pod="openshift-console/console-5dddfcd9fc-ltgv9"
Oct 30 20:36:33.965986 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:33.965851    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/fdfc3958-0d1c-4781-86f0-c10d37abdc05-data-volume\") pod \"insights-runtime-extractor-v2f4x\" (UID: \"fdfc3958-0d1c-4781-86f0-c10d37abdc05\") " pod="openshift-insights/insights-runtime-extractor-v2f4x"
Oct 30 20:36:33.965986 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:33.965956    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/fdfc3958-0d1c-4781-86f0-c10d37abdc05-crio-socket\") pod \"insights-runtime-extractor-v2f4x\" (UID: \"fdfc3958-0d1c-4781-86f0-c10d37abdc05\") " pod="openshift-insights/insights-runtime-extractor-v2f4x"
Oct 30 20:36:33.966113 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:33.966001    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jwqg6\" (UniqueName: \"kubernetes.io/projected/000a7a62-eca7-42cb-8e5f-829c1d37485d-kube-api-access-jwqg6\") pod \"downloads-6dd789c8b7-7dvr6\" (UID: \"000a7a62-eca7-42cb-8e5f-829c1d37485d\") " pod="openshift-console/downloads-6dd789c8b7-7dvr6"
Oct 30 20:36:33.966113 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:33.966025    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9f9d9f58-7252-4b1b-96ac-3a8b77b7f038-console-serving-cert\") pod \"console-5dddfcd9fc-ltgv9\" (UID: \"9f9d9f58-7252-4b1b-96ac-3a8b77b7f038\") " pod="openshift-console/console-5dddfcd9fc-ltgv9"
Oct 30 20:36:33.966113 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:33.966049    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9f9d9f58-7252-4b1b-96ac-3a8b77b7f038-console-config\") pod \"console-5dddfcd9fc-ltgv9\" (UID: \"9f9d9f58-7252-4b1b-96ac-3a8b77b7f038\") " pod="openshift-console/console-5dddfcd9fc-ltgv9"
Oct 30 20:36:33.966113 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:33.966075    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lgmj6\" (UniqueName: \"kubernetes.io/projected/9f9d9f58-7252-4b1b-96ac-3a8b77b7f038-kube-api-access-lgmj6\") pod \"console-5dddfcd9fc-ltgv9\" (UID: \"9f9d9f58-7252-4b1b-96ac-3a8b77b7f038\") " pod="openshift-console/console-5dddfcd9fc-ltgv9"
Oct 30 20:36:33.966113 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:33.966100    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fdfc3958-0d1c-4781-86f0-c10d37abdc05-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-v2f4x\" (UID: \"fdfc3958-0d1c-4781-86f0-c10d37abdc05\") " pod="openshift-insights/insights-runtime-extractor-v2f4x"
Oct 30 20:36:33.966347 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:33.966155    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fdfc3958-0d1c-4781-86f0-c10d37abdc05-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-v2f4x\" (UID: \"fdfc3958-0d1c-4781-86f0-c10d37abdc05\") " pod="openshift-insights/insights-runtime-extractor-v2f4x"
Oct 30 20:36:33.966347 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:33.966204    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/000a7a62-eca7-42cb-8e5f-829c1d37485d-tmp\") pod \"downloads-6dd789c8b7-7dvr6\" (UID: \"000a7a62-eca7-42cb-8e5f-829c1d37485d\") " pod="openshift-console/downloads-6dd789c8b7-7dvr6"
Oct 30 20:36:33.966347 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:33.966240    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9f9d9f58-7252-4b1b-96ac-3a8b77b7f038-service-ca\") pod \"console-5dddfcd9fc-ltgv9\" (UID: \"9f9d9f58-7252-4b1b-96ac-3a8b77b7f038\") " pod="openshift-console/console-5dddfcd9fc-ltgv9"
Oct 30 20:36:33.966347 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:33.966263    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9f9d9f58-7252-4b1b-96ac-3a8b77b7f038-tmp\") pod \"console-5dddfcd9fc-ltgv9\" (UID: \"9f9d9f58-7252-4b1b-96ac-3a8b77b7f038\") " pod="openshift-console/console-5dddfcd9fc-ltgv9"
Oct 30 20:36:33.966347 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:33.966289    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9f9d9f58-7252-4b1b-96ac-3a8b77b7f038-oauth-serving-cert\") pod \"console-5dddfcd9fc-ltgv9\" (UID: \"9f9d9f58-7252-4b1b-96ac-3a8b77b7f038\") " pod="openshift-console/console-5dddfcd9fc-ltgv9"
Oct 30 20:36:33.966347 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:33.966313    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wrz9r\" (UniqueName: \"kubernetes.io/projected/fdfc3958-0d1c-4781-86f0-c10d37abdc05-kube-api-access-wrz9r\") pod \"insights-runtime-extractor-v2f4x\" (UID: \"fdfc3958-0d1c-4781-86f0-c10d37abdc05\") " pod="openshift-insights/insights-runtime-extractor-v2f4x"
Oct 30 20:36:33.984386 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:33.984360    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Oct 30 20:36:33.984980 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:33.984959    4060 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-z42qf"]
Oct 30 20:36:33.986865 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:33.986850    4060 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7cd778b784-cpswn"]
Oct 30 20:36:33.986977 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:33.986963    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-z42qf"
Oct 30 20:36:33.988556 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:33.988538    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7cd778b784-cpswn"
Oct 30 20:36:34.020608 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:34.020580    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Oct 30 20:36:34.020608 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:34.020586    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Oct 30 20:36:34.020788 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:34.020586    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Oct 30 20:36:34.031712 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:34.031692    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6dd789c8b7-7dvr6"]
Oct 30 20:36:34.036811 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:34.036793    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"downloads-dockercfg-9ks7d\""
Oct 30 20:36:34.037063 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:34.037044    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Oct 30 20:36:34.037111 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:34.037054    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-mk8vz\""
Oct 30 20:36:34.040195 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:34.040178    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Oct 30 20:36:34.067504 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:34.067467    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jwqg6\" (UniqueName: \"kubernetes.io/projected/000a7a62-eca7-42cb-8e5f-829c1d37485d-kube-api-access-jwqg6\") pod \"downloads-6dd789c8b7-7dvr6\" (UID: \"000a7a62-eca7-42cb-8e5f-829c1d37485d\") " pod="openshift-console/downloads-6dd789c8b7-7dvr6"
Oct 30 20:36:34.067613 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:34.067511    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9f9d9f58-7252-4b1b-96ac-3a8b77b7f038-console-serving-cert\") pod \"console-5dddfcd9fc-ltgv9\" (UID: \"9f9d9f58-7252-4b1b-96ac-3a8b77b7f038\") " pod="openshift-console/console-5dddfcd9fc-ltgv9"
Oct 30 20:36:34.067613 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:34.067530    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9f9d9f58-7252-4b1b-96ac-3a8b77b7f038-console-config\") pod \"console-5dddfcd9fc-ltgv9\" (UID: \"9f9d9f58-7252-4b1b-96ac-3a8b77b7f038\") " pod="openshift-console/console-5dddfcd9fc-ltgv9"
Oct 30 20:36:34.067613 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:34.067548    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lgmj6\" (UniqueName: \"kubernetes.io/projected/9f9d9f58-7252-4b1b-96ac-3a8b77b7f038-kube-api-access-lgmj6\") pod \"console-5dddfcd9fc-ltgv9\" (UID: \"9f9d9f58-7252-4b1b-96ac-3a8b77b7f038\") " pod="openshift-console/console-5dddfcd9fc-ltgv9"
Oct 30 20:36:34.067767 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:34.067667    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fdfc3958-0d1c-4781-86f0-c10d37abdc05-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-v2f4x\" (UID: \"fdfc3958-0d1c-4781-86f0-c10d37abdc05\") " pod="openshift-insights/insights-runtime-extractor-v2f4x"
Oct 30 20:36:34.067767 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:34.067703    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e5d6d250-7e3a-4dce-b339-c128a7e4d651-tmp-dir\") pod \"dns-default-z42qf\" (UID: \"e5d6d250-7e3a-4dce-b339-c128a7e4d651\") " pod="openshift-dns/dns-default-z42qf"
Oct 30 20:36:34.067767 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:34.067748    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b0fe44e0-3ea1-4c46-adfd-b4c5b24327b8-registry-certificates\") pod \"image-registry-7cd778b784-cpswn\" (UID: \"b0fe44e0-3ea1-4c46-adfd-b4c5b24327b8\") " pod="openshift-image-registry/image-registry-7cd778b784-cpswn"
Oct 30 20:36:34.067910 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:34.067776    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b0fe44e0-3ea1-4c46-adfd-b4c5b24327b8-bound-sa-token\") pod \"image-registry-7cd778b784-cpswn\" (UID: \"b0fe44e0-3ea1-4c46-adfd-b4c5b24327b8\") " pod="openshift-image-registry/image-registry-7cd778b784-cpswn"
Oct 30 20:36:34.067910 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:34.067873    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fdfc3958-0d1c-4781-86f0-c10d37abdc05-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-v2f4x\" (UID: \"fdfc3958-0d1c-4781-86f0-c10d37abdc05\") " pod="openshift-insights/insights-runtime-extractor-v2f4x"
Oct 30 20:36:34.068008 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:34.067923    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b0fe44e0-3ea1-4c46-adfd-b4c5b24327b8-ca-trust-extracted\") pod \"image-registry-7cd778b784-cpswn\" (UID: \"b0fe44e0-3ea1-4c46-adfd-b4c5b24327b8\") " pod="openshift-image-registry/image-registry-7cd778b784-cpswn"
Oct 30 20:36:34.068008 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:34.067949    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b0fe44e0-3ea1-4c46-adfd-b4c5b24327b8-trusted-ca\") pod \"image-registry-7cd778b784-cpswn\" (UID: \"b0fe44e0-3ea1-4c46-adfd-b4c5b24327b8\") " pod="openshift-image-registry/image-registry-7cd778b784-cpswn"
Oct 30 20:36:34.068008 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:34.067975    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b0fe44e0-3ea1-4c46-adfd-b4c5b24327b8-installation-pull-secrets\") pod \"image-registry-7cd778b784-cpswn\" (UID: \"b0fe44e0-3ea1-4c46-adfd-b4c5b24327b8\") " pod="openshift-image-registry/image-registry-7cd778b784-cpswn"
Oct 30 20:36:34.068134 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:34.068029    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e5d6d250-7e3a-4dce-b339-c128a7e4d651-metrics-tls\") pod \"dns-default-z42qf\" (UID: \"e5d6d250-7e3a-4dce-b339-c128a7e4d651\") " pod="openshift-dns/dns-default-z42qf"
Oct 30 20:36:34.068134 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:34.068085    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/000a7a62-eca7-42cb-8e5f-829c1d37485d-tmp\") pod \"downloads-6dd789c8b7-7dvr6\" (UID: \"000a7a62-eca7-42cb-8e5f-829c1d37485d\") " pod="openshift-console/downloads-6dd789c8b7-7dvr6"
Oct 30 20:36:34.068134 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:34.068120    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9f9d9f58-7252-4b1b-96ac-3a8b77b7f038-service-ca\") pod \"console-5dddfcd9fc-ltgv9\" (UID: \"9f9d9f58-7252-4b1b-96ac-3a8b77b7f038\") " pod="openshift-console/console-5dddfcd9fc-ltgv9"
Oct 30 20:36:34.068233 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:34.068136    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9f9d9f58-7252-4b1b-96ac-3a8b77b7f038-tmp\") pod \"console-5dddfcd9fc-ltgv9\" (UID: \"9f9d9f58-7252-4b1b-96ac-3a8b77b7f038\") " pod="openshift-console/console-5dddfcd9fc-ltgv9"
Oct 30 20:36:34.068233 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:34.068160    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9f9d9f58-7252-4b1b-96ac-3a8b77b7f038-oauth-serving-cert\") pod \"console-5dddfcd9fc-ltgv9\" (UID: \"9f9d9f58-7252-4b1b-96ac-3a8b77b7f038\") " pod="openshift-console/console-5dddfcd9fc-ltgv9"
Oct 30 20:36:34.068233 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:34.068185    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wrz9r\" (UniqueName: \"kubernetes.io/projected/fdfc3958-0d1c-4781-86f0-c10d37abdc05-kube-api-access-wrz9r\") pod \"insights-runtime-extractor-v2f4x\" (UID: \"fdfc3958-0d1c-4781-86f0-c10d37abdc05\") " pod="openshift-insights/insights-runtime-extractor-v2f4x"
Oct 30 20:36:34.068233 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:34.068215    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9f9d9f58-7252-4b1b-96ac-3a8b77b7f038-console-oauth-config\") pod \"console-5dddfcd9fc-ltgv9\" (UID: \"9f9d9f58-7252-4b1b-96ac-3a8b77b7f038\") " pod="openshift-console/console-5dddfcd9fc-ltgv9"
Oct 30 20:36:34.068358 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:34.068244    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/fdfc3958-0d1c-4781-86f0-c10d37abdc05-data-volume\") pod \"insights-runtime-extractor-v2f4x\" (UID: \"fdfc3958-0d1c-4781-86f0-c10d37abdc05\") " pod="openshift-insights/insights-runtime-extractor-v2f4x"
Oct 30 20:36:34.068358 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:34.068269    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e5d6d250-7e3a-4dce-b339-c128a7e4d651-config-volume\") pod \"dns-default-z42qf\" (UID: \"e5d6d250-7e3a-4dce-b339-c128a7e4d651\") " pod="openshift-dns/dns-default-z42qf"
Oct 30 20:36:34.068358 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:34.068297    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9f9d9f58-7252-4b1b-96ac-3a8b77b7f038-console-config\") pod \"console-5dddfcd9fc-ltgv9\" (UID: \"9f9d9f58-7252-4b1b-96ac-3a8b77b7f038\") " pod="openshift-console/console-5dddfcd9fc-ltgv9"
Oct 30 20:36:34.068358 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:34.068301    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/fdfc3958-0d1c-4781-86f0-c10d37abdc05-crio-socket\") pod \"insights-runtime-extractor-v2f4x\" (UID: \"fdfc3958-0d1c-4781-86f0-c10d37abdc05\") " pod="openshift-insights/insights-runtime-extractor-v2f4x"
Oct 30 20:36:34.068358 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:34.068351    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b0fe44e0-3ea1-4c46-adfd-b4c5b24327b8-image-registry-private-configuration\") pod \"image-registry-7cd778b784-cpswn\" (UID: \"b0fe44e0-3ea1-4c46-adfd-b4c5b24327b8\") " pod="openshift-image-registry/image-registry-7cd778b784-cpswn"
Oct 30 20:36:34.068530 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:34.068376    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4jctm\" (UniqueName: \"kubernetes.io/projected/b0fe44e0-3ea1-4c46-adfd-b4c5b24327b8-kube-api-access-4jctm\") pod \"image-registry-7cd778b784-cpswn\" (UID: \"b0fe44e0-3ea1-4c46-adfd-b4c5b24327b8\") " pod="openshift-image-registry/image-registry-7cd778b784-cpswn"
Oct 30 20:36:34.068530 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:34.068401    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gk59v\" (UniqueName: \"kubernetes.io/projected/e5d6d250-7e3a-4dce-b339-c128a7e4d651-kube-api-access-gk59v\") pod \"dns-default-z42qf\" (UID: \"e5d6d250-7e3a-4dce-b339-c128a7e4d651\") " pod="openshift-dns/dns-default-z42qf"
Oct 30 20:36:34.068530 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:34.068420    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b0fe44e0-3ea1-4c46-adfd-b4c5b24327b8-registry-tls\") pod \"image-registry-7cd778b784-cpswn\" (UID: \"b0fe44e0-3ea1-4c46-adfd-b4c5b24327b8\") " pod="openshift-image-registry/image-registry-7cd778b784-cpswn"
Oct 30 20:36:34.068530 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:34.068412    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fdfc3958-0d1c-4781-86f0-c10d37abdc05-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-v2f4x\" (UID: \"fdfc3958-0d1c-4781-86f0-c10d37abdc05\") " pod="openshift-insights/insights-runtime-extractor-v2f4x"
Oct 30 20:36:34.068776 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:34.068755    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/fdfc3958-0d1c-4781-86f0-c10d37abdc05-crio-socket\") pod \"insights-runtime-extractor-v2f4x\" (UID: \"fdfc3958-0d1c-4781-86f0-c10d37abdc05\") " pod="openshift-insights/insights-runtime-extractor-v2f4x"
Oct 30 20:36:34.068776 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:34.068844    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9f9d9f58-7252-4b1b-96ac-3a8b77b7f038-oauth-serving-cert\") pod \"console-5dddfcd9fc-ltgv9\" (UID: \"9f9d9f58-7252-4b1b-96ac-3a8b77b7f038\") " pod="openshift-console/console-5dddfcd9fc-ltgv9"
Oct 30 20:36:34.068776 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:34.069033    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9f9d9f58-7252-4b1b-96ac-3a8b77b7f038-tmp\") pod \"console-5dddfcd9fc-ltgv9\" (UID: \"9f9d9f58-7252-4b1b-96ac-3a8b77b7f038\") " pod="openshift-console/console-5dddfcd9fc-ltgv9"
Oct 30 20:36:34.068776 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:34.069075    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/fdfc3958-0d1c-4781-86f0-c10d37abdc05-data-volume\") pod \"insights-runtime-extractor-v2f4x\" (UID: \"fdfc3958-0d1c-4781-86f0-c10d37abdc05\") " pod="openshift-insights/insights-runtime-extractor-v2f4x"
Oct 30 20:36:34.069238 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:34.069092    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/000a7a62-eca7-42cb-8e5f-829c1d37485d-tmp\") pod \"downloads-6dd789c8b7-7dvr6\" (UID: \"000a7a62-eca7-42cb-8e5f-829c1d37485d\") " pod="openshift-console/downloads-6dd789c8b7-7dvr6"
Oct 30 20:36:34.069238 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:34.069135    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9f9d9f58-7252-4b1b-96ac-3a8b77b7f038-service-ca\") pod \"console-5dddfcd9fc-ltgv9\" (UID: \"9f9d9f58-7252-4b1b-96ac-3a8b77b7f038\") " pod="openshift-console/console-5dddfcd9fc-ltgv9"
Oct 30 20:36:34.071940 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:34.071894    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fdfc3958-0d1c-4781-86f0-c10d37abdc05-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-v2f4x\" (UID: \"fdfc3958-0d1c-4781-86f0-c10d37abdc05\") " pod="openshift-insights/insights-runtime-extractor-v2f4x"
Oct 30 20:36:34.072022 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:34.071923    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9f9d9f58-7252-4b1b-96ac-3a8b77b7f038-console-oauth-config\") pod \"console-5dddfcd9fc-ltgv9\" (UID: \"9f9d9f58-7252-4b1b-96ac-3a8b77b7f038\") " pod="openshift-console/console-5dddfcd9fc-ltgv9"
Oct 30 20:36:34.072022 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:34.071988    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9f9d9f58-7252-4b1b-96ac-3a8b77b7f038-console-serving-cert\") pod \"console-5dddfcd9fc-ltgv9\" (UID: \"9f9d9f58-7252-4b1b-96ac-3a8b77b7f038\") " pod="openshift-console/console-5dddfcd9fc-ltgv9"
Oct 30 20:36:34.086889 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:34.086866    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Oct 30 20:36:34.090312 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:34.090294    4060 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-59c6s"]
Oct 30 20:36:34.092648 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:34.092634    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-59c6s"
Oct 30 20:36:34.100465 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:34.100446    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-v2f4x"]
Oct 30 20:36:34.100779 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:34.100763    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-z42qf"]
Oct 30 20:36:34.101845 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:34.101825    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5dddfcd9fc-ltgv9"]
Oct 30 20:36:34.126389 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:34.126324    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-59c6s"]
Oct 30 20:36:34.136845 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:34.136820    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lgmj6\" (UniqueName: \"kubernetes.io/projected/9f9d9f58-7252-4b1b-96ac-3a8b77b7f038-kube-api-access-lgmj6\") pod \"console-5dddfcd9fc-ltgv9\" (UID: \"9f9d9f58-7252-4b1b-96ac-3a8b77b7f038\") " pod="openshift-console/console-5dddfcd9fc-ltgv9"
Oct 30 20:36:34.141022 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:34.140998    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wrz9r\" (UniqueName: \"kubernetes.io/projected/fdfc3958-0d1c-4781-86f0-c10d37abdc05-kube-api-access-wrz9r\") pod \"insights-runtime-extractor-v2f4x\" (UID: \"fdfc3958-0d1c-4781-86f0-c10d37abdc05\") " pod="openshift-insights/insights-runtime-extractor-v2f4x"
Oct 30 20:36:34.147596 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:34.147581    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Oct 30 20:36:34.150178 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:34.150164    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Oct 30 20:36:34.151049 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:34.151029    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-9pwzv\""
Oct 30 20:36:34.151133 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:34.151091    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-79tcj\""
Oct 30 20:36:34.151280 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:34.151266    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Oct 30 20:36:34.151311 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:34.151295    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Oct 30 20:36:34.152216 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:34.152193    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jwqg6\" (UniqueName: \"kubernetes.io/projected/000a7a62-eca7-42cb-8e5f-829c1d37485d-kube-api-access-jwqg6\") pod \"downloads-6dd789c8b7-7dvr6\" (UID: \"000a7a62-eca7-42cb-8e5f-829c1d37485d\") " pod="openshift-console/downloads-6dd789c8b7-7dvr6"
Oct 30 20:36:34.154618 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:34.154598    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7cd778b784-cpswn"]
Oct 30 20:36:34.155969 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:34.155939    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Oct 30 20:36:34.156117 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:34.156071    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Oct 30 20:36:34.169313 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:34.169292    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4jctm\" (UniqueName: \"kubernetes.io/projected/b0fe44e0-3ea1-4c46-adfd-b4c5b24327b8-kube-api-access-4jctm\") pod \"image-registry-7cd778b784-cpswn\" (UID: \"b0fe44e0-3ea1-4c46-adfd-b4c5b24327b8\") " pod="openshift-image-registry/image-registry-7cd778b784-cpswn"
Oct 30 20:36:34.169412 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:34.169320    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gk59v\" (UniqueName: \"kubernetes.io/projected/e5d6d250-7e3a-4dce-b339-c128a7e4d651-kube-api-access-gk59v\") pod \"dns-default-z42qf\" (UID: \"e5d6d250-7e3a-4dce-b339-c128a7e4d651\") " pod="openshift-dns/dns-default-z42qf"
Oct 30 20:36:34.169412 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:34.169337    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b0fe44e0-3ea1-4c46-adfd-b4c5b24327b8-registry-tls\") pod \"image-registry-7cd778b784-cpswn\" (UID: \"b0fe44e0-3ea1-4c46-adfd-b4c5b24327b8\") " pod="openshift-image-registry/image-registry-7cd778b784-cpswn"
Oct 30 20:36:34.169412 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:34.169357    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e5d6d250-7e3a-4dce-b339-c128a7e4d651-tmp-dir\") pod \"dns-default-z42qf\" (UID: \"e5d6d250-7e3a-4dce-b339-c128a7e4d651\") " pod="openshift-dns/dns-default-z42qf"
Oct 30 20:36:34.169412 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:34.169376    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9777b208-7361-45ea-875a-0558c1b8b89b-cert\") pod \"ingress-canary-59c6s\" (UID: \"9777b208-7361-45ea-875a-0558c1b8b89b\") " pod="openshift-ingress-canary/ingress-canary-59c6s"
Oct 30 20:36:34.169412 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:34.169407    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b0fe44e0-3ea1-4c46-adfd-b4c5b24327b8-registry-certificates\") pod \"image-registry-7cd778b784-cpswn\" (UID: \"b0fe44e0-3ea1-4c46-adfd-b4c5b24327b8\") " pod="openshift-image-registry/image-registry-7cd778b784-cpswn"
Oct 30 20:36:34.169668 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:34.169430    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b0fe44e0-3ea1-4c46-adfd-b4c5b24327b8-bound-sa-token\") pod \"image-registry-7cd778b784-cpswn\" (UID: \"b0fe44e0-3ea1-4c46-adfd-b4c5b24327b8\") " pod="openshift-image-registry/image-registry-7cd778b784-cpswn"
Oct 30 20:36:34.169668 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:34.169544    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xfk7r\" (UniqueName: \"kubernetes.io/projected/9777b208-7361-45ea-875a-0558c1b8b89b-kube-api-access-xfk7r\") pod \"ingress-canary-59c6s\" (UID: \"9777b208-7361-45ea-875a-0558c1b8b89b\") " pod="openshift-ingress-canary/ingress-canary-59c6s"
Oct 30 20:36:34.169668 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:34.169600    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b0fe44e0-3ea1-4c46-adfd-b4c5b24327b8-ca-trust-extracted\") pod \"image-registry-7cd778b784-cpswn\" (UID: \"b0fe44e0-3ea1-4c46-adfd-b4c5b24327b8\") " pod="openshift-image-registry/image-registry-7cd778b784-cpswn"
Oct 30 20:36:34.169668 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:34.169657    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b0fe44e0-3ea1-4c46-adfd-b4c5b24327b8-trusted-ca\") pod \"image-registry-7cd778b784-cpswn\" (UID: \"b0fe44e0-3ea1-4c46-adfd-b4c5b24327b8\") " pod="openshift-image-registry/image-registry-7cd778b784-cpswn"
Oct 30 20:36:34.169860 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:34.169693    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b0fe44e0-3ea1-4c46-adfd-b4c5b24327b8-installation-pull-secrets\") pod \"image-registry-7cd778b784-cpswn\" (UID: \"b0fe44e0-3ea1-4c46-adfd-b4c5b24327b8\") " pod="openshift-image-registry/image-registry-7cd778b784-cpswn"
Oct 30 20:36:34.169860 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:34.169730    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e5d6d250-7e3a-4dce-b339-c128a7e4d651-metrics-tls\") pod \"dns-default-z42qf\" (UID: \"e5d6d250-7e3a-4dce-b339-c128a7e4d651\") " pod="openshift-dns/dns-default-z42qf"
Oct 30 20:36:34.169860 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:34.169735    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e5d6d250-7e3a-4dce-b339-c128a7e4d651-tmp-dir\") pod \"dns-default-z42qf\" (UID: \"e5d6d250-7e3a-4dce-b339-c128a7e4d651\") " pod="openshift-dns/dns-default-z42qf"
Oct 30 20:36:34.169860 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:34.169809    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e5d6d250-7e3a-4dce-b339-c128a7e4d651-config-volume\") pod \"dns-default-z42qf\" (UID: \"e5d6d250-7e3a-4dce-b339-c128a7e4d651\") " pod="openshift-dns/dns-default-z42qf"
Oct 30 20:36:34.169860 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:34.169845    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b0fe44e0-3ea1-4c46-adfd-b4c5b24327b8-image-registry-private-configuration\") pod \"image-registry-7cd778b784-cpswn\" (UID: \"b0fe44e0-3ea1-4c46-adfd-b4c5b24327b8\") " pod="openshift-image-registry/image-registry-7cd778b784-cpswn"
Oct 30 20:36:34.170093 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:34.170024    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b0fe44e0-3ea1-4c46-adfd-b4c5b24327b8-ca-trust-extracted\") pod \"image-registry-7cd778b784-cpswn\" (UID: \"b0fe44e0-3ea1-4c46-adfd-b4c5b24327b8\") " pod="openshift-image-registry/image-registry-7cd778b784-cpswn"
Oct 30 20:36:34.170411 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:34.170390    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b0fe44e0-3ea1-4c46-adfd-b4c5b24327b8-registry-certificates\") pod \"image-registry-7cd778b784-cpswn\" (UID: \"b0fe44e0-3ea1-4c46-adfd-b4c5b24327b8\") " pod="openshift-image-registry/image-registry-7cd778b784-cpswn"
Oct 30 20:36:34.170551 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:34.170529    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e5d6d250-7e3a-4dce-b339-c128a7e4d651-config-volume\") pod \"dns-default-z42qf\" (UID: \"e5d6d250-7e3a-4dce-b339-c128a7e4d651\") " pod="openshift-dns/dns-default-z42qf"
Oct 30 20:36:34.170551 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:34.170544    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b0fe44e0-3ea1-4c46-adfd-b4c5b24327b8-trusted-ca\") pod \"image-registry-7cd778b784-cpswn\" (UID: \"b0fe44e0-3ea1-4c46-adfd-b4c5b24327b8\") " pod="openshift-image-registry/image-registry-7cd778b784-cpswn"
Oct 30 20:36:34.172037 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:34.172016    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b0fe44e0-3ea1-4c46-adfd-b4c5b24327b8-installation-pull-secrets\") pod \"image-registry-7cd778b784-cpswn\" (UID: \"b0fe44e0-3ea1-4c46-adfd-b4c5b24327b8\") " pod="openshift-image-registry/image-registry-7cd778b784-cpswn"
Oct 30 20:36:34.172128 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:34.172071    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b0fe44e0-3ea1-4c46-adfd-b4c5b24327b8-image-registry-private-configuration\") pod \"image-registry-7cd778b784-cpswn\" (UID: \"b0fe44e0-3ea1-4c46-adfd-b4c5b24327b8\") " pod="openshift-image-registry/image-registry-7cd778b784-cpswn"
Oct 30 20:36:34.172183 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:34.172162    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e5d6d250-7e3a-4dce-b339-c128a7e4d651-metrics-tls\") pod \"dns-default-z42qf\" (UID: \"e5d6d250-7e3a-4dce-b339-c128a7e4d651\") " pod="openshift-dns/dns-default-z42qf"
Oct 30 20:36:34.172245 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:34.172228    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b0fe44e0-3ea1-4c46-adfd-b4c5b24327b8-registry-tls\") pod \"image-registry-7cd778b784-cpswn\" (UID: \"b0fe44e0-3ea1-4c46-adfd-b4c5b24327b8\") " pod="openshift-image-registry/image-registry-7cd778b784-cpswn"
Oct 30 20:36:34.174110 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:34.174093    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5dddfcd9fc-ltgv9"
Oct 30 20:36:34.186556 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:34.186532    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6dd789c8b7-7dvr6"
Oct 30 20:36:34.193325 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:34.193303    4060 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-wn6gs"]
Oct 30 20:36:34.195269 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:34.195249    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-wn6gs"
Oct 30 20:36:34.235040 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:34.234990    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4jctm\" (UniqueName: \"kubernetes.io/projected/b0fe44e0-3ea1-4c46-adfd-b4c5b24327b8-kube-api-access-4jctm\") pod \"image-registry-7cd778b784-cpswn\" (UID: \"b0fe44e0-3ea1-4c46-adfd-b4c5b24327b8\") " pod="openshift-image-registry/image-registry-7cd778b784-cpswn"
Oct 30 20:36:34.240526 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:34.240390    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-2nx5p\""
Oct 30 20:36:34.240526 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:34.240450    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Oct 30 20:36:34.245651 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:34.245467    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b0fe44e0-3ea1-4c46-adfd-b4c5b24327b8-bound-sa-token\") pod \"image-registry-7cd778b784-cpswn\" (UID: \"b0fe44e0-3ea1-4c46-adfd-b4c5b24327b8\") " pod="openshift-image-registry/image-registry-7cd778b784-cpswn"
Oct 30 20:36:34.245952 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:34.245929    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gk59v\" (UniqueName: \"kubernetes.io/projected/e5d6d250-7e3a-4dce-b339-c128a7e4d651-kube-api-access-gk59v\") pod \"dns-default-z42qf\" (UID: \"e5d6d250-7e3a-4dce-b339-c128a7e4d651\") " pod="openshift-dns/dns-default-z42qf"
Oct 30 20:36:34.247832 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:34.247813    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-v2f4x"
Oct 30 20:36:34.270535 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:34.270502    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9777b208-7361-45ea-875a-0558c1b8b89b-cert\") pod \"ingress-canary-59c6s\" (UID: \"9777b208-7361-45ea-875a-0558c1b8b89b\") " pod="openshift-ingress-canary/ingress-canary-59c6s"
Oct 30 20:36:34.270671 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:34.270555    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xfk7r\" (UniqueName: \"kubernetes.io/projected/9777b208-7361-45ea-875a-0558c1b8b89b-kube-api-access-xfk7r\") pod \"ingress-canary-59c6s\" (UID: \"9777b208-7361-45ea-875a-0558c1b8b89b\") " pod="openshift-ingress-canary/ingress-canary-59c6s"
Oct 30 20:36:34.270671 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:34.270610    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/dac1149e-df18-406d-8c47-24129245c95f-tls-certificates\") pod \"prometheus-operator-admission-webhook-6489d8bf89-wn6gs\" (UID: \"dac1149e-df18-406d-8c47-24129245c95f\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-wn6gs"
Oct 30 20:36:34.272716 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:34.272699    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9777b208-7361-45ea-875a-0558c1b8b89b-cert\") pod \"ingress-canary-59c6s\" (UID: \"9777b208-7361-45ea-875a-0558c1b8b89b\") " pod="openshift-ingress-canary/ingress-canary-59c6s"
Oct 30 20:36:34.276244 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:34.276222    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-wn6gs"]
Oct 30 20:36:34.297756 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:34.297731    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-z42qf"
Oct 30 20:36:34.318944 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:34.318922    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-f4pxg\""
Oct 30 20:36:34.319300 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:34.319284    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Oct 30 20:36:34.322463 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:34.322432    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7cd778b784-cpswn"
Oct 30 20:36:34.333323 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:34.332675    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xfk7r\" (UniqueName: \"kubernetes.io/projected/9777b208-7361-45ea-875a-0558c1b8b89b-kube-api-access-xfk7r\") pod \"ingress-canary-59c6s\" (UID: \"9777b208-7361-45ea-875a-0558c1b8b89b\") " pod="openshift-ingress-canary/ingress-canary-59c6s"
Oct 30 20:36:34.371308 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:34.371236    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/dac1149e-df18-406d-8c47-24129245c95f-tls-certificates\") pod \"prometheus-operator-admission-webhook-6489d8bf89-wn6gs\" (UID: \"dac1149e-df18-406d-8c47-24129245c95f\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-wn6gs"
Oct 30 20:36:34.374396 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:34.374227    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/dac1149e-df18-406d-8c47-24129245c95f-tls-certificates\") pod \"prometheus-operator-admission-webhook-6489d8bf89-wn6gs\" (UID: \"dac1149e-df18-406d-8c47-24129245c95f\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-wn6gs"
Oct 30 20:36:34.401290 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:34.401239    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-59c6s"
Oct 30 20:36:34.505299 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:34.505273    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-wn6gs"
Oct 30 20:36:34.578482 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:34.578457    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5dddfcd9fc-ltgv9"]
Oct 30 20:36:34.581168 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:34.581135    4060 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f9d9f58_7252_4b1b_96ac_3a8b77b7f038.slice/crio-4728ca3ef528f9ddb665d967b78a6c0745e3c3177a70dcb03f184443a86530ef WatchSource:0}: Error finding container 4728ca3ef528f9ddb665d967b78a6c0745e3c3177a70dcb03f184443a86530ef: Status 404 returned error can't find the container with id 4728ca3ef528f9ddb665d967b78a6c0745e3c3177a70dcb03f184443a86530ef
Oct 30 20:36:34.628523 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:34.628446    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6dd789c8b7-7dvr6"]
Oct 30 20:36:34.630783 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:34.630761    4060 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod000a7a62_eca7_42cb_8e5f_829c1d37485d.slice/crio-21fe1ea0d723380d4154ec44610bbfa97e33d697d3a570bf3b49487dc227b492 WatchSource:0}: Error finding container 21fe1ea0d723380d4154ec44610bbfa97e33d697d3a570bf3b49487dc227b492: Status 404 returned error can't find the container with id 21fe1ea0d723380d4154ec44610bbfa97e33d697d3a570bf3b49487dc227b492
Oct 30 20:36:34.632831 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:34.632637    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-v2f4x"]
Oct 30 20:36:34.636141 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:34.636122    4060 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfdfc3958_0d1c_4781_86f0_c10d37abdc05.slice/crio-157b1393a6fa1ead76160685da9ff33c53d5750d65819dd46e79f9f9f507d7f7 WatchSource:0}: Error finding container 157b1393a6fa1ead76160685da9ff33c53d5750d65819dd46e79f9f9f507d7f7: Status 404 returned error can't find the container with id 157b1393a6fa1ead76160685da9ff33c53d5750d65819dd46e79f9f9f507d7f7
Oct 30 20:36:34.716002 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:34.715972    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7cd778b784-cpswn"]
Oct 30 20:36:34.719111 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:34.719090    4060 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0fe44e0_3ea1_4c46_adfd_b4c5b24327b8.slice/crio-4f2aab23c120e7aae15793fbd60fb0de79b35bc9d703f6821dc25a5ef8758933 WatchSource:0}: Error finding container 4f2aab23c120e7aae15793fbd60fb0de79b35bc9d703f6821dc25a5ef8758933: Status 404 returned error can't find the container with id 4f2aab23c120e7aae15793fbd60fb0de79b35bc9d703f6821dc25a5ef8758933
Oct 30 20:36:34.770392 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:34.770369    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-59c6s"]
Oct 30 20:36:34.773841 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:34.773817    4060 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9777b208_7361_45ea_875a_0558c1b8b89b.slice/crio-bc48af083d82e5d623f8821ac20d749a455ae22754451f3b8b45fad01a69642a WatchSource:0}: Error finding container bc48af083d82e5d623f8821ac20d749a455ae22754451f3b8b45fad01a69642a: Status 404 returned error can't find the container with id bc48af083d82e5d623f8821ac20d749a455ae22754451f3b8b45fad01a69642a
Oct 30 20:36:34.803831 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:34.803799    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-z42qf"]
Oct 30 20:36:34.806608 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:34.806582    4060 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5d6d250_7e3a_4dce_b339_c128a7e4d651.slice/crio-9fd2906a5f33a2658668eed04a3ecb684e5ab422f11075f3bc816b86f2c39c72 WatchSource:0}: Error finding container 9fd2906a5f33a2658668eed04a3ecb684e5ab422f11075f3bc816b86f2c39c72: Status 404 returned error can't find the container with id 9fd2906a5f33a2658668eed04a3ecb684e5ab422f11075f3bc816b86f2c39c72
Oct 30 20:36:34.871157 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:34.871076    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-wn6gs"]
Oct 30 20:36:34.873751 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:34.873726    4060 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddac1149e_df18_406d_8c47_24129245c95f.slice/crio-2a498fc325be7314f78343fe63a462a6787a1c54dcdc11f60d691606ad59da3d WatchSource:0}: Error finding container 2a498fc325be7314f78343fe63a462a6787a1c54dcdc11f60d691606ad59da3d: Status 404 returned error can't find the container with id 2a498fc325be7314f78343fe63a462a6787a1c54dcdc11f60d691606ad59da3d
Oct 30 20:36:35.483297 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:35.483264    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7cd778b784-cpswn" event={"ID":"b0fe44e0-3ea1-4c46-adfd-b4c5b24327b8","Type":"ContainerStarted","Data":"41e35890669e021575b9a3b356beabb0acf51856439609ec7496a06e1f239999"}
Oct 30 20:36:35.483503 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:35.483321    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7cd778b784-cpswn" event={"ID":"b0fe44e0-3ea1-4c46-adfd-b4c5b24327b8","Type":"ContainerStarted","Data":"4f2aab23c120e7aae15793fbd60fb0de79b35bc9d703f6821dc25a5ef8758933"}
Oct 30 20:36:35.483503 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:35.483381    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7cd778b784-cpswn"
Oct 30 20:36:35.484575 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:35.484551    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-z42qf" event={"ID":"e5d6d250-7e3a-4dce-b339-c128a7e4d651","Type":"ContainerStarted","Data":"9fd2906a5f33a2658668eed04a3ecb684e5ab422f11075f3bc816b86f2c39c72"}
Oct 30 20:36:35.485666 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:35.485641    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6dd789c8b7-7dvr6" event={"ID":"000a7a62-eca7-42cb-8e5f-829c1d37485d","Type":"ContainerStarted","Data":"21fe1ea0d723380d4154ec44610bbfa97e33d697d3a570bf3b49487dc227b492"}
Oct 30 20:36:35.486708 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:35.486688    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5dddfcd9fc-ltgv9" event={"ID":"9f9d9f58-7252-4b1b-96ac-3a8b77b7f038","Type":"ContainerStarted","Data":"4728ca3ef528f9ddb665d967b78a6c0745e3c3177a70dcb03f184443a86530ef"}
Oct 30 20:36:35.487649 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:35.487630    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-wn6gs" event={"ID":"dac1149e-df18-406d-8c47-24129245c95f","Type":"ContainerStarted","Data":"2a498fc325be7314f78343fe63a462a6787a1c54dcdc11f60d691606ad59da3d"}
Oct 30 20:36:35.488659 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:35.488640    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-59c6s" event={"ID":"9777b208-7361-45ea-875a-0558c1b8b89b","Type":"ContainerStarted","Data":"bc48af083d82e5d623f8821ac20d749a455ae22754451f3b8b45fad01a69642a"}
Oct 30 20:36:35.489850 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:35.489832    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-v2f4x" event={"ID":"fdfc3958-0d1c-4781-86f0-c10d37abdc05","Type":"ContainerStarted","Data":"97a014cd34b183428029da0e1d62d763502adf2c9d9a7e9432f7f949bfbb8d88"}
Oct 30 20:36:35.489916 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:35.489869    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-v2f4x" event={"ID":"fdfc3958-0d1c-4781-86f0-c10d37abdc05","Type":"ContainerStarted","Data":"157b1393a6fa1ead76160685da9ff33c53d5750d65819dd46e79f9f9f507d7f7"}
Oct 30 20:36:35.617537 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:35.617429    4060 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7cd778b784-cpswn" podStartSLOduration=2.617415538 podStartE2EDuration="2.617415538s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:36:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:36:35.616824506 +0000 UTC m=+14.373822811" watchObservedRunningTime="2026-10-30 20:36:35.617415538 +0000 UTC m=+14.374413834"
Oct 30 20:36:36.505423 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:36.505347    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-v2f4x" event={"ID":"fdfc3958-0d1c-4781-86f0-c10d37abdc05","Type":"ContainerStarted","Data":"87a7fbdc6027f2860f8cf39084822504e2e1c2a51ae5928944ec8866a0420044"}
Oct 30 20:36:37.518517 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:37.518464    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-wn6gs" event={"ID":"dac1149e-df18-406d-8c47-24129245c95f","Type":"ContainerStarted","Data":"17b224e3a1e46403aee2436b1684c8be15d0e0de73b31e3e270cfeab4338275f"}
Oct 30 20:36:37.519052 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:37.518974    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-wn6gs"
Oct 30 20:36:37.526065 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:37.526041    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-wn6gs"
Oct 30 20:36:37.751522 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:37.750277    4060 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-wn6gs" podStartSLOduration=1.536433084 podStartE2EDuration="3.750261753s" totalImagesPullingTime="2.213828669s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:36:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:36:37.635437991 +0000 UTC m=+16.392436290" watchObservedRunningTime="2026-10-30 20:36:37.750261753 +0000 UTC m=+16.507260051"
Oct 30 20:36:38.525201 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:38.525167    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-z42qf" event={"ID":"e5d6d250-7e3a-4dce-b339-c128a7e4d651","Type":"ContainerStarted","Data":"10c58d9e7e2696410e9726c9611a081dcd2f3a07633d66def1ebb1035419771c"}
Oct 30 20:36:38.525608 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:38.525232    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-z42qf" event={"ID":"e5d6d250-7e3a-4dce-b339-c128a7e4d651","Type":"ContainerStarted","Data":"b51179852e7a2ee137d17cb119e366d2f6f696ff9160b1dc87f853557bc1126a"}
Oct 30 20:36:38.751159 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:38.751100    4060 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-dns/dns-default-z42qf" podStartSLOduration=2.538897145 podStartE2EDuration="5.75107969s" totalImagesPullingTime="3.212182545s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:36:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:36:38.643306912 +0000 UTC m=+17.400305209" watchObservedRunningTime="2026-10-30 20:36:38.75107969 +0000 UTC m=+17.508077987"
Oct 30 20:36:38.751716 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:38.751371    4060 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-9cd89b74c-rgltt"]
Oct 30 20:36:38.753606 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:38.753585    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-9cd89b74c-rgltt"
Oct 30 20:36:38.776745 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:38.776715    4060 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console/console-65c77b44d-d7rsp"]
Oct 30 20:36:38.778756 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:38.778732    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65c77b44d-d7rsp"
Oct 30 20:36:38.808815 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:38.808739    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/62d83fcc-c39b-4dc5-909f-cea15b697a2d-console-serving-cert\") pod \"console-65c77b44d-d7rsp\" (UID: \"62d83fcc-c39b-4dc5-909f-cea15b697a2d\") " pod="openshift-console/console-65c77b44d-d7rsp"
Oct 30 20:36:38.808960 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:38.808815    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/62d83fcc-c39b-4dc5-909f-cea15b697a2d-tmp\") pod \"console-65c77b44d-d7rsp\" (UID: \"62d83fcc-c39b-4dc5-909f-cea15b697a2d\") " pod="openshift-console/console-65c77b44d-d7rsp"
Oct 30 20:36:38.808960 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:38.808864    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/62d83fcc-c39b-4dc5-909f-cea15b697a2d-console-oauth-config\") pod \"console-65c77b44d-d7rsp\" (UID: \"62d83fcc-c39b-4dc5-909f-cea15b697a2d\") " pod="openshift-console/console-65c77b44d-d7rsp"
Oct 30 20:36:38.808960 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:38.808924    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a046541e-b2d8-4e1f-a0ab-b0d75e95a7fa-metrics-client-ca\") pod \"prometheus-operator-9cd89b74c-rgltt\" (UID: \"a046541e-b2d8-4e1f-a0ab-b0d75e95a7fa\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-rgltt"
Oct 30 20:36:38.809129 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:38.809025    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9k5cz\" (UniqueName: \"kubernetes.io/projected/a046541e-b2d8-4e1f-a0ab-b0d75e95a7fa-kube-api-access-9k5cz\") pod \"prometheus-operator-9cd89b74c-rgltt\" (UID: \"a046541e-b2d8-4e1f-a0ab-b0d75e95a7fa\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-rgltt"
Oct 30 20:36:38.809129 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:38.809068    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a046541e-b2d8-4e1f-a0ab-b0d75e95a7fa-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-9cd89b74c-rgltt\" (UID: \"a046541e-b2d8-4e1f-a0ab-b0d75e95a7fa\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-rgltt"
Oct 30 20:36:38.809241 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:38.809148    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/62d83fcc-c39b-4dc5-909f-cea15b697a2d-trusted-ca-bundle\") pod \"console-65c77b44d-d7rsp\" (UID: \"62d83fcc-c39b-4dc5-909f-cea15b697a2d\") " pod="openshift-console/console-65c77b44d-d7rsp"
Oct 30 20:36:38.809241 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:38.809171    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/62d83fcc-c39b-4dc5-909f-cea15b697a2d-console-config\") pod \"console-65c77b44d-d7rsp\" (UID: \"62d83fcc-c39b-4dc5-909f-cea15b697a2d\") " pod="openshift-console/console-65c77b44d-d7rsp"
Oct 30 20:36:38.809301 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:38.809233    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/a046541e-b2d8-4e1f-a0ab-b0d75e95a7fa-prometheus-operator-tls\") pod \"prometheus-operator-9cd89b74c-rgltt\" (UID: \"a046541e-b2d8-4e1f-a0ab-b0d75e95a7fa\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-rgltt"
Oct 30 20:36:38.809337 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:38.809318    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/62d83fcc-c39b-4dc5-909f-cea15b697a2d-service-ca\") pod \"console-65c77b44d-d7rsp\" (UID: \"62d83fcc-c39b-4dc5-909f-cea15b697a2d\") " pod="openshift-console/console-65c77b44d-d7rsp"
Oct 30 20:36:38.809368 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:38.809344    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/62d83fcc-c39b-4dc5-909f-cea15b697a2d-oauth-serving-cert\") pod \"console-65c77b44d-d7rsp\" (UID: \"62d83fcc-c39b-4dc5-909f-cea15b697a2d\") " pod="openshift-console/console-65c77b44d-d7rsp"
Oct 30 20:36:38.809414 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:38.809371    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x5hz7\" (UniqueName: \"kubernetes.io/projected/62d83fcc-c39b-4dc5-909f-cea15b697a2d-kube-api-access-x5hz7\") pod \"console-65c77b44d-d7rsp\" (UID: \"62d83fcc-c39b-4dc5-909f-cea15b697a2d\") " pod="openshift-console/console-65c77b44d-d7rsp"
Oct 30 20:36:38.809807 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:38.809786    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-shwwm\""
Oct 30 20:36:38.809900 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:38.809807    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Oct 30 20:36:38.809900 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:38.809857    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Oct 30 20:36:38.810244 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:38.810225    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Oct 30 20:36:38.810319 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:38.810310    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Oct 30 20:36:38.810506 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:38.810473    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Oct 30 20:36:38.826212 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:38.826182    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-9cd89b74c-rgltt"]
Oct 30 20:36:38.842758 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:38.842730    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-65c77b44d-d7rsp"]
Oct 30 20:36:38.910322 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:38.910288    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/62d83fcc-c39b-4dc5-909f-cea15b697a2d-service-ca\") pod \"console-65c77b44d-d7rsp\" (UID: \"62d83fcc-c39b-4dc5-909f-cea15b697a2d\") " pod="openshift-console/console-65c77b44d-d7rsp"
Oct 30 20:36:38.910549 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:38.910332    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/62d83fcc-c39b-4dc5-909f-cea15b697a2d-oauth-serving-cert\") pod \"console-65c77b44d-d7rsp\" (UID: \"62d83fcc-c39b-4dc5-909f-cea15b697a2d\") " pod="openshift-console/console-65c77b44d-d7rsp"
Oct 30 20:36:38.910549 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:38.910360    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x5hz7\" (UniqueName: \"kubernetes.io/projected/62d83fcc-c39b-4dc5-909f-cea15b697a2d-kube-api-access-x5hz7\") pod \"console-65c77b44d-d7rsp\" (UID: \"62d83fcc-c39b-4dc5-909f-cea15b697a2d\") " pod="openshift-console/console-65c77b44d-d7rsp"
Oct 30 20:36:38.910549 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:38.910395    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/62d83fcc-c39b-4dc5-909f-cea15b697a2d-console-serving-cert\") pod \"console-65c77b44d-d7rsp\" (UID: \"62d83fcc-c39b-4dc5-909f-cea15b697a2d\") " pod="openshift-console/console-65c77b44d-d7rsp"
Oct 30 20:36:38.910549 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:38.910418    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/62d83fcc-c39b-4dc5-909f-cea15b697a2d-tmp\") pod \"console-65c77b44d-d7rsp\" (UID: \"62d83fcc-c39b-4dc5-909f-cea15b697a2d\") " pod="openshift-console/console-65c77b44d-d7rsp"
Oct 30 20:36:38.910549 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:38.910451    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/62d83fcc-c39b-4dc5-909f-cea15b697a2d-console-oauth-config\") pod \"console-65c77b44d-d7rsp\" (UID: \"62d83fcc-c39b-4dc5-909f-cea15b697a2d\") " pod="openshift-console/console-65c77b44d-d7rsp"
Oct 30 20:36:38.910549 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:38.910483    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a046541e-b2d8-4e1f-a0ab-b0d75e95a7fa-metrics-client-ca\") pod \"prometheus-operator-9cd89b74c-rgltt\" (UID: \"a046541e-b2d8-4e1f-a0ab-b0d75e95a7fa\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-rgltt"
Oct 30 20:36:38.910549 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:38.910535    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9k5cz\" (UniqueName: \"kubernetes.io/projected/a046541e-b2d8-4e1f-a0ab-b0d75e95a7fa-kube-api-access-9k5cz\") pod \"prometheus-operator-9cd89b74c-rgltt\" (UID: \"a046541e-b2d8-4e1f-a0ab-b0d75e95a7fa\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-rgltt"
Oct 30 20:36:38.910858 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:38.910570    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a046541e-b2d8-4e1f-a0ab-b0d75e95a7fa-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-9cd89b74c-rgltt\" (UID: \"a046541e-b2d8-4e1f-a0ab-b0d75e95a7fa\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-rgltt"
Oct 30 20:36:38.910858 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:38.910598    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/62d83fcc-c39b-4dc5-909f-cea15b697a2d-trusted-ca-bundle\") pod \"console-65c77b44d-d7rsp\" (UID: \"62d83fcc-c39b-4dc5-909f-cea15b697a2d\") " pod="openshift-console/console-65c77b44d-d7rsp"
Oct 30 20:36:38.910858 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:38.910623    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/62d83fcc-c39b-4dc5-909f-cea15b697a2d-console-config\") pod \"console-65c77b44d-d7rsp\" (UID: \"62d83fcc-c39b-4dc5-909f-cea15b697a2d\") " pod="openshift-console/console-65c77b44d-d7rsp"
Oct 30 20:36:38.910858 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:38.910654    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/a046541e-b2d8-4e1f-a0ab-b0d75e95a7fa-prometheus-operator-tls\") pod \"prometheus-operator-9cd89b74c-rgltt\" (UID: \"a046541e-b2d8-4e1f-a0ab-b0d75e95a7fa\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-rgltt"
Oct 30 20:36:38.911061 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:38.910949    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/62d83fcc-c39b-4dc5-909f-cea15b697a2d-tmp\") pod \"console-65c77b44d-d7rsp\" (UID: \"62d83fcc-c39b-4dc5-909f-cea15b697a2d\") " pod="openshift-console/console-65c77b44d-d7rsp"
Oct 30 20:36:38.912381 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:38.911561    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/62d83fcc-c39b-4dc5-909f-cea15b697a2d-service-ca\") pod \"console-65c77b44d-d7rsp\" (UID: \"62d83fcc-c39b-4dc5-909f-cea15b697a2d\") " pod="openshift-console/console-65c77b44d-d7rsp"
Oct 30 20:36:38.912381 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:38.911976    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/62d83fcc-c39b-4dc5-909f-cea15b697a2d-console-config\") pod \"console-65c77b44d-d7rsp\" (UID: \"62d83fcc-c39b-4dc5-909f-cea15b697a2d\") " pod="openshift-console/console-65c77b44d-d7rsp"
Oct 30 20:36:38.912381 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:38.912056    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a046541e-b2d8-4e1f-a0ab-b0d75e95a7fa-metrics-client-ca\") pod \"prometheus-operator-9cd89b74c-rgltt\" (UID: \"a046541e-b2d8-4e1f-a0ab-b0d75e95a7fa\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-rgltt"
Oct 30 20:36:38.912381 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:38.912334    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/62d83fcc-c39b-4dc5-909f-cea15b697a2d-oauth-serving-cert\") pod \"console-65c77b44d-d7rsp\" (UID: \"62d83fcc-c39b-4dc5-909f-cea15b697a2d\") " pod="openshift-console/console-65c77b44d-d7rsp"
Oct 30 20:36:38.913837 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:38.913772    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/a046541e-b2d8-4e1f-a0ab-b0d75e95a7fa-prometheus-operator-tls\") pod \"prometheus-operator-9cd89b74c-rgltt\" (UID: \"a046541e-b2d8-4e1f-a0ab-b0d75e95a7fa\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-rgltt"
Oct 30 20:36:38.914508 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:38.914466    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/62d83fcc-c39b-4dc5-909f-cea15b697a2d-console-serving-cert\") pod \"console-65c77b44d-d7rsp\" (UID: \"62d83fcc-c39b-4dc5-909f-cea15b697a2d\") " pod="openshift-console/console-65c77b44d-d7rsp"
Oct 30 20:36:38.915884 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:38.915862    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a046541e-b2d8-4e1f-a0ab-b0d75e95a7fa-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-9cd89b74c-rgltt\" (UID: \"a046541e-b2d8-4e1f-a0ab-b0d75e95a7fa\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-rgltt"
Oct 30 20:36:38.918398 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:38.918378    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/62d83fcc-c39b-4dc5-909f-cea15b697a2d-console-oauth-config\") pod \"console-65c77b44d-d7rsp\" (UID: \"62d83fcc-c39b-4dc5-909f-cea15b697a2d\") " pod="openshift-console/console-65c77b44d-d7rsp"
Oct 30 20:36:38.960731 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:38.960696    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Oct 30 20:36:38.962267 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:38.962239    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/62d83fcc-c39b-4dc5-909f-cea15b697a2d-trusted-ca-bundle\") pod \"console-65c77b44d-d7rsp\" (UID: \"62d83fcc-c39b-4dc5-909f-cea15b697a2d\") " pod="openshift-console/console-65c77b44d-d7rsp"
Oct 30 20:36:38.974042 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:38.973962    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x5hz7\" (UniqueName: \"kubernetes.io/projected/62d83fcc-c39b-4dc5-909f-cea15b697a2d-kube-api-access-x5hz7\") pod \"console-65c77b44d-d7rsp\" (UID: \"62d83fcc-c39b-4dc5-909f-cea15b697a2d\") " pod="openshift-console/console-65c77b44d-d7rsp"
Oct 30 20:36:38.976120 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:38.974903    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9k5cz\" (UniqueName: \"kubernetes.io/projected/a046541e-b2d8-4e1f-a0ab-b0d75e95a7fa-kube-api-access-9k5cz\") pod \"prometheus-operator-9cd89b74c-rgltt\" (UID: \"a046541e-b2d8-4e1f-a0ab-b0d75e95a7fa\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-rgltt"
Oct 30 20:36:39.066775 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:39.066691    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-9cd89b74c-rgltt"
Oct 30 20:36:39.091071 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:39.091041    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65c77b44d-d7rsp"
Oct 30 20:36:39.476824 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:39.476780    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-9cd89b74c-rgltt"]
Oct 30 20:36:39.482392 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:39.482360    4060 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda046541e_b2d8_4e1f_a0ab_b0d75e95a7fa.slice/crio-4031f0e3d38f489133776c88eb9f34bfc0d29fd9d6a791b7ca282f7b20aad147 WatchSource:0}: Error finding container 4031f0e3d38f489133776c88eb9f34bfc0d29fd9d6a791b7ca282f7b20aad147: Status 404 returned error can't find the container with id 4031f0e3d38f489133776c88eb9f34bfc0d29fd9d6a791b7ca282f7b20aad147
Oct 30 20:36:39.504637 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:39.504604    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-65c77b44d-d7rsp"]
Oct 30 20:36:39.529993 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:39.529956    4060 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62d83fcc_c39b_4dc5_909f_cea15b697a2d.slice/crio-9efcee321e351493f62315588ff7e3e75c9138f8faaa52419410e3ae825008ac WatchSource:0}: Error finding container 9efcee321e351493f62315588ff7e3e75c9138f8faaa52419410e3ae825008ac: Status 404 returned error can't find the container with id 9efcee321e351493f62315588ff7e3e75c9138f8faaa52419410e3ae825008ac
Oct 30 20:36:39.531176 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:39.531106    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-9cd89b74c-rgltt" event={"ID":"a046541e-b2d8-4e1f-a0ab-b0d75e95a7fa","Type":"ContainerStarted","Data":"4031f0e3d38f489133776c88eb9f34bfc0d29fd9d6a791b7ca282f7b20aad147"}
Oct 30 20:36:39.534461 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:39.534426    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-59c6s" event={"ID":"9777b208-7361-45ea-875a-0558c1b8b89b","Type":"ContainerStarted","Data":"cb6956f439c59ba8f16d3403637ab361d91998db8d449412b6b655d6e369d3fd"}
Oct 30 20:36:39.536862 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:39.536839    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-v2f4x" event={"ID":"fdfc3958-0d1c-4781-86f0-c10d37abdc05","Type":"ContainerStarted","Data":"e460550e11d7f2b8e4eacbd823452192ad5627ea87acbe47a1c760b4af652365"}
Oct 30 20:36:39.537461 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:39.537445    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-z42qf"
Oct 30 20:36:39.649980 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:39.649930    4060 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-59c6s" podStartSLOduration=1.114414956 podStartE2EDuration="5.649917119s" totalImagesPullingTime="4.535502163s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:36:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:36:39.64965081 +0000 UTC m=+18.406649108" watchObservedRunningTime="2026-10-30 20:36:39.649917119 +0000 UTC m=+18.406915412"
Oct 30 20:36:39.770627 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:39.770567    4060 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-v2f4x" podStartSLOduration=3.059017549 podStartE2EDuration="6.770547333s" totalImagesPullingTime="3.711529784s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 20:36:33 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:36:39.769718657 +0000 UTC m=+18.526716950" watchObservedRunningTime="2026-10-30 20:36:39.770547333 +0000 UTC m=+18.527545628"
Oct 30 20:36:40.542046 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:40.542002    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65c77b44d-d7rsp" event={"ID":"62d83fcc-c39b-4dc5-909f-cea15b697a2d","Type":"ContainerStarted","Data":"10197a64ee13e9e2f97cc6dff216e35c2d036576b86a9c1a7423f8ae02f03618"}
Oct 30 20:36:40.542571 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:40.542058    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65c77b44d-d7rsp" event={"ID":"62d83fcc-c39b-4dc5-909f-cea15b697a2d","Type":"ContainerStarted","Data":"9efcee321e351493f62315588ff7e3e75c9138f8faaa52419410e3ae825008ac"}
Oct 30 20:36:40.544149 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:40.544117    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5dddfcd9fc-ltgv9" event={"ID":"9f9d9f58-7252-4b1b-96ac-3a8b77b7f038","Type":"ContainerStarted","Data":"fe2024ac53020349d6b4ff104715b3579e81f74fdb8ce372f629053368f7ad5c"}
Oct 30 20:36:40.661869 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:40.661289    4060 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-console/console-65c77b44d-d7rsp" podStartSLOduration=1.8078492929999999 podStartE2EDuration="2.661274196s" totalImagesPullingTime="853.424903ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:36:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:36:40.660283881 +0000 UTC m=+19.417282189" watchObservedRunningTime="2026-10-30 20:36:40.661274196 +0000 UTC m=+19.418272490"
Oct 30 20:36:40.779666 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:40.778696    4060 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-console/console-5dddfcd9fc-ltgv9" podStartSLOduration=2.819329957 podStartE2EDuration="7.778677568s" totalImagesPullingTime="4.959347611s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:36:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:36:40.77855595 +0000 UTC m=+19.535554246" watchObservedRunningTime="2026-10-30 20:36:40.778677568 +0000 UTC m=+19.535675863"
Oct 30 20:36:41.550229 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:41.550190    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-9cd89b74c-rgltt" event={"ID":"a046541e-b2d8-4e1f-a0ab-b0d75e95a7fa","Type":"ContainerStarted","Data":"97d4c86f8b3f0e9e5940ec132974cb0e0031fdb3a30316723df738fe62541973"}
Oct 30 20:36:41.550703 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:41.550279    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-9cd89b74c-rgltt" event={"ID":"a046541e-b2d8-4e1f-a0ab-b0d75e95a7fa","Type":"ContainerStarted","Data":"afdceef2a8c71a267438e0702546ae937d34504fc8713b314838bac856bc8d3d"}
Oct 30 20:36:41.730064 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:41.730003    4060 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-9cd89b74c-rgltt" podStartSLOduration=1.888717757 podStartE2EDuration="3.729984716s" totalImagesPullingTime="1.841266959s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:36:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:36:41.729634821 +0000 UTC m=+20.486633117" watchObservedRunningTime="2026-10-30 20:36:41.729984716 +0000 UTC m=+20.486983014"
Oct 30 20:36:42.153640 ip-10-0-142-4 kubenswrapper[4060]: E1030 20:36:42.153566    4060 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v2f4x" containerName="extractor"
Oct 30 20:36:44.126855 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:44.126822    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-mlgfz"
Oct 30 20:36:44.174420 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:44.174390    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5dddfcd9fc-ltgv9"
Oct 30 20:36:44.174605 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:44.174532    4060 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5dddfcd9fc-ltgv9"
Oct 30 20:36:44.180888 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:44.180866    4060 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5dddfcd9fc-ltgv9"
Oct 30 20:36:44.287056 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:44.287025    4060 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-bmddw"]
Oct 30 20:36:44.289291 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:44.289259    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-bmddw"
Oct 30 20:36:44.344990 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:44.344957    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Oct 30 20:36:44.351573 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:44.351543    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/28f01de8-7376-43d8-9543-5a30d01332e7-node-exporter-wtmp\") pod \"node-exporter-bmddw\" (UID: \"28f01de8-7376-43d8-9543-5a30d01332e7\") " pod="openshift-monitoring/node-exporter-bmddw"
Oct 30 20:36:44.351723 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:44.351592    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/28f01de8-7376-43d8-9543-5a30d01332e7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bmddw\" (UID: \"28f01de8-7376-43d8-9543-5a30d01332e7\") " pod="openshift-monitoring/node-exporter-bmddw"
Oct 30 20:36:44.351723 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:44.351675    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/28f01de8-7376-43d8-9543-5a30d01332e7-metrics-client-ca\") pod \"node-exporter-bmddw\" (UID: \"28f01de8-7376-43d8-9543-5a30d01332e7\") " pod="openshift-monitoring/node-exporter-bmddw"
Oct 30 20:36:44.351723 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:44.351709    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sp6zz\" (UniqueName: \"kubernetes.io/projected/28f01de8-7376-43d8-9543-5a30d01332e7-kube-api-access-sp6zz\") pod \"node-exporter-bmddw\" (UID: \"28f01de8-7376-43d8-9543-5a30d01332e7\") " pod="openshift-monitoring/node-exporter-bmddw"
Oct 30 20:36:44.351871 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:44.351784    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/28f01de8-7376-43d8-9543-5a30d01332e7-node-exporter-tls\") pod \"node-exporter-bmddw\" (UID: \"28f01de8-7376-43d8-9543-5a30d01332e7\") " pod="openshift-monitoring/node-exporter-bmddw"
Oct 30 20:36:44.351871 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:44.351830    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/28f01de8-7376-43d8-9543-5a30d01332e7-node-exporter-accelerators-collector-config\") pod \"node-exporter-bmddw\" (UID: \"28f01de8-7376-43d8-9543-5a30d01332e7\") " pod="openshift-monitoring/node-exporter-bmddw"
Oct 30 20:36:44.351871 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:44.351858    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/28f01de8-7376-43d8-9543-5a30d01332e7-sys\") pod \"node-exporter-bmddw\" (UID: \"28f01de8-7376-43d8-9543-5a30d01332e7\") " pod="openshift-monitoring/node-exporter-bmddw"
Oct 30 20:36:44.352006 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:44.351880    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/28f01de8-7376-43d8-9543-5a30d01332e7-root\") pod \"node-exporter-bmddw\" (UID: \"28f01de8-7376-43d8-9543-5a30d01332e7\") " pod="openshift-monitoring/node-exporter-bmddw"
Oct 30 20:36:44.352006 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:44.351966    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/28f01de8-7376-43d8-9543-5a30d01332e7-node-exporter-textfile\") pod \"node-exporter-bmddw\" (UID: \"28f01de8-7376-43d8-9543-5a30d01332e7\") " pod="openshift-monitoring/node-exporter-bmddw"
Oct 30 20:36:44.357236 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:44.357216    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Oct 30 20:36:44.357236 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:44.357225    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-5v6zk\""
Oct 30 20:36:44.357367 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:44.357263    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Oct 30 20:36:44.453153 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:44.453118    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/28f01de8-7376-43d8-9543-5a30d01332e7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bmddw\" (UID: \"28f01de8-7376-43d8-9543-5a30d01332e7\") " pod="openshift-monitoring/node-exporter-bmddw"
Oct 30 20:36:44.453430 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:44.453168    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/28f01de8-7376-43d8-9543-5a30d01332e7-metrics-client-ca\") pod \"node-exporter-bmddw\" (UID: \"28f01de8-7376-43d8-9543-5a30d01332e7\") " pod="openshift-monitoring/node-exporter-bmddw"
Oct 30 20:36:44.453430 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:44.453289    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sp6zz\" (UniqueName: \"kubernetes.io/projected/28f01de8-7376-43d8-9543-5a30d01332e7-kube-api-access-sp6zz\") pod \"node-exporter-bmddw\" (UID: \"28f01de8-7376-43d8-9543-5a30d01332e7\") " pod="openshift-monitoring/node-exporter-bmddw"
Oct 30 20:36:44.453430 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:44.453341    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/28f01de8-7376-43d8-9543-5a30d01332e7-node-exporter-tls\") pod \"node-exporter-bmddw\" (UID: \"28f01de8-7376-43d8-9543-5a30d01332e7\") " pod="openshift-monitoring/node-exporter-bmddw"
Oct 30 20:36:44.453430 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:44.453389    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/28f01de8-7376-43d8-9543-5a30d01332e7-node-exporter-accelerators-collector-config\") pod \"node-exporter-bmddw\" (UID: \"28f01de8-7376-43d8-9543-5a30d01332e7\") " pod="openshift-monitoring/node-exporter-bmddw"
Oct 30 20:36:44.453430 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:44.453421    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/28f01de8-7376-43d8-9543-5a30d01332e7-sys\") pod \"node-exporter-bmddw\" (UID: \"28f01de8-7376-43d8-9543-5a30d01332e7\") " pod="openshift-monitoring/node-exporter-bmddw"
Oct 30 20:36:44.453757 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:44.453441    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/28f01de8-7376-43d8-9543-5a30d01332e7-root\") pod \"node-exporter-bmddw\" (UID: \"28f01de8-7376-43d8-9543-5a30d01332e7\") " pod="openshift-monitoring/node-exporter-bmddw"
Oct 30 20:36:44.453757 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:44.453481    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/28f01de8-7376-43d8-9543-5a30d01332e7-node-exporter-textfile\") pod \"node-exporter-bmddw\" (UID: \"28f01de8-7376-43d8-9543-5a30d01332e7\") " pod="openshift-monitoring/node-exporter-bmddw"
Oct 30 20:36:44.453757 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:44.453540    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/28f01de8-7376-43d8-9543-5a30d01332e7-node-exporter-wtmp\") pod \"node-exporter-bmddw\" (UID: \"28f01de8-7376-43d8-9543-5a30d01332e7\") " pod="openshift-monitoring/node-exporter-bmddw"
Oct 30 20:36:44.453757 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:44.453716    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/28f01de8-7376-43d8-9543-5a30d01332e7-node-exporter-wtmp\") pod \"node-exporter-bmddw\" (UID: \"28f01de8-7376-43d8-9543-5a30d01332e7\") " pod="openshift-monitoring/node-exporter-bmddw"
Oct 30 20:36:44.454040 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:44.454013    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/28f01de8-7376-43d8-9543-5a30d01332e7-metrics-client-ca\") pod \"node-exporter-bmddw\" (UID: \"28f01de8-7376-43d8-9543-5a30d01332e7\") " pod="openshift-monitoring/node-exporter-bmddw"
Oct 30 20:36:44.454120 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:44.454103    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/28f01de8-7376-43d8-9543-5a30d01332e7-sys\") pod \"node-exporter-bmddw\" (UID: \"28f01de8-7376-43d8-9543-5a30d01332e7\") " pod="openshift-monitoring/node-exporter-bmddw"
Oct 30 20:36:44.454744 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:44.454412    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/28f01de8-7376-43d8-9543-5a30d01332e7-root\") pod \"node-exporter-bmddw\" (UID: \"28f01de8-7376-43d8-9543-5a30d01332e7\") " pod="openshift-monitoring/node-exporter-bmddw"
Oct 30 20:36:44.454744 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:44.454644    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/28f01de8-7376-43d8-9543-5a30d01332e7-node-exporter-accelerators-collector-config\") pod \"node-exporter-bmddw\" (UID: \"28f01de8-7376-43d8-9543-5a30d01332e7\") " pod="openshift-monitoring/node-exporter-bmddw"
Oct 30 20:36:44.454744 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:44.454704    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/28f01de8-7376-43d8-9543-5a30d01332e7-node-exporter-textfile\") pod \"node-exporter-bmddw\" (UID: \"28f01de8-7376-43d8-9543-5a30d01332e7\") " pod="openshift-monitoring/node-exporter-bmddw"
Oct 30 20:36:44.456430 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:44.456410    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/28f01de8-7376-43d8-9543-5a30d01332e7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bmddw\" (UID: \"28f01de8-7376-43d8-9543-5a30d01332e7\") " pod="openshift-monitoring/node-exporter-bmddw"
Oct 30 20:36:44.456568 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:44.456554    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/28f01de8-7376-43d8-9543-5a30d01332e7-node-exporter-tls\") pod \"node-exporter-bmddw\" (UID: \"28f01de8-7376-43d8-9543-5a30d01332e7\") " pod="openshift-monitoring/node-exporter-bmddw"
Oct 30 20:36:44.517118 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:44.517093    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sp6zz\" (UniqueName: \"kubernetes.io/projected/28f01de8-7376-43d8-9543-5a30d01332e7-kube-api-access-sp6zz\") pod \"node-exporter-bmddw\" (UID: \"28f01de8-7376-43d8-9543-5a30d01332e7\") " pod="openshift-monitoring/node-exporter-bmddw"
Oct 30 20:36:44.565297 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:44.565266    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5dddfcd9fc-ltgv9"
Oct 30 20:36:44.602586 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:44.602560    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-bmddw"
Oct 30 20:36:44.624041 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:44.624005    4060 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28f01de8_7376_43d8_9543_5a30d01332e7.slice/crio-e747cba36e33dc7d69d7615f14fa58ced0d379dcc0b45e181197a1d57b31d1e0 WatchSource:0}: Error finding container e747cba36e33dc7d69d7615f14fa58ced0d379dcc0b45e181197a1d57b31d1e0: Status 404 returned error can't find the container with id e747cba36e33dc7d69d7615f14fa58ced0d379dcc0b45e181197a1d57b31d1e0
Oct 30 20:36:45.566564 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:45.566529    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bmddw" event={"ID":"28f01de8-7376-43d8-9543-5a30d01332e7","Type":"ContainerStarted","Data":"e747cba36e33dc7d69d7615f14fa58ced0d379dcc0b45e181197a1d57b31d1e0"}
Oct 30 20:36:46.572783 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:46.572693    4060 generic.go:356] "Generic (PLEG): container finished" podID="28f01de8-7376-43d8-9543-5a30d01332e7" containerID="9a77d3e11353bf7cb92c0e6c7955973aa54f44172cc07728573de82dfc0e6c83" exitCode=0
Oct 30 20:36:46.572783 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:46.572735    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bmddw" event={"ID":"28f01de8-7376-43d8-9543-5a30d01332e7","Type":"ContainerDied","Data":"9a77d3e11353bf7cb92c0e6c7955973aa54f44172cc07728573de82dfc0e6c83"}
Oct 30 20:36:47.579444 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:47.579403    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bmddw" event={"ID":"28f01de8-7376-43d8-9543-5a30d01332e7","Type":"ContainerStarted","Data":"67a2e2b6d9df4e53b9e8597a24de6b0867639d687405ca5c509fb22eb25f72d8"}
Oct 30 20:36:47.579928 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:47.579471    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bmddw" event={"ID":"28f01de8-7376-43d8-9543-5a30d01332e7","Type":"ContainerStarted","Data":"00e9c8ac68f012ae97625d17905ee981318adb4c985c19985e02acb692c601c0"}
Oct 30 20:36:47.699525 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:47.699450    4060 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-bmddw" podStartSLOduration=2.014275905 podStartE2EDuration="3.69943635s" totalImagesPullingTime="1.613358717s" totalInitContainerRuntime="71.801728ms" isStatefulPod=true podCreationTimestamp="2026-10-30 20:36:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:36:47.699313739 +0000 UTC m=+26.456312062" watchObservedRunningTime="2026-10-30 20:36:47.69943635 +0000 UTC m=+26.456434641"
Oct 30 20:36:49.091483 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:49.091427    4060 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-65c77b44d-d7rsp"
Oct 30 20:36:49.091982 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:49.091529    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-65c77b44d-d7rsp"
Oct 30 20:36:49.096849 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:49.096826    4060 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-65c77b44d-d7rsp"
Oct 30 20:36:49.411302 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:49.411237    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-scs59"
Oct 30 20:36:49.546534 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:49.546505    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-z42qf"
Oct 30 20:36:49.592262 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:49.592231    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-65c77b44d-d7rsp"
Oct 30 20:36:49.875518 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:49.875470    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5dddfcd9fc-ltgv9"]
Oct 30 20:36:54.608280 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:54.608244    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6dd789c8b7-7dvr6" event={"ID":"000a7a62-eca7-42cb-8e5f-829c1d37485d","Type":"ContainerStarted","Data":"f2466321bf091b6be4000d2368171d6d903fb302b6c5a5ce117d0dd92a628096"}
Oct 30 20:36:54.608752 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:54.608367    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-6dd789c8b7-7dvr6"
Oct 30 20:36:54.615141 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:54.615112    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-6dd789c8b7-7dvr6"
Oct 30 20:36:54.824360 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:54.824305    4060 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-console/downloads-6dd789c8b7-7dvr6" podStartSLOduration=2.732870182 podStartE2EDuration="21.824289205s" totalImagesPullingTime="19.091419023s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:36:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:36:54.774312322 +0000 UTC m=+33.531310619" watchObservedRunningTime="2026-10-30 20:36:54.824289205 +0000 UTC m=+33.581287500"
Oct 30 20:36:55.032220 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:55.032172    4060 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console/console-7484b7dfbb-9v55p"]
Oct 30 20:36:55.060528 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:55.060480    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7484b7dfbb-9v55p"
Oct 30 20:36:55.099600 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:55.099563    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7484b7dfbb-9v55p"]
Oct 30 20:36:55.145447 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:55.145406    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/61348763-0eff-4826-854a-029c3679794f-console-oauth-config\") pod \"console-7484b7dfbb-9v55p\" (UID: \"61348763-0eff-4826-854a-029c3679794f\") " pod="openshift-console/console-7484b7dfbb-9v55p"
Oct 30 20:36:55.145637 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:55.145475    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wccwb\" (UniqueName: \"kubernetes.io/projected/61348763-0eff-4826-854a-029c3679794f-kube-api-access-wccwb\") pod \"console-7484b7dfbb-9v55p\" (UID: \"61348763-0eff-4826-854a-029c3679794f\") " pod="openshift-console/console-7484b7dfbb-9v55p"
Oct 30 20:36:55.145637 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:55.145606    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/61348763-0eff-4826-854a-029c3679794f-service-ca\") pod \"console-7484b7dfbb-9v55p\" (UID: \"61348763-0eff-4826-854a-029c3679794f\") " pod="openshift-console/console-7484b7dfbb-9v55p"
Oct 30 20:36:55.145757 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:55.145650    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/61348763-0eff-4826-854a-029c3679794f-trusted-ca-bundle\") pod \"console-7484b7dfbb-9v55p\" (UID: \"61348763-0eff-4826-854a-029c3679794f\") " pod="openshift-console/console-7484b7dfbb-9v55p"
Oct 30 20:36:55.145757 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:55.145688    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/61348763-0eff-4826-854a-029c3679794f-oauth-serving-cert\") pod \"console-7484b7dfbb-9v55p\" (UID: \"61348763-0eff-4826-854a-029c3679794f\") " pod="openshift-console/console-7484b7dfbb-9v55p"
Oct 30 20:36:55.145844 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:55.145823    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/61348763-0eff-4826-854a-029c3679794f-console-serving-cert\") pod \"console-7484b7dfbb-9v55p\" (UID: \"61348763-0eff-4826-854a-029c3679794f\") " pod="openshift-console/console-7484b7dfbb-9v55p"
Oct 30 20:36:55.145902 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:55.145861    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/61348763-0eff-4826-854a-029c3679794f-tmp\") pod \"console-7484b7dfbb-9v55p\" (UID: \"61348763-0eff-4826-854a-029c3679794f\") " pod="openshift-console/console-7484b7dfbb-9v55p"
Oct 30 20:36:55.145970 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:55.145948    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/61348763-0eff-4826-854a-029c3679794f-console-config\") pod \"console-7484b7dfbb-9v55p\" (UID: \"61348763-0eff-4826-854a-029c3679794f\") " pod="openshift-console/console-7484b7dfbb-9v55p"
Oct 30 20:36:55.246856 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:55.246818    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/61348763-0eff-4826-854a-029c3679794f-console-oauth-config\") pod \"console-7484b7dfbb-9v55p\" (UID: \"61348763-0eff-4826-854a-029c3679794f\") " pod="openshift-console/console-7484b7dfbb-9v55p"
Oct 30 20:36:55.247051 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:55.246890    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wccwb\" (UniqueName: \"kubernetes.io/projected/61348763-0eff-4826-854a-029c3679794f-kube-api-access-wccwb\") pod \"console-7484b7dfbb-9v55p\" (UID: \"61348763-0eff-4826-854a-029c3679794f\") " pod="openshift-console/console-7484b7dfbb-9v55p"
Oct 30 20:36:55.247051 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:55.246915    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/61348763-0eff-4826-854a-029c3679794f-service-ca\") pod \"console-7484b7dfbb-9v55p\" (UID: \"61348763-0eff-4826-854a-029c3679794f\") " pod="openshift-console/console-7484b7dfbb-9v55p"
Oct 30 20:36:55.247051 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:55.246944    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/61348763-0eff-4826-854a-029c3679794f-trusted-ca-bundle\") pod \"console-7484b7dfbb-9v55p\" (UID: \"61348763-0eff-4826-854a-029c3679794f\") " pod="openshift-console/console-7484b7dfbb-9v55p"
Oct 30 20:36:55.247051 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:55.246972    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/61348763-0eff-4826-854a-029c3679794f-oauth-serving-cert\") pod \"console-7484b7dfbb-9v55p\" (UID: \"61348763-0eff-4826-854a-029c3679794f\") " pod="openshift-console/console-7484b7dfbb-9v55p"
Oct 30 20:36:55.247051 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:55.247007    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/61348763-0eff-4826-854a-029c3679794f-console-serving-cert\") pod \"console-7484b7dfbb-9v55p\" (UID: \"61348763-0eff-4826-854a-029c3679794f\") " pod="openshift-console/console-7484b7dfbb-9v55p"
Oct 30 20:36:55.247051 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:55.247030    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/61348763-0eff-4826-854a-029c3679794f-tmp\") pod \"console-7484b7dfbb-9v55p\" (UID: \"61348763-0eff-4826-854a-029c3679794f\") " pod="openshift-console/console-7484b7dfbb-9v55p"
Oct 30 20:36:55.247352 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:55.247057    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/61348763-0eff-4826-854a-029c3679794f-console-config\") pod \"console-7484b7dfbb-9v55p\" (UID: \"61348763-0eff-4826-854a-029c3679794f\") " pod="openshift-console/console-7484b7dfbb-9v55p"
Oct 30 20:36:55.247892 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:55.247866    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/61348763-0eff-4826-854a-029c3679794f-service-ca\") pod \"console-7484b7dfbb-9v55p\" (UID: \"61348763-0eff-4826-854a-029c3679794f\") " pod="openshift-console/console-7484b7dfbb-9v55p"
Oct 30 20:36:55.248059 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:55.247906    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/61348763-0eff-4826-854a-029c3679794f-console-config\") pod \"console-7484b7dfbb-9v55p\" (UID: \"61348763-0eff-4826-854a-029c3679794f\") " pod="openshift-console/console-7484b7dfbb-9v55p"
Oct 30 20:36:55.248168 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:55.248024    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/61348763-0eff-4826-854a-029c3679794f-tmp\") pod \"console-7484b7dfbb-9v55p\" (UID: \"61348763-0eff-4826-854a-029c3679794f\") " pod="openshift-console/console-7484b7dfbb-9v55p"
Oct 30 20:36:55.248662 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:55.248639    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/61348763-0eff-4826-854a-029c3679794f-trusted-ca-bundle\") pod \"console-7484b7dfbb-9v55p\" (UID: \"61348763-0eff-4826-854a-029c3679794f\") " pod="openshift-console/console-7484b7dfbb-9v55p"
Oct 30 20:36:55.249333 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:55.249304    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/61348763-0eff-4826-854a-029c3679794f-oauth-serving-cert\") pod \"console-7484b7dfbb-9v55p\" (UID: \"61348763-0eff-4826-854a-029c3679794f\") " pod="openshift-console/console-7484b7dfbb-9v55p"
Oct 30 20:36:55.249973 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:55.249933    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/61348763-0eff-4826-854a-029c3679794f-console-oauth-config\") pod \"console-7484b7dfbb-9v55p\" (UID: \"61348763-0eff-4826-854a-029c3679794f\") " pod="openshift-console/console-7484b7dfbb-9v55p"
Oct 30 20:36:55.250185 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:55.250160    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/61348763-0eff-4826-854a-029c3679794f-console-serving-cert\") pod \"console-7484b7dfbb-9v55p\" (UID: \"61348763-0eff-4826-854a-029c3679794f\") " pod="openshift-console/console-7484b7dfbb-9v55p"
Oct 30 20:36:55.310159 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:55.310092    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wccwb\" (UniqueName: \"kubernetes.io/projected/61348763-0eff-4826-854a-029c3679794f-kube-api-access-wccwb\") pod \"console-7484b7dfbb-9v55p\" (UID: \"61348763-0eff-4826-854a-029c3679794f\") " pod="openshift-console/console-7484b7dfbb-9v55p"
Oct 30 20:36:55.389469 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:55.389230    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7484b7dfbb-9v55p"
Oct 30 20:36:55.795484 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:55.795452    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7484b7dfbb-9v55p"]
Oct 30 20:36:55.799409 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:36:55.799374    4060 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61348763_0eff_4826_854a_029c3679794f.slice/crio-15b27bf2fc2b7aefdcd1deeb61e91f7956d629709f098ecd9c817f003e6d942e WatchSource:0}: Error finding container 15b27bf2fc2b7aefdcd1deeb61e91f7956d629709f098ecd9c817f003e6d942e: Status 404 returned error can't find the container with id 15b27bf2fc2b7aefdcd1deeb61e91f7956d629709f098ecd9c817f003e6d942e
Oct 30 20:36:56.510753 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:56.510724    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7cd778b784-cpswn"
Oct 30 20:36:56.621677 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:56.621630    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7484b7dfbb-9v55p" event={"ID":"61348763-0eff-4826-854a-029c3679794f","Type":"ContainerStarted","Data":"5d17ddc1afe7efb761a9864649d5efb7cd8f1a0367972495b59d908cec3f4ad9"}
Oct 30 20:36:56.621861 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:56.621720    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7484b7dfbb-9v55p" event={"ID":"61348763-0eff-4826-854a-029c3679794f","Type":"ContainerStarted","Data":"15b27bf2fc2b7aefdcd1deeb61e91f7956d629709f098ecd9c817f003e6d942e"}
Oct 30 20:36:56.803172 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:36:56.803062    4060 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-console/console-7484b7dfbb-9v55p" podStartSLOduration=2.803044979 podStartE2EDuration="2.803044979s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:36:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:36:56.802202552 +0000 UTC m=+35.559200850" watchObservedRunningTime="2026-10-30 20:36:56.803044979 +0000 UTC m=+35.560043278"
Oct 30 20:37:05.390193 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:37:05.390071    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7484b7dfbb-9v55p"
Oct 30 20:37:05.390193 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:37:05.390135    4060 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7484b7dfbb-9v55p"
Oct 30 20:37:05.394994 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:37:05.394974    4060 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7484b7dfbb-9v55p"
Oct 30 20:37:05.657813 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:37:05.657733    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7484b7dfbb-9v55p"
Oct 30 20:37:05.821068 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:37:05.821031    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-65c77b44d-d7rsp"]
Oct 30 20:37:12.150027 ip-10-0-142-4 kubenswrapper[4060]: E1030 20:37:12.149993    4060 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v2f4x" containerName="extractor"
Oct 30 20:37:14.899553 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:37:14.899467    4060 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-console/console-5dddfcd9fc-ltgv9" podUID="9f9d9f58-7252-4b1b-96ac-3a8b77b7f038" containerName="console" containerID="cri-o://fe2024ac53020349d6b4ff104715b3579e81f74fdb8ce372f629053368f7ad5c" gracePeriod=15
Oct 30 20:37:15.148415 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:37:15.148391    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5dddfcd9fc-ltgv9"
Oct 30 20:37:15.309678 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:37:15.309649    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9f9d9f58-7252-4b1b-96ac-3a8b77b7f038-console-config\" (UniqueName: \"kubernetes.io/configmap/9f9d9f58-7252-4b1b-96ac-3a8b77b7f038-console-config\") pod \"9f9d9f58-7252-4b1b-96ac-3a8b77b7f038\" (UID: \"9f9d9f58-7252-4b1b-96ac-3a8b77b7f038\") "
Oct 30 20:37:15.309849 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:37:15.309692    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9f9d9f58-7252-4b1b-96ac-3a8b77b7f038-service-ca\" (UniqueName: \"kubernetes.io/configmap/9f9d9f58-7252-4b1b-96ac-3a8b77b7f038-service-ca\") pod \"9f9d9f58-7252-4b1b-96ac-3a8b77b7f038\" (UID: \"9f9d9f58-7252-4b1b-96ac-3a8b77b7f038\") "
Oct 30 20:37:15.309849 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:37:15.309739    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/9f9d9f58-7252-4b1b-96ac-3a8b77b7f038-console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9f9d9f58-7252-4b1b-96ac-3a8b77b7f038-console-serving-cert\") pod \"9f9d9f58-7252-4b1b-96ac-3a8b77b7f038\" (UID: \"9f9d9f58-7252-4b1b-96ac-3a8b77b7f038\") "
Oct 30 20:37:15.309849 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:37:15.309774    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9f9d9f58-7252-4b1b-96ac-3a8b77b7f038-kube-api-access-lgmj6\" (UniqueName: \"kubernetes.io/projected/9f9d9f58-7252-4b1b-96ac-3a8b77b7f038-kube-api-access-lgmj6\") pod \"9f9d9f58-7252-4b1b-96ac-3a8b77b7f038\" (UID: \"9f9d9f58-7252-4b1b-96ac-3a8b77b7f038\") "
Oct 30 20:37:15.309849 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:37:15.309800    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/9f9d9f58-7252-4b1b-96ac-3a8b77b7f038-console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9f9d9f58-7252-4b1b-96ac-3a8b77b7f038-console-oauth-config\") pod \"9f9d9f58-7252-4b1b-96ac-3a8b77b7f038\" (UID: \"9f9d9f58-7252-4b1b-96ac-3a8b77b7f038\") "
Oct 30 20:37:15.309849 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:37:15.309838    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9f9d9f58-7252-4b1b-96ac-3a8b77b7f038-tmp\" (UniqueName: \"kubernetes.io/empty-dir/9f9d9f58-7252-4b1b-96ac-3a8b77b7f038-tmp\") pod \"9f9d9f58-7252-4b1b-96ac-3a8b77b7f038\" (UID: \"9f9d9f58-7252-4b1b-96ac-3a8b77b7f038\") "
Oct 30 20:37:15.310093 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:37:15.309875    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9f9d9f58-7252-4b1b-96ac-3a8b77b7f038-oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9f9d9f58-7252-4b1b-96ac-3a8b77b7f038-oauth-serving-cert\") pod \"9f9d9f58-7252-4b1b-96ac-3a8b77b7f038\" (UID: \"9f9d9f58-7252-4b1b-96ac-3a8b77b7f038\") "
Oct 30 20:37:15.310148 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:37:15.310122    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9f9d9f58-7252-4b1b-96ac-3a8b77b7f038-console-config" pod "9f9d9f58-7252-4b1b-96ac-3a8b77b7f038" (UID: "9f9d9f58-7252-4b1b-96ac-3a8b77b7f038"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:37:15.310282 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:37:15.310249    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f9d9f58-7252-4b1b-96ac-3a8b77b7f038-tmp" pod "9f9d9f58-7252-4b1b-96ac-3a8b77b7f038" (UID: "9f9d9f58-7252-4b1b-96ac-3a8b77b7f038"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:37:15.310358 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:37:15.310273    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9f9d9f58-7252-4b1b-96ac-3a8b77b7f038-service-ca" pod "9f9d9f58-7252-4b1b-96ac-3a8b77b7f038" (UID: "9f9d9f58-7252-4b1b-96ac-3a8b77b7f038"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:37:15.310358 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:37:15.310324    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9f9d9f58-7252-4b1b-96ac-3a8b77b7f038-oauth-serving-cert" pod "9f9d9f58-7252-4b1b-96ac-3a8b77b7f038" (UID: "9f9d9f58-7252-4b1b-96ac-3a8b77b7f038"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:37:15.312113 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:37:15.312082    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9f9d9f58-7252-4b1b-96ac-3a8b77b7f038-console-oauth-config" pod "9f9d9f58-7252-4b1b-96ac-3a8b77b7f038" (UID: "9f9d9f58-7252-4b1b-96ac-3a8b77b7f038"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:37:15.312225 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:37:15.312116    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f9d9f58-7252-4b1b-96ac-3a8b77b7f038-kube-api-access-lgmj6" pod "9f9d9f58-7252-4b1b-96ac-3a8b77b7f038" (UID: "9f9d9f58-7252-4b1b-96ac-3a8b77b7f038"). InnerVolumeSpecName "kube-api-access-lgmj6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:37:15.312225 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:37:15.312143    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9f9d9f58-7252-4b1b-96ac-3a8b77b7f038-console-serving-cert" pod "9f9d9f58-7252-4b1b-96ac-3a8b77b7f038" (UID: "9f9d9f58-7252-4b1b-96ac-3a8b77b7f038"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:37:15.410770 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:37:15.410730    4060 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9f9d9f58-7252-4b1b-96ac-3a8b77b7f038-console-oauth-config\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:37:15.410770 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:37:15.410762    4060 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9f9d9f58-7252-4b1b-96ac-3a8b77b7f038-tmp\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:37:15.410770 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:37:15.410772    4060 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9f9d9f58-7252-4b1b-96ac-3a8b77b7f038-oauth-serving-cert\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:37:15.410770 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:37:15.410781    4060 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9f9d9f58-7252-4b1b-96ac-3a8b77b7f038-console-config\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:37:15.410770 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:37:15.410789    4060 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9f9d9f58-7252-4b1b-96ac-3a8b77b7f038-service-ca\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:37:15.411070 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:37:15.410798    4060 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9f9d9f58-7252-4b1b-96ac-3a8b77b7f038-console-serving-cert\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:37:15.411070 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:37:15.410806    4060 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lgmj6\" (UniqueName: \"kubernetes.io/projected/9f9d9f58-7252-4b1b-96ac-3a8b77b7f038-kube-api-access-lgmj6\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:37:15.687255 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:37:15.687170    4060 generic.go:356] "Generic (PLEG): container finished" podID="9f9d9f58-7252-4b1b-96ac-3a8b77b7f038" containerID="fe2024ac53020349d6b4ff104715b3579e81f74fdb8ce372f629053368f7ad5c" exitCode=0
Oct 30 20:37:15.687255 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:37:15.687214    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5dddfcd9fc-ltgv9"
Oct 30 20:37:15.687482 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:37:15.687259    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5dddfcd9fc-ltgv9" event={"ID":"9f9d9f58-7252-4b1b-96ac-3a8b77b7f038","Type":"ContainerDied","Data":"fe2024ac53020349d6b4ff104715b3579e81f74fdb8ce372f629053368f7ad5c"}
Oct 30 20:37:15.687482 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:37:15.687315    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5dddfcd9fc-ltgv9" event={"ID":"9f9d9f58-7252-4b1b-96ac-3a8b77b7f038","Type":"ContainerDied","Data":"4728ca3ef528f9ddb665d967b78a6c0745e3c3177a70dcb03f184443a86530ef"}
Oct 30 20:37:15.687482 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:37:15.687341    4060 scope.go:122] "RemoveContainer" containerID="fe2024ac53020349d6b4ff104715b3579e81f74fdb8ce372f629053368f7ad5c"
Oct 30 20:37:15.695584 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:37:15.695567    4060 scope.go:122] "RemoveContainer" containerID="fe2024ac53020349d6b4ff104715b3579e81f74fdb8ce372f629053368f7ad5c"
Oct 30 20:37:15.695861 ip-10-0-142-4 kubenswrapper[4060]: E1030 20:37:15.695841    4060 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fe2024ac53020349d6b4ff104715b3579e81f74fdb8ce372f629053368f7ad5c\": container with ID starting with fe2024ac53020349d6b4ff104715b3579e81f74fdb8ce372f629053368f7ad5c not found: ID does not exist" containerID="fe2024ac53020349d6b4ff104715b3579e81f74fdb8ce372f629053368f7ad5c"
Oct 30 20:37:15.695920 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:37:15.695870    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fe2024ac53020349d6b4ff104715b3579e81f74fdb8ce372f629053368f7ad5c"} err="failed to get container status \"fe2024ac53020349d6b4ff104715b3579e81f74fdb8ce372f629053368f7ad5c\": rpc error: code = NotFound desc = could not find container \"fe2024ac53020349d6b4ff104715b3579e81f74fdb8ce372f629053368f7ad5c\": container with ID starting with fe2024ac53020349d6b4ff104715b3579e81f74fdb8ce372f629053368f7ad5c not found: ID does not exist"
Oct 30 20:37:15.850174 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:37:15.850138    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5dddfcd9fc-ltgv9"]
Oct 30 20:37:15.899708 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:37:15.899678    4060 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5dddfcd9fc-ltgv9"]
Oct 30 20:37:17.425391 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:37:17.425359    4060 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9f9d9f58-7252-4b1b-96ac-3a8b77b7f038" path="/var/lib/kubelet/pods/9f9d9f58-7252-4b1b-96ac-3a8b77b7f038/volumes"
Oct 30 20:37:30.840152 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:37:30.840091    4060 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-console/console-65c77b44d-d7rsp" podUID="62d83fcc-c39b-4dc5-909f-cea15b697a2d" containerName="console" containerID="cri-o://10197a64ee13e9e2f97cc6dff216e35c2d036576b86a9c1a7423f8ae02f03618" gracePeriod=15
Oct 30 20:37:31.096445 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:37:31.096378    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65c77b44d-d7rsp"
Oct 30 20:37:31.125965 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:37:31.125938    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/62d83fcc-c39b-4dc5-909f-cea15b697a2d-tmp\" (UniqueName: \"kubernetes.io/empty-dir/62d83fcc-c39b-4dc5-909f-cea15b697a2d-tmp\") pod \"62d83fcc-c39b-4dc5-909f-cea15b697a2d\" (UID: \"62d83fcc-c39b-4dc5-909f-cea15b697a2d\") "
Oct 30 20:37:31.126092 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:37:31.125990    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/62d83fcc-c39b-4dc5-909f-cea15b697a2d-console-config\" (UniqueName: \"kubernetes.io/configmap/62d83fcc-c39b-4dc5-909f-cea15b697a2d-console-config\") pod \"62d83fcc-c39b-4dc5-909f-cea15b697a2d\" (UID: \"62d83fcc-c39b-4dc5-909f-cea15b697a2d\") "
Oct 30 20:37:31.126092 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:37:31.126023    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/62d83fcc-c39b-4dc5-909f-cea15b697a2d-oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/62d83fcc-c39b-4dc5-909f-cea15b697a2d-oauth-serving-cert\") pod \"62d83fcc-c39b-4dc5-909f-cea15b697a2d\" (UID: \"62d83fcc-c39b-4dc5-909f-cea15b697a2d\") "
Oct 30 20:37:31.126092 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:37:31.126044    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/62d83fcc-c39b-4dc5-909f-cea15b697a2d-service-ca\" (UniqueName: \"kubernetes.io/configmap/62d83fcc-c39b-4dc5-909f-cea15b697a2d-service-ca\") pod \"62d83fcc-c39b-4dc5-909f-cea15b697a2d\" (UID: \"62d83fcc-c39b-4dc5-909f-cea15b697a2d\") "
Oct 30 20:37:31.126092 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:37:31.126069    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/62d83fcc-c39b-4dc5-909f-cea15b697a2d-kube-api-access-x5hz7\" (UniqueName: \"kubernetes.io/projected/62d83fcc-c39b-4dc5-909f-cea15b697a2d-kube-api-access-x5hz7\") pod \"62d83fcc-c39b-4dc5-909f-cea15b697a2d\" (UID: \"62d83fcc-c39b-4dc5-909f-cea15b697a2d\") "
Oct 30 20:37:31.126276 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:37:31.126100    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/62d83fcc-c39b-4dc5-909f-cea15b697a2d-console-oauth-config\" (UniqueName: \"kubernetes.io/secret/62d83fcc-c39b-4dc5-909f-cea15b697a2d-console-oauth-config\") pod \"62d83fcc-c39b-4dc5-909f-cea15b697a2d\" (UID: \"62d83fcc-c39b-4dc5-909f-cea15b697a2d\") "
Oct 30 20:37:31.126276 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:37:31.126147    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/62d83fcc-c39b-4dc5-909f-cea15b697a2d-console-serving-cert\" (UniqueName: \"kubernetes.io/secret/62d83fcc-c39b-4dc5-909f-cea15b697a2d-console-serving-cert\") pod \"62d83fcc-c39b-4dc5-909f-cea15b697a2d\" (UID: \"62d83fcc-c39b-4dc5-909f-cea15b697a2d\") "
Oct 30 20:37:31.126276 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:37:31.126187    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/62d83fcc-c39b-4dc5-909f-cea15b697a2d-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/62d83fcc-c39b-4dc5-909f-cea15b697a2d-trusted-ca-bundle\") pod \"62d83fcc-c39b-4dc5-909f-cea15b697a2d\" (UID: \"62d83fcc-c39b-4dc5-909f-cea15b697a2d\") "
Oct 30 20:37:31.126276 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:37:31.126223    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/62d83fcc-c39b-4dc5-909f-cea15b697a2d-tmp" pod "62d83fcc-c39b-4dc5-909f-cea15b697a2d" (UID: "62d83fcc-c39b-4dc5-909f-cea15b697a2d"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:37:31.126393 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:37:31.126378    4060 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/62d83fcc-c39b-4dc5-909f-cea15b697a2d-tmp\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:37:31.126435 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:37:31.126416    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/62d83fcc-c39b-4dc5-909f-cea15b697a2d-oauth-serving-cert" pod "62d83fcc-c39b-4dc5-909f-cea15b697a2d" (UID: "62d83fcc-c39b-4dc5-909f-cea15b697a2d"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:37:31.126487 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:37:31.126446    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/62d83fcc-c39b-4dc5-909f-cea15b697a2d-service-ca" pod "62d83fcc-c39b-4dc5-909f-cea15b697a2d" (UID: "62d83fcc-c39b-4dc5-909f-cea15b697a2d"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:37:31.126572 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:37:31.126555    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/62d83fcc-c39b-4dc5-909f-cea15b697a2d-trusted-ca-bundle" pod "62d83fcc-c39b-4dc5-909f-cea15b697a2d" (UID: "62d83fcc-c39b-4dc5-909f-cea15b697a2d"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:37:31.126799 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:37:31.126771    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/62d83fcc-c39b-4dc5-909f-cea15b697a2d-console-config" pod "62d83fcc-c39b-4dc5-909f-cea15b697a2d" (UID: "62d83fcc-c39b-4dc5-909f-cea15b697a2d"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:37:31.128462 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:37:31.128436    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/62d83fcc-c39b-4dc5-909f-cea15b697a2d-console-oauth-config" pod "62d83fcc-c39b-4dc5-909f-cea15b697a2d" (UID: "62d83fcc-c39b-4dc5-909f-cea15b697a2d"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:37:31.128572 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:37:31.128480    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/62d83fcc-c39b-4dc5-909f-cea15b697a2d-console-serving-cert" pod "62d83fcc-c39b-4dc5-909f-cea15b697a2d" (UID: "62d83fcc-c39b-4dc5-909f-cea15b697a2d"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:37:31.128572 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:37:31.128539    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/62d83fcc-c39b-4dc5-909f-cea15b697a2d-kube-api-access-x5hz7" pod "62d83fcc-c39b-4dc5-909f-cea15b697a2d" (UID: "62d83fcc-c39b-4dc5-909f-cea15b697a2d"). InnerVolumeSpecName "kube-api-access-x5hz7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:37:31.227259 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:37:31.227231    4060 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/62d83fcc-c39b-4dc5-909f-cea15b697a2d-console-serving-cert\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:37:31.227259 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:37:31.227257    4060 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/62d83fcc-c39b-4dc5-909f-cea15b697a2d-trusted-ca-bundle\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:37:31.227259 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:37:31.227266    4060 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/62d83fcc-c39b-4dc5-909f-cea15b697a2d-console-config\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:37:31.227476 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:37:31.227275    4060 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/62d83fcc-c39b-4dc5-909f-cea15b697a2d-oauth-serving-cert\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:37:31.227476 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:37:31.227285    4060 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/62d83fcc-c39b-4dc5-909f-cea15b697a2d-service-ca\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:37:31.227476 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:37:31.227293    4060 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x5hz7\" (UniqueName: \"kubernetes.io/projected/62d83fcc-c39b-4dc5-909f-cea15b697a2d-kube-api-access-x5hz7\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:37:31.227476 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:37:31.227302    4060 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/62d83fcc-c39b-4dc5-909f-cea15b697a2d-console-oauth-config\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:37:31.742442 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:37:31.742406    4060 generic.go:356] "Generic (PLEG): container finished" podID="62d83fcc-c39b-4dc5-909f-cea15b697a2d" containerID="10197a64ee13e9e2f97cc6dff216e35c2d036576b86a9c1a7423f8ae02f03618" exitCode=0
Oct 30 20:37:31.742636 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:37:31.742461    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65c77b44d-d7rsp"
Oct 30 20:37:31.742636 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:37:31.742508    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65c77b44d-d7rsp" event={"ID":"62d83fcc-c39b-4dc5-909f-cea15b697a2d","Type":"ContainerDied","Data":"10197a64ee13e9e2f97cc6dff216e35c2d036576b86a9c1a7423f8ae02f03618"}
Oct 30 20:37:31.742636 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:37:31.742561    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65c77b44d-d7rsp" event={"ID":"62d83fcc-c39b-4dc5-909f-cea15b697a2d","Type":"ContainerDied","Data":"9efcee321e351493f62315588ff7e3e75c9138f8faaa52419410e3ae825008ac"}
Oct 30 20:37:31.742636 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:37:31.742581    4060 scope.go:122] "RemoveContainer" containerID="10197a64ee13e9e2f97cc6dff216e35c2d036576b86a9c1a7423f8ae02f03618"
Oct 30 20:37:31.749976 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:37:31.749957    4060 scope.go:122] "RemoveContainer" containerID="10197a64ee13e9e2f97cc6dff216e35c2d036576b86a9c1a7423f8ae02f03618"
Oct 30 20:37:31.750266 ip-10-0-142-4 kubenswrapper[4060]: E1030 20:37:31.750242    4060 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"10197a64ee13e9e2f97cc6dff216e35c2d036576b86a9c1a7423f8ae02f03618\": container with ID starting with 10197a64ee13e9e2f97cc6dff216e35c2d036576b86a9c1a7423f8ae02f03618 not found: ID does not exist" containerID="10197a64ee13e9e2f97cc6dff216e35c2d036576b86a9c1a7423f8ae02f03618"
Oct 30 20:37:31.750352 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:37:31.750273    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"10197a64ee13e9e2f97cc6dff216e35c2d036576b86a9c1a7423f8ae02f03618"} err="failed to get container status \"10197a64ee13e9e2f97cc6dff216e35c2d036576b86a9c1a7423f8ae02f03618\": rpc error: code = NotFound desc = could not find container \"10197a64ee13e9e2f97cc6dff216e35c2d036576b86a9c1a7423f8ae02f03618\": container with ID starting with 10197a64ee13e9e2f97cc6dff216e35c2d036576b86a9c1a7423f8ae02f03618 not found: ID does not exist"
Oct 30 20:37:31.904990 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:37:31.904961    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-65c77b44d-d7rsp"]
Oct 30 20:37:31.954439 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:37:31.954412    4060 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-65c77b44d-d7rsp"]
Oct 30 20:37:33.424986 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:37:33.424954    4060 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="62d83fcc-c39b-4dc5-909f-cea15b697a2d" path="/var/lib/kubelet/pods/62d83fcc-c39b-4dc5-909f-cea15b697a2d/volumes"
Oct 30 20:37:42.149251 ip-10-0-142-4 kubenswrapper[4060]: E1030 20:37:42.149211    4060 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v2f4x" containerName="extractor"
Oct 30 20:38:12.150045 ip-10-0-142-4 kubenswrapper[4060]: E1030 20:38:12.150009    4060 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v2f4x" containerName="extractor"
Oct 30 20:38:15.424780 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:38:15.424749    4060 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console/console-7c6dc46bc-jqcfj"]
Oct 30 20:38:15.425147 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:38:15.424965    4060 cpu_manager.go:414] "containerMap: removing container" podUID="62d83fcc-c39b-4dc5-909f-cea15b697a2d" containerName="console"
Oct 30 20:38:15.425147 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:38:15.424975    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="62d83fcc-c39b-4dc5-909f-cea15b697a2d" containerName="console"
Oct 30 20:38:15.425147 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:38:15.424987    4060 cpu_manager.go:414] "containerMap: removing container" podUID="9f9d9f58-7252-4b1b-96ac-3a8b77b7f038" containerName="console"
Oct 30 20:38:15.425147 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:38:15.424992    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9f9d9f58-7252-4b1b-96ac-3a8b77b7f038" containerName="console"
Oct 30 20:38:15.425147 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:38:15.425027    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="62d83fcc-c39b-4dc5-909f-cea15b697a2d" containerName="console"
Oct 30 20:38:15.425147 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:38:15.425034    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="9f9d9f58-7252-4b1b-96ac-3a8b77b7f038" containerName="console"
Oct 30 20:38:15.426642 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:38:15.426626    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c6dc46bc-jqcfj"
Oct 30 20:38:15.514157 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:38:15.514126    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7c6dc46bc-jqcfj"]
Oct 30 20:38:15.520580 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:38:15.520554    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5e382fc9-33a6-4d14-ad7f-655eb03abeed-console-serving-cert\") pod \"console-7c6dc46bc-jqcfj\" (UID: \"5e382fc9-33a6-4d14-ad7f-655eb03abeed\") " pod="openshift-console/console-7c6dc46bc-jqcfj"
Oct 30 20:38:15.520580 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:38:15.520581    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5e382fc9-33a6-4d14-ad7f-655eb03abeed-tmp\") pod \"console-7c6dc46bc-jqcfj\" (UID: \"5e382fc9-33a6-4d14-ad7f-655eb03abeed\") " pod="openshift-console/console-7c6dc46bc-jqcfj"
Oct 30 20:38:15.520786 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:38:15.520704    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5e382fc9-33a6-4d14-ad7f-655eb03abeed-console-config\") pod \"console-7c6dc46bc-jqcfj\" (UID: \"5e382fc9-33a6-4d14-ad7f-655eb03abeed\") " pod="openshift-console/console-7c6dc46bc-jqcfj"
Oct 30 20:38:15.520786 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:38:15.520741    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n94jf\" (UniqueName: \"kubernetes.io/projected/5e382fc9-33a6-4d14-ad7f-655eb03abeed-kube-api-access-n94jf\") pod \"console-7c6dc46bc-jqcfj\" (UID: \"5e382fc9-33a6-4d14-ad7f-655eb03abeed\") " pod="openshift-console/console-7c6dc46bc-jqcfj"
Oct 30 20:38:15.520786 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:38:15.520771    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5e382fc9-33a6-4d14-ad7f-655eb03abeed-service-ca\") pod \"console-7c6dc46bc-jqcfj\" (UID: \"5e382fc9-33a6-4d14-ad7f-655eb03abeed\") " pod="openshift-console/console-7c6dc46bc-jqcfj"
Oct 30 20:38:15.520900 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:38:15.520851    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5e382fc9-33a6-4d14-ad7f-655eb03abeed-trusted-ca-bundle\") pod \"console-7c6dc46bc-jqcfj\" (UID: \"5e382fc9-33a6-4d14-ad7f-655eb03abeed\") " pod="openshift-console/console-7c6dc46bc-jqcfj"
Oct 30 20:38:15.520900 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:38:15.520883    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5e382fc9-33a6-4d14-ad7f-655eb03abeed-oauth-serving-cert\") pod \"console-7c6dc46bc-jqcfj\" (UID: \"5e382fc9-33a6-4d14-ad7f-655eb03abeed\") " pod="openshift-console/console-7c6dc46bc-jqcfj"
Oct 30 20:38:15.520963 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:38:15.520903    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5e382fc9-33a6-4d14-ad7f-655eb03abeed-console-oauth-config\") pod \"console-7c6dc46bc-jqcfj\" (UID: \"5e382fc9-33a6-4d14-ad7f-655eb03abeed\") " pod="openshift-console/console-7c6dc46bc-jqcfj"
Oct 30 20:38:15.621360 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:38:15.621324    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5e382fc9-33a6-4d14-ad7f-655eb03abeed-trusted-ca-bundle\") pod \"console-7c6dc46bc-jqcfj\" (UID: \"5e382fc9-33a6-4d14-ad7f-655eb03abeed\") " pod="openshift-console/console-7c6dc46bc-jqcfj"
Oct 30 20:38:15.621360 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:38:15.621364    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5e382fc9-33a6-4d14-ad7f-655eb03abeed-oauth-serving-cert\") pod \"console-7c6dc46bc-jqcfj\" (UID: \"5e382fc9-33a6-4d14-ad7f-655eb03abeed\") " pod="openshift-console/console-7c6dc46bc-jqcfj"
Oct 30 20:38:15.621641 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:38:15.621381    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5e382fc9-33a6-4d14-ad7f-655eb03abeed-console-oauth-config\") pod \"console-7c6dc46bc-jqcfj\" (UID: \"5e382fc9-33a6-4d14-ad7f-655eb03abeed\") " pod="openshift-console/console-7c6dc46bc-jqcfj"
Oct 30 20:38:15.621641 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:38:15.621404    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5e382fc9-33a6-4d14-ad7f-655eb03abeed-console-serving-cert\") pod \"console-7c6dc46bc-jqcfj\" (UID: \"5e382fc9-33a6-4d14-ad7f-655eb03abeed\") " pod="openshift-console/console-7c6dc46bc-jqcfj"
Oct 30 20:38:15.621641 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:38:15.621418    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5e382fc9-33a6-4d14-ad7f-655eb03abeed-tmp\") pod \"console-7c6dc46bc-jqcfj\" (UID: \"5e382fc9-33a6-4d14-ad7f-655eb03abeed\") " pod="openshift-console/console-7c6dc46bc-jqcfj"
Oct 30 20:38:15.621641 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:38:15.621460    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5e382fc9-33a6-4d14-ad7f-655eb03abeed-console-config\") pod \"console-7c6dc46bc-jqcfj\" (UID: \"5e382fc9-33a6-4d14-ad7f-655eb03abeed\") " pod="openshift-console/console-7c6dc46bc-jqcfj"
Oct 30 20:38:15.621641 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:38:15.621477    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n94jf\" (UniqueName: \"kubernetes.io/projected/5e382fc9-33a6-4d14-ad7f-655eb03abeed-kube-api-access-n94jf\") pod \"console-7c6dc46bc-jqcfj\" (UID: \"5e382fc9-33a6-4d14-ad7f-655eb03abeed\") " pod="openshift-console/console-7c6dc46bc-jqcfj"
Oct 30 20:38:15.621641 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:38:15.621514    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5e382fc9-33a6-4d14-ad7f-655eb03abeed-service-ca\") pod \"console-7c6dc46bc-jqcfj\" (UID: \"5e382fc9-33a6-4d14-ad7f-655eb03abeed\") " pod="openshift-console/console-7c6dc46bc-jqcfj"
Oct 30 20:38:15.622566 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:38:15.622535    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5e382fc9-33a6-4d14-ad7f-655eb03abeed-oauth-serving-cert\") pod \"console-7c6dc46bc-jqcfj\" (UID: \"5e382fc9-33a6-4d14-ad7f-655eb03abeed\") " pod="openshift-console/console-7c6dc46bc-jqcfj"
Oct 30 20:38:15.622816 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:38:15.622584    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5e382fc9-33a6-4d14-ad7f-655eb03abeed-console-config\") pod \"console-7c6dc46bc-jqcfj\" (UID: \"5e382fc9-33a6-4d14-ad7f-655eb03abeed\") " pod="openshift-console/console-7c6dc46bc-jqcfj"
Oct 30 20:38:15.622962 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:38:15.622583    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5e382fc9-33a6-4d14-ad7f-655eb03abeed-tmp\") pod \"console-7c6dc46bc-jqcfj\" (UID: \"5e382fc9-33a6-4d14-ad7f-655eb03abeed\") " pod="openshift-console/console-7c6dc46bc-jqcfj"
Oct 30 20:38:15.623060 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:38:15.622631    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5e382fc9-33a6-4d14-ad7f-655eb03abeed-trusted-ca-bundle\") pod \"console-7c6dc46bc-jqcfj\" (UID: \"5e382fc9-33a6-4d14-ad7f-655eb03abeed\") " pod="openshift-console/console-7c6dc46bc-jqcfj"
Oct 30 20:38:15.623157 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:38:15.623106    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5e382fc9-33a6-4d14-ad7f-655eb03abeed-service-ca\") pod \"console-7c6dc46bc-jqcfj\" (UID: \"5e382fc9-33a6-4d14-ad7f-655eb03abeed\") " pod="openshift-console/console-7c6dc46bc-jqcfj"
Oct 30 20:38:15.625009 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:38:15.624981    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5e382fc9-33a6-4d14-ad7f-655eb03abeed-console-serving-cert\") pod \"console-7c6dc46bc-jqcfj\" (UID: \"5e382fc9-33a6-4d14-ad7f-655eb03abeed\") " pod="openshift-console/console-7c6dc46bc-jqcfj"
Oct 30 20:38:15.627467 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:38:15.627438    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5e382fc9-33a6-4d14-ad7f-655eb03abeed-console-oauth-config\") pod \"console-7c6dc46bc-jqcfj\" (UID: \"5e382fc9-33a6-4d14-ad7f-655eb03abeed\") " pod="openshift-console/console-7c6dc46bc-jqcfj"
Oct 30 20:38:15.682874 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:38:15.682772    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n94jf\" (UniqueName: \"kubernetes.io/projected/5e382fc9-33a6-4d14-ad7f-655eb03abeed-kube-api-access-n94jf\") pod \"console-7c6dc46bc-jqcfj\" (UID: \"5e382fc9-33a6-4d14-ad7f-655eb03abeed\") " pod="openshift-console/console-7c6dc46bc-jqcfj"
Oct 30 20:38:15.735866 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:38:15.735825    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c6dc46bc-jqcfj"
Oct 30 20:38:16.151939 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:38:16.151899    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7c6dc46bc-jqcfj"]
Oct 30 20:38:16.154973 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:38:16.154943    4060 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e382fc9_33a6_4d14_ad7f_655eb03abeed.slice/crio-9f9f85cf064b84d0b5ee5b06a2573fd36b94f7cc951f614958db6207613fd1f0 WatchSource:0}: Error finding container 9f9f85cf064b84d0b5ee5b06a2573fd36b94f7cc951f614958db6207613fd1f0: Status 404 returned error can't find the container with id 9f9f85cf064b84d0b5ee5b06a2573fd36b94f7cc951f614958db6207613fd1f0
Oct 30 20:38:16.877990 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:38:16.877958    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c6dc46bc-jqcfj" event={"ID":"5e382fc9-33a6-4d14-ad7f-655eb03abeed","Type":"ContainerStarted","Data":"c68e283021450e0752064c913b6822ca8862a8bb133d8b3833392beb3f6c113d"}
Oct 30 20:38:16.878363 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:38:16.878005    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c6dc46bc-jqcfj" event={"ID":"5e382fc9-33a6-4d14-ad7f-655eb03abeed","Type":"ContainerStarted","Data":"9f9f85cf064b84d0b5ee5b06a2573fd36b94f7cc951f614958db6207613fd1f0"}
Oct 30 20:38:17.045481 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:38:17.045420    4060 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-console/console-7c6dc46bc-jqcfj" podStartSLOduration=2.045406192 podStartE2EDuration="2.045406192s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:38:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:38:16.995508407 +0000 UTC m=+115.752506696" watchObservedRunningTime="2026-10-30 20:38:17.045406192 +0000 UTC m=+115.802404479"
Oct 30 20:38:25.736375 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:38:25.736343    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7c6dc46bc-jqcfj"
Oct 30 20:38:25.736811 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:38:25.736397    4060 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7c6dc46bc-jqcfj"
Oct 30 20:38:25.740988 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:38:25.740966    4060 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7c6dc46bc-jqcfj"
Oct 30 20:38:25.912860 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:38:25.912834    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7c6dc46bc-jqcfj"
Oct 30 20:38:26.063951 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:38:26.063883    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7484b7dfbb-9v55p"]
Oct 30 20:38:42.149884 ip-10-0-142-4 kubenswrapper[4060]: E1030 20:38:42.149803    4060 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v2f4x" containerName="extractor"
Oct 30 20:38:51.082536 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:38:51.082477    4060 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-console/console-7484b7dfbb-9v55p" podUID="61348763-0eff-4826-854a-029c3679794f" containerName="console" containerID="cri-o://5d17ddc1afe7efb761a9864649d5efb7cd8f1a0367972495b59d908cec3f4ad9" gracePeriod=15
Oct 30 20:38:51.325449 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:38:51.325427    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7484b7dfbb-9v55p"
Oct 30 20:38:51.372035 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:38:51.371967    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/61348763-0eff-4826-854a-029c3679794f-console-serving-cert\" (UniqueName: \"kubernetes.io/secret/61348763-0eff-4826-854a-029c3679794f-console-serving-cert\") pod \"61348763-0eff-4826-854a-029c3679794f\" (UID: \"61348763-0eff-4826-854a-029c3679794f\") "
Oct 30 20:38:51.372035 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:38:51.372002    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/61348763-0eff-4826-854a-029c3679794f-tmp\" (UniqueName: \"kubernetes.io/empty-dir/61348763-0eff-4826-854a-029c3679794f-tmp\") pod \"61348763-0eff-4826-854a-029c3679794f\" (UID: \"61348763-0eff-4826-854a-029c3679794f\") "
Oct 30 20:38:51.372192 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:38:51.372059    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/61348763-0eff-4826-854a-029c3679794f-service-ca\" (UniqueName: \"kubernetes.io/configmap/61348763-0eff-4826-854a-029c3679794f-service-ca\") pod \"61348763-0eff-4826-854a-029c3679794f\" (UID: \"61348763-0eff-4826-854a-029c3679794f\") "
Oct 30 20:38:51.372234 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:38:51.372217    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/61348763-0eff-4826-854a-029c3679794f-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/61348763-0eff-4826-854a-029c3679794f-trusted-ca-bundle\") pod \"61348763-0eff-4826-854a-029c3679794f\" (UID: \"61348763-0eff-4826-854a-029c3679794f\") "
Oct 30 20:38:51.372270 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:38:51.372253    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/61348763-0eff-4826-854a-029c3679794f-console-config\" (UniqueName: \"kubernetes.io/configmap/61348763-0eff-4826-854a-029c3679794f-console-config\") pod \"61348763-0eff-4826-854a-029c3679794f\" (UID: \"61348763-0eff-4826-854a-029c3679794f\") "
Oct 30 20:38:51.372310 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:38:51.372279    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/61348763-0eff-4826-854a-029c3679794f-oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/61348763-0eff-4826-854a-029c3679794f-oauth-serving-cert\") pod \"61348763-0eff-4826-854a-029c3679794f\" (UID: \"61348763-0eff-4826-854a-029c3679794f\") "
Oct 30 20:38:51.372356 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:38:51.372319    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/61348763-0eff-4826-854a-029c3679794f-kube-api-access-wccwb\" (UniqueName: \"kubernetes.io/projected/61348763-0eff-4826-854a-029c3679794f-kube-api-access-wccwb\") pod \"61348763-0eff-4826-854a-029c3679794f\" (UID: \"61348763-0eff-4826-854a-029c3679794f\") "
Oct 30 20:38:51.372356 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:38:51.372318    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/61348763-0eff-4826-854a-029c3679794f-tmp" pod "61348763-0eff-4826-854a-029c3679794f" (UID: "61348763-0eff-4826-854a-029c3679794f"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:38:51.372461 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:38:51.372358    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/61348763-0eff-4826-854a-029c3679794f-console-oauth-config\" (UniqueName: \"kubernetes.io/secret/61348763-0eff-4826-854a-029c3679794f-console-oauth-config\") pod \"61348763-0eff-4826-854a-029c3679794f\" (UID: \"61348763-0eff-4826-854a-029c3679794f\") "
Oct 30 20:38:51.372535 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:38:51.372487    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/61348763-0eff-4826-854a-029c3679794f-service-ca" pod "61348763-0eff-4826-854a-029c3679794f" (UID: "61348763-0eff-4826-854a-029c3679794f"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:38:51.372784 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:38:51.372584    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/61348763-0eff-4826-854a-029c3679794f-trusted-ca-bundle" pod "61348763-0eff-4826-854a-029c3679794f" (UID: "61348763-0eff-4826-854a-029c3679794f"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:38:51.372784 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:38:51.372593    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/61348763-0eff-4826-854a-029c3679794f-console-config" pod "61348763-0eff-4826-854a-029c3679794f" (UID: "61348763-0eff-4826-854a-029c3679794f"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:38:51.372784 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:38:51.372630    4060 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/61348763-0eff-4826-854a-029c3679794f-service-ca\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:38:51.372784 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:38:51.372646    4060 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/61348763-0eff-4826-854a-029c3679794f-tmp\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:38:51.372999 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:38:51.372897    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/61348763-0eff-4826-854a-029c3679794f-oauth-serving-cert" pod "61348763-0eff-4826-854a-029c3679794f" (UID: "61348763-0eff-4826-854a-029c3679794f"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:38:51.374128 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:38:51.374106    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/61348763-0eff-4826-854a-029c3679794f-console-serving-cert" pod "61348763-0eff-4826-854a-029c3679794f" (UID: "61348763-0eff-4826-854a-029c3679794f"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:38:51.374273 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:38:51.374248    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/61348763-0eff-4826-854a-029c3679794f-kube-api-access-wccwb" pod "61348763-0eff-4826-854a-029c3679794f" (UID: "61348763-0eff-4826-854a-029c3679794f"). InnerVolumeSpecName "kube-api-access-wccwb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:38:51.374379 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:38:51.374361    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/61348763-0eff-4826-854a-029c3679794f-console-oauth-config" pod "61348763-0eff-4826-854a-029c3679794f" (UID: "61348763-0eff-4826-854a-029c3679794f"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:38:51.473762 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:38:51.473729    4060 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/61348763-0eff-4826-854a-029c3679794f-trusted-ca-bundle\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:38:51.473762 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:38:51.473764    4060 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/61348763-0eff-4826-854a-029c3679794f-console-config\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:38:51.473953 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:38:51.473778    4060 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/61348763-0eff-4826-854a-029c3679794f-oauth-serving-cert\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:38:51.473953 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:38:51.473791    4060 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wccwb\" (UniqueName: \"kubernetes.io/projected/61348763-0eff-4826-854a-029c3679794f-kube-api-access-wccwb\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:38:51.473953 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:38:51.473819    4060 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/61348763-0eff-4826-854a-029c3679794f-console-oauth-config\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:38:51.473953 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:38:51.473832    4060 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/61348763-0eff-4826-854a-029c3679794f-console-serving-cert\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:38:51.991005 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:38:51.990972    4060 generic.go:356] "Generic (PLEG): container finished" podID="61348763-0eff-4826-854a-029c3679794f" containerID="5d17ddc1afe7efb761a9864649d5efb7cd8f1a0367972495b59d908cec3f4ad9" exitCode=0
Oct 30 20:38:51.991176 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:38:51.991031    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7484b7dfbb-9v55p"
Oct 30 20:38:51.991176 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:38:51.991041    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7484b7dfbb-9v55p" event={"ID":"61348763-0eff-4826-854a-029c3679794f","Type":"ContainerDied","Data":"5d17ddc1afe7efb761a9864649d5efb7cd8f1a0367972495b59d908cec3f4ad9"}
Oct 30 20:38:51.991176 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:38:51.991107    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7484b7dfbb-9v55p" event={"ID":"61348763-0eff-4826-854a-029c3679794f","Type":"ContainerDied","Data":"15b27bf2fc2b7aefdcd1deeb61e91f7956d629709f098ecd9c817f003e6d942e"}
Oct 30 20:38:51.991176 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:38:51.991127    4060 scope.go:122] "RemoveContainer" containerID="5d17ddc1afe7efb761a9864649d5efb7cd8f1a0367972495b59d908cec3f4ad9"
Oct 30 20:38:51.998798 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:38:51.998766    4060 scope.go:122] "RemoveContainer" containerID="5d17ddc1afe7efb761a9864649d5efb7cd8f1a0367972495b59d908cec3f4ad9"
Oct 30 20:38:51.999075 ip-10-0-142-4 kubenswrapper[4060]: E1030 20:38:51.999057    4060 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5d17ddc1afe7efb761a9864649d5efb7cd8f1a0367972495b59d908cec3f4ad9\": container with ID starting with 5d17ddc1afe7efb761a9864649d5efb7cd8f1a0367972495b59d908cec3f4ad9 not found: ID does not exist" containerID="5d17ddc1afe7efb761a9864649d5efb7cd8f1a0367972495b59d908cec3f4ad9"
Oct 30 20:38:51.999136 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:38:51.999083    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5d17ddc1afe7efb761a9864649d5efb7cd8f1a0367972495b59d908cec3f4ad9"} err="failed to get container status \"5d17ddc1afe7efb761a9864649d5efb7cd8f1a0367972495b59d908cec3f4ad9\": rpc error: code = NotFound desc = could not find container \"5d17ddc1afe7efb761a9864649d5efb7cd8f1a0367972495b59d908cec3f4ad9\": container with ID starting with 5d17ddc1afe7efb761a9864649d5efb7cd8f1a0367972495b59d908cec3f4ad9 not found: ID does not exist"
Oct 30 20:38:52.154252 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:38:52.154219    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7484b7dfbb-9v55p"]
Oct 30 20:38:52.203627 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:38:52.203597    4060 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7484b7dfbb-9v55p"]
Oct 30 20:38:53.425861 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:38:53.425828    4060 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="61348763-0eff-4826-854a-029c3679794f" path="/var/lib/kubelet/pods/61348763-0eff-4826-854a-029c3679794f/volumes"
Oct 30 20:39:12.149542 ip-10-0-142-4 kubenswrapper[4060]: E1030 20:39:12.149487    4060 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v2f4x" containerName="extractor"
Oct 30 20:39:42.149527 ip-10-0-142-4 kubenswrapper[4060]: E1030 20:39:42.149479    4060 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v2f4x" containerName="extractor"
Oct 30 20:40:12.148634 ip-10-0-142-4 kubenswrapper[4060]: E1030 20:40:12.148554    4060 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v2f4x" containerName="extractor"
Oct 30 20:40:42.148566 ip-10-0-142-4 kubenswrapper[4060]: E1030 20:40:42.148525    4060 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v2f4x" containerName="extractor"
Oct 30 20:41:12.148585 ip-10-0-142-4 kubenswrapper[4060]: E1030 20:41:12.148546    4060 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v2f4x" containerName="extractor"
Oct 30 20:41:42.149893 ip-10-0-142-4 kubenswrapper[4060]: E1030 20:41:42.149810    4060 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v2f4x" containerName="extractor"
Oct 30 20:42:12.149289 ip-10-0-142-4 kubenswrapper[4060]: E1030 20:42:12.149251    4060 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v2f4x" containerName="extractor"
Oct 30 20:42:42.151177 ip-10-0-142-4 kubenswrapper[4060]: E1030 20:42:42.151144    4060 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v2f4x" containerName="extractor"
Oct 30 20:42:46.753865 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:42:46.753823    4060 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cz2km4"]
Oct 30 20:42:46.754323 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:42:46.754081    4060 cpu_manager.go:414] "containerMap: removing container" podUID="61348763-0eff-4826-854a-029c3679794f" containerName="console"
Oct 30 20:42:46.754323 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:42:46.754092    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="61348763-0eff-4826-854a-029c3679794f" containerName="console"
Oct 30 20:42:46.754323 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:42:46.754133    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="61348763-0eff-4826-854a-029c3679794f" containerName="console"
Oct 30 20:42:46.756003 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:42:46.755989    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cz2km4"
Oct 30 20:42:46.859546 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:42:46.859511    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Oct 30 20:42:46.859546 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:42:46.859518    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Oct 30 20:42:46.859815 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:42:46.859635    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"c7537007944577f64df34960ace3c69136c416-139ec370-dockercfg-m99rj\""
Oct 30 20:42:46.860687 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:42:46.860668    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cz2km4"]
Oct 30 20:42:46.864143 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:42:46.864124    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/29c904d4-d4d7-4c00-8e96-ce4469d2e522-util\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cz2km4\" (UID: \"29c904d4-d4d7-4c00-8e96-ce4469d2e522\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cz2km4"
Oct 30 20:42:46.864219 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:42:46.864159    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lgb9h\" (UniqueName: \"kubernetes.io/projected/29c904d4-d4d7-4c00-8e96-ce4469d2e522-kube-api-access-lgb9h\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cz2km4\" (UID: \"29c904d4-d4d7-4c00-8e96-ce4469d2e522\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cz2km4"
Oct 30 20:42:46.864301 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:42:46.864283    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/29c904d4-d4d7-4c00-8e96-ce4469d2e522-bundle\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cz2km4\" (UID: \"29c904d4-d4d7-4c00-8e96-ce4469d2e522\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cz2km4"
Oct 30 20:42:46.965453 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:42:46.965400    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/29c904d4-d4d7-4c00-8e96-ce4469d2e522-bundle\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cz2km4\" (UID: \"29c904d4-d4d7-4c00-8e96-ce4469d2e522\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cz2km4"
Oct 30 20:42:46.965453 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:42:46.965459    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/29c904d4-d4d7-4c00-8e96-ce4469d2e522-util\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cz2km4\" (UID: \"29c904d4-d4d7-4c00-8e96-ce4469d2e522\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cz2km4"
Oct 30 20:42:46.965734 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:42:46.965485    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lgb9h\" (UniqueName: \"kubernetes.io/projected/29c904d4-d4d7-4c00-8e96-ce4469d2e522-kube-api-access-lgb9h\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cz2km4\" (UID: \"29c904d4-d4d7-4c00-8e96-ce4469d2e522\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cz2km4"
Oct 30 20:42:46.965839 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:42:46.965816    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/29c904d4-d4d7-4c00-8e96-ce4469d2e522-bundle\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cz2km4\" (UID: \"29c904d4-d4d7-4c00-8e96-ce4469d2e522\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cz2km4"
Oct 30 20:42:46.965913 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:42:46.965879    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/29c904d4-d4d7-4c00-8e96-ce4469d2e522-util\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cz2km4\" (UID: \"29c904d4-d4d7-4c00-8e96-ce4469d2e522\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cz2km4"
Oct 30 20:42:47.028151 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:42:47.028075    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lgb9h\" (UniqueName: \"kubernetes.io/projected/29c904d4-d4d7-4c00-8e96-ce4469d2e522-kube-api-access-lgb9h\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cz2km4\" (UID: \"29c904d4-d4d7-4c00-8e96-ce4469d2e522\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cz2km4"
Oct 30 20:42:47.067100 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:42:47.067063    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cz2km4"
Oct 30 20:42:47.442544 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:42:47.442523    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cz2km4"]
Oct 30 20:42:47.445284 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:42:47.445258    4060 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29c904d4_d4d7_4c00_8e96_ce4469d2e522.slice/crio-635d016254b8fa2b539cd8bc8c21b0256117d8cf73a918c044039a7098a58978 WatchSource:0}: Error finding container 635d016254b8fa2b539cd8bc8c21b0256117d8cf73a918c044039a7098a58978: Status 404 returned error can't find the container with id 635d016254b8fa2b539cd8bc8c21b0256117d8cf73a918c044039a7098a58978
Oct 30 20:42:47.447514 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:42:47.447475    4060 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 20:42:47.710781 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:42:47.710751    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cz2km4" event={"ID":"29c904d4-d4d7-4c00-8e96-ce4469d2e522","Type":"ContainerStarted","Data":"635d016254b8fa2b539cd8bc8c21b0256117d8cf73a918c044039a7098a58978"}
Oct 30 20:42:57.746446 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:42:57.746414    4060 generic.go:356] "Generic (PLEG): container finished" podID="29c904d4-d4d7-4c00-8e96-ce4469d2e522" containerID="45c80491c23d2df3481db7b949efb291d195f27389259953c30a5222e0113cef" exitCode=0
Oct 30 20:42:57.746856 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:42:57.746455    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cz2km4" event={"ID":"29c904d4-d4d7-4c00-8e96-ce4469d2e522","Type":"ContainerDied","Data":"45c80491c23d2df3481db7b949efb291d195f27389259953c30a5222e0113cef"}
Oct 30 20:43:01.761095 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:43:01.761062    4060 generic.go:356] "Generic (PLEG): container finished" podID="29c904d4-d4d7-4c00-8e96-ce4469d2e522" containerID="3c286ac80cb4f54dec086dad7e57f13192aa10313be13f57c98814079319f459" exitCode=0
Oct 30 20:43:01.761559 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:43:01.761149    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cz2km4" event={"ID":"29c904d4-d4d7-4c00-8e96-ce4469d2e522","Type":"ContainerDied","Data":"3c286ac80cb4f54dec086dad7e57f13192aa10313be13f57c98814079319f459"}
Oct 30 20:43:08.785362 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:43:08.785323    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cz2km4" event={"ID":"29c904d4-d4d7-4c00-8e96-ce4469d2e522","Type":"ContainerStarted","Data":"79eeab3d3ac909c837ec7c36ca2e62dd577146423610a00284a23048d5c00437"}
Oct 30 20:43:08.905864 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:43:08.905810    4060 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cz2km4" podStartSLOduration=3.451237501 podStartE2EDuration="22.90579584s" totalImagesPullingTime="19.454558339s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:42:46 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:43:08.905568307 +0000 UTC m=+407.662566604" watchObservedRunningTime="2026-10-30 20:43:08.90579584 +0000 UTC m=+407.662794138"
Oct 30 20:43:09.790786 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:43:09.790754    4060 generic.go:356] "Generic (PLEG): container finished" podID="29c904d4-d4d7-4c00-8e96-ce4469d2e522" containerID="79eeab3d3ac909c837ec7c36ca2e62dd577146423610a00284a23048d5c00437" exitCode=0
Oct 30 20:43:09.791245 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:43:09.790832    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cz2km4" event={"ID":"29c904d4-d4d7-4c00-8e96-ce4469d2e522","Type":"ContainerDied","Data":"79eeab3d3ac909c837ec7c36ca2e62dd577146423610a00284a23048d5c00437"}
Oct 30 20:43:10.931950 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:43:10.931914    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cz2km4"
Oct 30 20:43:11.046697 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:43:11.046608    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/29c904d4-d4d7-4c00-8e96-ce4469d2e522-util\" (UniqueName: \"kubernetes.io/empty-dir/29c904d4-d4d7-4c00-8e96-ce4469d2e522-util\") pod \"29c904d4-d4d7-4c00-8e96-ce4469d2e522\" (UID: \"29c904d4-d4d7-4c00-8e96-ce4469d2e522\") "
Oct 30 20:43:11.046874 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:43:11.046699    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/29c904d4-d4d7-4c00-8e96-ce4469d2e522-kube-api-access-lgb9h\" (UniqueName: \"kubernetes.io/projected/29c904d4-d4d7-4c00-8e96-ce4469d2e522-kube-api-access-lgb9h\") pod \"29c904d4-d4d7-4c00-8e96-ce4469d2e522\" (UID: \"29c904d4-d4d7-4c00-8e96-ce4469d2e522\") "
Oct 30 20:43:11.046874 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:43:11.046736    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/29c904d4-d4d7-4c00-8e96-ce4469d2e522-bundle\" (UniqueName: \"kubernetes.io/empty-dir/29c904d4-d4d7-4c00-8e96-ce4469d2e522-bundle\") pod \"29c904d4-d4d7-4c00-8e96-ce4469d2e522\" (UID: \"29c904d4-d4d7-4c00-8e96-ce4469d2e522\") "
Oct 30 20:43:11.047359 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:43:11.047332    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/29c904d4-d4d7-4c00-8e96-ce4469d2e522-bundle" pod "29c904d4-d4d7-4c00-8e96-ce4469d2e522" (UID: "29c904d4-d4d7-4c00-8e96-ce4469d2e522"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:43:11.048969 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:43:11.048947    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/29c904d4-d4d7-4c00-8e96-ce4469d2e522-kube-api-access-lgb9h" pod "29c904d4-d4d7-4c00-8e96-ce4469d2e522" (UID: "29c904d4-d4d7-4c00-8e96-ce4469d2e522"). InnerVolumeSpecName "kube-api-access-lgb9h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:43:11.051803 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:43:11.051777    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/29c904d4-d4d7-4c00-8e96-ce4469d2e522-util" pod "29c904d4-d4d7-4c00-8e96-ce4469d2e522" (UID: "29c904d4-d4d7-4c00-8e96-ce4469d2e522"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:43:11.147707 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:43:11.147668    4060 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/29c904d4-d4d7-4c00-8e96-ce4469d2e522-util\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:43:11.147707 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:43:11.147703    4060 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lgb9h\" (UniqueName: \"kubernetes.io/projected/29c904d4-d4d7-4c00-8e96-ce4469d2e522-kube-api-access-lgb9h\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:43:11.147707 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:43:11.147713    4060 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/29c904d4-d4d7-4c00-8e96-ce4469d2e522-bundle\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:43:11.798435 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:43:11.798404    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cz2km4"
Oct 30 20:43:11.798435 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:43:11.798407    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cz2km4" event={"ID":"29c904d4-d4d7-4c00-8e96-ce4469d2e522","Type":"ContainerDied","Data":"635d016254b8fa2b539cd8bc8c21b0256117d8cf73a918c044039a7098a58978"}
Oct 30 20:43:11.798624 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:43:11.798458    4060 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="635d016254b8fa2b539cd8bc8c21b0256117d8cf73a918c044039a7098a58978"
Oct 30 20:43:12.150607 ip-10-0-142-4 kubenswrapper[4060]: E1030 20:43:12.150531    4060 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v2f4x" containerName="extractor"
Oct 30 20:43:15.105463 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:43:15.105429    4060 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-65fc875df4-pqddj"]
Oct 30 20:43:15.105987 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:43:15.105673    4060 cpu_manager.go:414] "containerMap: removing container" podUID="29c904d4-d4d7-4c00-8e96-ce4469d2e522" containerName="pull"
Oct 30 20:43:15.105987 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:43:15.105683    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="29c904d4-d4d7-4c00-8e96-ce4469d2e522" containerName="pull"
Oct 30 20:43:15.105987 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:43:15.105700    4060 cpu_manager.go:414] "containerMap: removing container" podUID="29c904d4-d4d7-4c00-8e96-ce4469d2e522" containerName="util"
Oct 30 20:43:15.105987 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:43:15.105706    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="29c904d4-d4d7-4c00-8e96-ce4469d2e522" containerName="util"
Oct 30 20:43:15.105987 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:43:15.105719    4060 cpu_manager.go:414] "containerMap: removing container" podUID="29c904d4-d4d7-4c00-8e96-ce4469d2e522" containerName="extract"
Oct 30 20:43:15.105987 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:43:15.105724    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="29c904d4-d4d7-4c00-8e96-ce4469d2e522" containerName="extract"
Oct 30 20:43:15.105987 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:43:15.105766    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="29c904d4-d4d7-4c00-8e96-ce4469d2e522" containerName="extract"
Oct 30 20:43:15.107628 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:43:15.107612    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-65fc875df4-pqddj"
Oct 30 20:43:15.145232 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:43:15.145200    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-65fc875df4-pqddj"]
Oct 30 20:43:15.179633 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:43:15.179604    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/270e1222-563a-43e8-b73e-27f5ac334f4c-tmp\") pod \"cert-manager-operator-controller-manager-65fc875df4-pqddj\" (UID: \"270e1222-563a-43e8-b73e-27f5ac334f4c\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-65fc875df4-pqddj"
Oct 30 20:43:15.179799 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:43:15.179649    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-54qft\" (UniqueName: \"kubernetes.io/projected/270e1222-563a-43e8-b73e-27f5ac334f4c-kube-api-access-54qft\") pod \"cert-manager-operator-controller-manager-65fc875df4-pqddj\" (UID: \"270e1222-563a-43e8-b73e-27f5ac334f4c\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-65fc875df4-pqddj"
Oct 30 20:43:15.192926 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:43:15.192899    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Oct 30 20:43:15.193110 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:43:15.192954    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Oct 30 20:43:15.193110 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:43:15.193041    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-tkmmk\""
Oct 30 20:43:15.280412 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:43:15.280380    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-54qft\" (UniqueName: \"kubernetes.io/projected/270e1222-563a-43e8-b73e-27f5ac334f4c-kube-api-access-54qft\") pod \"cert-manager-operator-controller-manager-65fc875df4-pqddj\" (UID: \"270e1222-563a-43e8-b73e-27f5ac334f4c\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-65fc875df4-pqddj"
Oct 30 20:43:15.280597 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:43:15.280439    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/270e1222-563a-43e8-b73e-27f5ac334f4c-tmp\") pod \"cert-manager-operator-controller-manager-65fc875df4-pqddj\" (UID: \"270e1222-563a-43e8-b73e-27f5ac334f4c\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-65fc875df4-pqddj"
Oct 30 20:43:15.280803 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:43:15.280786    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/270e1222-563a-43e8-b73e-27f5ac334f4c-tmp\") pod \"cert-manager-operator-controller-manager-65fc875df4-pqddj\" (UID: \"270e1222-563a-43e8-b73e-27f5ac334f4c\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-65fc875df4-pqddj"
Oct 30 20:43:15.348522 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:43:15.348468    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-54qft\" (UniqueName: \"kubernetes.io/projected/270e1222-563a-43e8-b73e-27f5ac334f4c-kube-api-access-54qft\") pod \"cert-manager-operator-controller-manager-65fc875df4-pqddj\" (UID: \"270e1222-563a-43e8-b73e-27f5ac334f4c\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-65fc875df4-pqddj"
Oct 30 20:43:15.418212 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:43:15.418122    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-65fc875df4-pqddj"
Oct 30 20:43:15.842588 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:43:15.842549    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-65fc875df4-pqddj"]
Oct 30 20:43:15.846527 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:43:15.846500    4060 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod270e1222_563a_43e8_b73e_27f5ac334f4c.slice/crio-9440b9f446bc6f6630d26fd8860d4a1cd21756f39998bd2fae44a3c7344f0b7f WatchSource:0}: Error finding container 9440b9f446bc6f6630d26fd8860d4a1cd21756f39998bd2fae44a3c7344f0b7f: Status 404 returned error can't find the container with id 9440b9f446bc6f6630d26fd8860d4a1cd21756f39998bd2fae44a3c7344f0b7f
Oct 30 20:43:16.814544 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:43:16.814509    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-65fc875df4-pqddj" event={"ID":"270e1222-563a-43e8-b73e-27f5ac334f4c","Type":"ContainerStarted","Data":"9440b9f446bc6f6630d26fd8860d4a1cd21756f39998bd2fae44a3c7344f0b7f"}
Oct 30 20:43:18.823583 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:43:18.823473    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-65fc875df4-pqddj" event={"ID":"270e1222-563a-43e8-b73e-27f5ac334f4c","Type":"ContainerStarted","Data":"d6b4d2f2d7c2abf656ee551f19189002f0f2c949ddfa38d7f1163b3617f20d97"}
Oct 30 20:43:21.429445 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:43:21.429392    4060 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-65fc875df4-pqddj" podStartSLOduration=4.729213435 podStartE2EDuration="7.429374235s" totalImagesPullingTime="2.7001608s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:43:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:43:19.043389639 +0000 UTC m=+417.800387939" watchObservedRunningTime="2026-10-30 20:43:21.429374235 +0000 UTC m=+420.186372537"
Oct 30 20:43:21.430679 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:43:21.430657    4060 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-5dbbbf75cc-848th"]
Oct 30 20:43:21.432837 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:43:21.432813    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-5dbbbf75cc-848th"
Oct 30 20:43:21.494845 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:43:21.494814    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Oct 30 20:43:21.504596 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:43:21.504572    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-9jjck\""
Oct 30 20:43:21.504596 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:43:21.504578    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Oct 30 20:43:21.529653 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:43:21.529613    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jtsp2\" (UniqueName: \"kubernetes.io/projected/7d55d23f-5476-48e1-9b2e-dca8adfc84e7-kube-api-access-jtsp2\") pod \"cert-manager-webhook-5dbbbf75cc-848th\" (UID: \"7d55d23f-5476-48e1-9b2e-dca8adfc84e7\") " pod="cert-manager/cert-manager-webhook-5dbbbf75cc-848th"
Oct 30 20:43:21.529838 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:43:21.529819    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7d55d23f-5476-48e1-9b2e-dca8adfc84e7-bound-sa-token\") pod \"cert-manager-webhook-5dbbbf75cc-848th\" (UID: \"7d55d23f-5476-48e1-9b2e-dca8adfc84e7\") " pod="cert-manager/cert-manager-webhook-5dbbbf75cc-848th"
Oct 30 20:43:21.541229 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:43:21.541202    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-5dbbbf75cc-848th"]
Oct 30 20:43:21.630472 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:43:21.630434    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jtsp2\" (UniqueName: \"kubernetes.io/projected/7d55d23f-5476-48e1-9b2e-dca8adfc84e7-kube-api-access-jtsp2\") pod \"cert-manager-webhook-5dbbbf75cc-848th\" (UID: \"7d55d23f-5476-48e1-9b2e-dca8adfc84e7\") " pod="cert-manager/cert-manager-webhook-5dbbbf75cc-848th"
Oct 30 20:43:21.630472 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:43:21.630474    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7d55d23f-5476-48e1-9b2e-dca8adfc84e7-bound-sa-token\") pod \"cert-manager-webhook-5dbbbf75cc-848th\" (UID: \"7d55d23f-5476-48e1-9b2e-dca8adfc84e7\") " pod="cert-manager/cert-manager-webhook-5dbbbf75cc-848th"
Oct 30 20:43:21.693517 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:43:21.693438    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7d55d23f-5476-48e1-9b2e-dca8adfc84e7-bound-sa-token\") pod \"cert-manager-webhook-5dbbbf75cc-848th\" (UID: \"7d55d23f-5476-48e1-9b2e-dca8adfc84e7\") " pod="cert-manager/cert-manager-webhook-5dbbbf75cc-848th"
Oct 30 20:43:21.693648 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:43:21.693512    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jtsp2\" (UniqueName: \"kubernetes.io/projected/7d55d23f-5476-48e1-9b2e-dca8adfc84e7-kube-api-access-jtsp2\") pod \"cert-manager-webhook-5dbbbf75cc-848th\" (UID: \"7d55d23f-5476-48e1-9b2e-dca8adfc84e7\") " pod="cert-manager/cert-manager-webhook-5dbbbf75cc-848th"
Oct 30 20:43:21.758139 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:43:21.758103    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-5dbbbf75cc-848th"
Oct 30 20:43:22.145365 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:43:22.145336    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-5dbbbf75cc-848th"]
Oct 30 20:43:22.148776 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:43:22.148752    4060 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7d55d23f_5476_48e1_9b2e_dca8adfc84e7.slice/crio-f30ba084f996c15f31b6d782900276cbf635e5846e02d9b32a1ccb68b5faa92d WatchSource:0}: Error finding container f30ba084f996c15f31b6d782900276cbf635e5846e02d9b32a1ccb68b5faa92d: Status 404 returned error can't find the container with id f30ba084f996c15f31b6d782900276cbf635e5846e02d9b32a1ccb68b5faa92d
Oct 30 20:43:22.838623 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:43:22.838591    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-5dbbbf75cc-848th" event={"ID":"7d55d23f-5476-48e1-9b2e-dca8adfc84e7","Type":"ContainerStarted","Data":"f30ba084f996c15f31b6d782900276cbf635e5846e02d9b32a1ccb68b5faa92d"}
Oct 30 20:43:25.850431 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:43:25.850390    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-5dbbbf75cc-848th" event={"ID":"7d55d23f-5476-48e1-9b2e-dca8adfc84e7","Type":"ContainerStarted","Data":"e24e905d8b453690e02febdc24de13ce9ce2ff4c6f4966692ff1abb2ab1b2f38"}
Oct 30 20:43:25.850847 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:43:25.850533    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-5dbbbf75cc-848th"
Oct 30 20:43:25.978507 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:43:25.978444    4060 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-5dbbbf75cc-848th" podStartSLOduration=1.39543214 podStartE2EDuration="4.978431575s" totalImagesPullingTime="3.582999435s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:43:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:43:25.97728427 +0000 UTC m=+424.734282567" watchObservedRunningTime="2026-10-30 20:43:25.978431575 +0000 UTC m=+424.735429872"
Oct 30 20:43:28.325177 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:43:28.325144    4060 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-5c57bbd4fc-jlzb4"]
Oct 30 20:43:28.327031 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:43:28.327009    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-jlzb4"
Oct 30 20:43:28.383770 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:43:28.383735    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-qnfq8\""
Oct 30 20:43:28.434049 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:43:28.434014    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5c57bbd4fc-jlzb4"]
Oct 30 20:43:28.479905 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:43:28.479877    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/46f6cd4e-5d99-450b-9ab5-41254bf6f753-bound-sa-token\") pod \"cert-manager-cainjector-5c57bbd4fc-jlzb4\" (UID: \"46f6cd4e-5d99-450b-9ab5-41254bf6f753\") " pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-jlzb4"
Oct 30 20:43:28.480036 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:43:28.479909    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qnhnz\" (UniqueName: \"kubernetes.io/projected/46f6cd4e-5d99-450b-9ab5-41254bf6f753-kube-api-access-qnhnz\") pod \"cert-manager-cainjector-5c57bbd4fc-jlzb4\" (UID: \"46f6cd4e-5d99-450b-9ab5-41254bf6f753\") " pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-jlzb4"
Oct 30 20:43:28.580659 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:43:28.580543    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/46f6cd4e-5d99-450b-9ab5-41254bf6f753-bound-sa-token\") pod \"cert-manager-cainjector-5c57bbd4fc-jlzb4\" (UID: \"46f6cd4e-5d99-450b-9ab5-41254bf6f753\") " pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-jlzb4"
Oct 30 20:43:28.580659 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:43:28.580611    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qnhnz\" (UniqueName: \"kubernetes.io/projected/46f6cd4e-5d99-450b-9ab5-41254bf6f753-kube-api-access-qnhnz\") pod \"cert-manager-cainjector-5c57bbd4fc-jlzb4\" (UID: \"46f6cd4e-5d99-450b-9ab5-41254bf6f753\") " pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-jlzb4"
Oct 30 20:43:28.645117 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:43:28.645081    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/46f6cd4e-5d99-450b-9ab5-41254bf6f753-bound-sa-token\") pod \"cert-manager-cainjector-5c57bbd4fc-jlzb4\" (UID: \"46f6cd4e-5d99-450b-9ab5-41254bf6f753\") " pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-jlzb4"
Oct 30 20:43:28.651171 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:43:28.651143    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qnhnz\" (UniqueName: \"kubernetes.io/projected/46f6cd4e-5d99-450b-9ab5-41254bf6f753-kube-api-access-qnhnz\") pod \"cert-manager-cainjector-5c57bbd4fc-jlzb4\" (UID: \"46f6cd4e-5d99-450b-9ab5-41254bf6f753\") " pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-jlzb4"
Oct 30 20:43:28.936398 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:43:28.936312    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-jlzb4"
Oct 30 20:43:29.324130 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:43:29.324100    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5c57bbd4fc-jlzb4"]
Oct 30 20:43:29.326397 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:43:29.326369    4060 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod46f6cd4e_5d99_450b_9ab5_41254bf6f753.slice/crio-62b2af657e864184a23bc3395f0ce921aa735aa8588b03186a57951f0bf74466 WatchSource:0}: Error finding container 62b2af657e864184a23bc3395f0ce921aa735aa8588b03186a57951f0bf74466: Status 404 returned error can't find the container with id 62b2af657e864184a23bc3395f0ce921aa735aa8588b03186a57951f0bf74466
Oct 30 20:43:29.864865 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:43:29.864831    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-jlzb4" event={"ID":"46f6cd4e-5d99-450b-9ab5-41254bf6f753","Type":"ContainerStarted","Data":"ebd0a26114a28154e3fdaa699831540aed05e2ac2c1fdf30f42c80e179393d5b"}
Oct 30 20:43:29.864865 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:43:29.864872    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-jlzb4" event={"ID":"46f6cd4e-5d99-450b-9ab5-41254bf6f753","Type":"ContainerStarted","Data":"62b2af657e864184a23bc3395f0ce921aa735aa8588b03186a57951f0bf74466"}
Oct 30 20:43:29.982095 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:43:29.982037    4060 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-jlzb4" podStartSLOduration=1.982022849 podStartE2EDuration="1.982022849s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:43:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:43:29.981556283 +0000 UTC m=+428.738554580" watchObservedRunningTime="2026-10-30 20:43:29.982022849 +0000 UTC m=+428.739021146"
Oct 30 20:43:31.856464 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:43:31.856435    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-5dbbbf75cc-848th"
Oct 30 20:43:42.150831 ip-10-0-142-4 kubenswrapper[4060]: E1030 20:43:42.150791    4060 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v2f4x" containerName="extractor"
Oct 30 20:43:51.875224 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:43:51.875186    4060 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-observability-system/odh-observability-6f5479fd64-7gfbz"]
Oct 30 20:43:51.877423 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:43:51.877405    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-observability-system/odh-observability-6f5479fd64-7gfbz"
Oct 30 20:43:51.929401 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:43:51.929367    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-observability-system\"/\"odh-observability-webhook-cert\""
Oct 30 20:43:51.929591 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:43:51.929554    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-observability-system\"/\"kube-root-ca.crt\""
Oct 30 20:43:51.929672 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:43:51.929632    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-observability-system\"/\"odh-observability-dockercfg-rpdw5\""
Oct 30 20:43:51.929672 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:43:51.929632    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-observability-system\"/\"openshift-service-ca.crt\""
Oct 30 20:43:51.929672 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:43:51.929648    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-observability-system\"/\"odh-observability-metrics-tls\""
Oct 30 20:43:51.938238 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:43:51.938213    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-observability-system/odh-observability-6f5479fd64-7gfbz"]
Oct 30 20:43:51.947738 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:43:51.947697    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-certs\" (UniqueName: \"kubernetes.io/secret/cc6aeef9-afb1-4052-91eb-76d3d3a3427a-webhook-certs\") pod \"odh-observability-6f5479fd64-7gfbz\" (UID: \"cc6aeef9-afb1-4052-91eb-76d3d3a3427a\") " pod="odh-observability-system/odh-observability-6f5479fd64-7gfbz"
Oct 30 20:43:51.947877 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:43:51.947741    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qd9zv\" (UniqueName: \"kubernetes.io/projected/cc6aeef9-afb1-4052-91eb-76d3d3a3427a-kube-api-access-qd9zv\") pod \"odh-observability-6f5479fd64-7gfbz\" (UID: \"cc6aeef9-afb1-4052-91eb-76d3d3a3427a\") " pod="odh-observability-system/odh-observability-6f5479fd64-7gfbz"
Oct 30 20:43:51.947877 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:43:51.947800    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cc6aeef9-afb1-4052-91eb-76d3d3a3427a-metrics-tls\") pod \"odh-observability-6f5479fd64-7gfbz\" (UID: \"cc6aeef9-afb1-4052-91eb-76d3d3a3427a\") " pod="odh-observability-system/odh-observability-6f5479fd64-7gfbz"
Oct 30 20:43:52.048586 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:43:52.048555    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-certs\" (UniqueName: \"kubernetes.io/secret/cc6aeef9-afb1-4052-91eb-76d3d3a3427a-webhook-certs\") pod \"odh-observability-6f5479fd64-7gfbz\" (UID: \"cc6aeef9-afb1-4052-91eb-76d3d3a3427a\") " pod="odh-observability-system/odh-observability-6f5479fd64-7gfbz"
Oct 30 20:43:52.048586 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:43:52.048590    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qd9zv\" (UniqueName: \"kubernetes.io/projected/cc6aeef9-afb1-4052-91eb-76d3d3a3427a-kube-api-access-qd9zv\") pod \"odh-observability-6f5479fd64-7gfbz\" (UID: \"cc6aeef9-afb1-4052-91eb-76d3d3a3427a\") " pod="odh-observability-system/odh-observability-6f5479fd64-7gfbz"
Oct 30 20:43:52.048805 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:43:52.048636    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cc6aeef9-afb1-4052-91eb-76d3d3a3427a-metrics-tls\") pod \"odh-observability-6f5479fd64-7gfbz\" (UID: \"cc6aeef9-afb1-4052-91eb-76d3d3a3427a\") " pod="odh-observability-system/odh-observability-6f5479fd64-7gfbz"
Oct 30 20:43:52.048805 ip-10-0-142-4 kubenswrapper[4060]: E1030 20:43:52.048738    4060 secret.go:189] Couldn't get secret odh-observability-system/odh-observability-webhook-cert: secret "odh-observability-webhook-cert" not found
Oct 30 20:43:52.048896 ip-10-0-142-4 kubenswrapper[4060]: E1030 20:43:52.048831    4060 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc6aeef9-afb1-4052-91eb-76d3d3a3427a-webhook-certs podName:cc6aeef9-afb1-4052-91eb-76d3d3a3427a nodeName:}" failed. No retries permitted until 2026-10-30 20:43:52.548806719 +0000 UTC m=+451.305805012 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-certs" (UniqueName: "kubernetes.io/secret/cc6aeef9-afb1-4052-91eb-76d3d3a3427a-webhook-certs") pod "odh-observability-6f5479fd64-7gfbz" (UID: "cc6aeef9-afb1-4052-91eb-76d3d3a3427a") : secret "odh-observability-webhook-cert" not found
Oct 30 20:43:52.051079 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:43:52.051050    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cc6aeef9-afb1-4052-91eb-76d3d3a3427a-metrics-tls\") pod \"odh-observability-6f5479fd64-7gfbz\" (UID: \"cc6aeef9-afb1-4052-91eb-76d3d3a3427a\") " pod="odh-observability-system/odh-observability-6f5479fd64-7gfbz"
Oct 30 20:43:52.110083 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:43:52.110045    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qd9zv\" (UniqueName: \"kubernetes.io/projected/cc6aeef9-afb1-4052-91eb-76d3d3a3427a-kube-api-access-qd9zv\") pod \"odh-observability-6f5479fd64-7gfbz\" (UID: \"cc6aeef9-afb1-4052-91eb-76d3d3a3427a\") " pod="odh-observability-system/odh-observability-6f5479fd64-7gfbz"
Oct 30 20:43:52.551504 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:43:52.551460    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-certs\" (UniqueName: \"kubernetes.io/secret/cc6aeef9-afb1-4052-91eb-76d3d3a3427a-webhook-certs\") pod \"odh-observability-6f5479fd64-7gfbz\" (UID: \"cc6aeef9-afb1-4052-91eb-76d3d3a3427a\") " pod="odh-observability-system/odh-observability-6f5479fd64-7gfbz"
Oct 30 20:43:52.551684 ip-10-0-142-4 kubenswrapper[4060]: E1030 20:43:52.551606    4060 secret.go:189] Couldn't get secret odh-observability-system/odh-observability-webhook-cert: secret "odh-observability-webhook-cert" not found
Oct 30 20:43:52.551684 ip-10-0-142-4 kubenswrapper[4060]: E1030 20:43:52.551667    4060 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc6aeef9-afb1-4052-91eb-76d3d3a3427a-webhook-certs podName:cc6aeef9-afb1-4052-91eb-76d3d3a3427a nodeName:}" failed. No retries permitted until 2026-10-30 20:43:53.551651374 +0000 UTC m=+452.308649650 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "webhook-certs" (UniqueName: "kubernetes.io/secret/cc6aeef9-afb1-4052-91eb-76d3d3a3427a-webhook-certs") pod "odh-observability-6f5479fd64-7gfbz" (UID: "cc6aeef9-afb1-4052-91eb-76d3d3a3427a") : secret "odh-observability-webhook-cert" not found
Oct 30 20:43:53.558781 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:43:53.558738    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-certs\" (UniqueName: \"kubernetes.io/secret/cc6aeef9-afb1-4052-91eb-76d3d3a3427a-webhook-certs\") pod \"odh-observability-6f5479fd64-7gfbz\" (UID: \"cc6aeef9-afb1-4052-91eb-76d3d3a3427a\") " pod="odh-observability-system/odh-observability-6f5479fd64-7gfbz"
Oct 30 20:43:53.561173 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:43:53.561147    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-certs\" (UniqueName: \"kubernetes.io/secret/cc6aeef9-afb1-4052-91eb-76d3d3a3427a-webhook-certs\") pod \"odh-observability-6f5479fd64-7gfbz\" (UID: \"cc6aeef9-afb1-4052-91eb-76d3d3a3427a\") " pod="odh-observability-system/odh-observability-6f5479fd64-7gfbz"
Oct 30 20:43:53.689560 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:43:53.689528    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-observability-system/odh-observability-6f5479fd64-7gfbz"
Oct 30 20:43:54.062467 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:43:54.062344    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-observability-system/odh-observability-6f5479fd64-7gfbz"]
Oct 30 20:43:54.065225 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:43:54.065197    4060 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc6aeef9_afb1_4052_91eb_76d3d3a3427a.slice/crio-97afd907ed6e5c347c9c749e1f07dd2ac34a883e8b8d473556d157ba1189fa00 WatchSource:0}: Error finding container 97afd907ed6e5c347c9c749e1f07dd2ac34a883e8b8d473556d157ba1189fa00: Status 404 returned error can't find the container with id 97afd907ed6e5c347c9c749e1f07dd2ac34a883e8b8d473556d157ba1189fa00
Oct 30 20:43:54.964450 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:43:54.964414    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-observability-system/odh-observability-6f5479fd64-7gfbz" event={"ID":"cc6aeef9-afb1-4052-91eb-76d3d3a3427a","Type":"ContainerStarted","Data":"97afd907ed6e5c347c9c749e1f07dd2ac34a883e8b8d473556d157ba1189fa00"}
Oct 30 20:43:59.985914 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:43:59.985874    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-observability-system/odh-observability-6f5479fd64-7gfbz" event={"ID":"cc6aeef9-afb1-4052-91eb-76d3d3a3427a","Type":"ContainerStarted","Data":"c78ecfa1e03cb7bc96c931f72fb494c48214ec5d6580bf4c4d29cfe4d61fbb6f"}
Oct 30 20:43:59.986306 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:43:59.985998    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-observability-system/odh-observability-6f5479fd64-7gfbz"
Oct 30 20:44:00.103012 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:44:00.102903    4060 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-observability-system/odh-observability-6f5479fd64-7gfbz" podStartSLOduration=3.347624526 podStartE2EDuration="9.102876805s" totalImagesPullingTime="5.755252279s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:43:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:44:00.10206519 +0000 UTC m=+458.859063486" watchObservedRunningTime="2026-10-30 20:44:00.102876805 +0000 UTC m=+458.859875103"
Oct 30 20:44:10.992580 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:44:10.992550    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-observability-system/odh-observability-6f5479fd64-7gfbz"
Oct 30 20:44:12.150041 ip-10-0-142-4 kubenswrapper[4060]: E1030 20:44:12.150006    4060 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v2f4x" containerName="extractor"
Oct 30 20:44:42.150751 ip-10-0-142-4 kubenswrapper[4060]: E1030 20:44:42.150667    4060 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v2f4x" containerName="extractor"
Oct 30 20:45:12.149781 ip-10-0-142-4 kubenswrapper[4060]: E1030 20:45:12.149742    4060 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v2f4x" containerName="extractor"
Oct 30 20:45:19.643970 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:19.643934    4060 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/07f0b9f07fd02dc1509b226b57404b9c198c3c836737a4f34809a10054g47d7"]
Oct 30 20:45:19.647142 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:19.647124    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/07f0b9f07fd02dc1509b226b57404b9c198c3c836737a4f34809a10054g47d7"
Oct 30 20:45:19.749389 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:19.749351    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Oct 30 20:45:19.749389 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:19.749378    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Oct 30 20:45:19.749636 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:19.749426    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"07f0b9f07fd02dc1509b226b57404b9c198c3c-8adea440-dockercfg-9b8dp\""
Oct 30 20:45:19.750584 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:19.750569    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/07f0b9f07fd02dc1509b226b57404b9c198c3c836737a4f34809a10054g47d7"]
Oct 30 20:45:19.798062 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:19.798028    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4528bccb-2903-4917-a1f8-05446a80723c-util\") pod \"07f0b9f07fd02dc1509b226b57404b9c198c3c836737a4f34809a10054g47d7\" (UID: \"4528bccb-2903-4917-a1f8-05446a80723c\") " pod="openshift-marketplace/07f0b9f07fd02dc1509b226b57404b9c198c3c836737a4f34809a10054g47d7"
Oct 30 20:45:19.798221 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:19.798068    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xwldl\" (UniqueName: \"kubernetes.io/projected/4528bccb-2903-4917-a1f8-05446a80723c-kube-api-access-xwldl\") pod \"07f0b9f07fd02dc1509b226b57404b9c198c3c836737a4f34809a10054g47d7\" (UID: \"4528bccb-2903-4917-a1f8-05446a80723c\") " pod="openshift-marketplace/07f0b9f07fd02dc1509b226b57404b9c198c3c836737a4f34809a10054g47d7"
Oct 30 20:45:19.798221 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:19.798190    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4528bccb-2903-4917-a1f8-05446a80723c-bundle\") pod \"07f0b9f07fd02dc1509b226b57404b9c198c3c836737a4f34809a10054g47d7\" (UID: \"4528bccb-2903-4917-a1f8-05446a80723c\") " pod="openshift-marketplace/07f0b9f07fd02dc1509b226b57404b9c198c3c836737a4f34809a10054g47d7"
Oct 30 20:45:19.899509 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:19.899389    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4528bccb-2903-4917-a1f8-05446a80723c-bundle\") pod \"07f0b9f07fd02dc1509b226b57404b9c198c3c836737a4f34809a10054g47d7\" (UID: \"4528bccb-2903-4917-a1f8-05446a80723c\") " pod="openshift-marketplace/07f0b9f07fd02dc1509b226b57404b9c198c3c836737a4f34809a10054g47d7"
Oct 30 20:45:19.899509 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:19.899465    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4528bccb-2903-4917-a1f8-05446a80723c-util\") pod \"07f0b9f07fd02dc1509b226b57404b9c198c3c836737a4f34809a10054g47d7\" (UID: \"4528bccb-2903-4917-a1f8-05446a80723c\") " pod="openshift-marketplace/07f0b9f07fd02dc1509b226b57404b9c198c3c836737a4f34809a10054g47d7"
Oct 30 20:45:19.899753 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:19.899511    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xwldl\" (UniqueName: \"kubernetes.io/projected/4528bccb-2903-4917-a1f8-05446a80723c-kube-api-access-xwldl\") pod \"07f0b9f07fd02dc1509b226b57404b9c198c3c836737a4f34809a10054g47d7\" (UID: \"4528bccb-2903-4917-a1f8-05446a80723c\") " pod="openshift-marketplace/07f0b9f07fd02dc1509b226b57404b9c198c3c836737a4f34809a10054g47d7"
Oct 30 20:45:19.899828 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:19.899807    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4528bccb-2903-4917-a1f8-05446a80723c-bundle\") pod \"07f0b9f07fd02dc1509b226b57404b9c198c3c836737a4f34809a10054g47d7\" (UID: \"4528bccb-2903-4917-a1f8-05446a80723c\") " pod="openshift-marketplace/07f0b9f07fd02dc1509b226b57404b9c198c3c836737a4f34809a10054g47d7"
Oct 30 20:45:19.899890 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:19.899836    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4528bccb-2903-4917-a1f8-05446a80723c-util\") pod \"07f0b9f07fd02dc1509b226b57404b9c198c3c836737a4f34809a10054g47d7\" (UID: \"4528bccb-2903-4917-a1f8-05446a80723c\") " pod="openshift-marketplace/07f0b9f07fd02dc1509b226b57404b9c198c3c836737a4f34809a10054g47d7"
Oct 30 20:45:19.928156 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:19.928120    4060 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/6fb1a13d619f6ee73e221b33f4898cc831d48b9998b06378838f67eccf6c78h"]
Oct 30 20:45:19.931692 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:19.931670    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6fb1a13d619f6ee73e221b33f4898cc831d48b9998b06378838f67eccf6c78h"
Oct 30 20:45:19.960870 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:19.960840    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xwldl\" (UniqueName: \"kubernetes.io/projected/4528bccb-2903-4917-a1f8-05446a80723c-kube-api-access-xwldl\") pod \"07f0b9f07fd02dc1509b226b57404b9c198c3c836737a4f34809a10054g47d7\" (UID: \"4528bccb-2903-4917-a1f8-05446a80723c\") " pod="openshift-marketplace/07f0b9f07fd02dc1509b226b57404b9c198c3c836737a4f34809a10054g47d7"
Oct 30 20:45:19.962662 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:19.962636    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/07f0b9f07fd02dc1509b226b57404b9c198c3c836737a4f34809a10054g47d7"
Oct 30 20:45:19.986658 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:19.986637    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"6fb1a13d619f6ee73e221b33f4898cc831d48b-0ad9862f-dockercfg-x5nmc\""
Oct 30 20:45:20.010430 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:20.010352    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6fb1a13d619f6ee73e221b33f4898cc831d48b9998b06378838f67eccf6c78h"]
Oct 30 20:45:20.100418 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:20.100377    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qfznk\" (UniqueName: \"kubernetes.io/projected/43afac0f-9e6c-4040-8333-4d68ed3606e3-kube-api-access-qfznk\") pod \"6fb1a13d619f6ee73e221b33f4898cc831d48b9998b06378838f67eccf6c78h\" (UID: \"43afac0f-9e6c-4040-8333-4d68ed3606e3\") " pod="openshift-marketplace/6fb1a13d619f6ee73e221b33f4898cc831d48b9998b06378838f67eccf6c78h"
Oct 30 20:45:20.100612 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:20.100445    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/43afac0f-9e6c-4040-8333-4d68ed3606e3-util\") pod \"6fb1a13d619f6ee73e221b33f4898cc831d48b9998b06378838f67eccf6c78h\" (UID: \"43afac0f-9e6c-4040-8333-4d68ed3606e3\") " pod="openshift-marketplace/6fb1a13d619f6ee73e221b33f4898cc831d48b9998b06378838f67eccf6c78h"
Oct 30 20:45:20.100612 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:20.100548    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/43afac0f-9e6c-4040-8333-4d68ed3606e3-bundle\") pod \"6fb1a13d619f6ee73e221b33f4898cc831d48b9998b06378838f67eccf6c78h\" (UID: \"43afac0f-9e6c-4040-8333-4d68ed3606e3\") " pod="openshift-marketplace/6fb1a13d619f6ee73e221b33f4898cc831d48b9998b06378838f67eccf6c78h"
Oct 30 20:45:20.201780 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:20.201740    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/43afac0f-9e6c-4040-8333-4d68ed3606e3-util\") pod \"6fb1a13d619f6ee73e221b33f4898cc831d48b9998b06378838f67eccf6c78h\" (UID: \"43afac0f-9e6c-4040-8333-4d68ed3606e3\") " pod="openshift-marketplace/6fb1a13d619f6ee73e221b33f4898cc831d48b9998b06378838f67eccf6c78h"
Oct 30 20:45:20.201780 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:20.201781    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/43afac0f-9e6c-4040-8333-4d68ed3606e3-bundle\") pod \"6fb1a13d619f6ee73e221b33f4898cc831d48b9998b06378838f67eccf6c78h\" (UID: \"43afac0f-9e6c-4040-8333-4d68ed3606e3\") " pod="openshift-marketplace/6fb1a13d619f6ee73e221b33f4898cc831d48b9998b06378838f67eccf6c78h"
Oct 30 20:45:20.201982 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:20.201815    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qfznk\" (UniqueName: \"kubernetes.io/projected/43afac0f-9e6c-4040-8333-4d68ed3606e3-kube-api-access-qfznk\") pod \"6fb1a13d619f6ee73e221b33f4898cc831d48b9998b06378838f67eccf6c78h\" (UID: \"43afac0f-9e6c-4040-8333-4d68ed3606e3\") " pod="openshift-marketplace/6fb1a13d619f6ee73e221b33f4898cc831d48b9998b06378838f67eccf6c78h"
Oct 30 20:45:20.202166 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:20.202145    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/43afac0f-9e6c-4040-8333-4d68ed3606e3-util\") pod \"6fb1a13d619f6ee73e221b33f4898cc831d48b9998b06378838f67eccf6c78h\" (UID: \"43afac0f-9e6c-4040-8333-4d68ed3606e3\") " pod="openshift-marketplace/6fb1a13d619f6ee73e221b33f4898cc831d48b9998b06378838f67eccf6c78h"
Oct 30 20:45:20.202204 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:20.202176    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/43afac0f-9e6c-4040-8333-4d68ed3606e3-bundle\") pod \"6fb1a13d619f6ee73e221b33f4898cc831d48b9998b06378838f67eccf6c78h\" (UID: \"43afac0f-9e6c-4040-8333-4d68ed3606e3\") " pod="openshift-marketplace/6fb1a13d619f6ee73e221b33f4898cc831d48b9998b06378838f67eccf6c78h"
Oct 30 20:45:20.263721 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:20.263685    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qfznk\" (UniqueName: \"kubernetes.io/projected/43afac0f-9e6c-4040-8333-4d68ed3606e3-kube-api-access-qfznk\") pod \"6fb1a13d619f6ee73e221b33f4898cc831d48b9998b06378838f67eccf6c78h\" (UID: \"43afac0f-9e6c-4040-8333-4d68ed3606e3\") " pod="openshift-marketplace/6fb1a13d619f6ee73e221b33f4898cc831d48b9998b06378838f67eccf6c78h"
Oct 30 20:45:20.335573 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:20.335540    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/07f0b9f07fd02dc1509b226b57404b9c198c3c836737a4f34809a10054g47d7"]
Oct 30 20:45:20.339541 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:45:20.339515    4060 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4528bccb_2903_4917_a1f8_05446a80723c.slice/crio-442a9e6ade68afd40e272a2578f6f83a1c50f073ba891aef2ca095ec2a9f24f7 WatchSource:0}: Error finding container 442a9e6ade68afd40e272a2578f6f83a1c50f073ba891aef2ca095ec2a9f24f7: Status 404 returned error can't find the container with id 442a9e6ade68afd40e272a2578f6f83a1c50f073ba891aef2ca095ec2a9f24f7
Oct 30 20:45:20.547083 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:20.546996    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6fb1a13d619f6ee73e221b33f4898cc831d48b9998b06378838f67eccf6c78h"
Oct 30 20:45:20.916075 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:20.915959    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6fb1a13d619f6ee73e221b33f4898cc831d48b9998b06378838f67eccf6c78h"]
Oct 30 20:45:20.918751 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:45:20.918718    4060 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43afac0f_9e6c_4040_8333_4d68ed3606e3.slice/crio-0efd1ee7dc5b3de75c02c31fc79cb034b8881578deba22fce69f2fc0fb5e96ef WatchSource:0}: Error finding container 0efd1ee7dc5b3de75c02c31fc79cb034b8881578deba22fce69f2fc0fb5e96ef: Status 404 returned error can't find the container with id 0efd1ee7dc5b3de75c02c31fc79cb034b8881578deba22fce69f2fc0fb5e96ef
Oct 30 20:45:21.282620 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:21.282582    4060 generic.go:356] "Generic (PLEG): container finished" podID="4528bccb-2903-4917-a1f8-05446a80723c" containerID="9cec2e526d3742982f8f12346983bdb5eeaee75619d4e85fb483945c23674434" exitCode=0
Oct 30 20:45:21.282811 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:21.282666    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/07f0b9f07fd02dc1509b226b57404b9c198c3c836737a4f34809a10054g47d7" event={"ID":"4528bccb-2903-4917-a1f8-05446a80723c","Type":"ContainerDied","Data":"9cec2e526d3742982f8f12346983bdb5eeaee75619d4e85fb483945c23674434"}
Oct 30 20:45:21.282811 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:21.282723    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/07f0b9f07fd02dc1509b226b57404b9c198c3c836737a4f34809a10054g47d7" event={"ID":"4528bccb-2903-4917-a1f8-05446a80723c","Type":"ContainerStarted","Data":"442a9e6ade68afd40e272a2578f6f83a1c50f073ba891aef2ca095ec2a9f24f7"}
Oct 30 20:45:21.284261 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:21.284238    4060 generic.go:356] "Generic (PLEG): container finished" podID="43afac0f-9e6c-4040-8333-4d68ed3606e3" containerID="5f2a251c9bac0a359666dde209e59d10e771c725d85f7a2b9bf0c7b92ae67462" exitCode=0
Oct 30 20:45:21.284380 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:21.284275    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6fb1a13d619f6ee73e221b33f4898cc831d48b9998b06378838f67eccf6c78h" event={"ID":"43afac0f-9e6c-4040-8333-4d68ed3606e3","Type":"ContainerDied","Data":"5f2a251c9bac0a359666dde209e59d10e771c725d85f7a2b9bf0c7b92ae67462"}
Oct 30 20:45:21.284380 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:21.284304    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6fb1a13d619f6ee73e221b33f4898cc831d48b9998b06378838f67eccf6c78h" event={"ID":"43afac0f-9e6c-4040-8333-4d68ed3606e3","Type":"ContainerStarted","Data":"0efd1ee7dc5b3de75c02c31fc79cb034b8881578deba22fce69f2fc0fb5e96ef"}
Oct 30 20:45:22.822555 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:22.822516    4060 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e1df189bb31fb8c419c1e848482afda4dccb516290aeca4a9ece71e9747jfqx"]
Oct 30 20:45:22.826199 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:22.826180    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e1df189bb31fb8c419c1e848482afda4dccb516290aeca4a9ece71e9747jfqx"
Oct 30 20:45:22.922297 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:22.922260    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/25845d67-65c0-4b31-a674-fbcf78611f8e-util\") pod \"e1df189bb31fb8c419c1e848482afda4dccb516290aeca4a9ece71e9747jfqx\" (UID: \"25845d67-65c0-4b31-a674-fbcf78611f8e\") " pod="openshift-marketplace/e1df189bb31fb8c419c1e848482afda4dccb516290aeca4a9ece71e9747jfqx"
Oct 30 20:45:22.922297 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:22.922301    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/25845d67-65c0-4b31-a674-fbcf78611f8e-bundle\") pod \"e1df189bb31fb8c419c1e848482afda4dccb516290aeca4a9ece71e9747jfqx\" (UID: \"25845d67-65c0-4b31-a674-fbcf78611f8e\") " pod="openshift-marketplace/e1df189bb31fb8c419c1e848482afda4dccb516290aeca4a9ece71e9747jfqx"
Oct 30 20:45:22.922519 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:22.922326    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-whr55\" (UniqueName: \"kubernetes.io/projected/25845d67-65c0-4b31-a674-fbcf78611f8e-kube-api-access-whr55\") pod \"e1df189bb31fb8c419c1e848482afda4dccb516290aeca4a9ece71e9747jfqx\" (UID: \"25845d67-65c0-4b31-a674-fbcf78611f8e\") " pod="openshift-marketplace/e1df189bb31fb8c419c1e848482afda4dccb516290aeca4a9ece71e9747jfqx"
Oct 30 20:45:22.927859 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:22.927838    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"e1df189bb31fb8c419c1e848482afda4dccb51-08dd003f-dockercfg-6vfnf\""
Oct 30 20:45:22.929017 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:22.929000    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e1df189bb31fb8c419c1e848482afda4dccb516290aeca4a9ece71e9747jfqx"]
Oct 30 20:45:23.023027 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:23.022986    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/25845d67-65c0-4b31-a674-fbcf78611f8e-bundle\") pod \"e1df189bb31fb8c419c1e848482afda4dccb516290aeca4a9ece71e9747jfqx\" (UID: \"25845d67-65c0-4b31-a674-fbcf78611f8e\") " pod="openshift-marketplace/e1df189bb31fb8c419c1e848482afda4dccb516290aeca4a9ece71e9747jfqx"
Oct 30 20:45:23.023183 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:23.023040    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-whr55\" (UniqueName: \"kubernetes.io/projected/25845d67-65c0-4b31-a674-fbcf78611f8e-kube-api-access-whr55\") pod \"e1df189bb31fb8c419c1e848482afda4dccb516290aeca4a9ece71e9747jfqx\" (UID: \"25845d67-65c0-4b31-a674-fbcf78611f8e\") " pod="openshift-marketplace/e1df189bb31fb8c419c1e848482afda4dccb516290aeca4a9ece71e9747jfqx"
Oct 30 20:45:23.023183 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:23.023096    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/25845d67-65c0-4b31-a674-fbcf78611f8e-util\") pod \"e1df189bb31fb8c419c1e848482afda4dccb516290aeca4a9ece71e9747jfqx\" (UID: \"25845d67-65c0-4b31-a674-fbcf78611f8e\") " pod="openshift-marketplace/e1df189bb31fb8c419c1e848482afda4dccb516290aeca4a9ece71e9747jfqx"
Oct 30 20:45:23.023464 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:23.023445    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/25845d67-65c0-4b31-a674-fbcf78611f8e-bundle\") pod \"e1df189bb31fb8c419c1e848482afda4dccb516290aeca4a9ece71e9747jfqx\" (UID: \"25845d67-65c0-4b31-a674-fbcf78611f8e\") " pod="openshift-marketplace/e1df189bb31fb8c419c1e848482afda4dccb516290aeca4a9ece71e9747jfqx"
Oct 30 20:45:23.023529 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:23.023446    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/25845d67-65c0-4b31-a674-fbcf78611f8e-util\") pod \"e1df189bb31fb8c419c1e848482afda4dccb516290aeca4a9ece71e9747jfqx\" (UID: \"25845d67-65c0-4b31-a674-fbcf78611f8e\") " pod="openshift-marketplace/e1df189bb31fb8c419c1e848482afda4dccb516290aeca4a9ece71e9747jfqx"
Oct 30 20:45:23.084367 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:23.084300    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-whr55\" (UniqueName: \"kubernetes.io/projected/25845d67-65c0-4b31-a674-fbcf78611f8e-kube-api-access-whr55\") pod \"e1df189bb31fb8c419c1e848482afda4dccb516290aeca4a9ece71e9747jfqx\" (UID: \"25845d67-65c0-4b31-a674-fbcf78611f8e\") " pod="openshift-marketplace/e1df189bb31fb8c419c1e848482afda4dccb516290aeca4a9ece71e9747jfqx"
Oct 30 20:45:23.141341 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:23.141309    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e1df189bb31fb8c419c1e848482afda4dccb516290aeca4a9ece71e9747jfqx"
Oct 30 20:45:23.510317 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:23.510290    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e1df189bb31fb8c419c1e848482afda4dccb516290aeca4a9ece71e9747jfqx"]
Oct 30 20:45:23.559382 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:45:23.559349    4060 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25845d67_65c0_4b31_a674_fbcf78611f8e.slice/crio-793e747f77ed710dc23b360bbc8f808a9483c3d02c822f53c80e2c59b7b7bfa7 WatchSource:0}: Error finding container 793e747f77ed710dc23b360bbc8f808a9483c3d02c822f53c80e2c59b7b7bfa7: Status 404 returned error can't find the container with id 793e747f77ed710dc23b360bbc8f808a9483c3d02c822f53c80e2c59b7b7bfa7
Oct 30 20:45:24.296280 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:24.296247    4060 generic.go:356] "Generic (PLEG): container finished" podID="43afac0f-9e6c-4040-8333-4d68ed3606e3" containerID="b20095b8cad5656eeca0f23b9081b1d6732a697ab237b2e5bb8f8b50e1b6f269" exitCode=0
Oct 30 20:45:24.296742 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:24.296329    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6fb1a13d619f6ee73e221b33f4898cc831d48b9998b06378838f67eccf6c78h" event={"ID":"43afac0f-9e6c-4040-8333-4d68ed3606e3","Type":"ContainerDied","Data":"b20095b8cad5656eeca0f23b9081b1d6732a697ab237b2e5bb8f8b50e1b6f269"}
Oct 30 20:45:24.298365 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:24.298341    4060 generic.go:356] "Generic (PLEG): container finished" podID="4528bccb-2903-4917-a1f8-05446a80723c" containerID="1d9d86a8017fc08c47975ccc3b6c3a32a1493f58e8afced5246bc3afbd78960a" exitCode=0
Oct 30 20:45:24.298476 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:24.298392    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/07f0b9f07fd02dc1509b226b57404b9c198c3c836737a4f34809a10054g47d7" event={"ID":"4528bccb-2903-4917-a1f8-05446a80723c","Type":"ContainerDied","Data":"1d9d86a8017fc08c47975ccc3b6c3a32a1493f58e8afced5246bc3afbd78960a"}
Oct 30 20:45:24.300079 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:24.299965    4060 generic.go:356] "Generic (PLEG): container finished" podID="25845d67-65c0-4b31-a674-fbcf78611f8e" containerID="50e7d66c61c038d6f0fe4fb0053c1d3a96808ec439ecc67ccf32a6d4bd9d08a1" exitCode=0
Oct 30 20:45:24.300079 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:24.299995    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e1df189bb31fb8c419c1e848482afda4dccb516290aeca4a9ece71e9747jfqx" event={"ID":"25845d67-65c0-4b31-a674-fbcf78611f8e","Type":"ContainerDied","Data":"50e7d66c61c038d6f0fe4fb0053c1d3a96808ec439ecc67ccf32a6d4bd9d08a1"}
Oct 30 20:45:24.300079 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:24.300043    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e1df189bb31fb8c419c1e848482afda4dccb516290aeca4a9ece71e9747jfqx" event={"ID":"25845d67-65c0-4b31-a674-fbcf78611f8e","Type":"ContainerStarted","Data":"793e747f77ed710dc23b360bbc8f808a9483c3d02c822f53c80e2c59b7b7bfa7"}
Oct 30 20:45:25.305576 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:25.305551    4060 generic.go:356] "Generic (PLEG): container finished" podID="43afac0f-9e6c-4040-8333-4d68ed3606e3" containerID="bd2139cb64e4969aeb6939bec178c1acb226af4c806fab7cb8b0804043638007" exitCode=0
Oct 30 20:45:25.305963 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:25.305632    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6fb1a13d619f6ee73e221b33f4898cc831d48b9998b06378838f67eccf6c78h" event={"ID":"43afac0f-9e6c-4040-8333-4d68ed3606e3","Type":"ContainerDied","Data":"bd2139cb64e4969aeb6939bec178c1acb226af4c806fab7cb8b0804043638007"}
Oct 30 20:45:25.307525 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:25.307477    4060 generic.go:356] "Generic (PLEG): container finished" podID="4528bccb-2903-4917-a1f8-05446a80723c" containerID="e863dfd2015432bd8cd724cc4be1d13bc6a9b8b47cd7aac64e01b18b8c7fb617" exitCode=0
Oct 30 20:45:25.307633 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:25.307528    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/07f0b9f07fd02dc1509b226b57404b9c198c3c836737a4f34809a10054g47d7" event={"ID":"4528bccb-2903-4917-a1f8-05446a80723c","Type":"ContainerDied","Data":"e863dfd2015432bd8cd724cc4be1d13bc6a9b8b47cd7aac64e01b18b8c7fb617"}
Oct 30 20:45:26.475111 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:26.475090    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/07f0b9f07fd02dc1509b226b57404b9c198c3c836737a4f34809a10054g47d7"
Oct 30 20:45:26.489326 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:26.489308    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6fb1a13d619f6ee73e221b33f4898cc831d48b9998b06378838f67eccf6c78h"
Oct 30 20:45:26.547582 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:26.547558    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/43afac0f-9e6c-4040-8333-4d68ed3606e3-kube-api-access-qfznk\" (UniqueName: \"kubernetes.io/projected/43afac0f-9e6c-4040-8333-4d68ed3606e3-kube-api-access-qfznk\") pod \"43afac0f-9e6c-4040-8333-4d68ed3606e3\" (UID: \"43afac0f-9e6c-4040-8333-4d68ed3606e3\") "
Oct 30 20:45:26.547702 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:26.547610    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/43afac0f-9e6c-4040-8333-4d68ed3606e3-util\" (UniqueName: \"kubernetes.io/empty-dir/43afac0f-9e6c-4040-8333-4d68ed3606e3-util\") pod \"43afac0f-9e6c-4040-8333-4d68ed3606e3\" (UID: \"43afac0f-9e6c-4040-8333-4d68ed3606e3\") "
Oct 30 20:45:26.547702 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:26.547652    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/43afac0f-9e6c-4040-8333-4d68ed3606e3-bundle\" (UniqueName: \"kubernetes.io/empty-dir/43afac0f-9e6c-4040-8333-4d68ed3606e3-bundle\") pod \"43afac0f-9e6c-4040-8333-4d68ed3606e3\" (UID: \"43afac0f-9e6c-4040-8333-4d68ed3606e3\") "
Oct 30 20:45:26.547702 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:26.547680    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4528bccb-2903-4917-a1f8-05446a80723c-util\" (UniqueName: \"kubernetes.io/empty-dir/4528bccb-2903-4917-a1f8-05446a80723c-util\") pod \"4528bccb-2903-4917-a1f8-05446a80723c\" (UID: \"4528bccb-2903-4917-a1f8-05446a80723c\") "
Oct 30 20:45:26.547852 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:26.547707    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4528bccb-2903-4917-a1f8-05446a80723c-kube-api-access-xwldl\" (UniqueName: \"kubernetes.io/projected/4528bccb-2903-4917-a1f8-05446a80723c-kube-api-access-xwldl\") pod \"4528bccb-2903-4917-a1f8-05446a80723c\" (UID: \"4528bccb-2903-4917-a1f8-05446a80723c\") "
Oct 30 20:45:26.549190 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:26.549155    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/43afac0f-9e6c-4040-8333-4d68ed3606e3-bundle" pod "43afac0f-9e6c-4040-8333-4d68ed3606e3" (UID: "43afac0f-9e6c-4040-8333-4d68ed3606e3"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:45:26.549639 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:26.549612    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/43afac0f-9e6c-4040-8333-4d68ed3606e3-kube-api-access-qfznk" pod "43afac0f-9e6c-4040-8333-4d68ed3606e3" (UID: "43afac0f-9e6c-4040-8333-4d68ed3606e3"). InnerVolumeSpecName "kube-api-access-qfznk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:45:26.549728 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:26.549702    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4528bccb-2903-4917-a1f8-05446a80723c-kube-api-access-xwldl" pod "4528bccb-2903-4917-a1f8-05446a80723c" (UID: "4528bccb-2903-4917-a1f8-05446a80723c"). InnerVolumeSpecName "kube-api-access-xwldl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:45:26.552692 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:26.552675    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4528bccb-2903-4917-a1f8-05446a80723c-util" pod "4528bccb-2903-4917-a1f8-05446a80723c" (UID: "4528bccb-2903-4917-a1f8-05446a80723c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:45:26.552921 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:26.552904    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/43afac0f-9e6c-4040-8333-4d68ed3606e3-util" pod "43afac0f-9e6c-4040-8333-4d68ed3606e3" (UID: "43afac0f-9e6c-4040-8333-4d68ed3606e3"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:45:26.648431 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:26.648400    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4528bccb-2903-4917-a1f8-05446a80723c-bundle\" (UniqueName: \"kubernetes.io/empty-dir/4528bccb-2903-4917-a1f8-05446a80723c-bundle\") pod \"4528bccb-2903-4917-a1f8-05446a80723c\" (UID: \"4528bccb-2903-4917-a1f8-05446a80723c\") "
Oct 30 20:45:26.648587 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:26.648544    4060 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qfznk\" (UniqueName: \"kubernetes.io/projected/43afac0f-9e6c-4040-8333-4d68ed3606e3-kube-api-access-qfznk\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:45:26.648587 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:26.648557    4060 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/43afac0f-9e6c-4040-8333-4d68ed3606e3-util\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:45:26.648587 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:26.648567    4060 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/43afac0f-9e6c-4040-8333-4d68ed3606e3-bundle\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:45:26.648587 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:26.648579    4060 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4528bccb-2903-4917-a1f8-05446a80723c-util\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:45:26.648716 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:26.648589    4060 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xwldl\" (UniqueName: \"kubernetes.io/projected/4528bccb-2903-4917-a1f8-05446a80723c-kube-api-access-xwldl\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:45:26.648953 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:26.648913    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4528bccb-2903-4917-a1f8-05446a80723c-bundle" pod "4528bccb-2903-4917-a1f8-05446a80723c" (UID: "4528bccb-2903-4917-a1f8-05446a80723c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:45:26.748926 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:26.748892    4060 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4528bccb-2903-4917-a1f8-05446a80723c-bundle\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:45:27.317040 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:27.317008    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6fb1a13d619f6ee73e221b33f4898cc831d48b9998b06378838f67eccf6c78h"
Oct 30 20:45:27.317040 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:27.317015    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6fb1a13d619f6ee73e221b33f4898cc831d48b9998b06378838f67eccf6c78h" event={"ID":"43afac0f-9e6c-4040-8333-4d68ed3606e3","Type":"ContainerDied","Data":"0efd1ee7dc5b3de75c02c31fc79cb034b8881578deba22fce69f2fc0fb5e96ef"}
Oct 30 20:45:27.317262 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:27.317092    4060 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0efd1ee7dc5b3de75c02c31fc79cb034b8881578deba22fce69f2fc0fb5e96ef"
Oct 30 20:45:27.318846 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:27.318816    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/07f0b9f07fd02dc1509b226b57404b9c198c3c836737a4f34809a10054g47d7" event={"ID":"4528bccb-2903-4917-a1f8-05446a80723c","Type":"ContainerDied","Data":"442a9e6ade68afd40e272a2578f6f83a1c50f073ba891aef2ca095ec2a9f24f7"}
Oct 30 20:45:27.318846 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:27.318840    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/07f0b9f07fd02dc1509b226b57404b9c198c3c836737a4f34809a10054g47d7"
Oct 30 20:45:27.319047 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:27.318863    4060 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="442a9e6ade68afd40e272a2578f6f83a1c50f073ba891aef2ca095ec2a9f24f7"
Oct 30 20:45:27.320450 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:27.320427    4060 generic.go:356] "Generic (PLEG): container finished" podID="25845d67-65c0-4b31-a674-fbcf78611f8e" containerID="1027abd357ffd5e503bc6d880df78541a37f2d78008d03f7c28c73321782723a" exitCode=0
Oct 30 20:45:27.320576 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:27.320513    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e1df189bb31fb8c419c1e848482afda4dccb516290aeca4a9ece71e9747jfqx" event={"ID":"25845d67-65c0-4b31-a674-fbcf78611f8e","Type":"ContainerDied","Data":"1027abd357ffd5e503bc6d880df78541a37f2d78008d03f7c28c73321782723a"}
Oct 30 20:45:28.326651 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:28.326614    4060 generic.go:356] "Generic (PLEG): container finished" podID="25845d67-65c0-4b31-a674-fbcf78611f8e" containerID="3ea662f34c17be49c043c280151a67e736ceb1a688e53efc87e6aaf60710224d" exitCode=0
Oct 30 20:45:28.327076 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:28.326697    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e1df189bb31fb8c419c1e848482afda4dccb516290aeca4a9ece71e9747jfqx" event={"ID":"25845d67-65c0-4b31-a674-fbcf78611f8e","Type":"ContainerDied","Data":"3ea662f34c17be49c043c280151a67e736ceb1a688e53efc87e6aaf60710224d"}
Oct 30 20:45:29.448754 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:29.448729    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e1df189bb31fb8c419c1e848482afda4dccb516290aeca4a9ece71e9747jfqx"
Oct 30 20:45:29.461849 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:29.461825    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/25845d67-65c0-4b31-a674-fbcf78611f8e-kube-api-access-whr55\" (UniqueName: \"kubernetes.io/projected/25845d67-65c0-4b31-a674-fbcf78611f8e-kube-api-access-whr55\") pod \"25845d67-65c0-4b31-a674-fbcf78611f8e\" (UID: \"25845d67-65c0-4b31-a674-fbcf78611f8e\") "
Oct 30 20:45:29.461961 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:29.461854    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/25845d67-65c0-4b31-a674-fbcf78611f8e-util\" (UniqueName: \"kubernetes.io/empty-dir/25845d67-65c0-4b31-a674-fbcf78611f8e-util\") pod \"25845d67-65c0-4b31-a674-fbcf78611f8e\" (UID: \"25845d67-65c0-4b31-a674-fbcf78611f8e\") "
Oct 30 20:45:29.461961 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:29.461895    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/25845d67-65c0-4b31-a674-fbcf78611f8e-bundle\" (UniqueName: \"kubernetes.io/empty-dir/25845d67-65c0-4b31-a674-fbcf78611f8e-bundle\") pod \"25845d67-65c0-4b31-a674-fbcf78611f8e\" (UID: \"25845d67-65c0-4b31-a674-fbcf78611f8e\") "
Oct 30 20:45:29.462611 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:29.462579    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/25845d67-65c0-4b31-a674-fbcf78611f8e-bundle" pod "25845d67-65c0-4b31-a674-fbcf78611f8e" (UID: "25845d67-65c0-4b31-a674-fbcf78611f8e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:45:29.463916 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:29.463892    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/25845d67-65c0-4b31-a674-fbcf78611f8e-kube-api-access-whr55" pod "25845d67-65c0-4b31-a674-fbcf78611f8e" (UID: "25845d67-65c0-4b31-a674-fbcf78611f8e"). InnerVolumeSpecName "kube-api-access-whr55". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:45:29.466373 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:29.466349    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/25845d67-65c0-4b31-a674-fbcf78611f8e-util" pod "25845d67-65c0-4b31-a674-fbcf78611f8e" (UID: "25845d67-65c0-4b31-a674-fbcf78611f8e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:45:29.562508 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:29.562463    4060 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-whr55\" (UniqueName: \"kubernetes.io/projected/25845d67-65c0-4b31-a674-fbcf78611f8e-kube-api-access-whr55\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:45:29.562508 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:29.562511    4060 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/25845d67-65c0-4b31-a674-fbcf78611f8e-util\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:45:29.562691 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:29.562521    4060 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/25845d67-65c0-4b31-a674-fbcf78611f8e-bundle\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:45:30.336633 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:30.336607    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e1df189bb31fb8c419c1e848482afda4dccb516290aeca4a9ece71e9747jfqx"
Oct 30 20:45:30.336818 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:30.336605    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e1df189bb31fb8c419c1e848482afda4dccb516290aeca4a9ece71e9747jfqx" event={"ID":"25845d67-65c0-4b31-a674-fbcf78611f8e","Type":"ContainerDied","Data":"793e747f77ed710dc23b360bbc8f808a9483c3d02c822f53c80e2c59b7b7bfa7"}
Oct 30 20:45:30.336818 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:30.336721    4060 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="793e747f77ed710dc23b360bbc8f808a9483c3d02c822f53c80e2c59b7b7bfa7"
Oct 30 20:45:36.330068 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:36.330032    4060 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-tempo-operator/tempo-operator-controller-57594446b4-8x7j6"]
Oct 30 20:45:36.330462 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:36.330279    4060 cpu_manager.go:414] "containerMap: removing container" podUID="4528bccb-2903-4917-a1f8-05446a80723c" containerName="extract"
Oct 30 20:45:36.330462 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:36.330289    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4528bccb-2903-4917-a1f8-05446a80723c" containerName="extract"
Oct 30 20:45:36.330462 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:36.330300    4060 cpu_manager.go:414] "containerMap: removing container" podUID="25845d67-65c0-4b31-a674-fbcf78611f8e" containerName="pull"
Oct 30 20:45:36.330462 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:36.330305    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="25845d67-65c0-4b31-a674-fbcf78611f8e" containerName="pull"
Oct 30 20:45:36.330462 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:36.330318    4060 cpu_manager.go:414] "containerMap: removing container" podUID="25845d67-65c0-4b31-a674-fbcf78611f8e" containerName="extract"
Oct 30 20:45:36.330462 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:36.330323    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="25845d67-65c0-4b31-a674-fbcf78611f8e" containerName="extract"
Oct 30 20:45:36.330462 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:36.330331    4060 cpu_manager.go:414] "containerMap: removing container" podUID="4528bccb-2903-4917-a1f8-05446a80723c" containerName="util"
Oct 30 20:45:36.330462 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:36.330335    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4528bccb-2903-4917-a1f8-05446a80723c" containerName="util"
Oct 30 20:45:36.330462 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:36.330340    4060 cpu_manager.go:414] "containerMap: removing container" podUID="25845d67-65c0-4b31-a674-fbcf78611f8e" containerName="util"
Oct 30 20:45:36.330462 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:36.330344    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="25845d67-65c0-4b31-a674-fbcf78611f8e" containerName="util"
Oct 30 20:45:36.330462 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:36.330350    4060 cpu_manager.go:414] "containerMap: removing container" podUID="43afac0f-9e6c-4040-8333-4d68ed3606e3" containerName="extract"
Oct 30 20:45:36.330462 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:36.330354    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="43afac0f-9e6c-4040-8333-4d68ed3606e3" containerName="extract"
Oct 30 20:45:36.330462 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:36.330359    4060 cpu_manager.go:414] "containerMap: removing container" podUID="43afac0f-9e6c-4040-8333-4d68ed3606e3" containerName="pull"
Oct 30 20:45:36.330462 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:36.330363    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="43afac0f-9e6c-4040-8333-4d68ed3606e3" containerName="pull"
Oct 30 20:45:36.330462 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:36.330370    4060 cpu_manager.go:414] "containerMap: removing container" podUID="4528bccb-2903-4917-a1f8-05446a80723c" containerName="pull"
Oct 30 20:45:36.330462 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:36.330374    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4528bccb-2903-4917-a1f8-05446a80723c" containerName="pull"
Oct 30 20:45:36.330462 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:36.330383    4060 cpu_manager.go:414] "containerMap: removing container" podUID="43afac0f-9e6c-4040-8333-4d68ed3606e3" containerName="util"
Oct 30 20:45:36.330462 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:36.330388    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="43afac0f-9e6c-4040-8333-4d68ed3606e3" containerName="util"
Oct 30 20:45:36.330462 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:36.330441    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="4528bccb-2903-4917-a1f8-05446a80723c" containerName="extract"
Oct 30 20:45:36.330462 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:36.330448    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="25845d67-65c0-4b31-a674-fbcf78611f8e" containerName="extract"
Oct 30 20:45:36.330462 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:36.330454    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="43afac0f-9e6c-4040-8333-4d68ed3606e3" containerName="extract"
Oct 30 20:45:36.333197 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:36.333181    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-tempo-operator/tempo-operator-controller-57594446b4-8x7j6"
Oct 30 20:45:36.387141 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:36.387087    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-tempo-operator\"/\"tempo-operator-metrics\""
Oct 30 20:45:36.387141 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:36.387089    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-tempo-operator\"/\"webhook-server-cert\""
Oct 30 20:45:36.387333 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:36.387153    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-tempo-operator\"/\"tempo-operator-controller-manager-dockercfg-79nlq\""
Oct 30 20:45:36.406290 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:36.406259    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cmtnr\" (UniqueName: \"kubernetes.io/projected/4b2cd9c3-5860-4972-9815-2145bf95554d-kube-api-access-cmtnr\") pod \"tempo-operator-controller-57594446b4-8x7j6\" (UID: \"4b2cd9c3-5860-4972-9815-2145bf95554d\") " pod="openshift-tempo-operator/tempo-operator-controller-57594446b4-8x7j6"
Oct 30 20:45:36.406436 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:36.406347    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4b2cd9c3-5860-4972-9815-2145bf95554d-webhook-cert\") pod \"tempo-operator-controller-57594446b4-8x7j6\" (UID: \"4b2cd9c3-5860-4972-9815-2145bf95554d\") " pod="openshift-tempo-operator/tempo-operator-controller-57594446b4-8x7j6"
Oct 30 20:45:36.406436 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:36.406415    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tempo-operator-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4b2cd9c3-5860-4972-9815-2145bf95554d-tempo-operator-metrics-cert\") pod \"tempo-operator-controller-57594446b4-8x7j6\" (UID: \"4b2cd9c3-5860-4972-9815-2145bf95554d\") " pod="openshift-tempo-operator/tempo-operator-controller-57594446b4-8x7j6"
Oct 30 20:45:36.406549 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:36.406436    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4b2cd9c3-5860-4972-9815-2145bf95554d-apiservice-cert\") pod \"tempo-operator-controller-57594446b4-8x7j6\" (UID: \"4b2cd9c3-5860-4972-9815-2145bf95554d\") " pod="openshift-tempo-operator/tempo-operator-controller-57594446b4-8x7j6"
Oct 30 20:45:36.436712 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:36.436672    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-tempo-operator\"/\"openshift-service-ca.crt\""
Oct 30 20:45:36.436843 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:36.436759    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-tempo-operator\"/\"kube-root-ca.crt\""
Oct 30 20:45:36.486498 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:36.486467    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-tempo-operator/tempo-operator-controller-57594446b4-8x7j6"]
Oct 30 20:45:36.494022 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:36.493998    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-tempo-operator\"/\"tempo-operator-controller-service-cert\""
Oct 30 20:45:36.506907 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:36.506877    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cmtnr\" (UniqueName: \"kubernetes.io/projected/4b2cd9c3-5860-4972-9815-2145bf95554d-kube-api-access-cmtnr\") pod \"tempo-operator-controller-57594446b4-8x7j6\" (UID: \"4b2cd9c3-5860-4972-9815-2145bf95554d\") " pod="openshift-tempo-operator/tempo-operator-controller-57594446b4-8x7j6"
Oct 30 20:45:36.507023 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:36.506936    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4b2cd9c3-5860-4972-9815-2145bf95554d-webhook-cert\") pod \"tempo-operator-controller-57594446b4-8x7j6\" (UID: \"4b2cd9c3-5860-4972-9815-2145bf95554d\") " pod="openshift-tempo-operator/tempo-operator-controller-57594446b4-8x7j6"
Oct 30 20:45:36.507023 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:36.506988    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tempo-operator-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4b2cd9c3-5860-4972-9815-2145bf95554d-tempo-operator-metrics-cert\") pod \"tempo-operator-controller-57594446b4-8x7j6\" (UID: \"4b2cd9c3-5860-4972-9815-2145bf95554d\") " pod="openshift-tempo-operator/tempo-operator-controller-57594446b4-8x7j6"
Oct 30 20:45:36.507023 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:36.507015    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4b2cd9c3-5860-4972-9815-2145bf95554d-apiservice-cert\") pod \"tempo-operator-controller-57594446b4-8x7j6\" (UID: \"4b2cd9c3-5860-4972-9815-2145bf95554d\") " pod="openshift-tempo-operator/tempo-operator-controller-57594446b4-8x7j6"
Oct 30 20:45:36.509617 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:36.509589    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tempo-operator-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4b2cd9c3-5860-4972-9815-2145bf95554d-tempo-operator-metrics-cert\") pod \"tempo-operator-controller-57594446b4-8x7j6\" (UID: \"4b2cd9c3-5860-4972-9815-2145bf95554d\") " pod="openshift-tempo-operator/tempo-operator-controller-57594446b4-8x7j6"
Oct 30 20:45:36.509617 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:36.509615    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4b2cd9c3-5860-4972-9815-2145bf95554d-webhook-cert\") pod \"tempo-operator-controller-57594446b4-8x7j6\" (UID: \"4b2cd9c3-5860-4972-9815-2145bf95554d\") " pod="openshift-tempo-operator/tempo-operator-controller-57594446b4-8x7j6"
Oct 30 20:45:36.509798 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:36.509717    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4b2cd9c3-5860-4972-9815-2145bf95554d-apiservice-cert\") pod \"tempo-operator-controller-57594446b4-8x7j6\" (UID: \"4b2cd9c3-5860-4972-9815-2145bf95554d\") " pod="openshift-tempo-operator/tempo-operator-controller-57594446b4-8x7j6"
Oct 30 20:45:36.572516 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:36.572467    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cmtnr\" (UniqueName: \"kubernetes.io/projected/4b2cd9c3-5860-4972-9815-2145bf95554d-kube-api-access-cmtnr\") pod \"tempo-operator-controller-57594446b4-8x7j6\" (UID: \"4b2cd9c3-5860-4972-9815-2145bf95554d\") " pod="openshift-tempo-operator/tempo-operator-controller-57594446b4-8x7j6"
Oct 30 20:45:36.644179 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:36.644087    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-tempo-operator/tempo-operator-controller-57594446b4-8x7j6"
Oct 30 20:45:37.072253 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:37.072218    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-tempo-operator/tempo-operator-controller-57594446b4-8x7j6"]
Oct 30 20:45:37.076045 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:45:37.076016    4060 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b2cd9c3_5860_4972_9815_2145bf95554d.slice/crio-c3e121a3e9b9be222509224c53e47780ae97432b2502a0d4590ce1689a0f1c10 WatchSource:0}: Error finding container c3e121a3e9b9be222509224c53e47780ae97432b2502a0d4590ce1689a0f1c10: Status 404 returned error can't find the container with id c3e121a3e9b9be222509224c53e47780ae97432b2502a0d4590ce1689a0f1c10
Oct 30 20:45:37.366908 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:37.366814    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-tempo-operator/tempo-operator-controller-57594446b4-8x7j6" event={"ID":"4b2cd9c3-5860-4972-9815-2145bf95554d","Type":"ContainerStarted","Data":"c3e121a3e9b9be222509224c53e47780ae97432b2502a0d4590ce1689a0f1c10"}
Oct 30 20:45:41.384176 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:41.384142    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-tempo-operator/tempo-operator-controller-57594446b4-8x7j6" event={"ID":"4b2cd9c3-5860-4972-9815-2145bf95554d","Type":"ContainerStarted","Data":"2068503df4316c1692b0d6ef0f6e73360293d05ed03da56724f0066e57a2e86c"}
Oct 30 20:45:41.384580 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:41.384270    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-tempo-operator/tempo-operator-controller-57594446b4-8x7j6"
Oct 30 20:45:41.612025 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:41.611963    4060 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-tempo-operator/tempo-operator-controller-57594446b4-8x7j6" podStartSLOduration=1.9104863920000001 podStartE2EDuration="5.611945208s" totalImagesPullingTime="3.701458816s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:45:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:45:41.560945377 +0000 UTC m=+560.317943675" watchObservedRunningTime="2026-10-30 20:45:41.611945208 +0000 UTC m=+560.368943507"
Oct 30 20:45:42.151816 ip-10-0-142-4 kubenswrapper[4060]: E1030 20:45:42.151707    4060 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v2f4x" containerName="extractor"
Oct 30 20:45:47.994950 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:47.994916    4060 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-cluster-observability-operator/obo-prometheus-operator-6ddb664c4f-dmvdw"]
Oct 30 20:45:47.998975 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:47.998956    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-observability-operator/obo-prometheus-operator-6ddb664c4f-dmvdw"
Oct 30 20:45:48.056320 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:48.056281    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-observability-operator\"/\"openshift-service-ca.crt\""
Oct 30 20:45:48.096461 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:48.096427    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t9bd5\" (UniqueName: \"kubernetes.io/projected/c26e4143-2635-4e0c-823e-269b580408b4-kube-api-access-t9bd5\") pod \"obo-prometheus-operator-6ddb664c4f-dmvdw\" (UID: \"c26e4143-2635-4e0c-823e-269b580408b4\") " pod="openshift-cluster-observability-operator/obo-prometheus-operator-6ddb664c4f-dmvdw"
Oct 30 20:45:48.104820 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:48.104799    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-observability-operator\"/\"obo-prometheus-operator-dockercfg-99cd6\""
Oct 30 20:45:48.104926 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:48.104814    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-observability-operator\"/\"kube-root-ca.crt\""
Oct 30 20:45:48.110773 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:48.110746    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-observability-operator/obo-prometheus-operator-6ddb664c4f-dmvdw"]
Oct 30 20:45:48.196946 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:48.196916    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t9bd5\" (UniqueName: \"kubernetes.io/projected/c26e4143-2635-4e0c-823e-269b580408b4-kube-api-access-t9bd5\") pod \"obo-prometheus-operator-6ddb664c4f-dmvdw\" (UID: \"c26e4143-2635-4e0c-823e-269b580408b4\") " pod="openshift-cluster-observability-operator/obo-prometheus-operator-6ddb664c4f-dmvdw"
Oct 30 20:45:48.273081 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:48.273008    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t9bd5\" (UniqueName: \"kubernetes.io/projected/c26e4143-2635-4e0c-823e-269b580408b4-kube-api-access-t9bd5\") pod \"obo-prometheus-operator-6ddb664c4f-dmvdw\" (UID: \"c26e4143-2635-4e0c-823e-269b580408b4\") " pod="openshift-cluster-observability-operator/obo-prometheus-operator-6ddb664c4f-dmvdw"
Oct 30 20:45:48.312194 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:48.312164    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-observability-operator/obo-prometheus-operator-6ddb664c4f-dmvdw"
Oct 30 20:45:48.574628 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:48.574561    4060 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-cluster-observability-operator/obo-prometheus-operator-admission-webhook-564dd7b8b9-wz5w9"]
Oct 30 20:45:48.578552 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:48.578536    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-observability-operator/obo-prometheus-operator-admission-webhook-564dd7b8b9-wz5w9"
Oct 30 20:45:48.601148 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:48.601119    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3f8a1740-9672-4e9c-afc4-a1194b98186c-apiservice-cert\") pod \"obo-prometheus-operator-admission-webhook-564dd7b8b9-wz5w9\" (UID: \"3f8a1740-9672-4e9c-afc4-a1194b98186c\") " pod="openshift-cluster-observability-operator/obo-prometheus-operator-admission-webhook-564dd7b8b9-wz5w9"
Oct 30 20:45:48.601289 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:48.601185    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3f8a1740-9672-4e9c-afc4-a1194b98186c-webhook-cert\") pod \"obo-prometheus-operator-admission-webhook-564dd7b8b9-wz5w9\" (UID: \"3f8a1740-9672-4e9c-afc4-a1194b98186c\") " pod="openshift-cluster-observability-operator/obo-prometheus-operator-admission-webhook-564dd7b8b9-wz5w9"
Oct 30 20:45:48.662443 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:48.662414    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-observability-operator/obo-prometheus-operator-admission-webhook-564dd7b8b9-wz5w9"]
Oct 30 20:45:48.702069 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:48.702038    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3f8a1740-9672-4e9c-afc4-a1194b98186c-webhook-cert\") pod \"obo-prometheus-operator-admission-webhook-564dd7b8b9-wz5w9\" (UID: \"3f8a1740-9672-4e9c-afc4-a1194b98186c\") " pod="openshift-cluster-observability-operator/obo-prometheus-operator-admission-webhook-564dd7b8b9-wz5w9"
Oct 30 20:45:48.702069 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:48.702074    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3f8a1740-9672-4e9c-afc4-a1194b98186c-apiservice-cert\") pod \"obo-prometheus-operator-admission-webhook-564dd7b8b9-wz5w9\" (UID: \"3f8a1740-9672-4e9c-afc4-a1194b98186c\") " pod="openshift-cluster-observability-operator/obo-prometheus-operator-admission-webhook-564dd7b8b9-wz5w9"
Oct 30 20:45:48.719285 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:48.719254    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-observability-operator\"/\"obo-prometheus-operator-admission-webhook-service-cert\""
Oct 30 20:45:48.719482 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:48.719465    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-observability-operator\"/\"obo-prometheus-operator-admission-webhook-dockercfg-6vnnw\""
Oct 30 20:45:48.724560 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:48.724540    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3f8a1740-9672-4e9c-afc4-a1194b98186c-webhook-cert\") pod \"obo-prometheus-operator-admission-webhook-564dd7b8b9-wz5w9\" (UID: \"3f8a1740-9672-4e9c-afc4-a1194b98186c\") " pod="openshift-cluster-observability-operator/obo-prometheus-operator-admission-webhook-564dd7b8b9-wz5w9"
Oct 30 20:45:48.724737 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:48.724719    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3f8a1740-9672-4e9c-afc4-a1194b98186c-apiservice-cert\") pod \"obo-prometheus-operator-admission-webhook-564dd7b8b9-wz5w9\" (UID: \"3f8a1740-9672-4e9c-afc4-a1194b98186c\") " pod="openshift-cluster-observability-operator/obo-prometheus-operator-admission-webhook-564dd7b8b9-wz5w9"
Oct 30 20:45:48.786295 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:48.786262    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-observability-operator/obo-prometheus-operator-6ddb664c4f-dmvdw"]
Oct 30 20:45:48.789415 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:45:48.789392    4060 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc26e4143_2635_4e0c_823e_269b580408b4.slice/crio-4d36687b8de46e9389a350e6127459c3b767a780cdef9f506dc552621b84de7f WatchSource:0}: Error finding container 4d36687b8de46e9389a350e6127459c3b767a780cdef9f506dc552621b84de7f: Status 404 returned error can't find the container with id 4d36687b8de46e9389a350e6127459c3b767a780cdef9f506dc552621b84de7f
Oct 30 20:45:48.891931 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:48.891846    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-observability-operator/obo-prometheus-operator-admission-webhook-564dd7b8b9-wz5w9"
Oct 30 20:45:49.369961 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:49.369935    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-observability-operator/obo-prometheus-operator-admission-webhook-564dd7b8b9-wz5w9"]
Oct 30 20:45:49.371118 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:45:49.371092    4060 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f8a1740_9672_4e9c_afc4_a1194b98186c.slice/crio-86031977d77fa261c1e52be24b28e25845c2f9d68bf6ee94f349465fe865fe85 WatchSource:0}: Error finding container 86031977d77fa261c1e52be24b28e25845c2f9d68bf6ee94f349465fe865fe85: Status 404 returned error can't find the container with id 86031977d77fa261c1e52be24b28e25845c2f9d68bf6ee94f349465fe865fe85
Oct 30 20:45:49.415526 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:49.415474    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-observability-operator/obo-prometheus-operator-admission-webhook-564dd7b8b9-wz5w9" event={"ID":"3f8a1740-9672-4e9c-afc4-a1194b98186c","Type":"ContainerStarted","Data":"86031977d77fa261c1e52be24b28e25845c2f9d68bf6ee94f349465fe865fe85"}
Oct 30 20:45:49.416844 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:49.416819    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-observability-operator/obo-prometheus-operator-6ddb664c4f-dmvdw" event={"ID":"c26e4143-2635-4e0c-823e-269b580408b4","Type":"ContainerStarted","Data":"4d36687b8de46e9389a350e6127459c3b767a780cdef9f506dc552621b84de7f"}
Oct 30 20:45:52.392596 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:52.392552    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-tempo-operator/tempo-operator-controller-57594446b4-8x7j6"
Oct 30 20:45:52.761374 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:52.761339    4060 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-opentelemetry-operator/opentelemetry-operator-controller-manager-5f695b7fbf-md2pq"]
Oct 30 20:45:52.766350 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:52.766325    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-opentelemetry-operator/opentelemetry-operator-controller-manager-5f695b7fbf-md2pq"
Oct 30 20:45:52.824225 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:52.824197    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-opentelemetry-operator\"/\"kube-root-ca.crt\""
Oct 30 20:45:52.824381 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:52.824230    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-opentelemetry-operator\"/\"openshift-service-ca.crt\""
Oct 30 20:45:52.824672 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:52.824656    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-opentelemetry-operator\"/\"opentelemetry-operator-controller-manager-dockercfg-747cn\""
Oct 30 20:45:52.824805 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:52.824680    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-opentelemetry-operator\"/\"opentelemetry-operator-metrics\""
Oct 30 20:45:52.831796 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:52.831774    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-opentelemetry-operator/opentelemetry-operator-controller-manager-5f695b7fbf-md2pq"]
Oct 30 20:45:52.836800 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:52.836776    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"opentelemetry-operator-metrics-cert\" (UniqueName: \"kubernetes.io/secret/37d41d51-81ce-4a3b-b063-fab29310f7a7-opentelemetry-operator-metrics-cert\") pod \"opentelemetry-operator-controller-manager-5f695b7fbf-md2pq\" (UID: \"37d41d51-81ce-4a3b-b063-fab29310f7a7\") " pod="openshift-opentelemetry-operator/opentelemetry-operator-controller-manager-5f695b7fbf-md2pq"
Oct 30 20:45:52.836922 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:52.836867    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vbtwt\" (UniqueName: \"kubernetes.io/projected/37d41d51-81ce-4a3b-b063-fab29310f7a7-kube-api-access-vbtwt\") pod \"opentelemetry-operator-controller-manager-5f695b7fbf-md2pq\" (UID: \"37d41d51-81ce-4a3b-b063-fab29310f7a7\") " pod="openshift-opentelemetry-operator/opentelemetry-operator-controller-manager-5f695b7fbf-md2pq"
Oct 30 20:45:52.938060 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:52.937898    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"opentelemetry-operator-metrics-cert\" (UniqueName: \"kubernetes.io/secret/37d41d51-81ce-4a3b-b063-fab29310f7a7-opentelemetry-operator-metrics-cert\") pod \"opentelemetry-operator-controller-manager-5f695b7fbf-md2pq\" (UID: \"37d41d51-81ce-4a3b-b063-fab29310f7a7\") " pod="openshift-opentelemetry-operator/opentelemetry-operator-controller-manager-5f695b7fbf-md2pq"
Oct 30 20:45:52.938060 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:52.937959    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vbtwt\" (UniqueName: \"kubernetes.io/projected/37d41d51-81ce-4a3b-b063-fab29310f7a7-kube-api-access-vbtwt\") pod \"opentelemetry-operator-controller-manager-5f695b7fbf-md2pq\" (UID: \"37d41d51-81ce-4a3b-b063-fab29310f7a7\") " pod="openshift-opentelemetry-operator/opentelemetry-operator-controller-manager-5f695b7fbf-md2pq"
Oct 30 20:45:52.940960 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:52.940929    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"opentelemetry-operator-metrics-cert\" (UniqueName: \"kubernetes.io/secret/37d41d51-81ce-4a3b-b063-fab29310f7a7-opentelemetry-operator-metrics-cert\") pod \"opentelemetry-operator-controller-manager-5f695b7fbf-md2pq\" (UID: \"37d41d51-81ce-4a3b-b063-fab29310f7a7\") " pod="openshift-opentelemetry-operator/opentelemetry-operator-controller-manager-5f695b7fbf-md2pq"
Oct 30 20:45:53.016090 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:53.016018    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vbtwt\" (UniqueName: \"kubernetes.io/projected/37d41d51-81ce-4a3b-b063-fab29310f7a7-kube-api-access-vbtwt\") pod \"opentelemetry-operator-controller-manager-5f695b7fbf-md2pq\" (UID: \"37d41d51-81ce-4a3b-b063-fab29310f7a7\") " pod="openshift-opentelemetry-operator/opentelemetry-operator-controller-manager-5f695b7fbf-md2pq"
Oct 30 20:45:53.099235 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:53.099195    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-opentelemetry-operator/opentelemetry-operator-controller-manager-5f695b7fbf-md2pq"
Oct 30 20:45:53.618781 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:53.618748    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-opentelemetry-operator/opentelemetry-operator-controller-manager-5f695b7fbf-md2pq"]
Oct 30 20:45:53.622112 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:45:53.622078    4060 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37d41d51_81ce_4a3b_b063_fab29310f7a7.slice/crio-1c5e858f8ee34fe65c8cc569c0edfea6decbc17ed4f41575ef1ed035d3cdac27 WatchSource:0}: Error finding container 1c5e858f8ee34fe65c8cc569c0edfea6decbc17ed4f41575ef1ed035d3cdac27: Status 404 returned error can't find the container with id 1c5e858f8ee34fe65c8cc569c0edfea6decbc17ed4f41575ef1ed035d3cdac27
Oct 30 20:45:54.443028 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:54.442994    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-opentelemetry-operator/opentelemetry-operator-controller-manager-5f695b7fbf-md2pq" event={"ID":"37d41d51-81ce-4a3b-b063-fab29310f7a7","Type":"ContainerStarted","Data":"1c5e858f8ee34fe65c8cc569c0edfea6decbc17ed4f41575ef1ed035d3cdac27"}
Oct 30 20:45:54.444683 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:54.444625    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-observability-operator/obo-prometheus-operator-6ddb664c4f-dmvdw" event={"ID":"c26e4143-2635-4e0c-823e-269b580408b4","Type":"ContainerStarted","Data":"e20d990142af9b039629e4c4d39f1d4cb955427f7c23e89e359f4afb7d91aa8a"}
Oct 30 20:45:54.446192 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:54.446168    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-observability-operator/obo-prometheus-operator-admission-webhook-564dd7b8b9-wz5w9" event={"ID":"3f8a1740-9672-4e9c-afc4-a1194b98186c","Type":"ContainerStarted","Data":"0fe33b7b919a87aaaa32ed35a9692cd37d78b18db0efac28c6bca67b91307d83"}
Oct 30 20:45:54.578206 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:54.578147    4060 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-observability-operator/obo-prometheus-operator-6ddb664c4f-dmvdw" podStartSLOduration=2.932407848 podStartE2EDuration="7.578133293s" totalImagesPullingTime="4.645725445s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:45:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:45:54.577256579 +0000 UTC m=+573.334254876" watchObservedRunningTime="2026-10-30 20:45:54.578133293 +0000 UTC m=+573.335131592"
Oct 30 20:45:54.627268 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:54.627234    4060 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-opentelemetry-operator/opentelemetry-operator-webhook-5fc9f4c8f5-d9xb5"]
Oct 30 20:45:54.630576 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:54.630557    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-opentelemetry-operator/opentelemetry-operator-webhook-5fc9f4c8f5-d9xb5"
Oct 30 20:45:54.689116 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:54.689083    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-opentelemetry-operator/opentelemetry-operator-webhook-5fc9f4c8f5-d9xb5"]
Oct 30 20:45:54.715464 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:54.715401    4060 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-observability-operator/obo-prometheus-operator-admission-webhook-564dd7b8b9-wz5w9" podStartSLOduration=2.240562908 podStartE2EDuration="6.715382826s" totalImagesPullingTime="4.474819918s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:45:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:45:54.714305336 +0000 UTC m=+573.471303645" watchObservedRunningTime="2026-10-30 20:45:54.715382826 +0000 UTC m=+573.472381124"
Oct 30 20:45:54.757564 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:54.757529    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3a4c30f0-7470-4a3e-8db1-34cbc5801681-webhook-cert\") pod \"opentelemetry-operator-webhook-5fc9f4c8f5-d9xb5\" (UID: \"3a4c30f0-7470-4a3e-8db1-34cbc5801681\") " pod="openshift-opentelemetry-operator/opentelemetry-operator-webhook-5fc9f4c8f5-d9xb5"
Oct 30 20:45:54.757738 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:54.757581    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3a4c30f0-7470-4a3e-8db1-34cbc5801681-apiservice-cert\") pod \"opentelemetry-operator-webhook-5fc9f4c8f5-d9xb5\" (UID: \"3a4c30f0-7470-4a3e-8db1-34cbc5801681\") " pod="openshift-opentelemetry-operator/opentelemetry-operator-webhook-5fc9f4c8f5-d9xb5"
Oct 30 20:45:54.757738 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:54.757695    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qlkrt\" (UniqueName: \"kubernetes.io/projected/3a4c30f0-7470-4a3e-8db1-34cbc5801681-kube-api-access-qlkrt\") pod \"opentelemetry-operator-webhook-5fc9f4c8f5-d9xb5\" (UID: \"3a4c30f0-7470-4a3e-8db1-34cbc5801681\") " pod="openshift-opentelemetry-operator/opentelemetry-operator-webhook-5fc9f4c8f5-d9xb5"
Oct 30 20:45:54.775683 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:54.775653    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-opentelemetry-operator\"/\"opentelemetry-operator-webhook-service-cert\""
Oct 30 20:45:54.858870 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:54.858835    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qlkrt\" (UniqueName: \"kubernetes.io/projected/3a4c30f0-7470-4a3e-8db1-34cbc5801681-kube-api-access-qlkrt\") pod \"opentelemetry-operator-webhook-5fc9f4c8f5-d9xb5\" (UID: \"3a4c30f0-7470-4a3e-8db1-34cbc5801681\") " pod="openshift-opentelemetry-operator/opentelemetry-operator-webhook-5fc9f4c8f5-d9xb5"
Oct 30 20:45:54.858870 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:54.858867    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3a4c30f0-7470-4a3e-8db1-34cbc5801681-webhook-cert\") pod \"opentelemetry-operator-webhook-5fc9f4c8f5-d9xb5\" (UID: \"3a4c30f0-7470-4a3e-8db1-34cbc5801681\") " pod="openshift-opentelemetry-operator/opentelemetry-operator-webhook-5fc9f4c8f5-d9xb5"
Oct 30 20:45:54.859097 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:54.858910    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3a4c30f0-7470-4a3e-8db1-34cbc5801681-apiservice-cert\") pod \"opentelemetry-operator-webhook-5fc9f4c8f5-d9xb5\" (UID: \"3a4c30f0-7470-4a3e-8db1-34cbc5801681\") " pod="openshift-opentelemetry-operator/opentelemetry-operator-webhook-5fc9f4c8f5-d9xb5"
Oct 30 20:45:54.861348 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:54.861318    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3a4c30f0-7470-4a3e-8db1-34cbc5801681-apiservice-cert\") pod \"opentelemetry-operator-webhook-5fc9f4c8f5-d9xb5\" (UID: \"3a4c30f0-7470-4a3e-8db1-34cbc5801681\") " pod="openshift-opentelemetry-operator/opentelemetry-operator-webhook-5fc9f4c8f5-d9xb5"
Oct 30 20:45:54.861475 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:54.861361    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3a4c30f0-7470-4a3e-8db1-34cbc5801681-webhook-cert\") pod \"opentelemetry-operator-webhook-5fc9f4c8f5-d9xb5\" (UID: \"3a4c30f0-7470-4a3e-8db1-34cbc5801681\") " pod="openshift-opentelemetry-operator/opentelemetry-operator-webhook-5fc9f4c8f5-d9xb5"
Oct 30 20:45:54.927454 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:54.927421    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qlkrt\" (UniqueName: \"kubernetes.io/projected/3a4c30f0-7470-4a3e-8db1-34cbc5801681-kube-api-access-qlkrt\") pod \"opentelemetry-operator-webhook-5fc9f4c8f5-d9xb5\" (UID: \"3a4c30f0-7470-4a3e-8db1-34cbc5801681\") " pod="openshift-opentelemetry-operator/opentelemetry-operator-webhook-5fc9f4c8f5-d9xb5"
Oct 30 20:45:54.942281 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:54.942250    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-opentelemetry-operator/opentelemetry-operator-webhook-5fc9f4c8f5-d9xb5"
Oct 30 20:45:55.384340 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:55.384314    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-opentelemetry-operator/opentelemetry-operator-webhook-5fc9f4c8f5-d9xb5"]
Oct 30 20:45:55.386730 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:45:55.386688    4060 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a4c30f0_7470_4a3e_8db1_34cbc5801681.slice/crio-76a13cd236239b4c76383ce1b421556d9d734023d9cc3fc824c3443bb3b0be03 WatchSource:0}: Error finding container 76a13cd236239b4c76383ce1b421556d9d734023d9cc3fc824c3443bb3b0be03: Status 404 returned error can't find the container with id 76a13cd236239b4c76383ce1b421556d9d734023d9cc3fc824c3443bb3b0be03
Oct 30 20:45:55.452027 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:55.451997    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-opentelemetry-operator/opentelemetry-operator-webhook-5fc9f4c8f5-d9xb5" event={"ID":"3a4c30f0-7470-4a3e-8db1-34cbc5801681","Type":"ContainerStarted","Data":"76a13cd236239b4c76383ce1b421556d9d734023d9cc3fc824c3443bb3b0be03"}
Oct 30 20:45:57.463247 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:57.463157    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-opentelemetry-operator/opentelemetry-operator-controller-manager-5f695b7fbf-md2pq" event={"ID":"37d41d51-81ce-4a3b-b063-fab29310f7a7","Type":"ContainerStarted","Data":"7fe2af01fb06cb5bfe2085428949e94f64ebae20c43d44a9f471939bf8e549a7"}
Oct 30 20:45:57.463247 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:57.463221    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-opentelemetry-operator/opentelemetry-operator-controller-manager-5f695b7fbf-md2pq"
Oct 30 20:45:57.675614 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:57.675562    4060 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-opentelemetry-operator/opentelemetry-operator-controller-manager-5f695b7fbf-md2pq" podStartSLOduration=2.360597701 podStartE2EDuration="5.675549578s" totalImagesPullingTime="3.314951877s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:45:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:45:57.674156767 +0000 UTC m=+576.431155082" watchObservedRunningTime="2026-10-30 20:45:57.675549578 +0000 UTC m=+576.432547872"
Oct 30 20:45:58.469927 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:58.469884    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-opentelemetry-operator/opentelemetry-operator-webhook-5fc9f4c8f5-d9xb5" event={"ID":"3a4c30f0-7470-4a3e-8db1-34cbc5801681","Type":"ContainerStarted","Data":"9536b2c753c6eda4abf0ae8e3bba8593c17b7b5a1cf8bff5b4ce26bf8c49b846"}
Oct 30 20:45:58.470372 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:45:58.470075    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-opentelemetry-operator/opentelemetry-operator-webhook-5fc9f4c8f5-d9xb5"
Oct 30 20:46:08.472654 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:46:08.472573    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-opentelemetry-operator/opentelemetry-operator-controller-manager-5f695b7fbf-md2pq"
Oct 30 20:46:08.674805 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:46:08.674749    4060 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-opentelemetry-operator/opentelemetry-operator-webhook-5fc9f4c8f5-d9xb5" podStartSLOduration=12.617613356 podStartE2EDuration="14.674734747s" totalImagesPullingTime="2.057121391s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:45:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:45:58.688131337 +0000 UTC m=+577.445129635" watchObservedRunningTime="2026-10-30 20:46:08.674734747 +0000 UTC m=+587.431733044"
Oct 30 20:46:09.478755 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:46:09.478723    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-opentelemetry-operator/opentelemetry-operator-webhook-5fc9f4c8f5-d9xb5"
Oct 30 20:46:12.151158 ip-10-0-142-4 kubenswrapper[4060]: E1030 20:46:12.151121    4060 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v2f4x" containerName="extractor"
Oct 30 20:46:28.789147 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:46:28.789104    4060 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/d28b81ce69fab5e58d2cd73462dde4041bbc20368f72658a361322aaadlsczl"]
Oct 30 20:46:28.794822 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:46:28.794797    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/d28b81ce69fab5e58d2cd73462dde4041bbc20368f72658a361322aaadlsczl"
Oct 30 20:46:28.897161 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:46:28.897133    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Oct 30 20:46:28.897389 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:46:28.897253    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Oct 30 20:46:28.897389 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:46:28.897377    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"d28b81ce69fab5e58d2cd73462dde4041bbc20-487d35f4-dockercfg-h5nf7\""
Oct 30 20:46:28.898996 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:46:28.898978    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/d28b81ce69fab5e58d2cd73462dde4041bbc20368f72658a361322aaadlsczl"]
Oct 30 20:46:28.942577 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:46:28.942547    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cc0218b9-9235-46d0-896f-7e7296a98c44-bundle\") pod \"d28b81ce69fab5e58d2cd73462dde4041bbc20368f72658a361322aaadlsczl\" (UID: \"cc0218b9-9235-46d0-896f-7e7296a98c44\") " pod="openshift-marketplace/d28b81ce69fab5e58d2cd73462dde4041bbc20368f72658a361322aaadlsczl"
Oct 30 20:46:28.942577 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:46:28.942581    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-59vgn\" (UniqueName: \"kubernetes.io/projected/cc0218b9-9235-46d0-896f-7e7296a98c44-kube-api-access-59vgn\") pod \"d28b81ce69fab5e58d2cd73462dde4041bbc20368f72658a361322aaadlsczl\" (UID: \"cc0218b9-9235-46d0-896f-7e7296a98c44\") " pod="openshift-marketplace/d28b81ce69fab5e58d2cd73462dde4041bbc20368f72658a361322aaadlsczl"
Oct 30 20:46:28.942768 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:46:28.942610    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cc0218b9-9235-46d0-896f-7e7296a98c44-util\") pod \"d28b81ce69fab5e58d2cd73462dde4041bbc20368f72658a361322aaadlsczl\" (UID: \"cc0218b9-9235-46d0-896f-7e7296a98c44\") " pod="openshift-marketplace/d28b81ce69fab5e58d2cd73462dde4041bbc20368f72658a361322aaadlsczl"
Oct 30 20:46:29.043862 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:46:29.043778    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cc0218b9-9235-46d0-896f-7e7296a98c44-bundle\") pod \"d28b81ce69fab5e58d2cd73462dde4041bbc20368f72658a361322aaadlsczl\" (UID: \"cc0218b9-9235-46d0-896f-7e7296a98c44\") " pod="openshift-marketplace/d28b81ce69fab5e58d2cd73462dde4041bbc20368f72658a361322aaadlsczl"
Oct 30 20:46:29.043862 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:46:29.043816    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-59vgn\" (UniqueName: \"kubernetes.io/projected/cc0218b9-9235-46d0-896f-7e7296a98c44-kube-api-access-59vgn\") pod \"d28b81ce69fab5e58d2cd73462dde4041bbc20368f72658a361322aaadlsczl\" (UID: \"cc0218b9-9235-46d0-896f-7e7296a98c44\") " pod="openshift-marketplace/d28b81ce69fab5e58d2cd73462dde4041bbc20368f72658a361322aaadlsczl"
Oct 30 20:46:29.043862 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:46:29.043844    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cc0218b9-9235-46d0-896f-7e7296a98c44-util\") pod \"d28b81ce69fab5e58d2cd73462dde4041bbc20368f72658a361322aaadlsczl\" (UID: \"cc0218b9-9235-46d0-896f-7e7296a98c44\") " pod="openshift-marketplace/d28b81ce69fab5e58d2cd73462dde4041bbc20368f72658a361322aaadlsczl"
Oct 30 20:46:29.044260 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:46:29.044241    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cc0218b9-9235-46d0-896f-7e7296a98c44-bundle\") pod \"d28b81ce69fab5e58d2cd73462dde4041bbc20368f72658a361322aaadlsczl\" (UID: \"cc0218b9-9235-46d0-896f-7e7296a98c44\") " pod="openshift-marketplace/d28b81ce69fab5e58d2cd73462dde4041bbc20368f72658a361322aaadlsczl"
Oct 30 20:46:29.044305 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:46:29.044250    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cc0218b9-9235-46d0-896f-7e7296a98c44-util\") pod \"d28b81ce69fab5e58d2cd73462dde4041bbc20368f72658a361322aaadlsczl\" (UID: \"cc0218b9-9235-46d0-896f-7e7296a98c44\") " pod="openshift-marketplace/d28b81ce69fab5e58d2cd73462dde4041bbc20368f72658a361322aaadlsczl"
Oct 30 20:46:29.107958 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:46:29.107928    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-59vgn\" (UniqueName: \"kubernetes.io/projected/cc0218b9-9235-46d0-896f-7e7296a98c44-kube-api-access-59vgn\") pod \"d28b81ce69fab5e58d2cd73462dde4041bbc20368f72658a361322aaadlsczl\" (UID: \"cc0218b9-9235-46d0-896f-7e7296a98c44\") " pod="openshift-marketplace/d28b81ce69fab5e58d2cd73462dde4041bbc20368f72658a361322aaadlsczl"
Oct 30 20:46:29.407156 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:46:29.407066    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/d28b81ce69fab5e58d2cd73462dde4041bbc20368f72658a361322aaadlsczl"
Oct 30 20:46:29.780624 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:46:29.780586    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/d28b81ce69fab5e58d2cd73462dde4041bbc20368f72658a361322aaadlsczl"]
Oct 30 20:46:29.809740 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:46:29.809709    4060 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc0218b9_9235_46d0_896f_7e7296a98c44.slice/crio-8b4c2a473299a3a562660f741a3074a6b9710fbd5f7702f2a8c8d7855a5b24fe WatchSource:0}: Error finding container 8b4c2a473299a3a562660f741a3074a6b9710fbd5f7702f2a8c8d7855a5b24fe: Status 404 returned error can't find the container with id 8b4c2a473299a3a562660f741a3074a6b9710fbd5f7702f2a8c8d7855a5b24fe
Oct 30 20:46:30.607045 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:46:30.607012    4060 generic.go:356] "Generic (PLEG): container finished" podID="cc0218b9-9235-46d0-896f-7e7296a98c44" containerID="5a8f958fdc23971ce984a0b8d457c45b040682c53e0eff4ce1a9f82027742ad8" exitCode=0
Oct 30 20:46:30.607246 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:46:30.607100    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/d28b81ce69fab5e58d2cd73462dde4041bbc20368f72658a361322aaadlsczl" event={"ID":"cc0218b9-9235-46d0-896f-7e7296a98c44","Type":"ContainerDied","Data":"5a8f958fdc23971ce984a0b8d457c45b040682c53e0eff4ce1a9f82027742ad8"}
Oct 30 20:46:30.607246 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:46:30.607165    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/d28b81ce69fab5e58d2cd73462dde4041bbc20368f72658a361322aaadlsczl" event={"ID":"cc0218b9-9235-46d0-896f-7e7296a98c44","Type":"ContainerStarted","Data":"8b4c2a473299a3a562660f741a3074a6b9710fbd5f7702f2a8c8d7855a5b24fe"}
Oct 30 20:46:34.625307 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:46:34.625277    4060 generic.go:356] "Generic (PLEG): container finished" podID="cc0218b9-9235-46d0-896f-7e7296a98c44" containerID="88584f4de0e82f23ebd8d2fa15c6a86bfdc1855d7eefcbe3026689064c30acec" exitCode=0
Oct 30 20:46:34.625824 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:46:34.625348    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/d28b81ce69fab5e58d2cd73462dde4041bbc20368f72658a361322aaadlsczl" event={"ID":"cc0218b9-9235-46d0-896f-7e7296a98c44","Type":"ContainerDied","Data":"88584f4de0e82f23ebd8d2fa15c6a86bfdc1855d7eefcbe3026689064c30acec"}
Oct 30 20:46:35.631942 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:46:35.631905    4060 generic.go:356] "Generic (PLEG): container finished" podID="cc0218b9-9235-46d0-896f-7e7296a98c44" containerID="9c619214c18b0863aa7f0884d3518c15692a6eba4ba30d8505084a0710cf08ca" exitCode=0
Oct 30 20:46:35.632337 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:46:35.631994    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/d28b81ce69fab5e58d2cd73462dde4041bbc20368f72658a361322aaadlsczl" event={"ID":"cc0218b9-9235-46d0-896f-7e7296a98c44","Type":"ContainerDied","Data":"9c619214c18b0863aa7f0884d3518c15692a6eba4ba30d8505084a0710cf08ca"}
Oct 30 20:46:36.758499 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:46:36.758464    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/d28b81ce69fab5e58d2cd73462dde4041bbc20368f72658a361322aaadlsczl"
Oct 30 20:46:36.801585 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:46:36.801561    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/cc0218b9-9235-46d0-896f-7e7296a98c44-kube-api-access-59vgn\" (UniqueName: \"kubernetes.io/projected/cc0218b9-9235-46d0-896f-7e7296a98c44-kube-api-access-59vgn\") pod \"cc0218b9-9235-46d0-896f-7e7296a98c44\" (UID: \"cc0218b9-9235-46d0-896f-7e7296a98c44\") "
Oct 30 20:46:36.801703 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:46:36.801600    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/cc0218b9-9235-46d0-896f-7e7296a98c44-util\" (UniqueName: \"kubernetes.io/empty-dir/cc0218b9-9235-46d0-896f-7e7296a98c44-util\") pod \"cc0218b9-9235-46d0-896f-7e7296a98c44\" (UID: \"cc0218b9-9235-46d0-896f-7e7296a98c44\") "
Oct 30 20:46:36.801703 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:46:36.801625    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/cc0218b9-9235-46d0-896f-7e7296a98c44-bundle\" (UniqueName: \"kubernetes.io/empty-dir/cc0218b9-9235-46d0-896f-7e7296a98c44-bundle\") pod \"cc0218b9-9235-46d0-896f-7e7296a98c44\" (UID: \"cc0218b9-9235-46d0-896f-7e7296a98c44\") "
Oct 30 20:46:36.802209 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:46:36.802187    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc0218b9-9235-46d0-896f-7e7296a98c44-bundle" pod "cc0218b9-9235-46d0-896f-7e7296a98c44" (UID: "cc0218b9-9235-46d0-896f-7e7296a98c44"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:46:36.803589 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:46:36.803558    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc0218b9-9235-46d0-896f-7e7296a98c44-kube-api-access-59vgn" pod "cc0218b9-9235-46d0-896f-7e7296a98c44" (UID: "cc0218b9-9235-46d0-896f-7e7296a98c44"). InnerVolumeSpecName "kube-api-access-59vgn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:46:36.806535 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:46:36.806516    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc0218b9-9235-46d0-896f-7e7296a98c44-util" pod "cc0218b9-9235-46d0-896f-7e7296a98c44" (UID: "cc0218b9-9235-46d0-896f-7e7296a98c44"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:46:36.902086 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:46:36.902009    4060 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-59vgn\" (UniqueName: \"kubernetes.io/projected/cc0218b9-9235-46d0-896f-7e7296a98c44-kube-api-access-59vgn\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:46:36.902086 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:46:36.902037    4060 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cc0218b9-9235-46d0-896f-7e7296a98c44-util\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:46:36.902086 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:46:36.902047    4060 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cc0218b9-9235-46d0-896f-7e7296a98c44-bundle\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:46:37.642482 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:46:37.642454    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/d28b81ce69fab5e58d2cd73462dde4041bbc20368f72658a361322aaadlsczl"
Oct 30 20:46:37.642635 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:46:37.642448    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/d28b81ce69fab5e58d2cd73462dde4041bbc20368f72658a361322aaadlsczl" event={"ID":"cc0218b9-9235-46d0-896f-7e7296a98c44","Type":"ContainerDied","Data":"8b4c2a473299a3a562660f741a3074a6b9710fbd5f7702f2a8c8d7855a5b24fe"}
Oct 30 20:46:37.642635 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:46:37.642550    4060 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8b4c2a473299a3a562660f741a3074a6b9710fbd5f7702f2a8c8d7855a5b24fe"
Oct 30 20:46:42.150680 ip-10-0-142-4 kubenswrapper[4060]: E1030 20:46:42.150645    4060 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v2f4x" containerName="extractor"
Oct 30 20:47:02.539078 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:47:02.539034    4060 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/b60fd1021875ce556623478c7c5d4d22148dffc3b09ba9d735533c67226qmdq"]
Oct 30 20:47:02.539598 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:47:02.539337    4060 cpu_manager.go:414] "containerMap: removing container" podUID="cc0218b9-9235-46d0-896f-7e7296a98c44" containerName="extract"
Oct 30 20:47:02.539598 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:47:02.539349    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="cc0218b9-9235-46d0-896f-7e7296a98c44" containerName="extract"
Oct 30 20:47:02.539598 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:47:02.539361    4060 cpu_manager.go:414] "containerMap: removing container" podUID="cc0218b9-9235-46d0-896f-7e7296a98c44" containerName="util"
Oct 30 20:47:02.539598 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:47:02.539366    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="cc0218b9-9235-46d0-896f-7e7296a98c44" containerName="util"
Oct 30 20:47:02.539598 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:47:02.539375    4060 cpu_manager.go:414] "containerMap: removing container" podUID="cc0218b9-9235-46d0-896f-7e7296a98c44" containerName="pull"
Oct 30 20:47:02.539598 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:47:02.539379    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="cc0218b9-9235-46d0-896f-7e7296a98c44" containerName="pull"
Oct 30 20:47:02.539598 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:47:02.539437    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="cc0218b9-9235-46d0-896f-7e7296a98c44" containerName="extract"
Oct 30 20:47:02.543753 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:47:02.543734    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/b60fd1021875ce556623478c7c5d4d22148dffc3b09ba9d735533c67226qmdq"
Oct 30 20:47:02.605024 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:47:02.604989    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ac5cec8a-dffb-4a53-a1b8-306171286fcf-util\") pod \"b60fd1021875ce556623478c7c5d4d22148dffc3b09ba9d735533c67226qmdq\" (UID: \"ac5cec8a-dffb-4a53-a1b8-306171286fcf\") " pod="openshift-marketplace/b60fd1021875ce556623478c7c5d4d22148dffc3b09ba9d735533c67226qmdq"
Oct 30 20:47:02.605223 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:47:02.605051    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ac5cec8a-dffb-4a53-a1b8-306171286fcf-bundle\") pod \"b60fd1021875ce556623478c7c5d4d22148dffc3b09ba9d735533c67226qmdq\" (UID: \"ac5cec8a-dffb-4a53-a1b8-306171286fcf\") " pod="openshift-marketplace/b60fd1021875ce556623478c7c5d4d22148dffc3b09ba9d735533c67226qmdq"
Oct 30 20:47:02.605223 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:47:02.605135    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pc2r9\" (UniqueName: \"kubernetes.io/projected/ac5cec8a-dffb-4a53-a1b8-306171286fcf-kube-api-access-pc2r9\") pod \"b60fd1021875ce556623478c7c5d4d22148dffc3b09ba9d735533c67226qmdq\" (UID: \"ac5cec8a-dffb-4a53-a1b8-306171286fcf\") " pod="openshift-marketplace/b60fd1021875ce556623478c7c5d4d22148dffc3b09ba9d735533c67226qmdq"
Oct 30 20:47:02.645448 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:47:02.645412    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Oct 30 20:47:02.645652 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:47:02.645451    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Oct 30 20:47:02.645652 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:47:02.645542    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"b60fd1021875ce556623478c7c5d4d22148dff-4f0c4bdd-dockercfg-qbfff\""
Oct 30 20:47:02.647377 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:47:02.647354    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/b60fd1021875ce556623478c7c5d4d22148dffc3b09ba9d735533c67226qmdq"]
Oct 30 20:47:02.706542 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:47:02.706488    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ac5cec8a-dffb-4a53-a1b8-306171286fcf-bundle\") pod \"b60fd1021875ce556623478c7c5d4d22148dffc3b09ba9d735533c67226qmdq\" (UID: \"ac5cec8a-dffb-4a53-a1b8-306171286fcf\") " pod="openshift-marketplace/b60fd1021875ce556623478c7c5d4d22148dffc3b09ba9d735533c67226qmdq"
Oct 30 20:47:02.706542 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:47:02.706544    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pc2r9\" (UniqueName: \"kubernetes.io/projected/ac5cec8a-dffb-4a53-a1b8-306171286fcf-kube-api-access-pc2r9\") pod \"b60fd1021875ce556623478c7c5d4d22148dffc3b09ba9d735533c67226qmdq\" (UID: \"ac5cec8a-dffb-4a53-a1b8-306171286fcf\") " pod="openshift-marketplace/b60fd1021875ce556623478c7c5d4d22148dffc3b09ba9d735533c67226qmdq"
Oct 30 20:47:02.706803 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:47:02.706581    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ac5cec8a-dffb-4a53-a1b8-306171286fcf-util\") pod \"b60fd1021875ce556623478c7c5d4d22148dffc3b09ba9d735533c67226qmdq\" (UID: \"ac5cec8a-dffb-4a53-a1b8-306171286fcf\") " pod="openshift-marketplace/b60fd1021875ce556623478c7c5d4d22148dffc3b09ba9d735533c67226qmdq"
Oct 30 20:47:02.706917 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:47:02.706887    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ac5cec8a-dffb-4a53-a1b8-306171286fcf-bundle\") pod \"b60fd1021875ce556623478c7c5d4d22148dffc3b09ba9d735533c67226qmdq\" (UID: \"ac5cec8a-dffb-4a53-a1b8-306171286fcf\") " pod="openshift-marketplace/b60fd1021875ce556623478c7c5d4d22148dffc3b09ba9d735533c67226qmdq"
Oct 30 20:47:02.706983 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:47:02.706920    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ac5cec8a-dffb-4a53-a1b8-306171286fcf-util\") pod \"b60fd1021875ce556623478c7c5d4d22148dffc3b09ba9d735533c67226qmdq\" (UID: \"ac5cec8a-dffb-4a53-a1b8-306171286fcf\") " pod="openshift-marketplace/b60fd1021875ce556623478c7c5d4d22148dffc3b09ba9d735533c67226qmdq"
Oct 30 20:47:02.768060 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:47:02.768024    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pc2r9\" (UniqueName: \"kubernetes.io/projected/ac5cec8a-dffb-4a53-a1b8-306171286fcf-kube-api-access-pc2r9\") pod \"b60fd1021875ce556623478c7c5d4d22148dffc3b09ba9d735533c67226qmdq\" (UID: \"ac5cec8a-dffb-4a53-a1b8-306171286fcf\") " pod="openshift-marketplace/b60fd1021875ce556623478c7c5d4d22148dffc3b09ba9d735533c67226qmdq"
Oct 30 20:47:02.859181 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:47:02.859100    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/b60fd1021875ce556623478c7c5d4d22148dffc3b09ba9d735533c67226qmdq"
Oct 30 20:47:03.230594 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:47:03.230572    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/b60fd1021875ce556623478c7c5d4d22148dffc3b09ba9d735533c67226qmdq"]
Oct 30 20:47:03.233214 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:47:03.233185    4060 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac5cec8a_dffb_4a53_a1b8_306171286fcf.slice/crio-ab76c57ff1710f16939b135137107fb387c38abac80c47f042e6e69714acb368 WatchSource:0}: Error finding container ab76c57ff1710f16939b135137107fb387c38abac80c47f042e6e69714acb368: Status 404 returned error can't find the container with id ab76c57ff1710f16939b135137107fb387c38abac80c47f042e6e69714acb368
Oct 30 20:47:03.751525 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:47:03.751477    4060 generic.go:356] "Generic (PLEG): container finished" podID="ac5cec8a-dffb-4a53-a1b8-306171286fcf" containerID="590ab3c0f0eacc86b6e55b80aa7a2deb0df6d5e41e47483b924153193975ec74" exitCode=0
Oct 30 20:47:03.752009 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:47:03.751532    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/b60fd1021875ce556623478c7c5d4d22148dffc3b09ba9d735533c67226qmdq" event={"ID":"ac5cec8a-dffb-4a53-a1b8-306171286fcf","Type":"ContainerDied","Data":"590ab3c0f0eacc86b6e55b80aa7a2deb0df6d5e41e47483b924153193975ec74"}
Oct 30 20:47:03.752009 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:47:03.751580    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/b60fd1021875ce556623478c7c5d4d22148dffc3b09ba9d735533c67226qmdq" event={"ID":"ac5cec8a-dffb-4a53-a1b8-306171286fcf","Type":"ContainerStarted","Data":"ab76c57ff1710f16939b135137107fb387c38abac80c47f042e6e69714acb368"}
Oct 30 20:47:06.771764 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:47:06.771732    4060 generic.go:356] "Generic (PLEG): container finished" podID="ac5cec8a-dffb-4a53-a1b8-306171286fcf" containerID="493c8a574b65f09efc81d2264ad731698fb28dcda742cb86dc92a157f2e25215" exitCode=0
Oct 30 20:47:06.772144 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:47:06.771822    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/b60fd1021875ce556623478c7c5d4d22148dffc3b09ba9d735533c67226qmdq" event={"ID":"ac5cec8a-dffb-4a53-a1b8-306171286fcf","Type":"ContainerDied","Data":"493c8a574b65f09efc81d2264ad731698fb28dcda742cb86dc92a157f2e25215"}
Oct 30 20:47:07.778036 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:47:07.778000    4060 generic.go:356] "Generic (PLEG): container finished" podID="ac5cec8a-dffb-4a53-a1b8-306171286fcf" containerID="f4c26f8790dc2e75bc5a8b0927104bcbda5f8083a8401856654b3b4a55905e20" exitCode=0
Oct 30 20:47:07.778036 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:47:07.778037    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/b60fd1021875ce556623478c7c5d4d22148dffc3b09ba9d735533c67226qmdq" event={"ID":"ac5cec8a-dffb-4a53-a1b8-306171286fcf","Type":"ContainerDied","Data":"f4c26f8790dc2e75bc5a8b0927104bcbda5f8083a8401856654b3b4a55905e20"}
Oct 30 20:47:08.908598 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:47:08.908574    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/b60fd1021875ce556623478c7c5d4d22148dffc3b09ba9d735533c67226qmdq"
Oct 30 20:47:08.960891 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:47:08.960859    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ac5cec8a-dffb-4a53-a1b8-306171286fcf-kube-api-access-pc2r9\" (UniqueName: \"kubernetes.io/projected/ac5cec8a-dffb-4a53-a1b8-306171286fcf-kube-api-access-pc2r9\") pod \"ac5cec8a-dffb-4a53-a1b8-306171286fcf\" (UID: \"ac5cec8a-dffb-4a53-a1b8-306171286fcf\") "
Oct 30 20:47:08.961081 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:47:08.960936    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ac5cec8a-dffb-4a53-a1b8-306171286fcf-util\" (UniqueName: \"kubernetes.io/empty-dir/ac5cec8a-dffb-4a53-a1b8-306171286fcf-util\") pod \"ac5cec8a-dffb-4a53-a1b8-306171286fcf\" (UID: \"ac5cec8a-dffb-4a53-a1b8-306171286fcf\") "
Oct 30 20:47:08.961081 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:47:08.960989    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ac5cec8a-dffb-4a53-a1b8-306171286fcf-bundle\" (UniqueName: \"kubernetes.io/empty-dir/ac5cec8a-dffb-4a53-a1b8-306171286fcf-bundle\") pod \"ac5cec8a-dffb-4a53-a1b8-306171286fcf\" (UID: \"ac5cec8a-dffb-4a53-a1b8-306171286fcf\") "
Oct 30 20:47:08.961595 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:47:08.961570    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac5cec8a-dffb-4a53-a1b8-306171286fcf-bundle" pod "ac5cec8a-dffb-4a53-a1b8-306171286fcf" (UID: "ac5cec8a-dffb-4a53-a1b8-306171286fcf"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:47:08.963018 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:47:08.962989    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ac5cec8a-dffb-4a53-a1b8-306171286fcf-kube-api-access-pc2r9" pod "ac5cec8a-dffb-4a53-a1b8-306171286fcf" (UID: "ac5cec8a-dffb-4a53-a1b8-306171286fcf"). InnerVolumeSpecName "kube-api-access-pc2r9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:47:08.965794 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:47:08.965766    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac5cec8a-dffb-4a53-a1b8-306171286fcf-util" pod "ac5cec8a-dffb-4a53-a1b8-306171286fcf" (UID: "ac5cec8a-dffb-4a53-a1b8-306171286fcf"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:47:09.062275 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:47:09.062183    4060 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ac5cec8a-dffb-4a53-a1b8-306171286fcf-util\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:47:09.062275 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:47:09.062216    4060 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ac5cec8a-dffb-4a53-a1b8-306171286fcf-bundle\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:47:09.062275 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:47:09.062233    4060 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pc2r9\" (UniqueName: \"kubernetes.io/projected/ac5cec8a-dffb-4a53-a1b8-306171286fcf-kube-api-access-pc2r9\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:47:09.788448 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:47:09.788420    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/b60fd1021875ce556623478c7c5d4d22148dffc3b09ba9d735533c67226qmdq"
Oct 30 20:47:09.788675 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:47:09.788414    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/b60fd1021875ce556623478c7c5d4d22148dffc3b09ba9d735533c67226qmdq" event={"ID":"ac5cec8a-dffb-4a53-a1b8-306171286fcf","Type":"ContainerDied","Data":"ab76c57ff1710f16939b135137107fb387c38abac80c47f042e6e69714acb368"}
Oct 30 20:47:09.788675 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:47:09.788542    4060 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ab76c57ff1710f16939b135137107fb387c38abac80c47f042e6e69714acb368"
Oct 30 20:47:12.150889 ip-10-0-142-4 kubenswrapper[4060]: E1030 20:47:12.150852    4060 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v2f4x" containerName="extractor"
Oct 30 20:47:42.150585 ip-10-0-142-4 kubenswrapper[4060]: E1030 20:47:42.150483    4060 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v2f4x" containerName="extractor"
Oct 30 20:47:45.203533 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:47:45.203485    4060 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/korrel8r-6644769df5-5j27f"]
Oct 30 20:47:45.203918 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:47:45.203806    4060 cpu_manager.go:414] "containerMap: removing container" podUID="ac5cec8a-dffb-4a53-a1b8-306171286fcf" containerName="pull"
Oct 30 20:47:45.203918 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:47:45.203817    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ac5cec8a-dffb-4a53-a1b8-306171286fcf" containerName="pull"
Oct 30 20:47:45.203918 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:47:45.203832    4060 cpu_manager.go:414] "containerMap: removing container" podUID="ac5cec8a-dffb-4a53-a1b8-306171286fcf" containerName="util"
Oct 30 20:47:45.203918 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:47:45.203840    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ac5cec8a-dffb-4a53-a1b8-306171286fcf" containerName="util"
Oct 30 20:47:45.203918 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:47:45.203864    4060 cpu_manager.go:414] "containerMap: removing container" podUID="ac5cec8a-dffb-4a53-a1b8-306171286fcf" containerName="extract"
Oct 30 20:47:45.203918 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:47:45.203869    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ac5cec8a-dffb-4a53-a1b8-306171286fcf" containerName="extract"
Oct 30 20:47:45.204114 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:47:45.203925    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="ac5cec8a-dffb-4a53-a1b8-306171286fcf" containerName="extract"
Oct 30 20:47:45.206856 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:47:45.206837    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/korrel8r-6644769df5-5j27f"
Oct 30 20:47:45.246097 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:47:45.246056    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/ead97571-d960-4349-a7d1-b6a384a652fa-tls\") pod \"korrel8r-6644769df5-5j27f\" (UID: \"ead97571-d960-4349-a7d1-b6a384a652fa\") " pod="redhat-ods-monitoring/korrel8r-6644769df5-5j27f"
Oct 30 20:47:45.246295 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:47:45.246126    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ead97571-d960-4349-a7d1-b6a384a652fa-config\") pod \"korrel8r-6644769df5-5j27f\" (UID: \"ead97571-d960-4349-a7d1-b6a384a652fa\") " pod="redhat-ods-monitoring/korrel8r-6644769df5-5j27f"
Oct 30 20:47:45.246295 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:47:45.246188    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ph64t\" (UniqueName: \"kubernetes.io/projected/ead97571-d960-4349-a7d1-b6a384a652fa-kube-api-access-ph64t\") pod \"korrel8r-6644769df5-5j27f\" (UID: \"ead97571-d960-4349-a7d1-b6a384a652fa\") " pod="redhat-ods-monitoring/korrel8r-6644769df5-5j27f"
Oct 30 20:47:45.266108 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:47:45.266060    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"korrel8r-tls\""
Oct 30 20:47:45.266302 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:47:45.266198    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"openshift-service-ca.crt\""
Oct 30 20:47:45.315589 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:47:45.315551    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"korrel8r-dockercfg-x8fft\""
Oct 30 20:47:45.315779 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:47:45.315624    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"kube-root-ca.crt\""
Oct 30 20:47:45.315779 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:47:45.315637    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"korrel8r-config\""
Oct 30 20:47:45.317477 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:47:45.317452    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/korrel8r-6644769df5-5j27f"]
Oct 30 20:47:45.347193 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:47:45.347161    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ead97571-d960-4349-a7d1-b6a384a652fa-config\") pod \"korrel8r-6644769df5-5j27f\" (UID: \"ead97571-d960-4349-a7d1-b6a384a652fa\") " pod="redhat-ods-monitoring/korrel8r-6644769df5-5j27f"
Oct 30 20:47:45.347342 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:47:45.347213    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ph64t\" (UniqueName: \"kubernetes.io/projected/ead97571-d960-4349-a7d1-b6a384a652fa-kube-api-access-ph64t\") pod \"korrel8r-6644769df5-5j27f\" (UID: \"ead97571-d960-4349-a7d1-b6a384a652fa\") " pod="redhat-ods-monitoring/korrel8r-6644769df5-5j27f"
Oct 30 20:47:45.347342 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:47:45.347283    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/ead97571-d960-4349-a7d1-b6a384a652fa-tls\") pod \"korrel8r-6644769df5-5j27f\" (UID: \"ead97571-d960-4349-a7d1-b6a384a652fa\") " pod="redhat-ods-monitoring/korrel8r-6644769df5-5j27f"
Oct 30 20:47:45.348035 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:47:45.348016    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ead97571-d960-4349-a7d1-b6a384a652fa-config\") pod \"korrel8r-6644769df5-5j27f\" (UID: \"ead97571-d960-4349-a7d1-b6a384a652fa\") " pod="redhat-ods-monitoring/korrel8r-6644769df5-5j27f"
Oct 30 20:47:45.349713 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:47:45.349697    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls\" (UniqueName: \"kubernetes.io/secret/ead97571-d960-4349-a7d1-b6a384a652fa-tls\") pod \"korrel8r-6644769df5-5j27f\" (UID: \"ead97571-d960-4349-a7d1-b6a384a652fa\") " pod="redhat-ods-monitoring/korrel8r-6644769df5-5j27f"
Oct 30 20:47:45.408683 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:47:45.408653    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ph64t\" (UniqueName: \"kubernetes.io/projected/ead97571-d960-4349-a7d1-b6a384a652fa-kube-api-access-ph64t\") pod \"korrel8r-6644769df5-5j27f\" (UID: \"ead97571-d960-4349-a7d1-b6a384a652fa\") " pod="redhat-ods-monitoring/korrel8r-6644769df5-5j27f"
Oct 30 20:47:45.518639 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:47:45.518549    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/korrel8r-6644769df5-5j27f"
Oct 30 20:47:45.913097 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:47:45.913015    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/korrel8r-6644769df5-5j27f"]
Oct 30 20:47:45.917545 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:47:45.917517    4060 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podead97571_d960_4349_a7d1_b6a384a652fa.slice/crio-abc924fa61a41bcd14023cb07b03835738fbe3972a9fcf50dd6442fecb3e43ae WatchSource:0}: Error finding container abc924fa61a41bcd14023cb07b03835738fbe3972a9fcf50dd6442fecb3e43ae: Status 404 returned error can't find the container with id abc924fa61a41bcd14023cb07b03835738fbe3972a9fcf50dd6442fecb3e43ae
Oct 30 20:47:45.946117 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:47:45.946088    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/korrel8r-6644769df5-5j27f" event={"ID":"ead97571-d960-4349-a7d1-b6a384a652fa","Type":"ContainerStarted","Data":"abc924fa61a41bcd14023cb07b03835738fbe3972a9fcf50dd6442fecb3e43ae"}
Oct 30 20:47:47.915703 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:47:47.915670    4060 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 20:47:47.919922 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:47:47.919904    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:47:47.968389 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:47:47.968359    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-646x5\" (UniqueName: \"kubernetes.io/projected/3c714fe3-06bf-41f1-b342-e8758352b97f-kube-api-access-646x5\") pod \"data-science-collector-collector-0\" (UID: \"3c714fe3-06bf-41f1-b342-e8758352b97f\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:47:47.968591 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:47:47.968396    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/3c714fe3-06bf-41f1-b342-e8758352b97f-otc-internal\") pod \"data-science-collector-collector-0\" (UID: \"3c714fe3-06bf-41f1-b342-e8758352b97f\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:47:47.968591 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:47:47.968527    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/3c714fe3-06bf-41f1-b342-e8758352b97f-monitoring-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"3c714fe3-06bf-41f1-b342-e8758352b97f\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:47:47.968591 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:47:47.968557    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/3c714fe3-06bf-41f1-b342-e8758352b97f-otlp-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"3c714fe3-06bf-41f1-b342-e8758352b97f\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:47:47.973353 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:47:47.973333    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-monitoring-tls\""
Oct 30 20:47:48.022040 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:47:48.022004    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-dockercfg-f7h42\""
Oct 30 20:47:48.022212 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:47:48.022047    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-headless-tls\""
Oct 30 20:47:48.022563 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:47:48.022539    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-af329f19\""
Oct 30 20:47:48.024313 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:47:48.024295    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 20:47:48.069863 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:47:48.069824    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-646x5\" (UniqueName: \"kubernetes.io/projected/3c714fe3-06bf-41f1-b342-e8758352b97f-kube-api-access-646x5\") pod \"data-science-collector-collector-0\" (UID: \"3c714fe3-06bf-41f1-b342-e8758352b97f\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:47:48.069863 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:47:48.069863    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/3c714fe3-06bf-41f1-b342-e8758352b97f-otc-internal\") pod \"data-science-collector-collector-0\" (UID: \"3c714fe3-06bf-41f1-b342-e8758352b97f\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:47:48.070059 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:47:48.069917    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/3c714fe3-06bf-41f1-b342-e8758352b97f-monitoring-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"3c714fe3-06bf-41f1-b342-e8758352b97f\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:47:48.070059 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:47:48.069936    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/3c714fe3-06bf-41f1-b342-e8758352b97f-otlp-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"3c714fe3-06bf-41f1-b342-e8758352b97f\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:47:48.070709 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:47:48.070686    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/3c714fe3-06bf-41f1-b342-e8758352b97f-otc-internal\") pod \"data-science-collector-collector-0\" (UID: \"3c714fe3-06bf-41f1-b342-e8758352b97f\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:47:48.072419 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:47:48.072392    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/3c714fe3-06bf-41f1-b342-e8758352b97f-otlp-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"3c714fe3-06bf-41f1-b342-e8758352b97f\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:47:48.072655 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:47:48.072634    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/3c714fe3-06bf-41f1-b342-e8758352b97f-monitoring-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"3c714fe3-06bf-41f1-b342-e8758352b97f\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:47:48.131205 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:47:48.131173    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-646x5\" (UniqueName: \"kubernetes.io/projected/3c714fe3-06bf-41f1-b342-e8758352b97f-kube-api-access-646x5\") pod \"data-science-collector-collector-0\" (UID: \"3c714fe3-06bf-41f1-b342-e8758352b97f\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:47:48.232243 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:47:48.232209    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:47:48.605117 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:47:48.605091    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 20:47:48.607635 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:47:48.607606    4060 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c714fe3_06bf_41f1_b342_e8758352b97f.slice/crio-8fa0ea4dca4eb447db3c9b08d43b0931f79354c4abea562df136aa9d24d7cf73 WatchSource:0}: Error finding container 8fa0ea4dca4eb447db3c9b08d43b0931f79354c4abea562df136aa9d24d7cf73: Status 404 returned error can't find the container with id 8fa0ea4dca4eb447db3c9b08d43b0931f79354c4abea562df136aa9d24d7cf73
Oct 30 20:47:48.609694 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:47:48.609677    4060 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 20:47:48.962982 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:47:48.962944    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"3c714fe3-06bf-41f1-b342-e8758352b97f","Type":"ContainerStarted","Data":"8fa0ea4dca4eb447db3c9b08d43b0931f79354c4abea562df136aa9d24d7cf73"}
Oct 30 20:47:50.974920 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:47:50.974870    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/korrel8r-6644769df5-5j27f" event={"ID":"ead97571-d960-4349-a7d1-b6a384a652fa","Type":"ContainerStarted","Data":"9b5a0f93d6428fc62340b41f77381df2963f40da63d2df2e3c42046ba0f59b48"}
Oct 30 20:47:50.975336 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:47:50.975029    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/korrel8r-6644769df5-5j27f"
Oct 30 20:47:51.092797 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:47:51.092739    4060 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/korrel8r-6644769df5-5j27f" podStartSLOduration=1.7559047030000001 podStartE2EDuration="6.092721472s" totalImagesPullingTime="4.336816769s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:47:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:47:51.091053988 +0000 UTC m=+689.848052288" watchObservedRunningTime="2026-10-30 20:47:51.092721472 +0000 UTC m=+689.849719769"
Oct 30 20:47:55.423583 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:47:55.423536    4060 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 20:47:55.423894 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:47:55.423611    4060 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 20:47:56.004965 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:47:56.004931    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"3c714fe3-06bf-41f1-b342-e8758352b97f","Type":"ContainerStarted","Data":"df52bceb22b752b6a26940b605c518c834607e2f5910834cfcc073f0bcda713c"}
Oct 30 20:47:56.123870 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:47:56.123813    4060 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-collector-0" podStartSLOduration=2.310999154 podStartE2EDuration="9.123798013s" totalImagesPullingTime="6.812798859s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:47:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:47:56.122146045 +0000 UTC m=+694.879144343" watchObservedRunningTime="2026-10-30 20:47:56.123798013 +0000 UTC m=+694.880796349"
Oct 30 20:48:01.981435 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:01.981406    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/korrel8r-6644769df5-5j27f"
Oct 30 20:48:12.150753 ip-10-0-142-4 kubenswrapper[4060]: E1030 20:48:12.150720    4060 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v2f4x" containerName="extractor"
Oct 30 20:48:12.680693 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:12.680653    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/korrel8r-6644769df5-5j27f"]
Oct 30 20:48:12.680885 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:12.680864    4060 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/korrel8r-6644769df5-5j27f" podUID="ead97571-d960-4349-a7d1-b6a384a652fa" containerName="korrel8r" containerID="cri-o://9b5a0f93d6428fc62340b41f77381df2963f40da63d2df2e3c42046ba0f59b48" gracePeriod=30
Oct 30 20:48:12.925411 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:12.925385    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/korrel8r-6644769df5-5j27f"
Oct 30 20:48:13.076006 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:13.075978    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ead97571-d960-4349-a7d1-b6a384a652fa-tls\" (UniqueName: \"kubernetes.io/secret/ead97571-d960-4349-a7d1-b6a384a652fa-tls\") pod \"ead97571-d960-4349-a7d1-b6a384a652fa\" (UID: \"ead97571-d960-4349-a7d1-b6a384a652fa\") "
Oct 30 20:48:13.076230 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:13.076049    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ead97571-d960-4349-a7d1-b6a384a652fa-kube-api-access-ph64t\" (UniqueName: \"kubernetes.io/projected/ead97571-d960-4349-a7d1-b6a384a652fa-kube-api-access-ph64t\") pod \"ead97571-d960-4349-a7d1-b6a384a652fa\" (UID: \"ead97571-d960-4349-a7d1-b6a384a652fa\") "
Oct 30 20:48:13.076230 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:13.076105    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ead97571-d960-4349-a7d1-b6a384a652fa-config\" (UniqueName: \"kubernetes.io/configmap/ead97571-d960-4349-a7d1-b6a384a652fa-config\") pod \"ead97571-d960-4349-a7d1-b6a384a652fa\" (UID: \"ead97571-d960-4349-a7d1-b6a384a652fa\") "
Oct 30 20:48:13.076523 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:13.076463    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ead97571-d960-4349-a7d1-b6a384a652fa-config" pod "ead97571-d960-4349-a7d1-b6a384a652fa" (UID: "ead97571-d960-4349-a7d1-b6a384a652fa"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:48:13.078227 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:13.078190    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ead97571-d960-4349-a7d1-b6a384a652fa-tls" pod "ead97571-d960-4349-a7d1-b6a384a652fa" (UID: "ead97571-d960-4349-a7d1-b6a384a652fa"). InnerVolumeSpecName "tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:48:13.078633 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:13.078608    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ead97571-d960-4349-a7d1-b6a384a652fa-kube-api-access-ph64t" pod "ead97571-d960-4349-a7d1-b6a384a652fa" (UID: "ead97571-d960-4349-a7d1-b6a384a652fa"). InnerVolumeSpecName "kube-api-access-ph64t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:48:13.080193 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:13.080122    4060 generic.go:356] "Generic (PLEG): container finished" podID="ead97571-d960-4349-a7d1-b6a384a652fa" containerID="9b5a0f93d6428fc62340b41f77381df2963f40da63d2df2e3c42046ba0f59b48" exitCode=0
Oct 30 20:48:13.080193 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:13.080163    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/korrel8r-6644769df5-5j27f"
Oct 30 20:48:13.080357 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:13.080210    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/korrel8r-6644769df5-5j27f" event={"ID":"ead97571-d960-4349-a7d1-b6a384a652fa","Type":"ContainerDied","Data":"9b5a0f93d6428fc62340b41f77381df2963f40da63d2df2e3c42046ba0f59b48"}
Oct 30 20:48:13.080357 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:13.080279    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/korrel8r-6644769df5-5j27f" event={"ID":"ead97571-d960-4349-a7d1-b6a384a652fa","Type":"ContainerDied","Data":"abc924fa61a41bcd14023cb07b03835738fbe3972a9fcf50dd6442fecb3e43ae"}
Oct 30 20:48:13.080357 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:13.080311    4060 scope.go:122] "RemoveContainer" containerID="9b5a0f93d6428fc62340b41f77381df2963f40da63d2df2e3c42046ba0f59b48"
Oct 30 20:48:13.094123 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:13.094107    4060 scope.go:122] "RemoveContainer" containerID="9b5a0f93d6428fc62340b41f77381df2963f40da63d2df2e3c42046ba0f59b48"
Oct 30 20:48:13.094421 ip-10-0-142-4 kubenswrapper[4060]: E1030 20:48:13.094400    4060 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9b5a0f93d6428fc62340b41f77381df2963f40da63d2df2e3c42046ba0f59b48\": container with ID starting with 9b5a0f93d6428fc62340b41f77381df2963f40da63d2df2e3c42046ba0f59b48 not found: ID does not exist" containerID="9b5a0f93d6428fc62340b41f77381df2963f40da63d2df2e3c42046ba0f59b48"
Oct 30 20:48:13.094529 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:13.094431    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b5a0f93d6428fc62340b41f77381df2963f40da63d2df2e3c42046ba0f59b48"} err="failed to get container status \"9b5a0f93d6428fc62340b41f77381df2963f40da63d2df2e3c42046ba0f59b48\": rpc error: code = NotFound desc = could not find container \"9b5a0f93d6428fc62340b41f77381df2963f40da63d2df2e3c42046ba0f59b48\": container with ID starting with 9b5a0f93d6428fc62340b41f77381df2963f40da63d2df2e3c42046ba0f59b48 not found: ID does not exist"
Oct 30 20:48:13.176811 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:13.176776    4060 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ph64t\" (UniqueName: \"kubernetes.io/projected/ead97571-d960-4349-a7d1-b6a384a652fa-kube-api-access-ph64t\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:48:13.176811 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:13.176804    4060 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ead97571-d960-4349-a7d1-b6a384a652fa-config\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:48:13.176811 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:13.176814    4060 reconciler_common.go:299] "Volume detached for volume \"tls\" (UniqueName: \"kubernetes.io/secret/ead97571-d960-4349-a7d1-b6a384a652fa-tls\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:48:13.243816 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:13.243782    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/korrel8r-6644769df5-5j27f"]
Oct 30 20:48:13.248653 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:13.248629    4060 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/korrel8r-6644769df5-5j27f"]
Oct 30 20:48:13.427547 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:13.427462    4060 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ead97571-d960-4349-a7d1-b6a384a652fa" path="/var/lib/kubelet/pods/ead97571-d960-4349-a7d1-b6a384a652fa/volumes"
Oct 30 20:48:14.065962 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:14.065931    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 20:48:14.066156 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:14.066126    4060 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-collector-0" podUID="3c714fe3-06bf-41f1-b342-e8758352b97f" containerName="otc-container" containerID="cri-o://df52bceb22b752b6a26940b605c518c834607e2f5910834cfcc073f0bcda713c" gracePeriod=30
Oct 30 20:48:14.302570 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:14.302545    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:48:14.386841 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:14.386767    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/3c714fe3-06bf-41f1-b342-e8758352b97f-monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/3c714fe3-06bf-41f1-b342-e8758352b97f-monitoring-tls-certs\") pod \"3c714fe3-06bf-41f1-b342-e8758352b97f\" (UID: \"3c714fe3-06bf-41f1-b342-e8758352b97f\") "
Oct 30 20:48:14.386841 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:14.386831    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3c714fe3-06bf-41f1-b342-e8758352b97f-kube-api-access-646x5\" (UniqueName: \"kubernetes.io/projected/3c714fe3-06bf-41f1-b342-e8758352b97f-kube-api-access-646x5\") pod \"3c714fe3-06bf-41f1-b342-e8758352b97f\" (UID: \"3c714fe3-06bf-41f1-b342-e8758352b97f\") "
Oct 30 20:48:14.387074 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:14.386922    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/3c714fe3-06bf-41f1-b342-e8758352b97f-otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/3c714fe3-06bf-41f1-b342-e8758352b97f-otlp-tls-certs\") pod \"3c714fe3-06bf-41f1-b342-e8758352b97f\" (UID: \"3c714fe3-06bf-41f1-b342-e8758352b97f\") "
Oct 30 20:48:14.387074 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:14.386961    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/3c714fe3-06bf-41f1-b342-e8758352b97f-otc-internal\" (UniqueName: \"kubernetes.io/configmap/3c714fe3-06bf-41f1-b342-e8758352b97f-otc-internal\") pod \"3c714fe3-06bf-41f1-b342-e8758352b97f\" (UID: \"3c714fe3-06bf-41f1-b342-e8758352b97f\") "
Oct 30 20:48:14.387479 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:14.387447    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3c714fe3-06bf-41f1-b342-e8758352b97f-otc-internal" pod "3c714fe3-06bf-41f1-b342-e8758352b97f" (UID: "3c714fe3-06bf-41f1-b342-e8758352b97f"). InnerVolumeSpecName "otc-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:48:14.389065 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:14.389033    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c714fe3-06bf-41f1-b342-e8758352b97f-monitoring-tls-certs" pod "3c714fe3-06bf-41f1-b342-e8758352b97f" (UID: "3c714fe3-06bf-41f1-b342-e8758352b97f"). InnerVolumeSpecName "monitoring-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:48:14.389449 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:14.389416    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c714fe3-06bf-41f1-b342-e8758352b97f-kube-api-access-646x5" pod "3c714fe3-06bf-41f1-b342-e8758352b97f" (UID: "3c714fe3-06bf-41f1-b342-e8758352b97f"). InnerVolumeSpecName "kube-api-access-646x5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:48:14.389590 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:14.389570    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c714fe3-06bf-41f1-b342-e8758352b97f-otlp-tls-certs" pod "3c714fe3-06bf-41f1-b342-e8758352b97f" (UID: "3c714fe3-06bf-41f1-b342-e8758352b97f"). InnerVolumeSpecName "otlp-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:48:14.488081 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:14.488052    4060 reconciler_common.go:299] "Volume detached for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/3c714fe3-06bf-41f1-b342-e8758352b97f-otlp-tls-certs\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:48:14.488081 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:14.488079    4060 reconciler_common.go:299] "Volume detached for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/3c714fe3-06bf-41f1-b342-e8758352b97f-otc-internal\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:48:14.488081 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:14.488088    4060 reconciler_common.go:299] "Volume detached for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/3c714fe3-06bf-41f1-b342-e8758352b97f-monitoring-tls-certs\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:48:14.488296 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:14.488098    4060 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-646x5\" (UniqueName: \"kubernetes.io/projected/3c714fe3-06bf-41f1-b342-e8758352b97f-kube-api-access-646x5\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:48:15.093129 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:15.093100    4060 generic.go:356] "Generic (PLEG): container finished" podID="3c714fe3-06bf-41f1-b342-e8758352b97f" containerID="df52bceb22b752b6a26940b605c518c834607e2f5910834cfcc073f0bcda713c" exitCode=0
Oct 30 20:48:15.093300 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:15.093144    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:48:15.093300 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:15.093197    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"3c714fe3-06bf-41f1-b342-e8758352b97f","Type":"ContainerDied","Data":"df52bceb22b752b6a26940b605c518c834607e2f5910834cfcc073f0bcda713c"}
Oct 30 20:48:15.093300 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:15.093253    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"3c714fe3-06bf-41f1-b342-e8758352b97f","Type":"ContainerDied","Data":"8fa0ea4dca4eb447db3c9b08d43b0931f79354c4abea562df136aa9d24d7cf73"}
Oct 30 20:48:15.093300 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:15.093276    4060 scope.go:122] "RemoveContainer" containerID="df52bceb22b752b6a26940b605c518c834607e2f5910834cfcc073f0bcda713c"
Oct 30 20:48:15.106669 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:15.106648    4060 scope.go:122] "RemoveContainer" containerID="df52bceb22b752b6a26940b605c518c834607e2f5910834cfcc073f0bcda713c"
Oct 30 20:48:15.106973 ip-10-0-142-4 kubenswrapper[4060]: E1030 20:48:15.106943    4060 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"df52bceb22b752b6a26940b605c518c834607e2f5910834cfcc073f0bcda713c\": container with ID starting with df52bceb22b752b6a26940b605c518c834607e2f5910834cfcc073f0bcda713c not found: ID does not exist" containerID="df52bceb22b752b6a26940b605c518c834607e2f5910834cfcc073f0bcda713c"
Oct 30 20:48:15.107032 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:15.106981    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df52bceb22b752b6a26940b605c518c834607e2f5910834cfcc073f0bcda713c"} err="failed to get container status \"df52bceb22b752b6a26940b605c518c834607e2f5910834cfcc073f0bcda713c\": rpc error: code = NotFound desc = could not find container \"df52bceb22b752b6a26940b605c518c834607e2f5910834cfcc073f0bcda713c\": container with ID starting with df52bceb22b752b6a26940b605c518c834607e2f5910834cfcc073f0bcda713c not found: ID does not exist"
Oct 30 20:48:15.257348 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:15.257308    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 20:48:15.306987 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:15.306953    4060 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 20:48:15.427147 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:15.427073    4060 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="3c714fe3-06bf-41f1-b342-e8758352b97f" path="/var/lib/kubelet/pods/3c714fe3-06bf-41f1-b342-e8758352b97f/volumes"
Oct 30 20:48:23.838907 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:23.838869    4060 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/korrel8r-84f5b7859-lnmr8"]
Oct 30 20:48:23.839316 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:23.839161    4060 cpu_manager.go:414] "containerMap: removing container" podUID="3c714fe3-06bf-41f1-b342-e8758352b97f" containerName="otc-container"
Oct 30 20:48:23.839316 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:23.839172    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3c714fe3-06bf-41f1-b342-e8758352b97f" containerName="otc-container"
Oct 30 20:48:23.839316 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:23.839183    4060 cpu_manager.go:414] "containerMap: removing container" podUID="ead97571-d960-4349-a7d1-b6a384a652fa" containerName="korrel8r"
Oct 30 20:48:23.839316 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:23.839188    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ead97571-d960-4349-a7d1-b6a384a652fa" containerName="korrel8r"
Oct 30 20:48:23.839316 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:23.839245    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="3c714fe3-06bf-41f1-b342-e8758352b97f" containerName="otc-container"
Oct 30 20:48:23.839316 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:23.839253    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="ead97571-d960-4349-a7d1-b6a384a652fa" containerName="korrel8r"
Oct 30 20:48:23.842346 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:23.842328    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/korrel8r-84f5b7859-lnmr8"
Oct 30 20:48:23.944139 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:23.944109    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"openshift-service-ca.crt\""
Oct 30 20:48:23.944139 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:23.944128    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"korrel8r-config\""
Oct 30 20:48:23.944139 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:23.944142    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"kube-root-ca.crt\""
Oct 30 20:48:23.944438 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:23.944185    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"korrel8r-dockercfg-vcvwq\""
Oct 30 20:48:23.944438 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:23.944252    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"korrel8r-tls\""
Oct 30 20:48:23.946215 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:23.946192    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/korrel8r-84f5b7859-lnmr8"]
Oct 30 20:48:23.965634 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:23.965612    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7sphn\" (UniqueName: \"kubernetes.io/projected/0dd5e32c-0202-465e-8c38-63b7a597edd9-kube-api-access-7sphn\") pod \"korrel8r-84f5b7859-lnmr8\" (UID: \"0dd5e32c-0202-465e-8c38-63b7a597edd9\") " pod="redhat-ods-monitoring/korrel8r-84f5b7859-lnmr8"
Oct 30 20:48:23.965734 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:23.965640    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/0dd5e32c-0202-465e-8c38-63b7a597edd9-tls\") pod \"korrel8r-84f5b7859-lnmr8\" (UID: \"0dd5e32c-0202-465e-8c38-63b7a597edd9\") " pod="redhat-ods-monitoring/korrel8r-84f5b7859-lnmr8"
Oct 30 20:48:23.965734 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:23.965683    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0dd5e32c-0202-465e-8c38-63b7a597edd9-config\") pod \"korrel8r-84f5b7859-lnmr8\" (UID: \"0dd5e32c-0202-465e-8c38-63b7a597edd9\") " pod="redhat-ods-monitoring/korrel8r-84f5b7859-lnmr8"
Oct 30 20:48:24.066033 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:24.066006    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0dd5e32c-0202-465e-8c38-63b7a597edd9-config\") pod \"korrel8r-84f5b7859-lnmr8\" (UID: \"0dd5e32c-0202-465e-8c38-63b7a597edd9\") " pod="redhat-ods-monitoring/korrel8r-84f5b7859-lnmr8"
Oct 30 20:48:24.066186 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:24.066048    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7sphn\" (UniqueName: \"kubernetes.io/projected/0dd5e32c-0202-465e-8c38-63b7a597edd9-kube-api-access-7sphn\") pod \"korrel8r-84f5b7859-lnmr8\" (UID: \"0dd5e32c-0202-465e-8c38-63b7a597edd9\") " pod="redhat-ods-monitoring/korrel8r-84f5b7859-lnmr8"
Oct 30 20:48:24.066186 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:24.066069    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/0dd5e32c-0202-465e-8c38-63b7a597edd9-tls\") pod \"korrel8r-84f5b7859-lnmr8\" (UID: \"0dd5e32c-0202-465e-8c38-63b7a597edd9\") " pod="redhat-ods-monitoring/korrel8r-84f5b7859-lnmr8"
Oct 30 20:48:24.066762 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:24.066739    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0dd5e32c-0202-465e-8c38-63b7a597edd9-config\") pod \"korrel8r-84f5b7859-lnmr8\" (UID: \"0dd5e32c-0202-465e-8c38-63b7a597edd9\") " pod="redhat-ods-monitoring/korrel8r-84f5b7859-lnmr8"
Oct 30 20:48:24.068421 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:24.068405    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls\" (UniqueName: \"kubernetes.io/secret/0dd5e32c-0202-465e-8c38-63b7a597edd9-tls\") pod \"korrel8r-84f5b7859-lnmr8\" (UID: \"0dd5e32c-0202-465e-8c38-63b7a597edd9\") " pod="redhat-ods-monitoring/korrel8r-84f5b7859-lnmr8"
Oct 30 20:48:24.132369 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:24.132300    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7sphn\" (UniqueName: \"kubernetes.io/projected/0dd5e32c-0202-465e-8c38-63b7a597edd9-kube-api-access-7sphn\") pod \"korrel8r-84f5b7859-lnmr8\" (UID: \"0dd5e32c-0202-465e-8c38-63b7a597edd9\") " pod="redhat-ods-monitoring/korrel8r-84f5b7859-lnmr8"
Oct 30 20:48:24.153156 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:24.153128    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/korrel8r-84f5b7859-lnmr8"
Oct 30 20:48:24.524991 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:24.524968    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/korrel8r-84f5b7859-lnmr8"]
Oct 30 20:48:24.527528 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:48:24.527487    4060 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0dd5e32c_0202_465e_8c38_63b7a597edd9.slice/crio-462e947c7d54c79f01f7634888e84f7077b920790bd9e2de59e9f4168ad0df67 WatchSource:0}: Error finding container 462e947c7d54c79f01f7634888e84f7077b920790bd9e2de59e9f4168ad0df67: Status 404 returned error can't find the container with id 462e947c7d54c79f01f7634888e84f7077b920790bd9e2de59e9f4168ad0df67
Oct 30 20:48:25.138058 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:25.138019    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/korrel8r-84f5b7859-lnmr8" event={"ID":"0dd5e32c-0202-465e-8c38-63b7a597edd9","Type":"ContainerStarted","Data":"a6d30d6118175a73b1b091fe0b426fbe934ac2e2d7e61d94320b892aaf308088"}
Oct 30 20:48:25.138435 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:25.138074    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/korrel8r-84f5b7859-lnmr8" event={"ID":"0dd5e32c-0202-465e-8c38-63b7a597edd9","Type":"ContainerStarted","Data":"462e947c7d54c79f01f7634888e84f7077b920790bd9e2de59e9f4168ad0df67"}
Oct 30 20:48:25.138435 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:25.138101    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/korrel8r-84f5b7859-lnmr8"
Oct 30 20:48:25.254270 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:25.254224    4060 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/korrel8r-84f5b7859-lnmr8" podStartSLOduration=2.254209951 podStartE2EDuration="2.254209951s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:48:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:48:25.253568638 +0000 UTC m=+724.010566937" watchObservedRunningTime="2026-10-30 20:48:25.254209951 +0000 UTC m=+724.011208249"
Oct 30 20:48:27.119853 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:27.119816    4060 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-1"]
Oct 30 20:48:27.122194 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:27.122177    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 20:48:27.226789 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:27.226753    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-ta-client-cert\""
Oct 30 20:48:27.226789 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:27.226766    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-monitoring-tls\""
Oct 30 20:48:27.227032 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:27.226790    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-dockercfg-d65nb\""
Oct 30 20:48:27.227032 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:27.226803    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-headless-tls\""
Oct 30 20:48:27.227032 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:27.226973    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-b5f8018a\""
Oct 30 20:48:27.228798 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:27.228779    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-1"]
Oct 30 20:48:27.292878 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:27.292849    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/39c8ac83-7267-429c-868c-8cb56726f3be-otc-internal\") pod \"data-science-collector-collector-1\" (UID: \"39c8ac83-7267-429c-868c-8cb56726f3be\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 20:48:27.293039 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:27.292900    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/39c8ac83-7267-429c-868c-8cb56726f3be-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-1\" (UID: \"39c8ac83-7267-429c-868c-8cb56726f3be\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 20:48:27.293039 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:27.292973    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2k4k8\" (UniqueName: \"kubernetes.io/projected/39c8ac83-7267-429c-868c-8cb56726f3be-kube-api-access-2k4k8\") pod \"data-science-collector-collector-1\" (UID: \"39c8ac83-7267-429c-868c-8cb56726f3be\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 20:48:27.293112 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:27.293049    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/39c8ac83-7267-429c-868c-8cb56726f3be-otlp-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"39c8ac83-7267-429c-868c-8cb56726f3be\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 20:48:27.293112 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:27.293090    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/39c8ac83-7267-429c-868c-8cb56726f3be-monitoring-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"39c8ac83-7267-429c-868c-8cb56726f3be\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 20:48:27.393507 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:27.393422    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/39c8ac83-7267-429c-868c-8cb56726f3be-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-1\" (UID: \"39c8ac83-7267-429c-868c-8cb56726f3be\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 20:48:27.393507 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:27.393458    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2k4k8\" (UniqueName: \"kubernetes.io/projected/39c8ac83-7267-429c-868c-8cb56726f3be-kube-api-access-2k4k8\") pod \"data-science-collector-collector-1\" (UID: \"39c8ac83-7267-429c-868c-8cb56726f3be\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 20:48:27.393736 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:27.393487    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/39c8ac83-7267-429c-868c-8cb56726f3be-otlp-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"39c8ac83-7267-429c-868c-8cb56726f3be\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 20:48:27.393736 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:27.393553    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/39c8ac83-7267-429c-868c-8cb56726f3be-monitoring-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"39c8ac83-7267-429c-868c-8cb56726f3be\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 20:48:27.393736 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:27.393599    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/39c8ac83-7267-429c-868c-8cb56726f3be-otc-internal\") pod \"data-science-collector-collector-1\" (UID: \"39c8ac83-7267-429c-868c-8cb56726f3be\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 20:48:27.393736 ip-10-0-142-4 kubenswrapper[4060]: E1030 20:48:27.393606    4060 secret.go:189] Couldn't get secret redhat-ods-monitoring/data-science-collector-ta-client-cert: secret "data-science-collector-ta-client-cert" not found
Oct 30 20:48:27.393736 ip-10-0-142-4 kubenswrapper[4060]: E1030 20:48:27.393690    4060 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/39c8ac83-7267-429c-868c-8cb56726f3be-data-science-collector-ta-client-cert podName:39c8ac83-7267-429c-868c-8cb56726f3be nodeName:}" failed. No retries permitted until 2026-10-30 20:48:27.893668329 +0000 UTC m=+726.650666619 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "data-science-collector-ta-client-cert" (UniqueName: "kubernetes.io/secret/39c8ac83-7267-429c-868c-8cb56726f3be-data-science-collector-ta-client-cert") pod "data-science-collector-collector-1" (UID: "39c8ac83-7267-429c-868c-8cb56726f3be") : secret "data-science-collector-ta-client-cert" not found
Oct 30 20:48:27.394329 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:27.394307    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/39c8ac83-7267-429c-868c-8cb56726f3be-otc-internal\") pod \"data-science-collector-collector-1\" (UID: \"39c8ac83-7267-429c-868c-8cb56726f3be\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 20:48:27.396084 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:27.396061    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/39c8ac83-7267-429c-868c-8cb56726f3be-otlp-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"39c8ac83-7267-429c-868c-8cb56726f3be\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 20:48:27.396505 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:27.396475    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/39c8ac83-7267-429c-868c-8cb56726f3be-monitoring-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"39c8ac83-7267-429c-868c-8cb56726f3be\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 20:48:27.470061 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:27.470022    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2k4k8\" (UniqueName: \"kubernetes.io/projected/39c8ac83-7267-429c-868c-8cb56726f3be-kube-api-access-2k4k8\") pod \"data-science-collector-collector-1\" (UID: \"39c8ac83-7267-429c-868c-8cb56726f3be\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 20:48:27.898320 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:27.898287    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/39c8ac83-7267-429c-868c-8cb56726f3be-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-1\" (UID: \"39c8ac83-7267-429c-868c-8cb56726f3be\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 20:48:27.898519 ip-10-0-142-4 kubenswrapper[4060]: E1030 20:48:27.898407    4060 secret.go:189] Couldn't get secret redhat-ods-monitoring/data-science-collector-ta-client-cert: secret "data-science-collector-ta-client-cert" not found
Oct 30 20:48:27.898519 ip-10-0-142-4 kubenswrapper[4060]: E1030 20:48:27.898463    4060 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/39c8ac83-7267-429c-868c-8cb56726f3be-data-science-collector-ta-client-cert podName:39c8ac83-7267-429c-868c-8cb56726f3be nodeName:}" failed. No retries permitted until 2026-10-30 20:48:28.898449111 +0000 UTC m=+727.655447400 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "data-science-collector-ta-client-cert" (UniqueName: "kubernetes.io/secret/39c8ac83-7267-429c-868c-8cb56726f3be-data-science-collector-ta-client-cert") pod "data-science-collector-collector-1" (UID: "39c8ac83-7267-429c-868c-8cb56726f3be") : secret "data-science-collector-ta-client-cert" not found
Oct 30 20:48:28.906364 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:28.906325    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/39c8ac83-7267-429c-868c-8cb56726f3be-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-1\" (UID: \"39c8ac83-7267-429c-868c-8cb56726f3be\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 20:48:28.906783 ip-10-0-142-4 kubenswrapper[4060]: E1030 20:48:28.906444    4060 secret.go:189] Couldn't get secret redhat-ods-monitoring/data-science-collector-ta-client-cert: secret "data-science-collector-ta-client-cert" not found
Oct 30 20:48:28.906783 ip-10-0-142-4 kubenswrapper[4060]: E1030 20:48:28.906514    4060 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/39c8ac83-7267-429c-868c-8cb56726f3be-data-science-collector-ta-client-cert podName:39c8ac83-7267-429c-868c-8cb56726f3be nodeName:}" failed. No retries permitted until 2026-10-30 20:48:30.906482122 +0000 UTC m=+729.663480398 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "data-science-collector-ta-client-cert" (UniqueName: "kubernetes.io/secret/39c8ac83-7267-429c-868c-8cb56726f3be-data-science-collector-ta-client-cert") pod "data-science-collector-collector-1" (UID: "39c8ac83-7267-429c-868c-8cb56726f3be") : secret "data-science-collector-ta-client-cert" not found
Oct 30 20:48:30.926897 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:30.926852    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/39c8ac83-7267-429c-868c-8cb56726f3be-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-1\" (UID: \"39c8ac83-7267-429c-868c-8cb56726f3be\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 20:48:30.929264 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:30.929236    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/39c8ac83-7267-429c-868c-8cb56726f3be-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-1\" (UID: \"39c8ac83-7267-429c-868c-8cb56726f3be\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 20:48:31.033874 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:31.033841    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 20:48:31.407266 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:31.407242    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-1"]
Oct 30 20:48:31.409827 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:48:31.409794    4060 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39c8ac83_7267_429c_868c_8cb56726f3be.slice/crio-0d7595d40fe5958ca17dc9b7d94b90e4729d5ce1b25068f6a266cd5d8695fce9 WatchSource:0}: Error finding container 0d7595d40fe5958ca17dc9b7d94b90e4729d5ce1b25068f6a266cd5d8695fce9: Status 404 returned error can't find the container with id 0d7595d40fe5958ca17dc9b7d94b90e4729d5ce1b25068f6a266cd5d8695fce9
Oct 30 20:48:31.412123 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:31.412081    4060 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 20:48:31.412199 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:31.412161    4060 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 20:48:32.172635 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:32.172597    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-1" event={"ID":"39c8ac83-7267-429c-868c-8cb56726f3be","Type":"ContainerStarted","Data":"d98498e07cc2ad9942cd94aa151cb20914de825f92e496d56a5a35a51a49f7b5"}
Oct 30 20:48:32.173001 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:32.172656    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-1" event={"ID":"39c8ac83-7267-429c-868c-8cb56726f3be","Type":"ContainerStarted","Data":"0d7595d40fe5958ca17dc9b7d94b90e4729d5ce1b25068f6a266cd5d8695fce9"}
Oct 30 20:48:32.296057 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:32.291595    4060 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-collector-1" podStartSLOduration=5.29157666 podStartE2EDuration="5.29157666s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:48:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:48:32.289417001 +0000 UTC m=+731.046415300" watchObservedRunningTime="2026-10-30 20:48:32.29157666 +0000 UTC m=+731.048574959"
Oct 30 20:48:36.144008 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:36.143980    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/korrel8r-84f5b7859-lnmr8"
Oct 30 20:48:42.150070 ip-10-0-142-4 kubenswrapper[4060]: E1030 20:48:42.150031    4060 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v2f4x" containerName="extractor"
Oct 30 20:48:48.036705 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:48.036665    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/korrel8r-84f5b7859-lnmr8"]
Oct 30 20:48:48.037224 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:48.036915    4060 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/korrel8r-84f5b7859-lnmr8" podUID="0dd5e32c-0202-465e-8c38-63b7a597edd9" containerName="korrel8r" containerID="cri-o://a6d30d6118175a73b1b091fe0b426fbe934ac2e2d7e61d94320b892aaf308088" gracePeriod=30
Oct 30 20:48:48.245088 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:48.245052    4060 generic.go:356] "Generic (PLEG): container finished" podID="0dd5e32c-0202-465e-8c38-63b7a597edd9" containerID="a6d30d6118175a73b1b091fe0b426fbe934ac2e2d7e61d94320b892aaf308088" exitCode=0
Oct 30 20:48:48.245240 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:48.245098    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/korrel8r-84f5b7859-lnmr8" event={"ID":"0dd5e32c-0202-465e-8c38-63b7a597edd9","Type":"ContainerDied","Data":"a6d30d6118175a73b1b091fe0b426fbe934ac2e2d7e61d94320b892aaf308088"}
Oct 30 20:48:48.279655 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:48.279632    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/korrel8r-84f5b7859-lnmr8"
Oct 30 20:48:48.373524 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:48.373429    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0dd5e32c-0202-465e-8c38-63b7a597edd9-kube-api-access-7sphn\" (UniqueName: \"kubernetes.io/projected/0dd5e32c-0202-465e-8c38-63b7a597edd9-kube-api-access-7sphn\") pod \"0dd5e32c-0202-465e-8c38-63b7a597edd9\" (UID: \"0dd5e32c-0202-465e-8c38-63b7a597edd9\") "
Oct 30 20:48:48.373524 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:48.373468    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/0dd5e32c-0202-465e-8c38-63b7a597edd9-config\" (UniqueName: \"kubernetes.io/configmap/0dd5e32c-0202-465e-8c38-63b7a597edd9-config\") pod \"0dd5e32c-0202-465e-8c38-63b7a597edd9\" (UID: \"0dd5e32c-0202-465e-8c38-63b7a597edd9\") "
Oct 30 20:48:48.373524 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:48.373509    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/0dd5e32c-0202-465e-8c38-63b7a597edd9-tls\" (UniqueName: \"kubernetes.io/secret/0dd5e32c-0202-465e-8c38-63b7a597edd9-tls\") pod \"0dd5e32c-0202-465e-8c38-63b7a597edd9\" (UID: \"0dd5e32c-0202-465e-8c38-63b7a597edd9\") "
Oct 30 20:48:48.373898 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:48.373865    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0dd5e32c-0202-465e-8c38-63b7a597edd9-config" pod "0dd5e32c-0202-465e-8c38-63b7a597edd9" (UID: "0dd5e32c-0202-465e-8c38-63b7a597edd9"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:48:48.375571 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:48.375536    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0dd5e32c-0202-465e-8c38-63b7a597edd9-tls" pod "0dd5e32c-0202-465e-8c38-63b7a597edd9" (UID: "0dd5e32c-0202-465e-8c38-63b7a597edd9"). InnerVolumeSpecName "tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:48:48.375708 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:48.375690    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0dd5e32c-0202-465e-8c38-63b7a597edd9-kube-api-access-7sphn" pod "0dd5e32c-0202-465e-8c38-63b7a597edd9" (UID: "0dd5e32c-0202-465e-8c38-63b7a597edd9"). InnerVolumeSpecName "kube-api-access-7sphn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:48:48.474733 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:48.474698    4060 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7sphn\" (UniqueName: \"kubernetes.io/projected/0dd5e32c-0202-465e-8c38-63b7a597edd9-kube-api-access-7sphn\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:48:48.474733 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:48.474726    4060 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0dd5e32c-0202-465e-8c38-63b7a597edd9-config\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:48:48.474733 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:48.474736    4060 reconciler_common.go:299] "Volume detached for volume \"tls\" (UniqueName: \"kubernetes.io/secret/0dd5e32c-0202-465e-8c38-63b7a597edd9-tls\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:48:49.250663 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:49.250635    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/korrel8r-84f5b7859-lnmr8"
Oct 30 20:48:49.250663 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:49.250653    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/korrel8r-84f5b7859-lnmr8" event={"ID":"0dd5e32c-0202-465e-8c38-63b7a597edd9","Type":"ContainerDied","Data":"462e947c7d54c79f01f7634888e84f7077b920790bd9e2de59e9f4168ad0df67"}
Oct 30 20:48:49.251199 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:49.250710    4060 scope.go:122] "RemoveContainer" containerID="a6d30d6118175a73b1b091fe0b426fbe934ac2e2d7e61d94320b892aaf308088"
Oct 30 20:48:49.414667 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:49.414632    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/korrel8r-84f5b7859-lnmr8"]
Oct 30 20:48:49.418419 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:49.418394    4060 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/korrel8r-84f5b7859-lnmr8"]
Oct 30 20:48:49.426097 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:49.426070    4060 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="0dd5e32c-0202-465e-8c38-63b7a597edd9" path="/var/lib/kubelet/pods/0dd5e32c-0202-465e-8c38-63b7a597edd9/volumes"
Oct 30 20:48:50.850552 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:50.850519    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-1"]
Oct 30 20:48:50.850993 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:50.850751    4060 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-collector-1" podUID="39c8ac83-7267-429c-868c-8cb56726f3be" containerName="otc-container" containerID="cri-o://d98498e07cc2ad9942cd94aa151cb20914de825f92e496d56a5a35a51a49f7b5" gracePeriod=30
Oct 30 20:48:51.104384 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:51.104329    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 20:48:51.198935 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:51.198903    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/39c8ac83-7267-429c-868c-8cb56726f3be-data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/39c8ac83-7267-429c-868c-8cb56726f3be-data-science-collector-ta-client-cert\") pod \"39c8ac83-7267-429c-868c-8cb56726f3be\" (UID: \"39c8ac83-7267-429c-868c-8cb56726f3be\") "
Oct 30 20:48:51.199124 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:51.198982    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/39c8ac83-7267-429c-868c-8cb56726f3be-monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/39c8ac83-7267-429c-868c-8cb56726f3be-monitoring-tls-certs\") pod \"39c8ac83-7267-429c-868c-8cb56726f3be\" (UID: \"39c8ac83-7267-429c-868c-8cb56726f3be\") "
Oct 30 20:48:51.199124 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:51.199026    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/39c8ac83-7267-429c-868c-8cb56726f3be-otc-internal\" (UniqueName: \"kubernetes.io/configmap/39c8ac83-7267-429c-868c-8cb56726f3be-otc-internal\") pod \"39c8ac83-7267-429c-868c-8cb56726f3be\" (UID: \"39c8ac83-7267-429c-868c-8cb56726f3be\") "
Oct 30 20:48:51.199124 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:51.199048    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/39c8ac83-7267-429c-868c-8cb56726f3be-otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/39c8ac83-7267-429c-868c-8cb56726f3be-otlp-tls-certs\") pod \"39c8ac83-7267-429c-868c-8cb56726f3be\" (UID: \"39c8ac83-7267-429c-868c-8cb56726f3be\") "
Oct 30 20:48:51.199124 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:51.199079    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/39c8ac83-7267-429c-868c-8cb56726f3be-kube-api-access-2k4k8\" (UniqueName: \"kubernetes.io/projected/39c8ac83-7267-429c-868c-8cb56726f3be-kube-api-access-2k4k8\") pod \"39c8ac83-7267-429c-868c-8cb56726f3be\" (UID: \"39c8ac83-7267-429c-868c-8cb56726f3be\") "
Oct 30 20:48:51.199594 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:51.199560    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/39c8ac83-7267-429c-868c-8cb56726f3be-otc-internal" pod "39c8ac83-7267-429c-868c-8cb56726f3be" (UID: "39c8ac83-7267-429c-868c-8cb56726f3be"). InnerVolumeSpecName "otc-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:48:51.201077 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:51.201047    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/39c8ac83-7267-429c-868c-8cb56726f3be-otlp-tls-certs" pod "39c8ac83-7267-429c-868c-8cb56726f3be" (UID: "39c8ac83-7267-429c-868c-8cb56726f3be"). InnerVolumeSpecName "otlp-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:48:51.201183 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:51.201085    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/39c8ac83-7267-429c-868c-8cb56726f3be-data-science-collector-ta-client-cert" pod "39c8ac83-7267-429c-868c-8cb56726f3be" (UID: "39c8ac83-7267-429c-868c-8cb56726f3be"). InnerVolumeSpecName "data-science-collector-ta-client-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:48:51.201233 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:51.201173    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/39c8ac83-7267-429c-868c-8cb56726f3be-kube-api-access-2k4k8" pod "39c8ac83-7267-429c-868c-8cb56726f3be" (UID: "39c8ac83-7267-429c-868c-8cb56726f3be"). InnerVolumeSpecName "kube-api-access-2k4k8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:48:51.201283 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:51.201246    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/39c8ac83-7267-429c-868c-8cb56726f3be-monitoring-tls-certs" pod "39c8ac83-7267-429c-868c-8cb56726f3be" (UID: "39c8ac83-7267-429c-868c-8cb56726f3be"). InnerVolumeSpecName "monitoring-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:48:51.263147 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:51.263113    4060 generic.go:356] "Generic (PLEG): container finished" podID="39c8ac83-7267-429c-868c-8cb56726f3be" containerID="d98498e07cc2ad9942cd94aa151cb20914de825f92e496d56a5a35a51a49f7b5" exitCode=0
Oct 30 20:48:51.263304 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:51.263161    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-1" event={"ID":"39c8ac83-7267-429c-868c-8cb56726f3be","Type":"ContainerDied","Data":"d98498e07cc2ad9942cd94aa151cb20914de825f92e496d56a5a35a51a49f7b5"}
Oct 30 20:48:51.263304 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:51.263187    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 20:48:51.263304 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:51.263217    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-1" event={"ID":"39c8ac83-7267-429c-868c-8cb56726f3be","Type":"ContainerDied","Data":"0d7595d40fe5958ca17dc9b7d94b90e4729d5ce1b25068f6a266cd5d8695fce9"}
Oct 30 20:48:51.263304 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:51.263249    4060 scope.go:122] "RemoveContainer" containerID="d98498e07cc2ad9942cd94aa151cb20914de825f92e496d56a5a35a51a49f7b5"
Oct 30 20:48:51.272665 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:51.272647    4060 scope.go:122] "RemoveContainer" containerID="d98498e07cc2ad9942cd94aa151cb20914de825f92e496d56a5a35a51a49f7b5"
Oct 30 20:48:51.272936 ip-10-0-142-4 kubenswrapper[4060]: E1030 20:48:51.272913    4060 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d98498e07cc2ad9942cd94aa151cb20914de825f92e496d56a5a35a51a49f7b5\": container with ID starting with d98498e07cc2ad9942cd94aa151cb20914de825f92e496d56a5a35a51a49f7b5 not found: ID does not exist" containerID="d98498e07cc2ad9942cd94aa151cb20914de825f92e496d56a5a35a51a49f7b5"
Oct 30 20:48:51.273024 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:51.272948    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d98498e07cc2ad9942cd94aa151cb20914de825f92e496d56a5a35a51a49f7b5"} err="failed to get container status \"d98498e07cc2ad9942cd94aa151cb20914de825f92e496d56a5a35a51a49f7b5\": rpc error: code = NotFound desc = could not find container \"d98498e07cc2ad9942cd94aa151cb20914de825f92e496d56a5a35a51a49f7b5\": container with ID starting with d98498e07cc2ad9942cd94aa151cb20914de825f92e496d56a5a35a51a49f7b5 not found: ID does not exist"
Oct 30 20:48:51.299921 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:51.299894    4060 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/39c8ac83-7267-429c-868c-8cb56726f3be-data-science-collector-ta-client-cert\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:48:51.299921 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:51.299919    4060 reconciler_common.go:299] "Volume detached for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/39c8ac83-7267-429c-868c-8cb56726f3be-monitoring-tls-certs\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:48:51.300082 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:51.299930    4060 reconciler_common.go:299] "Volume detached for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/39c8ac83-7267-429c-868c-8cb56726f3be-otc-internal\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:48:51.300082 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:51.299941    4060 reconciler_common.go:299] "Volume detached for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/39c8ac83-7267-429c-868c-8cb56726f3be-otlp-tls-certs\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:48:51.300082 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:51.299950    4060 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2k4k8\" (UniqueName: \"kubernetes.io/projected/39c8ac83-7267-429c-868c-8cb56726f3be-kube-api-access-2k4k8\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:48:51.427376 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:51.427299    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-1"]
Oct 30 20:48:51.432821 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:51.432797    4060 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-1"]
Oct 30 20:48:53.426863 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:53.426828    4060 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="39c8ac83-7267-429c-868c-8cb56726f3be" path="/var/lib/kubelet/pods/39c8ac83-7267-429c-868c-8cb56726f3be/volumes"
Oct 30 20:48:57.171925 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:57.171894    4060 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/korrel8r-58bbdb5dcb-l2vdl"]
Oct 30 20:48:57.172300 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:57.172173    4060 cpu_manager.go:414] "containerMap: removing container" podUID="39c8ac83-7267-429c-868c-8cb56726f3be" containerName="otc-container"
Oct 30 20:48:57.172300 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:57.172184    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="39c8ac83-7267-429c-868c-8cb56726f3be" containerName="otc-container"
Oct 30 20:48:57.172300 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:57.172206    4060 cpu_manager.go:414] "containerMap: removing container" podUID="0dd5e32c-0202-465e-8c38-63b7a597edd9" containerName="korrel8r"
Oct 30 20:48:57.172300 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:57.172212    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0dd5e32c-0202-465e-8c38-63b7a597edd9" containerName="korrel8r"
Oct 30 20:48:57.172300 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:57.172259    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="39c8ac83-7267-429c-868c-8cb56726f3be" containerName="otc-container"
Oct 30 20:48:57.172300 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:57.172271    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="0dd5e32c-0202-465e-8c38-63b7a597edd9" containerName="korrel8r"
Oct 30 20:48:57.176403 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:57.176382    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/korrel8r-58bbdb5dcb-l2vdl"
Oct 30 20:48:57.228741 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:57.228709    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"kube-root-ca.crt\""
Oct 30 20:48:57.249014 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:57.248986    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/7d5d6dc8-6990-4abf-9ce3-4ec88ddf7f8b-tls\") pod \"korrel8r-58bbdb5dcb-l2vdl\" (UID: \"7d5d6dc8-6990-4abf-9ce3-4ec88ddf7f8b\") " pod="redhat-ods-monitoring/korrel8r-58bbdb5dcb-l2vdl"
Oct 30 20:48:57.249158 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:57.249050    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7d5d6dc8-6990-4abf-9ce3-4ec88ddf7f8b-config\") pod \"korrel8r-58bbdb5dcb-l2vdl\" (UID: \"7d5d6dc8-6990-4abf-9ce3-4ec88ddf7f8b\") " pod="redhat-ods-monitoring/korrel8r-58bbdb5dcb-l2vdl"
Oct 30 20:48:57.249204 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:57.249149    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9p4lg\" (UniqueName: \"kubernetes.io/projected/7d5d6dc8-6990-4abf-9ce3-4ec88ddf7f8b-kube-api-access-9p4lg\") pod \"korrel8r-58bbdb5dcb-l2vdl\" (UID: \"7d5d6dc8-6990-4abf-9ce3-4ec88ddf7f8b\") " pod="redhat-ods-monitoring/korrel8r-58bbdb5dcb-l2vdl"
Oct 30 20:48:57.270149 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:57.270127    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"openshift-service-ca.crt\""
Oct 30 20:48:57.278325 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:57.278299    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"korrel8r-dockercfg-t7nxc\""
Oct 30 20:48:57.278325 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:57.278319    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"korrel8r-tls\""
Oct 30 20:48:57.278480 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:57.278371    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"korrel8r-config\""
Oct 30 20:48:57.280134 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:57.280111    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/korrel8r-58bbdb5dcb-l2vdl"]
Oct 30 20:48:57.350083 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:57.350053    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9p4lg\" (UniqueName: \"kubernetes.io/projected/7d5d6dc8-6990-4abf-9ce3-4ec88ddf7f8b-kube-api-access-9p4lg\") pod \"korrel8r-58bbdb5dcb-l2vdl\" (UID: \"7d5d6dc8-6990-4abf-9ce3-4ec88ddf7f8b\") " pod="redhat-ods-monitoring/korrel8r-58bbdb5dcb-l2vdl"
Oct 30 20:48:57.350248 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:57.350096    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/7d5d6dc8-6990-4abf-9ce3-4ec88ddf7f8b-tls\") pod \"korrel8r-58bbdb5dcb-l2vdl\" (UID: \"7d5d6dc8-6990-4abf-9ce3-4ec88ddf7f8b\") " pod="redhat-ods-monitoring/korrel8r-58bbdb5dcb-l2vdl"
Oct 30 20:48:57.350248 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:57.350133    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7d5d6dc8-6990-4abf-9ce3-4ec88ddf7f8b-config\") pod \"korrel8r-58bbdb5dcb-l2vdl\" (UID: \"7d5d6dc8-6990-4abf-9ce3-4ec88ddf7f8b\") " pod="redhat-ods-monitoring/korrel8r-58bbdb5dcb-l2vdl"
Oct 30 20:48:57.350861 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:57.350839    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7d5d6dc8-6990-4abf-9ce3-4ec88ddf7f8b-config\") pod \"korrel8r-58bbdb5dcb-l2vdl\" (UID: \"7d5d6dc8-6990-4abf-9ce3-4ec88ddf7f8b\") " pod="redhat-ods-monitoring/korrel8r-58bbdb5dcb-l2vdl"
Oct 30 20:48:57.352638 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:57.352617    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls\" (UniqueName: \"kubernetes.io/secret/7d5d6dc8-6990-4abf-9ce3-4ec88ddf7f8b-tls\") pod \"korrel8r-58bbdb5dcb-l2vdl\" (UID: \"7d5d6dc8-6990-4abf-9ce3-4ec88ddf7f8b\") " pod="redhat-ods-monitoring/korrel8r-58bbdb5dcb-l2vdl"
Oct 30 20:48:57.411218 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:57.411183    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9p4lg\" (UniqueName: \"kubernetes.io/projected/7d5d6dc8-6990-4abf-9ce3-4ec88ddf7f8b-kube-api-access-9p4lg\") pod \"korrel8r-58bbdb5dcb-l2vdl\" (UID: \"7d5d6dc8-6990-4abf-9ce3-4ec88ddf7f8b\") " pod="redhat-ods-monitoring/korrel8r-58bbdb5dcb-l2vdl"
Oct 30 20:48:57.488504 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:57.488471    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/korrel8r-58bbdb5dcb-l2vdl"
Oct 30 20:48:57.861835 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:57.861811    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/korrel8r-58bbdb5dcb-l2vdl"]
Oct 30 20:48:57.864198 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:48:57.864168    4060 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d5d6dc8_6990_4abf_9ce3_4ec88ddf7f8b.slice/crio-b4495229f9bc3a2ec9c2c27a4bdc51c73617f0ff574f31f9f3925c3a7881188d WatchSource:0}: Error finding container b4495229f9bc3a2ec9c2c27a4bdc51c73617f0ff574f31f9f3925c3a7881188d: Status 404 returned error can't find the container with id b4495229f9bc3a2ec9c2c27a4bdc51c73617f0ff574f31f9f3925c3a7881188d
Oct 30 20:48:58.295704 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:58.295672    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/korrel8r-58bbdb5dcb-l2vdl" event={"ID":"7d5d6dc8-6990-4abf-9ce3-4ec88ddf7f8b","Type":"ContainerStarted","Data":"790f272ec160c99ffae6f186977df5b5dbced23b76cf84051e78071f2e575b23"}
Oct 30 20:48:58.296144 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:58.295726    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/korrel8r-58bbdb5dcb-l2vdl" event={"ID":"7d5d6dc8-6990-4abf-9ce3-4ec88ddf7f8b","Type":"ContainerStarted","Data":"b4495229f9bc3a2ec9c2c27a4bdc51c73617f0ff574f31f9f3925c3a7881188d"}
Oct 30 20:48:58.296144 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:58.295756    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/korrel8r-58bbdb5dcb-l2vdl"
Oct 30 20:48:58.412831 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:58.412777    4060 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/korrel8r-58bbdb5dcb-l2vdl" podStartSLOduration=1.412762601 podStartE2EDuration="1.412762601s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:48:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:48:58.411267086 +0000 UTC m=+757.168265385" watchObservedRunningTime="2026-10-30 20:48:58.412762601 +0000 UTC m=+757.169760898"
Oct 30 20:48:58.790187 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:58.790149    4060 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 20:48:58.793417 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:58.793398    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:48:58.863192 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:58.863163    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/b6c49f72-25fc-4729-8381-0a7b7b027c05-otlp-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"b6c49f72-25fc-4729-8381-0a7b7b027c05\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:48:58.863334 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:58.863197    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/b6c49f72-25fc-4729-8381-0a7b7b027c05-monitoring-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"b6c49f72-25fc-4729-8381-0a7b7b027c05\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:48:58.863334 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:58.863219    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6wc28\" (UniqueName: \"kubernetes.io/projected/b6c49f72-25fc-4729-8381-0a7b7b027c05-kube-api-access-6wc28\") pod \"data-science-collector-collector-0\" (UID: \"b6c49f72-25fc-4729-8381-0a7b7b027c05\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:48:58.863334 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:58.863315    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/b6c49f72-25fc-4729-8381-0a7b7b027c05-otc-internal\") pod \"data-science-collector-collector-0\" (UID: \"b6c49f72-25fc-4729-8381-0a7b7b027c05\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:48:58.895102 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:58.895072    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-headless-tls\""
Oct 30 20:48:58.895243 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:58.895113    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-monitoring-tls\""
Oct 30 20:48:58.895243 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:58.895116    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-c631c892\""
Oct 30 20:48:58.895243 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:58.895232    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-dockercfg-mkvcc\""
Oct 30 20:48:58.897303 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:58.897277    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 20:48:58.963744 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:58.963711    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/b6c49f72-25fc-4729-8381-0a7b7b027c05-monitoring-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"b6c49f72-25fc-4729-8381-0a7b7b027c05\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:48:58.963917 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:58.963752    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6wc28\" (UniqueName: \"kubernetes.io/projected/b6c49f72-25fc-4729-8381-0a7b7b027c05-kube-api-access-6wc28\") pod \"data-science-collector-collector-0\" (UID: \"b6c49f72-25fc-4729-8381-0a7b7b027c05\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:48:58.963917 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:58.963793    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/b6c49f72-25fc-4729-8381-0a7b7b027c05-otc-internal\") pod \"data-science-collector-collector-0\" (UID: \"b6c49f72-25fc-4729-8381-0a7b7b027c05\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:48:58.963917 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:58.963842    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/b6c49f72-25fc-4729-8381-0a7b7b027c05-otlp-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"b6c49f72-25fc-4729-8381-0a7b7b027c05\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:48:58.964093 ip-10-0-142-4 kubenswrapper[4060]: E1030 20:48:58.963926    4060 secret.go:189] Couldn't get secret redhat-ods-monitoring/data-science-collector-collector-headless-tls: secret "data-science-collector-collector-headless-tls" not found
Oct 30 20:48:58.964093 ip-10-0-142-4 kubenswrapper[4060]: E1030 20:48:58.963987    4060 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6c49f72-25fc-4729-8381-0a7b7b027c05-otlp-tls-certs podName:b6c49f72-25fc-4729-8381-0a7b7b027c05 nodeName:}" failed. No retries permitted until 2026-10-30 20:48:59.463971439 +0000 UTC m=+758.220969719 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "otlp-tls-certs" (UniqueName: "kubernetes.io/secret/b6c49f72-25fc-4729-8381-0a7b7b027c05-otlp-tls-certs") pod "data-science-collector-collector-0" (UID: "b6c49f72-25fc-4729-8381-0a7b7b027c05") : secret "data-science-collector-collector-headless-tls" not found
Oct 30 20:48:58.964542 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:58.964519    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/b6c49f72-25fc-4729-8381-0a7b7b027c05-otc-internal\") pod \"data-science-collector-collector-0\" (UID: \"b6c49f72-25fc-4729-8381-0a7b7b027c05\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:48:58.966048 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:58.966031    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/b6c49f72-25fc-4729-8381-0a7b7b027c05-monitoring-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"b6c49f72-25fc-4729-8381-0a7b7b027c05\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:48:59.030524 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:59.030477    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6wc28\" (UniqueName: \"kubernetes.io/projected/b6c49f72-25fc-4729-8381-0a7b7b027c05-kube-api-access-6wc28\") pod \"data-science-collector-collector-0\" (UID: \"b6c49f72-25fc-4729-8381-0a7b7b027c05\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:48:59.468152 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:59.468120    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/b6c49f72-25fc-4729-8381-0a7b7b027c05-otlp-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"b6c49f72-25fc-4729-8381-0a7b7b027c05\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:48:59.470396 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:59.470373    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/b6c49f72-25fc-4729-8381-0a7b7b027c05-otlp-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"b6c49f72-25fc-4729-8381-0a7b7b027c05\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:48:59.705362 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:48:59.705326    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:49:00.082544 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:49:00.082516    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 20:49:00.084782 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:49:00.084754    4060 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6c49f72_25fc_4729_8381_0a7b7b027c05.slice/crio-9c22e2bc6cef4e829275658fbcc3a2cb37218c8e8c6f20758f4cb4589ad360de WatchSource:0}: Error finding container 9c22e2bc6cef4e829275658fbcc3a2cb37218c8e8c6f20758f4cb4589ad360de: Status 404 returned error can't find the container with id 9c22e2bc6cef4e829275658fbcc3a2cb37218c8e8c6f20758f4cb4589ad360de
Oct 30 20:49:00.086910 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:49:00.086866    4060 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 20:49:00.086978 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:49:00.086933    4060 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 20:49:00.306451 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:49:00.306417    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"b6c49f72-25fc-4729-8381-0a7b7b027c05","Type":"ContainerStarted","Data":"1a3bedd15623e3974c5353ca386fa7df619a88d80f9589d5d1d2863c4cfb7f75"}
Oct 30 20:49:00.306721 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:49:00.306484    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"b6c49f72-25fc-4729-8381-0a7b7b027c05","Type":"ContainerStarted","Data":"9c22e2bc6cef4e829275658fbcc3a2cb37218c8e8c6f20758f4cb4589ad360de"}
Oct 30 20:49:00.426182 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:49:00.426067    4060 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-collector-0" podStartSLOduration=2.426048662 podStartE2EDuration="2.426048662s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:48:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:49:00.424141255 +0000 UTC m=+759.181139552" watchObservedRunningTime="2026-10-30 20:49:00.426048662 +0000 UTC m=+759.183046962"
Oct 30 20:49:09.302935 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:49:09.302855    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/korrel8r-58bbdb5dcb-l2vdl"
Oct 30 20:49:12.150628 ip-10-0-142-4 kubenswrapper[4060]: E1030 20:49:12.150595    4060 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v2f4x" containerName="extractor"
Oct 30 20:49:20.033907 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:49:20.033874    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/korrel8r-58bbdb5dcb-l2vdl"]
Oct 30 20:49:20.034319 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:49:20.034063    4060 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/korrel8r-58bbdb5dcb-l2vdl" podUID="7d5d6dc8-6990-4abf-9ce3-4ec88ddf7f8b" containerName="korrel8r" containerID="cri-o://790f272ec160c99ffae6f186977df5b5dbced23b76cf84051e78071f2e575b23" gracePeriod=30
Oct 30 20:49:20.274207 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:49:20.274184    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/korrel8r-58bbdb5dcb-l2vdl"
Oct 30 20:49:20.399088 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:49:20.398997    4060 generic.go:356] "Generic (PLEG): container finished" podID="7d5d6dc8-6990-4abf-9ce3-4ec88ddf7f8b" containerID="790f272ec160c99ffae6f186977df5b5dbced23b76cf84051e78071f2e575b23" exitCode=0
Oct 30 20:49:20.399088 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:49:20.399051    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/korrel8r-58bbdb5dcb-l2vdl"
Oct 30 20:49:20.399264 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:49:20.399075    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/korrel8r-58bbdb5dcb-l2vdl" event={"ID":"7d5d6dc8-6990-4abf-9ce3-4ec88ddf7f8b","Type":"ContainerDied","Data":"790f272ec160c99ffae6f186977df5b5dbced23b76cf84051e78071f2e575b23"}
Oct 30 20:49:20.399264 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:49:20.399149    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/korrel8r-58bbdb5dcb-l2vdl" event={"ID":"7d5d6dc8-6990-4abf-9ce3-4ec88ddf7f8b","Type":"ContainerDied","Data":"b4495229f9bc3a2ec9c2c27a4bdc51c73617f0ff574f31f9f3925c3a7881188d"}
Oct 30 20:49:20.399264 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:49:20.399180    4060 scope.go:122] "RemoveContainer" containerID="790f272ec160c99ffae6f186977df5b5dbced23b76cf84051e78071f2e575b23"
Oct 30 20:49:20.408296 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:49:20.408268    4060 scope.go:122] "RemoveContainer" containerID="790f272ec160c99ffae6f186977df5b5dbced23b76cf84051e78071f2e575b23"
Oct 30 20:49:20.408613 ip-10-0-142-4 kubenswrapper[4060]: E1030 20:49:20.408586    4060 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"790f272ec160c99ffae6f186977df5b5dbced23b76cf84051e78071f2e575b23\": container with ID starting with 790f272ec160c99ffae6f186977df5b5dbced23b76cf84051e78071f2e575b23 not found: ID does not exist" containerID="790f272ec160c99ffae6f186977df5b5dbced23b76cf84051e78071f2e575b23"
Oct 30 20:49:20.408697 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:49:20.408614    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"790f272ec160c99ffae6f186977df5b5dbced23b76cf84051e78071f2e575b23"} err="failed to get container status \"790f272ec160c99ffae6f186977df5b5dbced23b76cf84051e78071f2e575b23\": rpc error: code = NotFound desc = could not find container \"790f272ec160c99ffae6f186977df5b5dbced23b76cf84051e78071f2e575b23\": container with ID starting with 790f272ec160c99ffae6f186977df5b5dbced23b76cf84051e78071f2e575b23 not found: ID does not exist"
Oct 30 20:49:20.449023 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:49:20.448992    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/7d5d6dc8-6990-4abf-9ce3-4ec88ddf7f8b-config\" (UniqueName: \"kubernetes.io/configmap/7d5d6dc8-6990-4abf-9ce3-4ec88ddf7f8b-config\") pod \"7d5d6dc8-6990-4abf-9ce3-4ec88ddf7f8b\" (UID: \"7d5d6dc8-6990-4abf-9ce3-4ec88ddf7f8b\") "
Oct 30 20:49:20.449188 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:49:20.449097    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/7d5d6dc8-6990-4abf-9ce3-4ec88ddf7f8b-tls\" (UniqueName: \"kubernetes.io/secret/7d5d6dc8-6990-4abf-9ce3-4ec88ddf7f8b-tls\") pod \"7d5d6dc8-6990-4abf-9ce3-4ec88ddf7f8b\" (UID: \"7d5d6dc8-6990-4abf-9ce3-4ec88ddf7f8b\") "
Oct 30 20:49:20.449188 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:49:20.449141    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7d5d6dc8-6990-4abf-9ce3-4ec88ddf7f8b-kube-api-access-9p4lg\" (UniqueName: \"kubernetes.io/projected/7d5d6dc8-6990-4abf-9ce3-4ec88ddf7f8b-kube-api-access-9p4lg\") pod \"7d5d6dc8-6990-4abf-9ce3-4ec88ddf7f8b\" (UID: \"7d5d6dc8-6990-4abf-9ce3-4ec88ddf7f8b\") "
Oct 30 20:49:20.449381 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:49:20.449353    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7d5d6dc8-6990-4abf-9ce3-4ec88ddf7f8b-config" pod "7d5d6dc8-6990-4abf-9ce3-4ec88ddf7f8b" (UID: "7d5d6dc8-6990-4abf-9ce3-4ec88ddf7f8b"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:49:20.451154 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:49:20.451132    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7d5d6dc8-6990-4abf-9ce3-4ec88ddf7f8b-tls" pod "7d5d6dc8-6990-4abf-9ce3-4ec88ddf7f8b" (UID: "7d5d6dc8-6990-4abf-9ce3-4ec88ddf7f8b"). InnerVolumeSpecName "tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:49:20.451281 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:49:20.451192    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d5d6dc8-6990-4abf-9ce3-4ec88ddf7f8b-kube-api-access-9p4lg" pod "7d5d6dc8-6990-4abf-9ce3-4ec88ddf7f8b" (UID: "7d5d6dc8-6990-4abf-9ce3-4ec88ddf7f8b"). InnerVolumeSpecName "kube-api-access-9p4lg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:49:20.551153 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:49:20.551118    4060 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7d5d6dc8-6990-4abf-9ce3-4ec88ddf7f8b-config\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:49:20.551153 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:49:20.551146    4060 reconciler_common.go:299] "Volume detached for volume \"tls\" (UniqueName: \"kubernetes.io/secret/7d5d6dc8-6990-4abf-9ce3-4ec88ddf7f8b-tls\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:49:20.551153 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:49:20.551156    4060 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9p4lg\" (UniqueName: \"kubernetes.io/projected/7d5d6dc8-6990-4abf-9ce3-4ec88ddf7f8b-kube-api-access-9p4lg\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:49:20.818700 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:49:20.818666    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/korrel8r-58bbdb5dcb-l2vdl"]
Oct 30 20:49:20.868143 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:49:20.868111    4060 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/korrel8r-58bbdb5dcb-l2vdl"]
Oct 30 20:49:21.292581 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:49:21.292549    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 20:49:21.293009 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:49:21.292779    4060 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-collector-0" podUID="b6c49f72-25fc-4729-8381-0a7b7b027c05" containerName="otc-container" containerID="cri-o://1a3bedd15623e3974c5353ca386fa7df619a88d80f9589d5d1d2863c4cfb7f75" gracePeriod=30
Oct 30 20:49:21.427352 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:49:21.427325    4060 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="7d5d6dc8-6990-4abf-9ce3-4ec88ddf7f8b" path="/var/lib/kubelet/pods/7d5d6dc8-6990-4abf-9ce3-4ec88ddf7f8b/volumes"
Oct 30 20:49:21.537967 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:49:21.537939    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:49:21.658977 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:49:21.658884    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b6c49f72-25fc-4729-8381-0a7b7b027c05-otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/b6c49f72-25fc-4729-8381-0a7b7b027c05-otlp-tls-certs\") pod \"b6c49f72-25fc-4729-8381-0a7b7b027c05\" (UID: \"b6c49f72-25fc-4729-8381-0a7b7b027c05\") "
Oct 30 20:49:21.659474 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:49:21.659450    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b6c49f72-25fc-4729-8381-0a7b7b027c05-kube-api-access-6wc28\" (UniqueName: \"kubernetes.io/projected/b6c49f72-25fc-4729-8381-0a7b7b027c05-kube-api-access-6wc28\") pod \"b6c49f72-25fc-4729-8381-0a7b7b027c05\" (UID: \"b6c49f72-25fc-4729-8381-0a7b7b027c05\") "
Oct 30 20:49:21.659631 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:49:21.659575    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b6c49f72-25fc-4729-8381-0a7b7b027c05-monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/b6c49f72-25fc-4729-8381-0a7b7b027c05-monitoring-tls-certs\") pod \"b6c49f72-25fc-4729-8381-0a7b7b027c05\" (UID: \"b6c49f72-25fc-4729-8381-0a7b7b027c05\") "
Oct 30 20:49:21.659707 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:49:21.659634    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b6c49f72-25fc-4729-8381-0a7b7b027c05-otc-internal\" (UniqueName: \"kubernetes.io/configmap/b6c49f72-25fc-4729-8381-0a7b7b027c05-otc-internal\") pod \"b6c49f72-25fc-4729-8381-0a7b7b027c05\" (UID: \"b6c49f72-25fc-4729-8381-0a7b7b027c05\") "
Oct 30 20:49:21.660310 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:49:21.660283    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b6c49f72-25fc-4729-8381-0a7b7b027c05-otc-internal" pod "b6c49f72-25fc-4729-8381-0a7b7b027c05" (UID: "b6c49f72-25fc-4729-8381-0a7b7b027c05"). InnerVolumeSpecName "otc-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:49:21.660510 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:49:21.660472    4060 reconciler_common.go:299] "Volume detached for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/b6c49f72-25fc-4729-8381-0a7b7b027c05-otc-internal\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:49:21.661758 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:49:21.661732    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b6c49f72-25fc-4729-8381-0a7b7b027c05-otlp-tls-certs" pod "b6c49f72-25fc-4729-8381-0a7b7b027c05" (UID: "b6c49f72-25fc-4729-8381-0a7b7b027c05"). InnerVolumeSpecName "otlp-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:49:21.662452 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:49:21.662427    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b6c49f72-25fc-4729-8381-0a7b7b027c05-kube-api-access-6wc28" pod "b6c49f72-25fc-4729-8381-0a7b7b027c05" (UID: "b6c49f72-25fc-4729-8381-0a7b7b027c05"). InnerVolumeSpecName "kube-api-access-6wc28". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:49:21.662609 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:49:21.662548    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b6c49f72-25fc-4729-8381-0a7b7b027c05-monitoring-tls-certs" pod "b6c49f72-25fc-4729-8381-0a7b7b027c05" (UID: "b6c49f72-25fc-4729-8381-0a7b7b027c05"). InnerVolumeSpecName "monitoring-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:49:21.761186 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:49:21.761151    4060 reconciler_common.go:299] "Volume detached for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/b6c49f72-25fc-4729-8381-0a7b7b027c05-monitoring-tls-certs\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:49:21.761186 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:49:21.761176    4060 reconciler_common.go:299] "Volume detached for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/b6c49f72-25fc-4729-8381-0a7b7b027c05-otlp-tls-certs\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:49:21.761186 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:49:21.761186    4060 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6wc28\" (UniqueName: \"kubernetes.io/projected/b6c49f72-25fc-4729-8381-0a7b7b027c05-kube-api-access-6wc28\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:49:22.410951 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:49:22.410912    4060 generic.go:356] "Generic (PLEG): container finished" podID="b6c49f72-25fc-4729-8381-0a7b7b027c05" containerID="1a3bedd15623e3974c5353ca386fa7df619a88d80f9589d5d1d2863c4cfb7f75" exitCode=0
Oct 30 20:49:22.411441 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:49:22.410967    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:49:22.411441 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:49:22.411005    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"b6c49f72-25fc-4729-8381-0a7b7b027c05","Type":"ContainerDied","Data":"1a3bedd15623e3974c5353ca386fa7df619a88d80f9589d5d1d2863c4cfb7f75"}
Oct 30 20:49:22.411441 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:49:22.411076    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"b6c49f72-25fc-4729-8381-0a7b7b027c05","Type":"ContainerDied","Data":"9c22e2bc6cef4e829275658fbcc3a2cb37218c8e8c6f20758f4cb4589ad360de"}
Oct 30 20:49:22.411441 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:49:22.411117    4060 scope.go:122] "RemoveContainer" containerID="1a3bedd15623e3974c5353ca386fa7df619a88d80f9589d5d1d2863c4cfb7f75"
Oct 30 20:49:22.419949 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:49:22.419929    4060 scope.go:122] "RemoveContainer" containerID="1a3bedd15623e3974c5353ca386fa7df619a88d80f9589d5d1d2863c4cfb7f75"
Oct 30 20:49:22.420215 ip-10-0-142-4 kubenswrapper[4060]: E1030 20:49:22.420196    4060 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1a3bedd15623e3974c5353ca386fa7df619a88d80f9589d5d1d2863c4cfb7f75\": container with ID starting with 1a3bedd15623e3974c5353ca386fa7df619a88d80f9589d5d1d2863c4cfb7f75 not found: ID does not exist" containerID="1a3bedd15623e3974c5353ca386fa7df619a88d80f9589d5d1d2863c4cfb7f75"
Oct 30 20:49:22.420267 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:49:22.420224    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a3bedd15623e3974c5353ca386fa7df619a88d80f9589d5d1d2863c4cfb7f75"} err="failed to get container status \"1a3bedd15623e3974c5353ca386fa7df619a88d80f9589d5d1d2863c4cfb7f75\": rpc error: code = NotFound desc = could not find container \"1a3bedd15623e3974c5353ca386fa7df619a88d80f9589d5d1d2863c4cfb7f75\": container with ID starting with 1a3bedd15623e3974c5353ca386fa7df619a88d80f9589d5d1d2863c4cfb7f75 not found: ID does not exist"
Oct 30 20:49:22.576154 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:49:22.576120    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 20:49:22.625383 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:49:22.625353    4060 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 20:49:23.426169 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:49:23.426135    4060 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b6c49f72-25fc-4729-8381-0a7b7b027c05" path="/var/lib/kubelet/pods/b6c49f72-25fc-4729-8381-0a7b7b027c05/volumes"
Oct 30 20:49:28.440175 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:49:28.440132    4060 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/korrel8r-5c7449969d-g2wkc"]
Oct 30 20:49:28.440683 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:49:28.440418    4060 cpu_manager.go:414] "containerMap: removing container" podUID="7d5d6dc8-6990-4abf-9ce3-4ec88ddf7f8b" containerName="korrel8r"
Oct 30 20:49:28.440683 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:49:28.440428    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7d5d6dc8-6990-4abf-9ce3-4ec88ddf7f8b" containerName="korrel8r"
Oct 30 20:49:28.440683 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:49:28.440447    4060 cpu_manager.go:414] "containerMap: removing container" podUID="b6c49f72-25fc-4729-8381-0a7b7b027c05" containerName="otc-container"
Oct 30 20:49:28.440683 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:49:28.440452    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b6c49f72-25fc-4729-8381-0a7b7b027c05" containerName="otc-container"
Oct 30 20:49:28.440683 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:49:28.440520    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="b6c49f72-25fc-4729-8381-0a7b7b027c05" containerName="otc-container"
Oct 30 20:49:28.440683 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:49:28.440531    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="7d5d6dc8-6990-4abf-9ce3-4ec88ddf7f8b" containerName="korrel8r"
Oct 30 20:49:28.444536 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:49:28.444519    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/korrel8r-5c7449969d-g2wkc"
Oct 30 20:49:28.498103 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:49:28.498078    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"openshift-service-ca.crt\""
Oct 30 20:49:28.512560 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:49:28.512531    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/70d17cfb-0718-4f4a-bc15-859fb8f13c5c-config\") pod \"korrel8r-5c7449969d-g2wkc\" (UID: \"70d17cfb-0718-4f4a-bc15-859fb8f13c5c\") " pod="redhat-ods-monitoring/korrel8r-5c7449969d-g2wkc"
Oct 30 20:49:28.512678 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:49:28.512566    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/70d17cfb-0718-4f4a-bc15-859fb8f13c5c-tls\") pod \"korrel8r-5c7449969d-g2wkc\" (UID: \"70d17cfb-0718-4f4a-bc15-859fb8f13c5c\") " pod="redhat-ods-monitoring/korrel8r-5c7449969d-g2wkc"
Oct 30 20:49:28.512678 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:49:28.512666    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lhnhd\" (UniqueName: \"kubernetes.io/projected/70d17cfb-0718-4f4a-bc15-859fb8f13c5c-kube-api-access-lhnhd\") pod \"korrel8r-5c7449969d-g2wkc\" (UID: \"70d17cfb-0718-4f4a-bc15-859fb8f13c5c\") " pod="redhat-ods-monitoring/korrel8r-5c7449969d-g2wkc"
Oct 30 20:49:28.547502 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:49:28.547463    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"kube-root-ca.crt\""
Oct 30 20:49:28.547609 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:49:28.547547    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"korrel8r-tls\""
Oct 30 20:49:28.547609 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:49:28.547558    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"korrel8r-dockercfg-sg884\""
Oct 30 20:49:28.549219 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:49:28.549201    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/korrel8r-5c7449969d-g2wkc"]
Oct 30 20:49:28.599294 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:49:28.599273    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"korrel8r-config\""
Oct 30 20:49:28.613672 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:49:28.613650    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lhnhd\" (UniqueName: \"kubernetes.io/projected/70d17cfb-0718-4f4a-bc15-859fb8f13c5c-kube-api-access-lhnhd\") pod \"korrel8r-5c7449969d-g2wkc\" (UID: \"70d17cfb-0718-4f4a-bc15-859fb8f13c5c\") " pod="redhat-ods-monitoring/korrel8r-5c7449969d-g2wkc"
Oct 30 20:49:28.613758 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:49:28.613700    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/70d17cfb-0718-4f4a-bc15-859fb8f13c5c-config\") pod \"korrel8r-5c7449969d-g2wkc\" (UID: \"70d17cfb-0718-4f4a-bc15-859fb8f13c5c\") " pod="redhat-ods-monitoring/korrel8r-5c7449969d-g2wkc"
Oct 30 20:49:28.613758 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:49:28.613721    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/70d17cfb-0718-4f4a-bc15-859fb8f13c5c-tls\") pod \"korrel8r-5c7449969d-g2wkc\" (UID: \"70d17cfb-0718-4f4a-bc15-859fb8f13c5c\") " pod="redhat-ods-monitoring/korrel8r-5c7449969d-g2wkc"
Oct 30 20:49:28.614470 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:49:28.614453    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/70d17cfb-0718-4f4a-bc15-859fb8f13c5c-config\") pod \"korrel8r-5c7449969d-g2wkc\" (UID: \"70d17cfb-0718-4f4a-bc15-859fb8f13c5c\") " pod="redhat-ods-monitoring/korrel8r-5c7449969d-g2wkc"
Oct 30 20:49:28.616082 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:49:28.616065    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls\" (UniqueName: \"kubernetes.io/secret/70d17cfb-0718-4f4a-bc15-859fb8f13c5c-tls\") pod \"korrel8r-5c7449969d-g2wkc\" (UID: \"70d17cfb-0718-4f4a-bc15-859fb8f13c5c\") " pod="redhat-ods-monitoring/korrel8r-5c7449969d-g2wkc"
Oct 30 20:49:28.674372 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:49:28.674346    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lhnhd\" (UniqueName: \"kubernetes.io/projected/70d17cfb-0718-4f4a-bc15-859fb8f13c5c-kube-api-access-lhnhd\") pod \"korrel8r-5c7449969d-g2wkc\" (UID: \"70d17cfb-0718-4f4a-bc15-859fb8f13c5c\") " pod="redhat-ods-monitoring/korrel8r-5c7449969d-g2wkc"
Oct 30 20:49:28.755778 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:49:28.755755    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/korrel8r-5c7449969d-g2wkc"
Oct 30 20:49:29.127976 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:49:29.127950    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/korrel8r-5c7449969d-g2wkc"]
Oct 30 20:49:29.130203 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:49:29.130177    4060 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70d17cfb_0718_4f4a_bc15_859fb8f13c5c.slice/crio-28e6ac847a20dacc2e9dc97d30aac6e2d1bf048ce4b79f95f98132026ae9a276 WatchSource:0}: Error finding container 28e6ac847a20dacc2e9dc97d30aac6e2d1bf048ce4b79f95f98132026ae9a276: Status 404 returned error can't find the container with id 28e6ac847a20dacc2e9dc97d30aac6e2d1bf048ce4b79f95f98132026ae9a276
Oct 30 20:49:29.447518 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:49:29.447417    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/korrel8r-5c7449969d-g2wkc" event={"ID":"70d17cfb-0718-4f4a-bc15-859fb8f13c5c","Type":"ContainerStarted","Data":"1f67c17719fa702773664622d1fc868c5be531c4f2e7876a414d891f43e058dd"}
Oct 30 20:49:29.447518 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:49:29.447463    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/korrel8r-5c7449969d-g2wkc" event={"ID":"70d17cfb-0718-4f4a-bc15-859fb8f13c5c","Type":"ContainerStarted","Data":"28e6ac847a20dacc2e9dc97d30aac6e2d1bf048ce4b79f95f98132026ae9a276"}
Oct 30 20:49:29.447959 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:49:29.447525    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/korrel8r-5c7449969d-g2wkc"
Oct 30 20:49:29.563595 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:49:29.563541    4060 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/korrel8r-5c7449969d-g2wkc" podStartSLOduration=1.563525947 podStartE2EDuration="1.563525947s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:49:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:49:29.563077285 +0000 UTC m=+788.320075583" watchObservedRunningTime="2026-10-30 20:49:29.563525947 +0000 UTC m=+788.320524248"
Oct 30 20:49:31.748328 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:49:31.748296    4060 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 20:49:31.751353 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:49:31.751335    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:49:31.840354 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:49:31.840321    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/f9399a82-7bf3-4050-8a0c-dd1347231fe4-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-0\" (UID: \"f9399a82-7bf3-4050-8a0c-dd1347231fe4\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:49:31.840562 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:49:31.840393    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/f9399a82-7bf3-4050-8a0c-dd1347231fe4-monitoring-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"f9399a82-7bf3-4050-8a0c-dd1347231fe4\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:49:31.840562 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:49:31.840525    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/f9399a82-7bf3-4050-8a0c-dd1347231fe4-otc-internal\") pod \"data-science-collector-collector-0\" (UID: \"f9399a82-7bf3-4050-8a0c-dd1347231fe4\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:49:31.840693 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:49:31.840582    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8l8nd\" (UniqueName: \"kubernetes.io/projected/f9399a82-7bf3-4050-8a0c-dd1347231fe4-kube-api-access-8l8nd\") pod \"data-science-collector-collector-0\" (UID: \"f9399a82-7bf3-4050-8a0c-dd1347231fe4\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:49:31.840748 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:49:31.840682    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/f9399a82-7bf3-4050-8a0c-dd1347231fe4-otlp-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"f9399a82-7bf3-4050-8a0c-dd1347231fe4\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:49:31.857296 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:49:31.857250    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-4d267ad2\""
Oct 30 20:49:31.857473 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:49:31.857307    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-headless-tls\""
Oct 30 20:49:31.857473 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:49:31.857380    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-dockercfg-9htg9\""
Oct 30 20:49:31.857650 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:49:31.857634    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-monitoring-tls\""
Oct 30 20:49:31.857897 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:49:31.857882    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-ta-client-cert\""
Oct 30 20:49:31.859633 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:49:31.859611    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 20:49:31.941446 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:49:31.941409    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/f9399a82-7bf3-4050-8a0c-dd1347231fe4-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-0\" (UID: \"f9399a82-7bf3-4050-8a0c-dd1347231fe4\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:49:31.941632 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:49:31.941455    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/f9399a82-7bf3-4050-8a0c-dd1347231fe4-monitoring-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"f9399a82-7bf3-4050-8a0c-dd1347231fe4\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:49:31.941632 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:49:31.941485    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/f9399a82-7bf3-4050-8a0c-dd1347231fe4-otc-internal\") pod \"data-science-collector-collector-0\" (UID: \"f9399a82-7bf3-4050-8a0c-dd1347231fe4\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:49:31.941632 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:49:31.941534    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8l8nd\" (UniqueName: \"kubernetes.io/projected/f9399a82-7bf3-4050-8a0c-dd1347231fe4-kube-api-access-8l8nd\") pod \"data-science-collector-collector-0\" (UID: \"f9399a82-7bf3-4050-8a0c-dd1347231fe4\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:49:31.941745 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:49:31.941681    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/f9399a82-7bf3-4050-8a0c-dd1347231fe4-otlp-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"f9399a82-7bf3-4050-8a0c-dd1347231fe4\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:49:31.942102 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:49:31.942084    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/f9399a82-7bf3-4050-8a0c-dd1347231fe4-otc-internal\") pod \"data-science-collector-collector-0\" (UID: \"f9399a82-7bf3-4050-8a0c-dd1347231fe4\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:49:31.944157 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:49:31.944129    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/f9399a82-7bf3-4050-8a0c-dd1347231fe4-monitoring-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"f9399a82-7bf3-4050-8a0c-dd1347231fe4\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:49:31.944252 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:49:31.944178    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/f9399a82-7bf3-4050-8a0c-dd1347231fe4-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-0\" (UID: \"f9399a82-7bf3-4050-8a0c-dd1347231fe4\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:49:31.944252 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:49:31.944176    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/f9399a82-7bf3-4050-8a0c-dd1347231fe4-otlp-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"f9399a82-7bf3-4050-8a0c-dd1347231fe4\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:49:32.004035 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:49:32.003965    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8l8nd\" (UniqueName: \"kubernetes.io/projected/f9399a82-7bf3-4050-8a0c-dd1347231fe4-kube-api-access-8l8nd\") pod \"data-science-collector-collector-0\" (UID: \"f9399a82-7bf3-4050-8a0c-dd1347231fe4\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:49:32.063888 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:49:32.063859    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:49:32.437358 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:49:32.437330    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 20:49:32.438772 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:49:32.438748    4060 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9399a82_7bf3_4050_8a0c_dd1347231fe4.slice/crio-ff78bda1fead6ceb00a5c2ad6faa3d20495e98c1b59817f976a86a8f2f8a1a50 WatchSource:0}: Error finding container ff78bda1fead6ceb00a5c2ad6faa3d20495e98c1b59817f976a86a8f2f8a1a50: Status 404 returned error can't find the container with id ff78bda1fead6ceb00a5c2ad6faa3d20495e98c1b59817f976a86a8f2f8a1a50
Oct 30 20:49:32.440872 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:49:32.440841    4060 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 20:49:32.440936 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:49:32.440895    4060 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 20:49:32.460258 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:49:32.460219    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"f9399a82-7bf3-4050-8a0c-dd1347231fe4","Type":"ContainerStarted","Data":"ff78bda1fead6ceb00a5c2ad6faa3d20495e98c1b59817f976a86a8f2f8a1a50"}
Oct 30 20:49:33.466423 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:49:33.466391    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"f9399a82-7bf3-4050-8a0c-dd1347231fe4","Type":"ContainerStarted","Data":"af4a1d96ba1952f81d301d0a3b5729e038e8111f3521132ca5be3d4f22ff0a7f"}
Oct 30 20:49:33.586341 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:49:33.586289    4060 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-collector-0" podStartSLOduration=2.586274641 podStartE2EDuration="2.586274641s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:49:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:49:33.584338589 +0000 UTC m=+792.341336888" watchObservedRunningTime="2026-10-30 20:49:33.586274641 +0000 UTC m=+792.343272939"
Oct 30 20:49:40.454112 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:49:40.454080    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/korrel8r-5c7449969d-g2wkc"
Oct 30 20:49:42.149720 ip-10-0-142-4 kubenswrapper[4060]: E1030 20:49:42.149678    4060 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v2f4x" containerName="extractor"
Oct 30 20:49:55.753023 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:49:55.752993    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/korrel8r-5c7449969d-g2wkc"]
Oct 30 20:49:55.753436 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:49:55.753184    4060 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/korrel8r-5c7449969d-g2wkc" podUID="70d17cfb-0718-4f4a-bc15-859fb8f13c5c" containerName="korrel8r" containerID="cri-o://1f67c17719fa702773664622d1fc868c5be531c4f2e7876a414d891f43e058dd" gracePeriod=30
Oct 30 20:49:55.983130 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:49:55.983105    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/korrel8r-5c7449969d-g2wkc"
Oct 30 20:49:56.031341 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:49:56.031289    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/70d17cfb-0718-4f4a-bc15-859fb8f13c5c-tls\" (UniqueName: \"kubernetes.io/secret/70d17cfb-0718-4f4a-bc15-859fb8f13c5c-tls\") pod \"70d17cfb-0718-4f4a-bc15-859fb8f13c5c\" (UID: \"70d17cfb-0718-4f4a-bc15-859fb8f13c5c\") "
Oct 30 20:49:56.031341 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:49:56.031333    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/70d17cfb-0718-4f4a-bc15-859fb8f13c5c-kube-api-access-lhnhd\" (UniqueName: \"kubernetes.io/projected/70d17cfb-0718-4f4a-bc15-859fb8f13c5c-kube-api-access-lhnhd\") pod \"70d17cfb-0718-4f4a-bc15-859fb8f13c5c\" (UID: \"70d17cfb-0718-4f4a-bc15-859fb8f13c5c\") "
Oct 30 20:49:56.031536 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:49:56.031463    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/70d17cfb-0718-4f4a-bc15-859fb8f13c5c-config\" (UniqueName: \"kubernetes.io/configmap/70d17cfb-0718-4f4a-bc15-859fb8f13c5c-config\") pod \"70d17cfb-0718-4f4a-bc15-859fb8f13c5c\" (UID: \"70d17cfb-0718-4f4a-bc15-859fb8f13c5c\") "
Oct 30 20:49:56.031792 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:49:56.031770    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/70d17cfb-0718-4f4a-bc15-859fb8f13c5c-config" pod "70d17cfb-0718-4f4a-bc15-859fb8f13c5c" (UID: "70d17cfb-0718-4f4a-bc15-859fb8f13c5c"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:49:56.033310 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:49:56.033289    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/70d17cfb-0718-4f4a-bc15-859fb8f13c5c-tls" pod "70d17cfb-0718-4f4a-bc15-859fb8f13c5c" (UID: "70d17cfb-0718-4f4a-bc15-859fb8f13c5c"). InnerVolumeSpecName "tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:49:56.033432 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:49:56.033411    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/70d17cfb-0718-4f4a-bc15-859fb8f13c5c-kube-api-access-lhnhd" pod "70d17cfb-0718-4f4a-bc15-859fb8f13c5c" (UID: "70d17cfb-0718-4f4a-bc15-859fb8f13c5c"). InnerVolumeSpecName "kube-api-access-lhnhd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:49:56.132450 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:49:56.132421    4060 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/70d17cfb-0718-4f4a-bc15-859fb8f13c5c-config\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:49:56.132450 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:49:56.132448    4060 reconciler_common.go:299] "Volume detached for volume \"tls\" (UniqueName: \"kubernetes.io/secret/70d17cfb-0718-4f4a-bc15-859fb8f13c5c-tls\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:49:56.132640 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:49:56.132463    4060 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lhnhd\" (UniqueName: \"kubernetes.io/projected/70d17cfb-0718-4f4a-bc15-859fb8f13c5c-kube-api-access-lhnhd\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:49:56.566504 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:49:56.566456    4060 generic.go:356] "Generic (PLEG): container finished" podID="70d17cfb-0718-4f4a-bc15-859fb8f13c5c" containerID="1f67c17719fa702773664622d1fc868c5be531c4f2e7876a414d891f43e058dd" exitCode=0
Oct 30 20:49:56.566677 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:49:56.566526    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/korrel8r-5c7449969d-g2wkc"
Oct 30 20:49:56.566677 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:49:56.566528    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/korrel8r-5c7449969d-g2wkc" event={"ID":"70d17cfb-0718-4f4a-bc15-859fb8f13c5c","Type":"ContainerDied","Data":"1f67c17719fa702773664622d1fc868c5be531c4f2e7876a414d891f43e058dd"}
Oct 30 20:49:56.566677 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:49:56.566584    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/korrel8r-5c7449969d-g2wkc" event={"ID":"70d17cfb-0718-4f4a-bc15-859fb8f13c5c","Type":"ContainerDied","Data":"28e6ac847a20dacc2e9dc97d30aac6e2d1bf048ce4b79f95f98132026ae9a276"}
Oct 30 20:49:56.566677 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:49:56.566606    4060 scope.go:122] "RemoveContainer" containerID="1f67c17719fa702773664622d1fc868c5be531c4f2e7876a414d891f43e058dd"
Oct 30 20:49:56.574962 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:49:56.574947    4060 scope.go:122] "RemoveContainer" containerID="1f67c17719fa702773664622d1fc868c5be531c4f2e7876a414d891f43e058dd"
Oct 30 20:49:56.575223 ip-10-0-142-4 kubenswrapper[4060]: E1030 20:49:56.575202    4060 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1f67c17719fa702773664622d1fc868c5be531c4f2e7876a414d891f43e058dd\": container with ID starting with 1f67c17719fa702773664622d1fc868c5be531c4f2e7876a414d891f43e058dd not found: ID does not exist" containerID="1f67c17719fa702773664622d1fc868c5be531c4f2e7876a414d891f43e058dd"
Oct 30 20:49:56.575313 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:49:56.575228    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f67c17719fa702773664622d1fc868c5be531c4f2e7876a414d891f43e058dd"} err="failed to get container status \"1f67c17719fa702773664622d1fc868c5be531c4f2e7876a414d891f43e058dd\": rpc error: code = NotFound desc = could not find container \"1f67c17719fa702773664622d1fc868c5be531c4f2e7876a414d891f43e058dd\": container with ID starting with 1f67c17719fa702773664622d1fc868c5be531c4f2e7876a414d891f43e058dd not found: ID does not exist"
Oct 30 20:49:56.732681 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:49:56.732653    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/korrel8r-5c7449969d-g2wkc"]
Oct 30 20:49:56.737265 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:49:56.737231    4060 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/korrel8r-5c7449969d-g2wkc"]
Oct 30 20:49:57.426570 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:49:57.426539    4060 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="70d17cfb-0718-4f4a-bc15-859fb8f13c5c" path="/var/lib/kubelet/pods/70d17cfb-0718-4f4a-bc15-859fb8f13c5c/volumes"
Oct 30 20:49:58.695454 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:49:58.695419    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 20:49:58.695928 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:49:58.695682    4060 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-collector-0" podUID="f9399a82-7bf3-4050-8a0c-dd1347231fe4" containerName="otc-container" containerID="cri-o://af4a1d96ba1952f81d301d0a3b5729e038e8111f3521132ca5be3d4f22ff0a7f" gracePeriod=30
Oct 30 20:49:58.938159 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:49:58.938137    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:49:59.054128 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:49:59.054102    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/f9399a82-7bf3-4050-8a0c-dd1347231fe4-otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/f9399a82-7bf3-4050-8a0c-dd1347231fe4-otlp-tls-certs\") pod \"f9399a82-7bf3-4050-8a0c-dd1347231fe4\" (UID: \"f9399a82-7bf3-4050-8a0c-dd1347231fe4\") "
Oct 30 20:49:59.054282 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:49:59.054134    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/f9399a82-7bf3-4050-8a0c-dd1347231fe4-otc-internal\" (UniqueName: \"kubernetes.io/configmap/f9399a82-7bf3-4050-8a0c-dd1347231fe4-otc-internal\") pod \"f9399a82-7bf3-4050-8a0c-dd1347231fe4\" (UID: \"f9399a82-7bf3-4050-8a0c-dd1347231fe4\") "
Oct 30 20:49:59.054282 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:49:59.054158    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/f9399a82-7bf3-4050-8a0c-dd1347231fe4-data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/f9399a82-7bf3-4050-8a0c-dd1347231fe4-data-science-collector-ta-client-cert\") pod \"f9399a82-7bf3-4050-8a0c-dd1347231fe4\" (UID: \"f9399a82-7bf3-4050-8a0c-dd1347231fe4\") "
Oct 30 20:49:59.054282 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:49:59.054197    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f9399a82-7bf3-4050-8a0c-dd1347231fe4-kube-api-access-8l8nd\" (UniqueName: \"kubernetes.io/projected/f9399a82-7bf3-4050-8a0c-dd1347231fe4-kube-api-access-8l8nd\") pod \"f9399a82-7bf3-4050-8a0c-dd1347231fe4\" (UID: \"f9399a82-7bf3-4050-8a0c-dd1347231fe4\") "
Oct 30 20:49:59.054282 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:49:59.054255    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/f9399a82-7bf3-4050-8a0c-dd1347231fe4-monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/f9399a82-7bf3-4050-8a0c-dd1347231fe4-monitoring-tls-certs\") pod \"f9399a82-7bf3-4050-8a0c-dd1347231fe4\" (UID: \"f9399a82-7bf3-4050-8a0c-dd1347231fe4\") "
Oct 30 20:49:59.054534 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:49:59.054479    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f9399a82-7bf3-4050-8a0c-dd1347231fe4-otc-internal" pod "f9399a82-7bf3-4050-8a0c-dd1347231fe4" (UID: "f9399a82-7bf3-4050-8a0c-dd1347231fe4"). InnerVolumeSpecName "otc-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:49:59.056258 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:49:59.056228    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f9399a82-7bf3-4050-8a0c-dd1347231fe4-data-science-collector-ta-client-cert" pod "f9399a82-7bf3-4050-8a0c-dd1347231fe4" (UID: "f9399a82-7bf3-4050-8a0c-dd1347231fe4"). InnerVolumeSpecName "data-science-collector-ta-client-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:49:59.056390 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:49:59.056324    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f9399a82-7bf3-4050-8a0c-dd1347231fe4-otlp-tls-certs" pod "f9399a82-7bf3-4050-8a0c-dd1347231fe4" (UID: "f9399a82-7bf3-4050-8a0c-dd1347231fe4"). InnerVolumeSpecName "otlp-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:49:59.056450 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:49:59.056433    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f9399a82-7bf3-4050-8a0c-dd1347231fe4-kube-api-access-8l8nd" pod "f9399a82-7bf3-4050-8a0c-dd1347231fe4" (UID: "f9399a82-7bf3-4050-8a0c-dd1347231fe4"). InnerVolumeSpecName "kube-api-access-8l8nd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:49:59.056504 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:49:59.056437    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f9399a82-7bf3-4050-8a0c-dd1347231fe4-monitoring-tls-certs" pod "f9399a82-7bf3-4050-8a0c-dd1347231fe4" (UID: "f9399a82-7bf3-4050-8a0c-dd1347231fe4"). InnerVolumeSpecName "monitoring-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:49:59.155058 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:49:59.155022    4060 reconciler_common.go:299] "Volume detached for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/f9399a82-7bf3-4050-8a0c-dd1347231fe4-otlp-tls-certs\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:49:59.155058 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:49:59.155052    4060 reconciler_common.go:299] "Volume detached for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/f9399a82-7bf3-4050-8a0c-dd1347231fe4-otc-internal\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:49:59.155058 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:49:59.155063    4060 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/f9399a82-7bf3-4050-8a0c-dd1347231fe4-data-science-collector-ta-client-cert\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:49:59.155275 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:49:59.155073    4060 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8l8nd\" (UniqueName: \"kubernetes.io/projected/f9399a82-7bf3-4050-8a0c-dd1347231fe4-kube-api-access-8l8nd\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:49:59.155275 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:49:59.155084    4060 reconciler_common.go:299] "Volume detached for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/f9399a82-7bf3-4050-8a0c-dd1347231fe4-monitoring-tls-certs\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:49:59.581302 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:49:59.581273    4060 generic.go:356] "Generic (PLEG): container finished" podID="f9399a82-7bf3-4050-8a0c-dd1347231fe4" containerID="af4a1d96ba1952f81d301d0a3b5729e038e8111f3521132ca5be3d4f22ff0a7f" exitCode=0
Oct 30 20:49:59.581459 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:49:59.581322    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:49:59.581459 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:49:59.581358    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"f9399a82-7bf3-4050-8a0c-dd1347231fe4","Type":"ContainerDied","Data":"af4a1d96ba1952f81d301d0a3b5729e038e8111f3521132ca5be3d4f22ff0a7f"}
Oct 30 20:49:59.581459 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:49:59.581410    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"f9399a82-7bf3-4050-8a0c-dd1347231fe4","Type":"ContainerDied","Data":"ff78bda1fead6ceb00a5c2ad6faa3d20495e98c1b59817f976a86a8f2f8a1a50"}
Oct 30 20:49:59.581459 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:49:59.581430    4060 scope.go:122] "RemoveContainer" containerID="af4a1d96ba1952f81d301d0a3b5729e038e8111f3521132ca5be3d4f22ff0a7f"
Oct 30 20:49:59.589617 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:49:59.589600    4060 scope.go:122] "RemoveContainer" containerID="af4a1d96ba1952f81d301d0a3b5729e038e8111f3521132ca5be3d4f22ff0a7f"
Oct 30 20:49:59.589870 ip-10-0-142-4 kubenswrapper[4060]: E1030 20:49:59.589854    4060 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"af4a1d96ba1952f81d301d0a3b5729e038e8111f3521132ca5be3d4f22ff0a7f\": container with ID starting with af4a1d96ba1952f81d301d0a3b5729e038e8111f3521132ca5be3d4f22ff0a7f not found: ID does not exist" containerID="af4a1d96ba1952f81d301d0a3b5729e038e8111f3521132ca5be3d4f22ff0a7f"
Oct 30 20:49:59.589918 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:49:59.589878    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af4a1d96ba1952f81d301d0a3b5729e038e8111f3521132ca5be3d4f22ff0a7f"} err="failed to get container status \"af4a1d96ba1952f81d301d0a3b5729e038e8111f3521132ca5be3d4f22ff0a7f\": rpc error: code = NotFound desc = could not find container \"af4a1d96ba1952f81d301d0a3b5729e038e8111f3521132ca5be3d4f22ff0a7f\": container with ID starting with af4a1d96ba1952f81d301d0a3b5729e038e8111f3521132ca5be3d4f22ff0a7f not found: ID does not exist"
Oct 30 20:49:59.746671 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:49:59.746640    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 20:49:59.753250 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:49:59.753230    4060 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 20:50:01.426748 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:50:01.426718    4060 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f9399a82-7bf3-4050-8a0c-dd1347231fe4" path="/var/lib/kubelet/pods/f9399a82-7bf3-4050-8a0c-dd1347231fe4/volumes"
Oct 30 20:50:12.150663 ip-10-0-142-4 kubenswrapper[4060]: E1030 20:50:12.150619    4060 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v2f4x" containerName="extractor"
Oct 30 20:50:13.554617 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:50:13.554581    4060 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-m4nwx"]
Oct 30 20:50:13.555004 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:50:13.554865    4060 cpu_manager.go:414] "containerMap: removing container" podUID="f9399a82-7bf3-4050-8a0c-dd1347231fe4" containerName="otc-container"
Oct 30 20:50:13.555004 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:50:13.554876    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f9399a82-7bf3-4050-8a0c-dd1347231fe4" containerName="otc-container"
Oct 30 20:50:13.555004 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:50:13.554904    4060 cpu_manager.go:414] "containerMap: removing container" podUID="70d17cfb-0718-4f4a-bc15-859fb8f13c5c" containerName="korrel8r"
Oct 30 20:50:13.555004 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:50:13.554909    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="70d17cfb-0718-4f4a-bc15-859fb8f13c5c" containerName="korrel8r"
Oct 30 20:50:13.555004 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:50:13.554962    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="f9399a82-7bf3-4050-8a0c-dd1347231fe4" containerName="otc-container"
Oct 30 20:50:13.555004 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:50:13.554972    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="70d17cfb-0718-4f4a-bc15-859fb8f13c5c" containerName="korrel8r"
Oct 30 20:50:13.557874 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:50:13.557858    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-m4nwx"
Oct 30 20:50:13.613855 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:50:13.613820    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"prometheus-web-tls-ca\""
Oct 30 20:50:13.614033 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:50:13.613908    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-prometheus-cluster-proxy-kube-rbac-proxy\""
Oct 30 20:50:13.663229 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:50:13.663199    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"openshift-service-ca.crt\""
Oct 30 20:50:13.663515 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:50:13.663469    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"prometheus-operated-tls\""
Oct 30 20:50:13.663593 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:50:13.663575    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-prometheus-cluster-proxy-dockercfg-bf69m\""
Oct 30 20:50:13.663636 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:50:13.663582    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-prometheus-cluster-proxy-tls\""
Oct 30 20:50:13.679885 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:50:13.679850    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/38d3a608-9681-4a78-9cce-b354c5ac720f-kube-rbac-proxy-config\") pod \"data-science-prometheus-cluster-proxy-545f759f7c-m4nwx\" (UID: \"38d3a608-9681-4a78-9cce-b354c5ac720f\") " pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-m4nwx"
Oct 30 20:50:13.680035 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:50:13.679886    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-ca\" (UniqueName: \"kubernetes.io/configmap/38d3a608-9681-4a78-9cce-b354c5ac720f-prometheus-ca\") pod \"data-science-prometheus-cluster-proxy-545f759f7c-m4nwx\" (UID: \"38d3a608-9681-4a78-9cce-b354c5ac720f\") " pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-m4nwx"
Oct 30 20:50:13.680035 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:50:13.679915    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g2nzg\" (UniqueName: \"kubernetes.io/projected/38d3a608-9681-4a78-9cce-b354c5ac720f-kube-api-access-g2nzg\") pod \"data-science-prometheus-cluster-proxy-545f759f7c-m4nwx\" (UID: \"38d3a608-9681-4a78-9cce-b354c5ac720f\") " pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-m4nwx"
Oct 30 20:50:13.680128 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:50:13.680070    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/38d3a608-9681-4a78-9cce-b354c5ac720f-tls\") pod \"data-science-prometheus-cluster-proxy-545f759f7c-m4nwx\" (UID: \"38d3a608-9681-4a78-9cce-b354c5ac720f\") " pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-m4nwx"
Oct 30 20:50:13.680164 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:50:13.680133    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-client-cert\" (UniqueName: \"kubernetes.io/secret/38d3a608-9681-4a78-9cce-b354c5ac720f-prometheus-client-cert\") pod \"data-science-prometheus-cluster-proxy-545f759f7c-m4nwx\" (UID: \"38d3a608-9681-4a78-9cce-b354c5ac720f\") " pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-m4nwx"
Oct 30 20:50:13.704432 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:50:13.704402    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"kube-root-ca.crt\""
Oct 30 20:50:13.714930 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:50:13.714906    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-m4nwx"]
Oct 30 20:50:13.716590 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:50:13.716569    4060 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-prometheus-namespace-proxy-66dfd66cdb-jgp9k"]
Oct 30 20:50:13.720194 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:50:13.720173    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-prometheus-namespace-proxy-66dfd66cdb-jgp9k"
Oct 30 20:50:13.739404 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:50:13.739374    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-prometheus-namespace-proxy-66dfd66cdb-jgp9k"]
Oct 30 20:50:13.774735 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:50:13.774694    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-prometheus-namespace-proxy-dockercfg-9mstv\""
Oct 30 20:50:13.774735 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:50:13.774716    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-prometheus-namespace-proxy-tls\""
Oct 30 20:50:13.774971 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:50:13.774741    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"prometheus-client-ca\""
Oct 30 20:50:13.774971 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:50:13.774863    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-prometheus-namespace-proxy-config\""
Oct 30 20:50:13.781177 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:50:13.781152    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/38d3a608-9681-4a78-9cce-b354c5ac720f-tls\") pod \"data-science-prometheus-cluster-proxy-545f759f7c-m4nwx\" (UID: \"38d3a608-9681-4a78-9cce-b354c5ac720f\") " pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-m4nwx"
Oct 30 20:50:13.781438 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:50:13.781210    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-client-cert\" (UniqueName: \"kubernetes.io/secret/38d3a608-9681-4a78-9cce-b354c5ac720f-prometheus-client-cert\") pod \"data-science-prometheus-cluster-proxy-545f759f7c-m4nwx\" (UID: \"38d3a608-9681-4a78-9cce-b354c5ac720f\") " pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-m4nwx"
Oct 30 20:50:13.781438 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:50:13.781273    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/38d3a608-9681-4a78-9cce-b354c5ac720f-kube-rbac-proxy-config\") pod \"data-science-prometheus-cluster-proxy-545f759f7c-m4nwx\" (UID: \"38d3a608-9681-4a78-9cce-b354c5ac720f\") " pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-m4nwx"
Oct 30 20:50:13.781438 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:50:13.781298    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-ca\" (UniqueName: \"kubernetes.io/configmap/38d3a608-9681-4a78-9cce-b354c5ac720f-prometheus-ca\") pod \"data-science-prometheus-cluster-proxy-545f759f7c-m4nwx\" (UID: \"38d3a608-9681-4a78-9cce-b354c5ac720f\") " pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-m4nwx"
Oct 30 20:50:13.781438 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:50:13.781324    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g2nzg\" (UniqueName: \"kubernetes.io/projected/38d3a608-9681-4a78-9cce-b354c5ac720f-kube-api-access-g2nzg\") pod \"data-science-prometheus-cluster-proxy-545f759f7c-m4nwx\" (UID: \"38d3a608-9681-4a78-9cce-b354c5ac720f\") " pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-m4nwx"
Oct 30 20:50:13.782074 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:50:13.782053    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-ca\" (UniqueName: \"kubernetes.io/configmap/38d3a608-9681-4a78-9cce-b354c5ac720f-prometheus-ca\") pod \"data-science-prometheus-cluster-proxy-545f759f7c-m4nwx\" (UID: \"38d3a608-9681-4a78-9cce-b354c5ac720f\") " pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-m4nwx"
Oct 30 20:50:13.783833 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:50:13.783813    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls\" (UniqueName: \"kubernetes.io/secret/38d3a608-9681-4a78-9cce-b354c5ac720f-tls\") pod \"data-science-prometheus-cluster-proxy-545f759f7c-m4nwx\" (UID: \"38d3a608-9681-4a78-9cce-b354c5ac720f\") " pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-m4nwx"
Oct 30 20:50:13.783940 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:50:13.783905    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/38d3a608-9681-4a78-9cce-b354c5ac720f-kube-rbac-proxy-config\") pod \"data-science-prometheus-cluster-proxy-545f759f7c-m4nwx\" (UID: \"38d3a608-9681-4a78-9cce-b354c5ac720f\") " pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-m4nwx"
Oct 30 20:50:13.784011 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:50:13.783941    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-client-cert\" (UniqueName: \"kubernetes.io/secret/38d3a608-9681-4a78-9cce-b354c5ac720f-prometheus-client-cert\") pod \"data-science-prometheus-cluster-proxy-545f759f7c-m4nwx\" (UID: \"38d3a608-9681-4a78-9cce-b354c5ac720f\") " pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-m4nwx"
Oct 30 20:50:13.844569 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:50:13.844487    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g2nzg\" (UniqueName: \"kubernetes.io/projected/38d3a608-9681-4a78-9cce-b354c5ac720f-kube-api-access-g2nzg\") pod \"data-science-prometheus-cluster-proxy-545f759f7c-m4nwx\" (UID: \"38d3a608-9681-4a78-9cce-b354c5ac720f\") " pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-m4nwx"
Oct 30 20:50:13.870158 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:50:13.870127    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-m4nwx"
Oct 30 20:50:13.882414 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:50:13.882376    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-tls-ca\" (UniqueName: \"kubernetes.io/configmap/05e20f5e-4bd4-4095-8fe6-1d00b118c8cf-prometheus-tls-ca\") pod \"data-science-prometheus-namespace-proxy-66dfd66cdb-jgp9k\" (UID: \"05e20f5e-4bd4-4095-8fe6-1d00b118c8cf\") " pod="redhat-ods-monitoring/data-science-prometheus-namespace-proxy-66dfd66cdb-jgp9k"
Oct 30 20:50:13.882559 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:50:13.882425    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/05e20f5e-4bd4-4095-8fe6-1d00b118c8cf-tls\") pod \"data-science-prometheus-namespace-proxy-66dfd66cdb-jgp9k\" (UID: \"05e20f5e-4bd4-4095-8fe6-1d00b118c8cf\") " pod="redhat-ods-monitoring/data-science-prometheus-namespace-proxy-66dfd66cdb-jgp9k"
Oct 30 20:50:13.882631 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:50:13.882562    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/05e20f5e-4bd4-4095-8fe6-1d00b118c8cf-config\") pod \"data-science-prometheus-namespace-proxy-66dfd66cdb-jgp9k\" (UID: \"05e20f5e-4bd4-4095-8fe6-1d00b118c8cf\") " pod="redhat-ods-monitoring/data-science-prometheus-namespace-proxy-66dfd66cdb-jgp9k"
Oct 30 20:50:13.882631 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:50:13.882620    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ctj5q\" (UniqueName: \"kubernetes.io/projected/05e20f5e-4bd4-4095-8fe6-1d00b118c8cf-kube-api-access-ctj5q\") pod \"data-science-prometheus-namespace-proxy-66dfd66cdb-jgp9k\" (UID: \"05e20f5e-4bd4-4095-8fe6-1d00b118c8cf\") " pod="redhat-ods-monitoring/data-science-prometheus-namespace-proxy-66dfd66cdb-jgp9k"
Oct 30 20:50:13.882735 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:50:13.882667    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/05e20f5e-4bd4-4095-8fe6-1d00b118c8cf-client-ca\") pod \"data-science-prometheus-namespace-proxy-66dfd66cdb-jgp9k\" (UID: \"05e20f5e-4bd4-4095-8fe6-1d00b118c8cf\") " pod="redhat-ods-monitoring/data-science-prometheus-namespace-proxy-66dfd66cdb-jgp9k"
Oct 30 20:50:13.897344 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:50:13.897319    4060 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/korrel8r-5cbcc89b8f-qrz8v"]
Oct 30 20:50:13.900560 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:50:13.900541    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-qrz8v"
Oct 30 20:50:13.960580 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:50:13.960542    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/korrel8r-5cbcc89b8f-qrz8v"]
Oct 30 20:50:13.973976 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:50:13.973929    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"korrel8r-dockercfg-8d997\""
Oct 30 20:50:13.974242 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:50:13.974012    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"korrel8r-tls\""
Oct 30 20:50:13.975481 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:50:13.975467    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"korrel8r-config\""
Oct 30 20:50:13.983857 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:50:13.983831    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/05e20f5e-4bd4-4095-8fe6-1d00b118c8cf-config\") pod \"data-science-prometheus-namespace-proxy-66dfd66cdb-jgp9k\" (UID: \"05e20f5e-4bd4-4095-8fe6-1d00b118c8cf\") " pod="redhat-ods-monitoring/data-science-prometheus-namespace-proxy-66dfd66cdb-jgp9k"
Oct 30 20:50:13.983933 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:50:13.983866    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/072f3bfe-ceb8-444d-8f77-780030601722-tls\") pod \"korrel8r-5cbcc89b8f-qrz8v\" (UID: \"072f3bfe-ceb8-444d-8f77-780030601722\") " pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-qrz8v"
Oct 30 20:50:13.983933 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:50:13.983896    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ctj5q\" (UniqueName: \"kubernetes.io/projected/05e20f5e-4bd4-4095-8fe6-1d00b118c8cf-kube-api-access-ctj5q\") pod \"data-science-prometheus-namespace-proxy-66dfd66cdb-jgp9k\" (UID: \"05e20f5e-4bd4-4095-8fe6-1d00b118c8cf\") " pod="redhat-ods-monitoring/data-science-prometheus-namespace-proxy-66dfd66cdb-jgp9k"
Oct 30 20:50:13.984014 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:50:13.983960    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/05e20f5e-4bd4-4095-8fe6-1d00b118c8cf-client-ca\") pod \"data-science-prometheus-namespace-proxy-66dfd66cdb-jgp9k\" (UID: \"05e20f5e-4bd4-4095-8fe6-1d00b118c8cf\") " pod="redhat-ods-monitoring/data-science-prometheus-namespace-proxy-66dfd66cdb-jgp9k"
Oct 30 20:50:13.984014 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:50:13.983996    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/072f3bfe-ceb8-444d-8f77-780030601722-config\") pod \"korrel8r-5cbcc89b8f-qrz8v\" (UID: \"072f3bfe-ceb8-444d-8f77-780030601722\") " pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-qrz8v"
Oct 30 20:50:13.984117 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:50:13.984096    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kzfrt\" (UniqueName: \"kubernetes.io/projected/072f3bfe-ceb8-444d-8f77-780030601722-kube-api-access-kzfrt\") pod \"korrel8r-5cbcc89b8f-qrz8v\" (UID: \"072f3bfe-ceb8-444d-8f77-780030601722\") " pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-qrz8v"
Oct 30 20:50:13.984164 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:50:13.984136    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-tls-ca\" (UniqueName: \"kubernetes.io/configmap/05e20f5e-4bd4-4095-8fe6-1d00b118c8cf-prometheus-tls-ca\") pod \"data-science-prometheus-namespace-proxy-66dfd66cdb-jgp9k\" (UID: \"05e20f5e-4bd4-4095-8fe6-1d00b118c8cf\") " pod="redhat-ods-monitoring/data-science-prometheus-namespace-proxy-66dfd66cdb-jgp9k"
Oct 30 20:50:13.984164 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:50:13.984154    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/05e20f5e-4bd4-4095-8fe6-1d00b118c8cf-tls\") pod \"data-science-prometheus-namespace-proxy-66dfd66cdb-jgp9k\" (UID: \"05e20f5e-4bd4-4095-8fe6-1d00b118c8cf\") " pod="redhat-ods-monitoring/data-science-prometheus-namespace-proxy-66dfd66cdb-jgp9k"
Oct 30 20:50:13.984518 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:50:13.984475    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/05e20f5e-4bd4-4095-8fe6-1d00b118c8cf-client-ca\") pod \"data-science-prometheus-namespace-proxy-66dfd66cdb-jgp9k\" (UID: \"05e20f5e-4bd4-4095-8fe6-1d00b118c8cf\") " pod="redhat-ods-monitoring/data-science-prometheus-namespace-proxy-66dfd66cdb-jgp9k"
Oct 30 20:50:13.984693 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:50:13.984673    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/05e20f5e-4bd4-4095-8fe6-1d00b118c8cf-config\") pod \"data-science-prometheus-namespace-proxy-66dfd66cdb-jgp9k\" (UID: \"05e20f5e-4bd4-4095-8fe6-1d00b118c8cf\") " pod="redhat-ods-monitoring/data-science-prometheus-namespace-proxy-66dfd66cdb-jgp9k"
Oct 30 20:50:13.984756 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:50:13.984674    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-tls-ca\" (UniqueName: \"kubernetes.io/configmap/05e20f5e-4bd4-4095-8fe6-1d00b118c8cf-prometheus-tls-ca\") pod \"data-science-prometheus-namespace-proxy-66dfd66cdb-jgp9k\" (UID: \"05e20f5e-4bd4-4095-8fe6-1d00b118c8cf\") " pod="redhat-ods-monitoring/data-science-prometheus-namespace-proxy-66dfd66cdb-jgp9k"
Oct 30 20:50:13.986419 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:50:13.986403    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls\" (UniqueName: \"kubernetes.io/secret/05e20f5e-4bd4-4095-8fe6-1d00b118c8cf-tls\") pod \"data-science-prometheus-namespace-proxy-66dfd66cdb-jgp9k\" (UID: \"05e20f5e-4bd4-4095-8fe6-1d00b118c8cf\") " pod="redhat-ods-monitoring/data-science-prometheus-namespace-proxy-66dfd66cdb-jgp9k"
Oct 30 20:50:14.046863 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:50:14.046837    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ctj5q\" (UniqueName: \"kubernetes.io/projected/05e20f5e-4bd4-4095-8fe6-1d00b118c8cf-kube-api-access-ctj5q\") pod \"data-science-prometheus-namespace-proxy-66dfd66cdb-jgp9k\" (UID: \"05e20f5e-4bd4-4095-8fe6-1d00b118c8cf\") " pod="redhat-ods-monitoring/data-science-prometheus-namespace-proxy-66dfd66cdb-jgp9k"
Oct 30 20:50:14.085473 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:50:14.085380    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/072f3bfe-ceb8-444d-8f77-780030601722-config\") pod \"korrel8r-5cbcc89b8f-qrz8v\" (UID: \"072f3bfe-ceb8-444d-8f77-780030601722\") " pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-qrz8v"
Oct 30 20:50:14.085625 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:50:14.085529    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kzfrt\" (UniqueName: \"kubernetes.io/projected/072f3bfe-ceb8-444d-8f77-780030601722-kube-api-access-kzfrt\") pod \"korrel8r-5cbcc89b8f-qrz8v\" (UID: \"072f3bfe-ceb8-444d-8f77-780030601722\") " pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-qrz8v"
Oct 30 20:50:14.085691 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:50:14.085637    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/072f3bfe-ceb8-444d-8f77-780030601722-tls\") pod \"korrel8r-5cbcc89b8f-qrz8v\" (UID: \"072f3bfe-ceb8-444d-8f77-780030601722\") " pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-qrz8v"
Oct 30 20:50:14.086047 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:50:14.086023    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/072f3bfe-ceb8-444d-8f77-780030601722-config\") pod \"korrel8r-5cbcc89b8f-qrz8v\" (UID: \"072f3bfe-ceb8-444d-8f77-780030601722\") " pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-qrz8v"
Oct 30 20:50:14.087886 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:50:14.087865    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls\" (UniqueName: \"kubernetes.io/secret/072f3bfe-ceb8-444d-8f77-780030601722-tls\") pod \"korrel8r-5cbcc89b8f-qrz8v\" (UID: \"072f3bfe-ceb8-444d-8f77-780030601722\") " pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-qrz8v"
Oct 30 20:50:14.146465 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:50:14.146410    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kzfrt\" (UniqueName: \"kubernetes.io/projected/072f3bfe-ceb8-444d-8f77-780030601722-kube-api-access-kzfrt\") pod \"korrel8r-5cbcc89b8f-qrz8v\" (UID: \"072f3bfe-ceb8-444d-8f77-780030601722\") " pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-qrz8v"
Oct 30 20:50:14.214623 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:50:14.214589    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-qrz8v"
Oct 30 20:50:14.251913 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:50:14.251869    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-m4nwx"]
Oct 30 20:50:14.254344 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:50:14.254312    4060 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38d3a608_9681_4a78_9cce_b354c5ac720f.slice/crio-da27e06089cfe90d9fb4393c506eedd5a0d9ca79bb3771020a12699af4e75578 WatchSource:0}: Error finding container da27e06089cfe90d9fb4393c506eedd5a0d9ca79bb3771020a12699af4e75578: Status 404 returned error can't find the container with id da27e06089cfe90d9fb4393c506eedd5a0d9ca79bb3771020a12699af4e75578
Oct 30 20:50:14.337339 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:50:14.337307    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-prometheus-namespace-proxy-66dfd66cdb-jgp9k"
Oct 30 20:50:14.586756 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:50:14.586723    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/korrel8r-5cbcc89b8f-qrz8v"]
Oct 30 20:50:14.588943 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:50:14.588900    4060 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod072f3bfe_ceb8_444d_8f77_780030601722.slice/crio-6fe40e1a7ab991d3019bad8173e3e8e528035fd5dd01fe533385630f9c53aae9 WatchSource:0}: Error finding container 6fe40e1a7ab991d3019bad8173e3e8e528035fd5dd01fe533385630f9c53aae9: Status 404 returned error can't find the container with id 6fe40e1a7ab991d3019bad8173e3e8e528035fd5dd01fe533385630f9c53aae9
Oct 30 20:50:14.658770 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:50:14.658735    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-m4nwx" event={"ID":"38d3a608-9681-4a78-9cce-b354c5ac720f","Type":"ContainerStarted","Data":"da27e06089cfe90d9fb4393c506eedd5a0d9ca79bb3771020a12699af4e75578"}
Oct 30 20:50:14.660348 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:50:14.660322    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-qrz8v" event={"ID":"072f3bfe-ceb8-444d-8f77-780030601722","Type":"ContainerStarted","Data":"db63e9016e7b4653c72ae738f6e161c1fcf7351467876673594adc857cedaab7"}
Oct 30 20:50:14.660459 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:50:14.660370    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-qrz8v" event={"ID":"072f3bfe-ceb8-444d-8f77-780030601722","Type":"ContainerStarted","Data":"6fe40e1a7ab991d3019bad8173e3e8e528035fd5dd01fe533385630f9c53aae9"}
Oct 30 20:50:14.660553 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:50:14.660539    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-qrz8v"
Oct 30 20:50:14.711721 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:50:14.711701    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-prometheus-namespace-proxy-66dfd66cdb-jgp9k"]
Oct 30 20:50:14.714062 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:50:14.714036    4060 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05e20f5e_4bd4_4095_8fe6_1d00b118c8cf.slice/crio-b148ac38b11f82ee5525ff2593d5b4b26b7de381c4d2b3a9464e138b0bdd97f6 WatchSource:0}: Error finding container b148ac38b11f82ee5525ff2593d5b4b26b7de381c4d2b3a9464e138b0bdd97f6: Status 404 returned error can't find the container with id b148ac38b11f82ee5525ff2593d5b4b26b7de381c4d2b3a9464e138b0bdd97f6
Oct 30 20:50:14.777776 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:50:14.777726    4060 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-qrz8v" podStartSLOduration=1.777711947 podStartE2EDuration="1.777711947s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:50:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:50:14.775954656 +0000 UTC m=+833.532952968" watchObservedRunningTime="2026-10-30 20:50:14.777711947 +0000 UTC m=+833.534710400"
Oct 30 20:50:15.666432 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:50:15.666393    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-prometheus-namespace-proxy-66dfd66cdb-jgp9k" event={"ID":"05e20f5e-4bd4-4095-8fe6-1d00b118c8cf","Type":"ContainerStarted","Data":"b148ac38b11f82ee5525ff2593d5b4b26b7de381c4d2b3a9464e138b0bdd97f6"}
Oct 30 20:50:18.396838 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:50:18.396806    4060 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 20:50:18.400146 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:50:18.400129    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:50:18.457543 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:50:18.457488    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-a0f9182a\""
Oct 30 20:50:18.506744 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:50:18.506713    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-headless-tls\""
Oct 30 20:50:18.506956 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:50:18.506813    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-ta-client-cert\""
Oct 30 20:50:18.506956 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:50:18.506850    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-monitoring-tls\""
Oct 30 20:50:18.506956 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:50:18.506930    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-tls\""
Oct 30 20:50:18.509157 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:50:18.509132    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 20:50:18.524309 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:50:18.524277    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/a45734fd-1c12-4eb5-b572-41a0d3637e46-monitoring-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"a45734fd-1c12-4eb5-b572-41a0d3637e46\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:50:18.524487 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:50:18.524398    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8r7bg\" (UniqueName: \"kubernetes.io/projected/a45734fd-1c12-4eb5-b572-41a0d3637e46-kube-api-access-8r7bg\") pod \"data-science-collector-collector-0\" (UID: \"a45734fd-1c12-4eb5-b572-41a0d3637e46\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:50:18.524487 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:50:18.524449    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/a45734fd-1c12-4eb5-b572-41a0d3637e46-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-0\" (UID: \"a45734fd-1c12-4eb5-b572-41a0d3637e46\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:50:18.524625 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:50:18.524539    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a45734fd-1c12-4eb5-b572-41a0d3637e46-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"a45734fd-1c12-4eb5-b572-41a0d3637e46\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:50:18.524676 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:50:18.524643    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/a45734fd-1c12-4eb5-b572-41a0d3637e46-otc-internal\") pod \"data-science-collector-collector-0\" (UID: \"a45734fd-1c12-4eb5-b572-41a0d3637e46\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:50:18.524756 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:50:18.524736    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/a45734fd-1c12-4eb5-b572-41a0d3637e46-otlp-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"a45734fd-1c12-4eb5-b572-41a0d3637e46\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:50:18.625973 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:50:18.625938    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/a45734fd-1c12-4eb5-b572-41a0d3637e46-otlp-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"a45734fd-1c12-4eb5-b572-41a0d3637e46\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:50:18.626168 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:50:18.625985    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/a45734fd-1c12-4eb5-b572-41a0d3637e46-monitoring-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"a45734fd-1c12-4eb5-b572-41a0d3637e46\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:50:18.626168 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:50:18.626026    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8r7bg\" (UniqueName: \"kubernetes.io/projected/a45734fd-1c12-4eb5-b572-41a0d3637e46-kube-api-access-8r7bg\") pod \"data-science-collector-collector-0\" (UID: \"a45734fd-1c12-4eb5-b572-41a0d3637e46\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:50:18.626168 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:50:18.626053    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/a45734fd-1c12-4eb5-b572-41a0d3637e46-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-0\" (UID: \"a45734fd-1c12-4eb5-b572-41a0d3637e46\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:50:18.626168 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:50:18.626090    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a45734fd-1c12-4eb5-b572-41a0d3637e46-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"a45734fd-1c12-4eb5-b572-41a0d3637e46\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:50:18.626168 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:50:18.626115    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/a45734fd-1c12-4eb5-b572-41a0d3637e46-otc-internal\") pod \"data-science-collector-collector-0\" (UID: \"a45734fd-1c12-4eb5-b572-41a0d3637e46\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:50:18.626168 ip-10-0-142-4 kubenswrapper[4060]: E1030 20:50:18.626118    4060 secret.go:189] Couldn't get secret redhat-ods-monitoring/data-science-collector-collector-headless-tls: secret "data-science-collector-collector-headless-tls" not found
Oct 30 20:50:18.628263 ip-10-0-142-4 kubenswrapper[4060]: E1030 20:50:18.626194    4060 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a45734fd-1c12-4eb5-b572-41a0d3637e46-otlp-tls-certs podName:a45734fd-1c12-4eb5-b572-41a0d3637e46 nodeName:}" failed. No retries permitted until 2026-10-30 20:50:19.126172703 +0000 UTC m=+837.883170993 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "otlp-tls-certs" (UniqueName: "kubernetes.io/secret/a45734fd-1c12-4eb5-b572-41a0d3637e46-otlp-tls-certs") pod "data-science-collector-collector-0" (UID: "a45734fd-1c12-4eb5-b572-41a0d3637e46") : secret "data-science-collector-collector-headless-tls" not found
Oct 30 20:50:18.628263 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:50:18.626920    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/a45734fd-1c12-4eb5-b572-41a0d3637e46-otc-internal\") pod \"data-science-collector-collector-0\" (UID: \"a45734fd-1c12-4eb5-b572-41a0d3637e46\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:50:18.629171 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:50:18.629126    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/a45734fd-1c12-4eb5-b572-41a0d3637e46-monitoring-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"a45734fd-1c12-4eb5-b572-41a0d3637e46\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:50:18.629292 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:50:18.629268    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/a45734fd-1c12-4eb5-b572-41a0d3637e46-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-0\" (UID: \"a45734fd-1c12-4eb5-b572-41a0d3637e46\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:50:18.629592 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:50:18.629573    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a45734fd-1c12-4eb5-b572-41a0d3637e46-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"a45734fd-1c12-4eb5-b572-41a0d3637e46\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:50:18.688851 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:50:18.688784    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8r7bg\" (UniqueName: \"kubernetes.io/projected/a45734fd-1c12-4eb5-b572-41a0d3637e46-kube-api-access-8r7bg\") pod \"data-science-collector-collector-0\" (UID: \"a45734fd-1c12-4eb5-b572-41a0d3637e46\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:50:19.130080 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:50:19.130037    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/a45734fd-1c12-4eb5-b572-41a0d3637e46-otlp-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"a45734fd-1c12-4eb5-b572-41a0d3637e46\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:50:19.132445 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:50:19.132423    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/a45734fd-1c12-4eb5-b572-41a0d3637e46-otlp-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"a45734fd-1c12-4eb5-b572-41a0d3637e46\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:50:19.313825 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:50:19.313788    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:50:19.705792 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:50:19.705764    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 20:50:19.735201 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:50:19.735163    4060 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda45734fd_1c12_4eb5_b572_41a0d3637e46.slice/crio-5e751bd27a8163de164232faf79a67d30ffb161b1f04014f2d1e2f536728d927 WatchSource:0}: Error finding container 5e751bd27a8163de164232faf79a67d30ffb161b1f04014f2d1e2f536728d927: Status 404 returned error can't find the container with id 5e751bd27a8163de164232faf79a67d30ffb161b1f04014f2d1e2f536728d927
Oct 30 20:50:19.737483 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:50:19.737448    4060 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 20:50:19.737613 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:50:19.737544    4060 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 20:50:20.694400 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:50:20.694371    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-prometheus-namespace-proxy-66dfd66cdb-jgp9k" event={"ID":"05e20f5e-4bd4-4095-8fe6-1d00b118c8cf","Type":"ContainerStarted","Data":"a299faaf3b79721aa6a7016165f068bdac9cc3a7d1f777d4fa89b215ebcc113f"}
Oct 30 20:50:20.694558 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:50:20.694462    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-prometheus-namespace-proxy-66dfd66cdb-jgp9k" event={"ID":"05e20f5e-4bd4-4095-8fe6-1d00b118c8cf","Type":"ContainerStarted","Data":"6d0467d0a7a85db097caae5dd1e3f1c6113c573ee40120ca310ce6fc1fb10be2"}
Oct 30 20:50:20.696018 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:50:20.695988    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"a45734fd-1c12-4eb5-b572-41a0d3637e46","Type":"ContainerStarted","Data":"6576410ccbc58ae29dea4146f0fb40f8746964bde081d008d1a91b1756b371b9"}
Oct 30 20:50:20.696139 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:50:20.696034    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"a45734fd-1c12-4eb5-b572-41a0d3637e46","Type":"ContainerStarted","Data":"5e751bd27a8163de164232faf79a67d30ffb161b1f04014f2d1e2f536728d927"}
Oct 30 20:50:20.867524 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:50:20.867408    4060 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-collector-0" podStartSLOduration=2.867394022 podStartE2EDuration="2.867394022s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:50:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:50:20.865276086 +0000 UTC m=+839.622274419" watchObservedRunningTime="2026-10-30 20:50:20.867394022 +0000 UTC m=+839.624392320"
Oct 30 20:50:21.702873 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:50:21.702782    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-m4nwx" event={"ID":"38d3a608-9681-4a78-9cce-b354c5ac720f","Type":"ContainerStarted","Data":"2179e6ee811e72a3d5f6894cfcb86c6497ea0e4b53cab2f3d099dacaa26353d9"}
Oct 30 20:50:21.703200 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:50:21.703176    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-m4nwx"
Oct 30 20:50:21.820544 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:50:21.820409    4060 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-m4nwx" podStartSLOduration=2.554257025 podStartE2EDuration="8.820393593s" totalImagesPullingTime="6.266136568s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:50:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:50:21.820025442 +0000 UTC m=+840.577023740" watchObservedRunningTime="2026-10-30 20:50:21.820393593 +0000 UTC m=+840.577391890"
Oct 30 20:50:23.714337 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:50:23.714304    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-prometheus-namespace-proxy-66dfd66cdb-jgp9k" event={"ID":"05e20f5e-4bd4-4095-8fe6-1d00b118c8cf","Type":"ContainerStarted","Data":"87d80d195cdb01158691d6786d96e5355346386fa08a6f41ee7df6a077158ea8"}
Oct 30 20:50:23.837162 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:50:23.837112    4060 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-prometheus-namespace-proxy-66dfd66cdb-jgp9k" podStartSLOduration=2.764179585 podStartE2EDuration="10.837097535s" totalImagesPullingTime="8.07291795s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:50:13 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:50:23.836473488 +0000 UTC m=+842.593471785" watchObservedRunningTime="2026-10-30 20:50:23.837097535 +0000 UTC m=+842.594095833"
Oct 30 20:50:25.669060 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:50:25.669024    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-qrz8v"
Oct 30 20:50:28.716943 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:50:28.716915    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-m4nwx"
Oct 30 20:50:32.460850 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:50:32.460813    4060 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"]
Oct 30 20:50:32.464677 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:50:32.464658    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 20:50:32.519782 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:50:32.519758    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"alertmanager-data-science-monitoringstack-web-config\""
Oct 30 20:50:32.519782 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:50:32.519764    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"alertmanager-data-science-monitoringstack-tls-assets-0\""
Oct 30 20:50:32.519782 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:50:32.519777    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"alertmanager-data-science-monitoringstack-generated\""
Oct 30 20:50:32.519782 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:50:32.519761    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"alertmanager-data-science-monitoringstack-cluster-tls-config\""
Oct 30 20:50:32.539296 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:50:32.539272    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-data-science-monitoringstack-db\" (UniqueName: \"kubernetes.io/empty-dir/d5b95904-51b0-4fb3-b957-2f5cf1d0eb06-alertmanager-data-science-monitoringstack-db\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"d5b95904-51b0-4fb3-b957-2f5cf1d0eb06\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 20:50:32.539385 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:50:32.539305    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2wth6\" (UniqueName: \"kubernetes.io/projected/d5b95904-51b0-4fb3-b957-2f5cf1d0eb06-kube-api-access-2wth6\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"d5b95904-51b0-4fb3-b957-2f5cf1d0eb06\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 20:50:32.539429 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:50:32.539382    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d5b95904-51b0-4fb3-b957-2f5cf1d0eb06-tls-assets\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"d5b95904-51b0-4fb3-b957-2f5cf1d0eb06\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 20:50:32.539475 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:50:32.539430    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d5b95904-51b0-4fb3-b957-2f5cf1d0eb06-cluster-tls-config\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"d5b95904-51b0-4fb3-b957-2f5cf1d0eb06\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 20:50:32.539475 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:50:32.539454    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d5b95904-51b0-4fb3-b957-2f5cf1d0eb06-config-out\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"d5b95904-51b0-4fb3-b957-2f5cf1d0eb06\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 20:50:32.539590 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:50:32.539502    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d5b95904-51b0-4fb3-b957-2f5cf1d0eb06-web-config\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"d5b95904-51b0-4fb3-b957-2f5cf1d0eb06\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 20:50:32.539628 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:50:32.539605    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d5b95904-51b0-4fb3-b957-2f5cf1d0eb06-config-volume\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"d5b95904-51b0-4fb3-b957-2f5cf1d0eb06\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 20:50:32.568614 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:50:32.568581    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-monitoringstack-alertmanager-dockercfg-l4l28\""
Oct 30 20:50:32.573286 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:50:32.573253    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"]
Oct 30 20:50:32.640260 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:50:32.640179    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-data-science-monitoringstack-db\" (UniqueName: \"kubernetes.io/empty-dir/d5b95904-51b0-4fb3-b957-2f5cf1d0eb06-alertmanager-data-science-monitoringstack-db\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"d5b95904-51b0-4fb3-b957-2f5cf1d0eb06\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 20:50:32.640260 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:50:32.640209    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2wth6\" (UniqueName: \"kubernetes.io/projected/d5b95904-51b0-4fb3-b957-2f5cf1d0eb06-kube-api-access-2wth6\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"d5b95904-51b0-4fb3-b957-2f5cf1d0eb06\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 20:50:32.640260 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:50:32.640243    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d5b95904-51b0-4fb3-b957-2f5cf1d0eb06-tls-assets\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"d5b95904-51b0-4fb3-b957-2f5cf1d0eb06\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 20:50:32.640572 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:50:32.640427    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d5b95904-51b0-4fb3-b957-2f5cf1d0eb06-cluster-tls-config\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"d5b95904-51b0-4fb3-b957-2f5cf1d0eb06\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 20:50:32.640572 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:50:32.640483    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d5b95904-51b0-4fb3-b957-2f5cf1d0eb06-config-out\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"d5b95904-51b0-4fb3-b957-2f5cf1d0eb06\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 20:50:32.640572 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:50:32.640534    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d5b95904-51b0-4fb3-b957-2f5cf1d0eb06-web-config\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"d5b95904-51b0-4fb3-b957-2f5cf1d0eb06\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 20:50:32.640732 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:50:32.640575    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d5b95904-51b0-4fb3-b957-2f5cf1d0eb06-config-volume\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"d5b95904-51b0-4fb3-b957-2f5cf1d0eb06\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 20:50:32.640732 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:50:32.640603    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-data-science-monitoringstack-db\" (UniqueName: \"kubernetes.io/empty-dir/d5b95904-51b0-4fb3-b957-2f5cf1d0eb06-alertmanager-data-science-monitoringstack-db\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"d5b95904-51b0-4fb3-b957-2f5cf1d0eb06\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 20:50:32.643617 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:50:32.642863    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d5b95904-51b0-4fb3-b957-2f5cf1d0eb06-config-out\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"d5b95904-51b0-4fb3-b957-2f5cf1d0eb06\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 20:50:32.643617 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:50:32.643252    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d5b95904-51b0-4fb3-b957-2f5cf1d0eb06-cluster-tls-config\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"d5b95904-51b0-4fb3-b957-2f5cf1d0eb06\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 20:50:32.643617 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:50:32.643276    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d5b95904-51b0-4fb3-b957-2f5cf1d0eb06-tls-assets\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"d5b95904-51b0-4fb3-b957-2f5cf1d0eb06\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 20:50:32.643830 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:50:32.643625    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d5b95904-51b0-4fb3-b957-2f5cf1d0eb06-config-volume\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"d5b95904-51b0-4fb3-b957-2f5cf1d0eb06\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 20:50:32.643830 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:50:32.643686    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d5b95904-51b0-4fb3-b957-2f5cf1d0eb06-web-config\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"d5b95904-51b0-4fb3-b957-2f5cf1d0eb06\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 20:50:32.701397 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:50:32.701364    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2wth6\" (UniqueName: \"kubernetes.io/projected/d5b95904-51b0-4fb3-b957-2f5cf1d0eb06-kube-api-access-2wth6\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"d5b95904-51b0-4fb3-b957-2f5cf1d0eb06\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 20:50:32.800372 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:50:32.800279    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 20:50:33.247442 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:50:33.247418    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"]
Oct 30 20:50:33.248501 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:50:33.248458    4060 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5b95904_51b0_4fb3_b957_2f5cf1d0eb06.slice/crio-50c7fc18f93363aba4fa5543fd04d20a9ac0db147ed487b01163d4a9b0afbac4 WatchSource:0}: Error finding container 50c7fc18f93363aba4fa5543fd04d20a9ac0db147ed487b01163d4a9b0afbac4: Status 404 returned error can't find the container with id 50c7fc18f93363aba4fa5543fd04d20a9ac0db147ed487b01163d4a9b0afbac4
Oct 30 20:50:33.760373 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:50:33.760334    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0" event={"ID":"d5b95904-51b0-4fb3-b957-2f5cf1d0eb06","Type":"ContainerStarted","Data":"50c7fc18f93363aba4fa5543fd04d20a9ac0db147ed487b01163d4a9b0afbac4"}
Oct 30 20:50:37.781400 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:50:37.781361    4060 generic.go:356] "Generic (PLEG): container finished" podID="cc6aeef9-afb1-4052-91eb-76d3d3a3427a" containerID="c78ecfa1e03cb7bc96c931f72fb494c48214ec5d6580bf4c4d29cfe4d61fbb6f" exitCode=137
Oct 30 20:50:37.781886 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:50:37.781436    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-observability-system/odh-observability-6f5479fd64-7gfbz" event={"ID":"cc6aeef9-afb1-4052-91eb-76d3d3a3427a","Type":"ContainerDied","Data":"c78ecfa1e03cb7bc96c931f72fb494c48214ec5d6580bf4c4d29cfe4d61fbb6f"}
Oct 30 20:50:37.781886 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:50:37.781772    4060 scope.go:122] "RemoveContainer" containerID="c78ecfa1e03cb7bc96c931f72fb494c48214ec5d6580bf4c4d29cfe4d61fbb6f"
Oct 30 20:50:38.787980 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:50:38.787951    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-observability-system/odh-observability-6f5479fd64-7gfbz" event={"ID":"cc6aeef9-afb1-4052-91eb-76d3d3a3427a","Type":"ContainerStarted","Data":"4bb24a3af92c97102b47314019e0a5683c03e153ecf04972d55c9910b9db0cf4"}
Oct 30 20:50:38.788357 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:50:38.788160    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-observability-system/odh-observability-6f5479fd64-7gfbz"
Oct 30 20:50:42.150548 ip-10-0-142-4 kubenswrapper[4060]: E1030 20:50:42.150513    4060 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v2f4x" containerName="extractor"
Oct 30 20:50:42.810006 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:50:42.809961    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0" event={"ID":"d5b95904-51b0-4fb3-b957-2f5cf1d0eb06","Type":"ContainerStarted","Data":"35d38bab38f5e1ed07391e4e051a8dd16d910b608555c2bcf8d4b93907110744"}
Oct 30 20:50:46.829820 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:50:46.829788    4060 generic.go:356] "Generic (PLEG): container finished" podID="d5b95904-51b0-4fb3-b957-2f5cf1d0eb06" containerID="35d38bab38f5e1ed07391e4e051a8dd16d910b608555c2bcf8d4b93907110744" exitCode=0
Oct 30 20:50:46.830246 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:50:46.829868    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0" event={"ID":"d5b95904-51b0-4fb3-b957-2f5cf1d0eb06","Type":"ContainerDied","Data":"35d38bab38f5e1ed07391e4e051a8dd16d910b608555c2bcf8d4b93907110744"}
Oct 30 20:50:49.796610 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:50:49.796579    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-observability-system/odh-observability-6f5479fd64-7gfbz"
Oct 30 20:50:50.849724 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:50:50.849683    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0" event={"ID":"d5b95904-51b0-4fb3-b957-2f5cf1d0eb06","Type":"ContainerStarted","Data":"37a6c153e9d5b68ea93b3230beed78e5a1edf72d2ca59c7f9ba1506cb9d87355"}
Oct 30 20:50:51.857622 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:50:51.857590    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0" event={"ID":"d5b95904-51b0-4fb3-b957-2f5cf1d0eb06","Type":"ContainerStarted","Data":"c5321e2563646e702b680eea20b4ec0fe5d0deeb54cf9d7b04554af1b7d8857b"}
Oct 30 20:50:51.858023 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:50:51.857678    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 20:50:52.080706 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:50:52.080654    4060 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0" podStartSLOduration=4.272515044 podStartE2EDuration="20.080639304s" totalImagesPullingTime="11.924527393s" totalInitContainerRuntime="3.883596867s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:50:32 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:50:52.029937625 +0000 UTC m=+870.786935946" watchObservedRunningTime="2026-10-30 20:50:52.080639304 +0000 UTC m=+870.837637602"
Oct 30 20:50:57.864532 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:50:57.864485    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 20:51:11.405748 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:11.405710    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-m4nwx"]
Oct 30 20:51:11.406277 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:11.405920    4060 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-m4nwx" podUID="38d3a608-9681-4a78-9cce-b354c5ac720f" containerName="kube-rbac-proxy" containerID="cri-o://2179e6ee811e72a3d5f6894cfcb86c6497ea0e4b53cab2f3d099dacaa26353d9" gracePeriod=30
Oct 30 20:51:11.455273 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:11.455236    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-prometheus-namespace-proxy-66dfd66cdb-jgp9k"]
Oct 30 20:51:11.455633 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:11.455546    4060 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-prometheus-namespace-proxy-66dfd66cdb-jgp9k" podUID="05e20f5e-4bd4-4095-8fe6-1d00b118c8cf" containerName="kube-rbac-proxy" containerID="cri-o://6d0467d0a7a85db097caae5dd1e3f1c6113c573ee40120ca310ce6fc1fb10be2" gracePeriod=30
Oct 30 20:51:11.455633 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:11.455553    4060 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-prometheus-namespace-proxy-66dfd66cdb-jgp9k" podUID="05e20f5e-4bd4-4095-8fe6-1d00b118c8cf" containerName="method-gate" containerID="cri-o://a299faaf3b79721aa6a7016165f068bdac9cc3a7d1f777d4fa89b215ebcc113f" gracePeriod=30
Oct 30 20:51:11.455633 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:11.455553    4060 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-prometheus-namespace-proxy-66dfd66cdb-jgp9k" podUID="05e20f5e-4bd4-4095-8fe6-1d00b118c8cf" containerName="prom-label-proxy" containerID="cri-o://87d80d195cdb01158691d6786d96e5355346386fa08a6f41ee7df6a077158ea8" gracePeriod=30
Oct 30 20:51:11.563644 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:11.563609    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/korrel8r-5cbcc89b8f-qrz8v"]
Oct 30 20:51:11.563883 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:11.563855    4060 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-qrz8v" podUID="072f3bfe-ceb8-444d-8f77-780030601722" containerName="korrel8r" containerID="cri-o://db63e9016e7b4653c72ae738f6e161c1fcf7351467876673594adc857cedaab7" gracePeriod=30
Oct 30 20:51:11.724195 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:11.724086    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-m4nwx"
Oct 30 20:51:11.728865 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:11.728842    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-prometheus-namespace-proxy-66dfd66cdb-jgp9k"
Oct 30 20:51:11.810323 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:11.810300    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-qrz8v"
Oct 30 20:51:11.876812 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:11.876772    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/38d3a608-9681-4a78-9cce-b354c5ac720f-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/38d3a608-9681-4a78-9cce-b354c5ac720f-kube-rbac-proxy-config\") pod \"38d3a608-9681-4a78-9cce-b354c5ac720f\" (UID: \"38d3a608-9681-4a78-9cce-b354c5ac720f\") "
Oct 30 20:51:11.876812 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:11.876825    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/38d3a608-9681-4a78-9cce-b354c5ac720f-kube-api-access-g2nzg\" (UniqueName: \"kubernetes.io/projected/38d3a608-9681-4a78-9cce-b354c5ac720f-kube-api-access-g2nzg\") pod \"38d3a608-9681-4a78-9cce-b354c5ac720f\" (UID: \"38d3a608-9681-4a78-9cce-b354c5ac720f\") "
Oct 30 20:51:11.877055 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:11.876860    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/38d3a608-9681-4a78-9cce-b354c5ac720f-prometheus-client-cert\" (UniqueName: \"kubernetes.io/secret/38d3a608-9681-4a78-9cce-b354c5ac720f-prometheus-client-cert\") pod \"38d3a608-9681-4a78-9cce-b354c5ac720f\" (UID: \"38d3a608-9681-4a78-9cce-b354c5ac720f\") "
Oct 30 20:51:11.877055 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:11.876897    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/05e20f5e-4bd4-4095-8fe6-1d00b118c8cf-tls\" (UniqueName: \"kubernetes.io/secret/05e20f5e-4bd4-4095-8fe6-1d00b118c8cf-tls\") pod \"05e20f5e-4bd4-4095-8fe6-1d00b118c8cf\" (UID: \"05e20f5e-4bd4-4095-8fe6-1d00b118c8cf\") "
Oct 30 20:51:11.877055 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:11.876946    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/05e20f5e-4bd4-4095-8fe6-1d00b118c8cf-kube-api-access-ctj5q\" (UniqueName: \"kubernetes.io/projected/05e20f5e-4bd4-4095-8fe6-1d00b118c8cf-kube-api-access-ctj5q\") pod \"05e20f5e-4bd4-4095-8fe6-1d00b118c8cf\" (UID: \"05e20f5e-4bd4-4095-8fe6-1d00b118c8cf\") "
Oct 30 20:51:11.877055 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:11.876986    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/05e20f5e-4bd4-4095-8fe6-1d00b118c8cf-prometheus-tls-ca\" (UniqueName: \"kubernetes.io/configmap/05e20f5e-4bd4-4095-8fe6-1d00b118c8cf-prometheus-tls-ca\") pod \"05e20f5e-4bd4-4095-8fe6-1d00b118c8cf\" (UID: \"05e20f5e-4bd4-4095-8fe6-1d00b118c8cf\") "
Oct 30 20:51:11.877055 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:11.877020    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/38d3a608-9681-4a78-9cce-b354c5ac720f-prometheus-ca\" (UniqueName: \"kubernetes.io/configmap/38d3a608-9681-4a78-9cce-b354c5ac720f-prometheus-ca\") pod \"38d3a608-9681-4a78-9cce-b354c5ac720f\" (UID: \"38d3a608-9681-4a78-9cce-b354c5ac720f\") "
Oct 30 20:51:11.877055 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:11.877054    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/38d3a608-9681-4a78-9cce-b354c5ac720f-tls\" (UniqueName: \"kubernetes.io/secret/38d3a608-9681-4a78-9cce-b354c5ac720f-tls\") pod \"38d3a608-9681-4a78-9cce-b354c5ac720f\" (UID: \"38d3a608-9681-4a78-9cce-b354c5ac720f\") "
Oct 30 20:51:11.877366 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:11.877171    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/05e20f5e-4bd4-4095-8fe6-1d00b118c8cf-client-ca\" (UniqueName: \"kubernetes.io/configmap/05e20f5e-4bd4-4095-8fe6-1d00b118c8cf-client-ca\") pod \"05e20f5e-4bd4-4095-8fe6-1d00b118c8cf\" (UID: \"05e20f5e-4bd4-4095-8fe6-1d00b118c8cf\") "
Oct 30 20:51:11.877366 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:11.877226    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/05e20f5e-4bd4-4095-8fe6-1d00b118c8cf-config\" (UniqueName: \"kubernetes.io/configmap/05e20f5e-4bd4-4095-8fe6-1d00b118c8cf-config\") pod \"05e20f5e-4bd4-4095-8fe6-1d00b118c8cf\" (UID: \"05e20f5e-4bd4-4095-8fe6-1d00b118c8cf\") "
Oct 30 20:51:11.877621 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:11.877593    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/38d3a608-9681-4a78-9cce-b354c5ac720f-prometheus-ca" pod "38d3a608-9681-4a78-9cce-b354c5ac720f" (UID: "38d3a608-9681-4a78-9cce-b354c5ac720f"). InnerVolumeSpecName "prometheus-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:51:11.877881 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:11.877822    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/05e20f5e-4bd4-4095-8fe6-1d00b118c8cf-config" pod "05e20f5e-4bd4-4095-8fe6-1d00b118c8cf" (UID: "05e20f5e-4bd4-4095-8fe6-1d00b118c8cf"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:51:11.878192 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:11.878162    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/05e20f5e-4bd4-4095-8fe6-1d00b118c8cf-client-ca" pod "05e20f5e-4bd4-4095-8fe6-1d00b118c8cf" (UID: "05e20f5e-4bd4-4095-8fe6-1d00b118c8cf"). InnerVolumeSpecName "client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:51:11.878563 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:11.878540    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/05e20f5e-4bd4-4095-8fe6-1d00b118c8cf-prometheus-tls-ca" pod "05e20f5e-4bd4-4095-8fe6-1d00b118c8cf" (UID: "05e20f5e-4bd4-4095-8fe6-1d00b118c8cf"). InnerVolumeSpecName "prometheus-tls-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:51:11.879294 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:11.879274    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/38d3a608-9681-4a78-9cce-b354c5ac720f-kube-rbac-proxy-config" pod "38d3a608-9681-4a78-9cce-b354c5ac720f" (UID: "38d3a608-9681-4a78-9cce-b354c5ac720f"). InnerVolumeSpecName "kube-rbac-proxy-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:51:11.880125 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:11.880096    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/38d3a608-9681-4a78-9cce-b354c5ac720f-kube-api-access-g2nzg" pod "38d3a608-9681-4a78-9cce-b354c5ac720f" (UID: "38d3a608-9681-4a78-9cce-b354c5ac720f"). InnerVolumeSpecName "kube-api-access-g2nzg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:51:11.880237 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:11.880196    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/05e20f5e-4bd4-4095-8fe6-1d00b118c8cf-kube-api-access-ctj5q" pod "05e20f5e-4bd4-4095-8fe6-1d00b118c8cf" (UID: "05e20f5e-4bd4-4095-8fe6-1d00b118c8cf"). InnerVolumeSpecName "kube-api-access-ctj5q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:51:11.880302 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:11.880279    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/05e20f5e-4bd4-4095-8fe6-1d00b118c8cf-tls" pod "05e20f5e-4bd4-4095-8fe6-1d00b118c8cf" (UID: "05e20f5e-4bd4-4095-8fe6-1d00b118c8cf"). InnerVolumeSpecName "tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:51:11.881573 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:11.881542    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/38d3a608-9681-4a78-9cce-b354c5ac720f-prometheus-client-cert" pod "38d3a608-9681-4a78-9cce-b354c5ac720f" (UID: "38d3a608-9681-4a78-9cce-b354c5ac720f"). InnerVolumeSpecName "prometheus-client-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:51:11.881662 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:11.881572    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/38d3a608-9681-4a78-9cce-b354c5ac720f-tls" pod "38d3a608-9681-4a78-9cce-b354c5ac720f" (UID: "38d3a608-9681-4a78-9cce-b354c5ac720f"). InnerVolumeSpecName "tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:51:11.951539 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:11.951486    4060 generic.go:356] "Generic (PLEG): container finished" podID="38d3a608-9681-4a78-9cce-b354c5ac720f" containerID="2179e6ee811e72a3d5f6894cfcb86c6497ea0e4b53cab2f3d099dacaa26353d9" exitCode=0
Oct 30 20:51:11.951726 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:11.951588    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-m4nwx"
Oct 30 20:51:11.951726 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:11.951595    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-m4nwx" event={"ID":"38d3a608-9681-4a78-9cce-b354c5ac720f","Type":"ContainerDied","Data":"2179e6ee811e72a3d5f6894cfcb86c6497ea0e4b53cab2f3d099dacaa26353d9"}
Oct 30 20:51:11.951726 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:11.951686    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-m4nwx" event={"ID":"38d3a608-9681-4a78-9cce-b354c5ac720f","Type":"ContainerDied","Data":"da27e06089cfe90d9fb4393c506eedd5a0d9ca79bb3771020a12699af4e75578"}
Oct 30 20:51:11.951726 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:11.951716    4060 scope.go:122] "RemoveContainer" containerID="2179e6ee811e72a3d5f6894cfcb86c6497ea0e4b53cab2f3d099dacaa26353d9"
Oct 30 20:51:11.953220 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:11.953202    4060 generic.go:356] "Generic (PLEG): container finished" podID="072f3bfe-ceb8-444d-8f77-780030601722" containerID="db63e9016e7b4653c72ae738f6e161c1fcf7351467876673594adc857cedaab7" exitCode=0
Oct 30 20:51:11.953346 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:11.953300    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-qrz8v" event={"ID":"072f3bfe-ceb8-444d-8f77-780030601722","Type":"ContainerDied","Data":"db63e9016e7b4653c72ae738f6e161c1fcf7351467876673594adc857cedaab7"}
Oct 30 20:51:11.953346 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:11.953340    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-qrz8v" event={"ID":"072f3bfe-ceb8-444d-8f77-780030601722","Type":"ContainerDied","Data":"6fe40e1a7ab991d3019bad8173e3e8e528035fd5dd01fe533385630f9c53aae9"}
Oct 30 20:51:11.953532 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:11.953425    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-qrz8v"
Oct 30 20:51:11.956529 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:11.956063    4060 generic.go:356] "Generic (PLEG): container finished" podID="05e20f5e-4bd4-4095-8fe6-1d00b118c8cf" containerID="87d80d195cdb01158691d6786d96e5355346386fa08a6f41ee7df6a077158ea8" exitCode=0
Oct 30 20:51:11.956529 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:11.956079    4060 generic.go:356] "Generic (PLEG): container finished" podID="05e20f5e-4bd4-4095-8fe6-1d00b118c8cf" containerID="a299faaf3b79721aa6a7016165f068bdac9cc3a7d1f777d4fa89b215ebcc113f" exitCode=0
Oct 30 20:51:11.956529 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:11.956089    4060 generic.go:356] "Generic (PLEG): container finished" podID="05e20f5e-4bd4-4095-8fe6-1d00b118c8cf" containerID="6d0467d0a7a85db097caae5dd1e3f1c6113c573ee40120ca310ce6fc1fb10be2" exitCode=0
Oct 30 20:51:11.956529 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:11.956148    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-prometheus-namespace-proxy-66dfd66cdb-jgp9k"
Oct 30 20:51:11.956529 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:11.956156    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-prometheus-namespace-proxy-66dfd66cdb-jgp9k" event={"ID":"05e20f5e-4bd4-4095-8fe6-1d00b118c8cf","Type":"ContainerDied","Data":"87d80d195cdb01158691d6786d96e5355346386fa08a6f41ee7df6a077158ea8"}
Oct 30 20:51:11.956529 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:11.956238    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-prometheus-namespace-proxy-66dfd66cdb-jgp9k" event={"ID":"05e20f5e-4bd4-4095-8fe6-1d00b118c8cf","Type":"ContainerDied","Data":"a299faaf3b79721aa6a7016165f068bdac9cc3a7d1f777d4fa89b215ebcc113f"}
Oct 30 20:51:11.956529 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:11.956279    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-prometheus-namespace-proxy-66dfd66cdb-jgp9k" event={"ID":"05e20f5e-4bd4-4095-8fe6-1d00b118c8cf","Type":"ContainerDied","Data":"6d0467d0a7a85db097caae5dd1e3f1c6113c573ee40120ca310ce6fc1fb10be2"}
Oct 30 20:51:11.956529 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:11.956316    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-prometheus-namespace-proxy-66dfd66cdb-jgp9k" event={"ID":"05e20f5e-4bd4-4095-8fe6-1d00b118c8cf","Type":"ContainerDied","Data":"b148ac38b11f82ee5525ff2593d5b4b26b7de381c4d2b3a9464e138b0bdd97f6"}
Oct 30 20:51:11.963028 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:11.962923    4060 scope.go:122] "RemoveContainer" containerID="2179e6ee811e72a3d5f6894cfcb86c6497ea0e4b53cab2f3d099dacaa26353d9"
Oct 30 20:51:11.963398 ip-10-0-142-4 kubenswrapper[4060]: E1030 20:51:11.963283    4060 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2179e6ee811e72a3d5f6894cfcb86c6497ea0e4b53cab2f3d099dacaa26353d9\": container with ID starting with 2179e6ee811e72a3d5f6894cfcb86c6497ea0e4b53cab2f3d099dacaa26353d9 not found: ID does not exist" containerID="2179e6ee811e72a3d5f6894cfcb86c6497ea0e4b53cab2f3d099dacaa26353d9"
Oct 30 20:51:11.963398 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:11.963316    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2179e6ee811e72a3d5f6894cfcb86c6497ea0e4b53cab2f3d099dacaa26353d9"} err="failed to get container status \"2179e6ee811e72a3d5f6894cfcb86c6497ea0e4b53cab2f3d099dacaa26353d9\": rpc error: code = NotFound desc = could not find container \"2179e6ee811e72a3d5f6894cfcb86c6497ea0e4b53cab2f3d099dacaa26353d9\": container with ID starting with 2179e6ee811e72a3d5f6894cfcb86c6497ea0e4b53cab2f3d099dacaa26353d9 not found: ID does not exist"
Oct 30 20:51:11.963398 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:11.963338    4060 scope.go:122] "RemoveContainer" containerID="db63e9016e7b4653c72ae738f6e161c1fcf7351467876673594adc857cedaab7"
Oct 30 20:51:11.972592 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:11.972568    4060 scope.go:122] "RemoveContainer" containerID="db63e9016e7b4653c72ae738f6e161c1fcf7351467876673594adc857cedaab7"
Oct 30 20:51:11.972884 ip-10-0-142-4 kubenswrapper[4060]: E1030 20:51:11.972866    4060 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"db63e9016e7b4653c72ae738f6e161c1fcf7351467876673594adc857cedaab7\": container with ID starting with db63e9016e7b4653c72ae738f6e161c1fcf7351467876673594adc857cedaab7 not found: ID does not exist" containerID="db63e9016e7b4653c72ae738f6e161c1fcf7351467876673594adc857cedaab7"
Oct 30 20:51:11.972936 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:11.972892    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db63e9016e7b4653c72ae738f6e161c1fcf7351467876673594adc857cedaab7"} err="failed to get container status \"db63e9016e7b4653c72ae738f6e161c1fcf7351467876673594adc857cedaab7\": rpc error: code = NotFound desc = could not find container \"db63e9016e7b4653c72ae738f6e161c1fcf7351467876673594adc857cedaab7\": container with ID starting with db63e9016e7b4653c72ae738f6e161c1fcf7351467876673594adc857cedaab7 not found: ID does not exist"
Oct 30 20:51:11.972936 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:11.972908    4060 scope.go:122] "RemoveContainer" containerID="87d80d195cdb01158691d6786d96e5355346386fa08a6f41ee7df6a077158ea8"
Oct 30 20:51:11.978107 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:11.978084    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/072f3bfe-ceb8-444d-8f77-780030601722-tls\" (UniqueName: \"kubernetes.io/secret/072f3bfe-ceb8-444d-8f77-780030601722-tls\") pod \"072f3bfe-ceb8-444d-8f77-780030601722\" (UID: \"072f3bfe-ceb8-444d-8f77-780030601722\") "
Oct 30 20:51:11.978222 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:11.978206    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/072f3bfe-ceb8-444d-8f77-780030601722-kube-api-access-kzfrt\" (UniqueName: \"kubernetes.io/projected/072f3bfe-ceb8-444d-8f77-780030601722-kube-api-access-kzfrt\") pod \"072f3bfe-ceb8-444d-8f77-780030601722\" (UID: \"072f3bfe-ceb8-444d-8f77-780030601722\") "
Oct 30 20:51:11.978285 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:11.978254    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/072f3bfe-ceb8-444d-8f77-780030601722-config\" (UniqueName: \"kubernetes.io/configmap/072f3bfe-ceb8-444d-8f77-780030601722-config\") pod \"072f3bfe-ceb8-444d-8f77-780030601722\" (UID: \"072f3bfe-ceb8-444d-8f77-780030601722\") "
Oct 30 20:51:11.978521 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:11.978477    4060 reconciler_common.go:299] "Volume detached for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/05e20f5e-4bd4-4095-8fe6-1d00b118c8cf-client-ca\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:51:11.978650 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:11.978522    4060 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/05e20f5e-4bd4-4095-8fe6-1d00b118c8cf-config\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:51:11.978650 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:11.978565    4060 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/38d3a608-9681-4a78-9cce-b354c5ac720f-kube-rbac-proxy-config\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:51:11.978650 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:11.978580    4060 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g2nzg\" (UniqueName: \"kubernetes.io/projected/38d3a608-9681-4a78-9cce-b354c5ac720f-kube-api-access-g2nzg\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:51:11.978650 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:11.978594    4060 reconciler_common.go:299] "Volume detached for volume \"prometheus-client-cert\" (UniqueName: \"kubernetes.io/secret/38d3a608-9681-4a78-9cce-b354c5ac720f-prometheus-client-cert\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:51:11.978650 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:11.978607    4060 reconciler_common.go:299] "Volume detached for volume \"tls\" (UniqueName: \"kubernetes.io/secret/05e20f5e-4bd4-4095-8fe6-1d00b118c8cf-tls\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:51:11.978650 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:11.978620    4060 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ctj5q\" (UniqueName: \"kubernetes.io/projected/05e20f5e-4bd4-4095-8fe6-1d00b118c8cf-kube-api-access-ctj5q\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:51:11.978650 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:11.978634    4060 reconciler_common.go:299] "Volume detached for volume \"prometheus-tls-ca\" (UniqueName: \"kubernetes.io/configmap/05e20f5e-4bd4-4095-8fe6-1d00b118c8cf-prometheus-tls-ca\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:51:11.978650 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:11.978647    4060 reconciler_common.go:299] "Volume detached for volume \"prometheus-ca\" (UniqueName: \"kubernetes.io/configmap/38d3a608-9681-4a78-9cce-b354c5ac720f-prometheus-ca\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:51:11.979091 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:11.978660    4060 reconciler_common.go:299] "Volume detached for volume \"tls\" (UniqueName: \"kubernetes.io/secret/38d3a608-9681-4a78-9cce-b354c5ac720f-tls\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:51:11.979091 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:11.978696    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/072f3bfe-ceb8-444d-8f77-780030601722-config" pod "072f3bfe-ceb8-444d-8f77-780030601722" (UID: "072f3bfe-ceb8-444d-8f77-780030601722"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:51:11.980163 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:11.980140    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/072f3bfe-ceb8-444d-8f77-780030601722-tls" pod "072f3bfe-ceb8-444d-8f77-780030601722" (UID: "072f3bfe-ceb8-444d-8f77-780030601722"). InnerVolumeSpecName "tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:51:11.980393 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:11.980371    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/072f3bfe-ceb8-444d-8f77-780030601722-kube-api-access-kzfrt" pod "072f3bfe-ceb8-444d-8f77-780030601722" (UID: "072f3bfe-ceb8-444d-8f77-780030601722"). InnerVolumeSpecName "kube-api-access-kzfrt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:51:11.980898 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:11.980879    4060 scope.go:122] "RemoveContainer" containerID="a299faaf3b79721aa6a7016165f068bdac9cc3a7d1f777d4fa89b215ebcc113f"
Oct 30 20:51:11.988281 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:11.988264    4060 scope.go:122] "RemoveContainer" containerID="6d0467d0a7a85db097caae5dd1e3f1c6113c573ee40120ca310ce6fc1fb10be2"
Oct 30 20:51:11.995386 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:11.995371    4060 scope.go:122] "RemoveContainer" containerID="87d80d195cdb01158691d6786d96e5355346386fa08a6f41ee7df6a077158ea8"
Oct 30 20:51:11.995723 ip-10-0-142-4 kubenswrapper[4060]: E1030 20:51:11.995687    4060 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"87d80d195cdb01158691d6786d96e5355346386fa08a6f41ee7df6a077158ea8\": container with ID starting with 87d80d195cdb01158691d6786d96e5355346386fa08a6f41ee7df6a077158ea8 not found: ID does not exist" containerID="87d80d195cdb01158691d6786d96e5355346386fa08a6f41ee7df6a077158ea8"
Oct 30 20:51:11.995794 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:11.995734    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"87d80d195cdb01158691d6786d96e5355346386fa08a6f41ee7df6a077158ea8"} err="failed to get container status \"87d80d195cdb01158691d6786d96e5355346386fa08a6f41ee7df6a077158ea8\": rpc error: code = NotFound desc = could not find container \"87d80d195cdb01158691d6786d96e5355346386fa08a6f41ee7df6a077158ea8\": container with ID starting with 87d80d195cdb01158691d6786d96e5355346386fa08a6f41ee7df6a077158ea8 not found: ID does not exist"
Oct 30 20:51:11.995794 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:11.995757    4060 scope.go:122] "RemoveContainer" containerID="a299faaf3b79721aa6a7016165f068bdac9cc3a7d1f777d4fa89b215ebcc113f"
Oct 30 20:51:11.996037 ip-10-0-142-4 kubenswrapper[4060]: E1030 20:51:11.996020    4060 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a299faaf3b79721aa6a7016165f068bdac9cc3a7d1f777d4fa89b215ebcc113f\": container with ID starting with a299faaf3b79721aa6a7016165f068bdac9cc3a7d1f777d4fa89b215ebcc113f not found: ID does not exist" containerID="a299faaf3b79721aa6a7016165f068bdac9cc3a7d1f777d4fa89b215ebcc113f"
Oct 30 20:51:11.996076 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:11.996043    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a299faaf3b79721aa6a7016165f068bdac9cc3a7d1f777d4fa89b215ebcc113f"} err="failed to get container status \"a299faaf3b79721aa6a7016165f068bdac9cc3a7d1f777d4fa89b215ebcc113f\": rpc error: code = NotFound desc = could not find container \"a299faaf3b79721aa6a7016165f068bdac9cc3a7d1f777d4fa89b215ebcc113f\": container with ID starting with a299faaf3b79721aa6a7016165f068bdac9cc3a7d1f777d4fa89b215ebcc113f not found: ID does not exist"
Oct 30 20:51:11.996076 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:11.996058    4060 scope.go:122] "RemoveContainer" containerID="6d0467d0a7a85db097caae5dd1e3f1c6113c573ee40120ca310ce6fc1fb10be2"
Oct 30 20:51:11.996285 ip-10-0-142-4 kubenswrapper[4060]: E1030 20:51:11.996265    4060 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6d0467d0a7a85db097caae5dd1e3f1c6113c573ee40120ca310ce6fc1fb10be2\": container with ID starting with 6d0467d0a7a85db097caae5dd1e3f1c6113c573ee40120ca310ce6fc1fb10be2 not found: ID does not exist" containerID="6d0467d0a7a85db097caae5dd1e3f1c6113c573ee40120ca310ce6fc1fb10be2"
Oct 30 20:51:11.996349 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:11.996292    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d0467d0a7a85db097caae5dd1e3f1c6113c573ee40120ca310ce6fc1fb10be2"} err="failed to get container status \"6d0467d0a7a85db097caae5dd1e3f1c6113c573ee40120ca310ce6fc1fb10be2\": rpc error: code = NotFound desc = could not find container \"6d0467d0a7a85db097caae5dd1e3f1c6113c573ee40120ca310ce6fc1fb10be2\": container with ID starting with 6d0467d0a7a85db097caae5dd1e3f1c6113c573ee40120ca310ce6fc1fb10be2 not found: ID does not exist"
Oct 30 20:51:11.996349 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:11.996312    4060 scope.go:122] "RemoveContainer" containerID="87d80d195cdb01158691d6786d96e5355346386fa08a6f41ee7df6a077158ea8"
Oct 30 20:51:11.996640 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:11.996617    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"87d80d195cdb01158691d6786d96e5355346386fa08a6f41ee7df6a077158ea8"} err="failed to get container status \"87d80d195cdb01158691d6786d96e5355346386fa08a6f41ee7df6a077158ea8\": rpc error: code = NotFound desc = could not find container \"87d80d195cdb01158691d6786d96e5355346386fa08a6f41ee7df6a077158ea8\": container with ID starting with 87d80d195cdb01158691d6786d96e5355346386fa08a6f41ee7df6a077158ea8 not found: ID does not exist"
Oct 30 20:51:11.996696 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:11.996642    4060 scope.go:122] "RemoveContainer" containerID="a299faaf3b79721aa6a7016165f068bdac9cc3a7d1f777d4fa89b215ebcc113f"
Oct 30 20:51:11.996892 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:11.996869    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a299faaf3b79721aa6a7016165f068bdac9cc3a7d1f777d4fa89b215ebcc113f"} err="failed to get container status \"a299faaf3b79721aa6a7016165f068bdac9cc3a7d1f777d4fa89b215ebcc113f\": rpc error: code = NotFound desc = could not find container \"a299faaf3b79721aa6a7016165f068bdac9cc3a7d1f777d4fa89b215ebcc113f\": container with ID starting with a299faaf3b79721aa6a7016165f068bdac9cc3a7d1f777d4fa89b215ebcc113f not found: ID does not exist"
Oct 30 20:51:11.996946 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:11.996892    4060 scope.go:122] "RemoveContainer" containerID="6d0467d0a7a85db097caae5dd1e3f1c6113c573ee40120ca310ce6fc1fb10be2"
Oct 30 20:51:11.997107 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:11.997086    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d0467d0a7a85db097caae5dd1e3f1c6113c573ee40120ca310ce6fc1fb10be2"} err="failed to get container status \"6d0467d0a7a85db097caae5dd1e3f1c6113c573ee40120ca310ce6fc1fb10be2\": rpc error: code = NotFound desc = could not find container \"6d0467d0a7a85db097caae5dd1e3f1c6113c573ee40120ca310ce6fc1fb10be2\": container with ID starting with 6d0467d0a7a85db097caae5dd1e3f1c6113c573ee40120ca310ce6fc1fb10be2 not found: ID does not exist"
Oct 30 20:51:11.997176 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:11.997108    4060 scope.go:122] "RemoveContainer" containerID="87d80d195cdb01158691d6786d96e5355346386fa08a6f41ee7df6a077158ea8"
Oct 30 20:51:11.997337 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:11.997322    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"87d80d195cdb01158691d6786d96e5355346386fa08a6f41ee7df6a077158ea8"} err="failed to get container status \"87d80d195cdb01158691d6786d96e5355346386fa08a6f41ee7df6a077158ea8\": rpc error: code = NotFound desc = could not find container \"87d80d195cdb01158691d6786d96e5355346386fa08a6f41ee7df6a077158ea8\": container with ID starting with 87d80d195cdb01158691d6786d96e5355346386fa08a6f41ee7df6a077158ea8 not found: ID does not exist"
Oct 30 20:51:11.997388 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:11.997338    4060 scope.go:122] "RemoveContainer" containerID="a299faaf3b79721aa6a7016165f068bdac9cc3a7d1f777d4fa89b215ebcc113f"
Oct 30 20:51:11.997563 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:11.997540    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a299faaf3b79721aa6a7016165f068bdac9cc3a7d1f777d4fa89b215ebcc113f"} err="failed to get container status \"a299faaf3b79721aa6a7016165f068bdac9cc3a7d1f777d4fa89b215ebcc113f\": rpc error: code = NotFound desc = could not find container \"a299faaf3b79721aa6a7016165f068bdac9cc3a7d1f777d4fa89b215ebcc113f\": container with ID starting with a299faaf3b79721aa6a7016165f068bdac9cc3a7d1f777d4fa89b215ebcc113f not found: ID does not exist"
Oct 30 20:51:11.997563 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:11.997561    4060 scope.go:122] "RemoveContainer" containerID="6d0467d0a7a85db097caae5dd1e3f1c6113c573ee40120ca310ce6fc1fb10be2"
Oct 30 20:51:11.997835 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:11.997815    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d0467d0a7a85db097caae5dd1e3f1c6113c573ee40120ca310ce6fc1fb10be2"} err="failed to get container status \"6d0467d0a7a85db097caae5dd1e3f1c6113c573ee40120ca310ce6fc1fb10be2\": rpc error: code = NotFound desc = could not find container \"6d0467d0a7a85db097caae5dd1e3f1c6113c573ee40120ca310ce6fc1fb10be2\": container with ID starting with 6d0467d0a7a85db097caae5dd1e3f1c6113c573ee40120ca310ce6fc1fb10be2 not found: ID does not exist"
Oct 30 20:51:12.079469 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:12.079432    4060 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/072f3bfe-ceb8-444d-8f77-780030601722-config\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:51:12.079469 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:12.079455    4060 reconciler_common.go:299] "Volume detached for volume \"tls\" (UniqueName: \"kubernetes.io/secret/072f3bfe-ceb8-444d-8f77-780030601722-tls\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:51:12.079469 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:12.079465    4060 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kzfrt\" (UniqueName: \"kubernetes.io/projected/072f3bfe-ceb8-444d-8f77-780030601722-kube-api-access-kzfrt\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:51:12.150074 ip-10-0-142-4 kubenswrapper[4060]: E1030 20:51:12.150044    4060 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v2f4x" containerName="extractor"
Oct 30 20:51:12.298083 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:12.298048    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-m4nwx"]
Oct 30 20:51:12.304326 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:12.304297    4060 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-m4nwx"]
Oct 30 20:51:12.422721 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:12.422694    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-prometheus-namespace-proxy-66dfd66cdb-jgp9k"]
Oct 30 20:51:12.430090 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:12.430063    4060 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-prometheus-namespace-proxy-66dfd66cdb-jgp9k"]
Oct 30 20:51:12.597665 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:12.597588    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/korrel8r-5cbcc89b8f-qrz8v"]
Oct 30 20:51:12.601680 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:12.601655    4060 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/korrel8r-5cbcc89b8f-qrz8v"]
Oct 30 20:51:12.792728 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:12.792696    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"]
Oct 30 20:51:12.793163 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:12.792948    4060 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0" podUID="d5b95904-51b0-4fb3-b957-2f5cf1d0eb06" containerName="alertmanager" containerID="cri-o://37a6c153e9d5b68ea93b3230beed78e5a1edf72d2ca59c7f9ba1506cb9d87355" gracePeriod=120
Oct 30 20:51:12.793163 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:12.793029    4060 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0" podUID="d5b95904-51b0-4fb3-b957-2f5cf1d0eb06" containerName="config-reloader" containerID="cri-o://c5321e2563646e702b680eea20b4ec0fe5d0deeb54cf9d7b04554af1b7d8857b" gracePeriod=120
Oct 30 20:51:12.863231 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:12.863150    4060 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0" podUID="d5b95904-51b0-4fb3-b957-2f5cf1d0eb06" containerName="alertmanager" probeResult="failure" output="Get \"http://10.133.0.44:9093/-/ready\": dial tcp 10.133.0.44:9093: connect: connection refused"
Oct 30 20:51:13.426342 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:13.426312    4060 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="05e20f5e-4bd4-4095-8fe6-1d00b118c8cf" path="/var/lib/kubelet/pods/05e20f5e-4bd4-4095-8fe6-1d00b118c8cf/volumes"
Oct 30 20:51:13.426798 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:13.426784    4060 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="072f3bfe-ceb8-444d-8f77-780030601722" path="/var/lib/kubelet/pods/072f3bfe-ceb8-444d-8f77-780030601722/volumes"
Oct 30 20:51:13.427124 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:13.427112    4060 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="38d3a608-9681-4a78-9cce-b354c5ac720f" path="/var/lib/kubelet/pods/38d3a608-9681-4a78-9cce-b354c5ac720f/volumes"
Oct 30 20:51:13.971804 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:13.971767    4060 generic.go:356] "Generic (PLEG): container finished" podID="d5b95904-51b0-4fb3-b957-2f5cf1d0eb06" containerID="c5321e2563646e702b680eea20b4ec0fe5d0deeb54cf9d7b04554af1b7d8857b" exitCode=0
Oct 30 20:51:13.971951 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:13.971831    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0" event={"ID":"d5b95904-51b0-4fb3-b957-2f5cf1d0eb06","Type":"ContainerDied","Data":"c5321e2563646e702b680eea20b4ec0fe5d0deeb54cf9d7b04554af1b7d8857b"}
Oct 30 20:51:15.145069 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:15.145036    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 20:51:15.145569 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:15.145295    4060 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-collector-0" podUID="a45734fd-1c12-4eb5-b572-41a0d3637e46" containerName="otc-container" containerID="cri-o://6576410ccbc58ae29dea4146f0fb40f8746964bde081d008d1a91b1756b371b9" gracePeriod=30
Oct 30 20:51:15.392256 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:15.392231    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:51:15.508781 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:15.508755    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a45734fd-1c12-4eb5-b572-41a0d3637e46-kube-api-access-8r7bg\" (UniqueName: \"kubernetes.io/projected/a45734fd-1c12-4eb5-b572-41a0d3637e46-kube-api-access-8r7bg\") pod \"a45734fd-1c12-4eb5-b572-41a0d3637e46\" (UID: \"a45734fd-1c12-4eb5-b572-41a0d3637e46\") "
Oct 30 20:51:15.508955 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:15.508823    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/a45734fd-1c12-4eb5-b572-41a0d3637e46-tls-certs\" (UniqueName: \"kubernetes.io/secret/a45734fd-1c12-4eb5-b572-41a0d3637e46-tls-certs\") pod \"a45734fd-1c12-4eb5-b572-41a0d3637e46\" (UID: \"a45734fd-1c12-4eb5-b572-41a0d3637e46\") "
Oct 30 20:51:15.508955 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:15.508862    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a45734fd-1c12-4eb5-b572-41a0d3637e46-otc-internal\" (UniqueName: \"kubernetes.io/configmap/a45734fd-1c12-4eb5-b572-41a0d3637e46-otc-internal\") pod \"a45734fd-1c12-4eb5-b572-41a0d3637e46\" (UID: \"a45734fd-1c12-4eb5-b572-41a0d3637e46\") "
Oct 30 20:51:15.508955 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:15.508914    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/a45734fd-1c12-4eb5-b572-41a0d3637e46-data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/a45734fd-1c12-4eb5-b572-41a0d3637e46-data-science-collector-ta-client-cert\") pod \"a45734fd-1c12-4eb5-b572-41a0d3637e46\" (UID: \"a45734fd-1c12-4eb5-b572-41a0d3637e46\") "
Oct 30 20:51:15.508955 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:15.508950    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/a45734fd-1c12-4eb5-b572-41a0d3637e46-monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/a45734fd-1c12-4eb5-b572-41a0d3637e46-monitoring-tls-certs\") pod \"a45734fd-1c12-4eb5-b572-41a0d3637e46\" (UID: \"a45734fd-1c12-4eb5-b572-41a0d3637e46\") "
Oct 30 20:51:15.509102 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:15.509012    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/a45734fd-1c12-4eb5-b572-41a0d3637e46-otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/a45734fd-1c12-4eb5-b572-41a0d3637e46-otlp-tls-certs\") pod \"a45734fd-1c12-4eb5-b572-41a0d3637e46\" (UID: \"a45734fd-1c12-4eb5-b572-41a0d3637e46\") "
Oct 30 20:51:15.509301 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:15.509268    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a45734fd-1c12-4eb5-b572-41a0d3637e46-otc-internal" pod "a45734fd-1c12-4eb5-b572-41a0d3637e46" (UID: "a45734fd-1c12-4eb5-b572-41a0d3637e46"). InnerVolumeSpecName "otc-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:51:15.511555 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:15.511517    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a45734fd-1c12-4eb5-b572-41a0d3637e46-monitoring-tls-certs" pod "a45734fd-1c12-4eb5-b572-41a0d3637e46" (UID: "a45734fd-1c12-4eb5-b572-41a0d3637e46"). InnerVolumeSpecName "monitoring-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:51:15.511796 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:15.511769    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a45734fd-1c12-4eb5-b572-41a0d3637e46-tls-certs" pod "a45734fd-1c12-4eb5-b572-41a0d3637e46" (UID: "a45734fd-1c12-4eb5-b572-41a0d3637e46"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:51:15.511949 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:15.511810    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a45734fd-1c12-4eb5-b572-41a0d3637e46-otlp-tls-certs" pod "a45734fd-1c12-4eb5-b572-41a0d3637e46" (UID: "a45734fd-1c12-4eb5-b572-41a0d3637e46"). InnerVolumeSpecName "otlp-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:51:15.512214 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:15.512192    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a45734fd-1c12-4eb5-b572-41a0d3637e46-kube-api-access-8r7bg" pod "a45734fd-1c12-4eb5-b572-41a0d3637e46" (UID: "a45734fd-1c12-4eb5-b572-41a0d3637e46"). InnerVolumeSpecName "kube-api-access-8r7bg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:51:15.512293 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:15.512231    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a45734fd-1c12-4eb5-b572-41a0d3637e46-data-science-collector-ta-client-cert" pod "a45734fd-1c12-4eb5-b572-41a0d3637e46" (UID: "a45734fd-1c12-4eb5-b572-41a0d3637e46"). InnerVolumeSpecName "data-science-collector-ta-client-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:51:15.609854 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:15.609824    4060 reconciler_common.go:299] "Volume detached for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/a45734fd-1c12-4eb5-b572-41a0d3637e46-otlp-tls-certs\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:51:15.609854 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:15.609850    4060 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8r7bg\" (UniqueName: \"kubernetes.io/projected/a45734fd-1c12-4eb5-b572-41a0d3637e46-kube-api-access-8r7bg\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:51:15.609854 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:15.609861    4060 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a45734fd-1c12-4eb5-b572-41a0d3637e46-tls-certs\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:51:15.610079 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:15.609870    4060 reconciler_common.go:299] "Volume detached for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/a45734fd-1c12-4eb5-b572-41a0d3637e46-otc-internal\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:51:15.610079 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:15.609882    4060 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/a45734fd-1c12-4eb5-b572-41a0d3637e46-data-science-collector-ta-client-cert\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:51:15.610079 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:15.609891    4060 reconciler_common.go:299] "Volume detached for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/a45734fd-1c12-4eb5-b572-41a0d3637e46-monitoring-tls-certs\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:51:15.981901 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:15.981872    4060 generic.go:356] "Generic (PLEG): container finished" podID="a45734fd-1c12-4eb5-b572-41a0d3637e46" containerID="6576410ccbc58ae29dea4146f0fb40f8746964bde081d008d1a91b1756b371b9" exitCode=0
Oct 30 20:51:15.982101 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:15.981913    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:51:15.982101 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:15.981959    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"a45734fd-1c12-4eb5-b572-41a0d3637e46","Type":"ContainerDied","Data":"6576410ccbc58ae29dea4146f0fb40f8746964bde081d008d1a91b1756b371b9"}
Oct 30 20:51:15.982101 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:15.982017    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"a45734fd-1c12-4eb5-b572-41a0d3637e46","Type":"ContainerDied","Data":"5e751bd27a8163de164232faf79a67d30ffb161b1f04014f2d1e2f536728d927"}
Oct 30 20:51:15.982101 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:15.982046    4060 scope.go:122] "RemoveContainer" containerID="6576410ccbc58ae29dea4146f0fb40f8746964bde081d008d1a91b1756b371b9"
Oct 30 20:51:15.990957 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:15.990936    4060 scope.go:122] "RemoveContainer" containerID="6576410ccbc58ae29dea4146f0fb40f8746964bde081d008d1a91b1756b371b9"
Oct 30 20:51:15.991213 ip-10-0-142-4 kubenswrapper[4060]: E1030 20:51:15.991190    4060 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6576410ccbc58ae29dea4146f0fb40f8746964bde081d008d1a91b1756b371b9\": container with ID starting with 6576410ccbc58ae29dea4146f0fb40f8746964bde081d008d1a91b1756b371b9 not found: ID does not exist" containerID="6576410ccbc58ae29dea4146f0fb40f8746964bde081d008d1a91b1756b371b9"
Oct 30 20:51:15.991285 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:15.991216    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6576410ccbc58ae29dea4146f0fb40f8746964bde081d008d1a91b1756b371b9"} err="failed to get container status \"6576410ccbc58ae29dea4146f0fb40f8746964bde081d008d1a91b1756b371b9\": rpc error: code = NotFound desc = could not find container \"6576410ccbc58ae29dea4146f0fb40f8746964bde081d008d1a91b1756b371b9\": container with ID starting with 6576410ccbc58ae29dea4146f0fb40f8746964bde081d008d1a91b1756b371b9 not found: ID does not exist"
Oct 30 20:51:16.147426 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:16.147387    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 20:51:16.151642 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:16.151613    4060 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 20:51:17.426961 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:17.426927    4060 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a45734fd-1c12-4eb5-b572-41a0d3637e46" path="/var/lib/kubelet/pods/a45734fd-1c12-4eb5-b572-41a0d3637e46/volumes"
Oct 30 20:51:17.863731 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:17.863689    4060 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0" podUID="d5b95904-51b0-4fb3-b957-2f5cf1d0eb06" containerName="alertmanager" probeResult="failure" output="Get \"http://10.133.0.44:9093/-/ready\": dial tcp 10.133.0.44:9093: connect: connection refused"
Oct 30 20:51:22.863878 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:22.863838    4060 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0" podUID="d5b95904-51b0-4fb3-b957-2f5cf1d0eb06" containerName="alertmanager" probeResult="failure" output="Get \"http://10.133.0.44:9093/-/ready\": dial tcp 10.133.0.44:9093: connect: connection refused"
Oct 30 20:51:23.018647 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:23.018611    4060 generic.go:356] "Generic (PLEG): container finished" podID="d5b95904-51b0-4fb3-b957-2f5cf1d0eb06" containerID="37a6c153e9d5b68ea93b3230beed78e5a1edf72d2ca59c7f9ba1506cb9d87355" exitCode=0
Oct 30 20:51:23.018855 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:23.018666    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0" event={"ID":"d5b95904-51b0-4fb3-b957-2f5cf1d0eb06","Type":"ContainerDied","Data":"37a6c153e9d5b68ea93b3230beed78e5a1edf72d2ca59c7f9ba1506cb9d87355"}
Oct 30 20:51:23.047130 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:23.047103    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 20:51:23.173979 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:23.173905    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d5b95904-51b0-4fb3-b957-2f5cf1d0eb06-config-out\" (UniqueName: \"kubernetes.io/empty-dir/d5b95904-51b0-4fb3-b957-2f5cf1d0eb06-config-out\") pod \"d5b95904-51b0-4fb3-b957-2f5cf1d0eb06\" (UID: \"d5b95904-51b0-4fb3-b957-2f5cf1d0eb06\") "
Oct 30 20:51:23.173979 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:23.173944    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d5b95904-51b0-4fb3-b957-2f5cf1d0eb06-web-config\" (UniqueName: \"kubernetes.io/secret/d5b95904-51b0-4fb3-b957-2f5cf1d0eb06-web-config\") pod \"d5b95904-51b0-4fb3-b957-2f5cf1d0eb06\" (UID: \"d5b95904-51b0-4fb3-b957-2f5cf1d0eb06\") "
Oct 30 20:51:23.174207 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:23.173981    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d5b95904-51b0-4fb3-b957-2f5cf1d0eb06-tls-assets\" (UniqueName: \"kubernetes.io/projected/d5b95904-51b0-4fb3-b957-2f5cf1d0eb06-tls-assets\") pod \"d5b95904-51b0-4fb3-b957-2f5cf1d0eb06\" (UID: \"d5b95904-51b0-4fb3-b957-2f5cf1d0eb06\") "
Oct 30 20:51:23.174207 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:23.174025    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d5b95904-51b0-4fb3-b957-2f5cf1d0eb06-config-volume\" (UniqueName: \"kubernetes.io/secret/d5b95904-51b0-4fb3-b957-2f5cf1d0eb06-config-volume\") pod \"d5b95904-51b0-4fb3-b957-2f5cf1d0eb06\" (UID: \"d5b95904-51b0-4fb3-b957-2f5cf1d0eb06\") "
Oct 30 20:51:23.174207 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:23.174061    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d5b95904-51b0-4fb3-b957-2f5cf1d0eb06-cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d5b95904-51b0-4fb3-b957-2f5cf1d0eb06-cluster-tls-config\") pod \"d5b95904-51b0-4fb3-b957-2f5cf1d0eb06\" (UID: \"d5b95904-51b0-4fb3-b957-2f5cf1d0eb06\") "
Oct 30 20:51:23.174207 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:23.174113    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d5b95904-51b0-4fb3-b957-2f5cf1d0eb06-kube-api-access-2wth6\" (UniqueName: \"kubernetes.io/projected/d5b95904-51b0-4fb3-b957-2f5cf1d0eb06-kube-api-access-2wth6\") pod \"d5b95904-51b0-4fb3-b957-2f5cf1d0eb06\" (UID: \"d5b95904-51b0-4fb3-b957-2f5cf1d0eb06\") "
Oct 30 20:51:23.174207 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:23.174179    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d5b95904-51b0-4fb3-b957-2f5cf1d0eb06-alertmanager-data-science-monitoringstack-db\" (UniqueName: \"kubernetes.io/empty-dir/d5b95904-51b0-4fb3-b957-2f5cf1d0eb06-alertmanager-data-science-monitoringstack-db\") pod \"d5b95904-51b0-4fb3-b957-2f5cf1d0eb06\" (UID: \"d5b95904-51b0-4fb3-b957-2f5cf1d0eb06\") "
Oct 30 20:51:23.174712 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:23.174683    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d5b95904-51b0-4fb3-b957-2f5cf1d0eb06-alertmanager-data-science-monitoringstack-db" pod "d5b95904-51b0-4fb3-b957-2f5cf1d0eb06" (UID: "d5b95904-51b0-4fb3-b957-2f5cf1d0eb06"). InnerVolumeSpecName "alertmanager-data-science-monitoringstack-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:51:23.176688 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:23.176655    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d5b95904-51b0-4fb3-b957-2f5cf1d0eb06-config-out" pod "d5b95904-51b0-4fb3-b957-2f5cf1d0eb06" (UID: "d5b95904-51b0-4fb3-b957-2f5cf1d0eb06"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:51:23.177207 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:23.177161    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d5b95904-51b0-4fb3-b957-2f5cf1d0eb06-tls-assets" pod "d5b95904-51b0-4fb3-b957-2f5cf1d0eb06" (UID: "d5b95904-51b0-4fb3-b957-2f5cf1d0eb06"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:51:23.177973 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:23.177631    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d5b95904-51b0-4fb3-b957-2f5cf1d0eb06-kube-api-access-2wth6" pod "d5b95904-51b0-4fb3-b957-2f5cf1d0eb06" (UID: "d5b95904-51b0-4fb3-b957-2f5cf1d0eb06"). InnerVolumeSpecName "kube-api-access-2wth6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:51:23.177973 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:23.177838    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d5b95904-51b0-4fb3-b957-2f5cf1d0eb06-config-volume" pod "d5b95904-51b0-4fb3-b957-2f5cf1d0eb06" (UID: "d5b95904-51b0-4fb3-b957-2f5cf1d0eb06"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:51:23.183541 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:23.183508    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d5b95904-51b0-4fb3-b957-2f5cf1d0eb06-cluster-tls-config" pod "d5b95904-51b0-4fb3-b957-2f5cf1d0eb06" (UID: "d5b95904-51b0-4fb3-b957-2f5cf1d0eb06"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:51:23.189020 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:23.188995    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d5b95904-51b0-4fb3-b957-2f5cf1d0eb06-web-config" pod "d5b95904-51b0-4fb3-b957-2f5cf1d0eb06" (UID: "d5b95904-51b0-4fb3-b957-2f5cf1d0eb06"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:51:23.275404 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:23.275365    4060 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2wth6\" (UniqueName: \"kubernetes.io/projected/d5b95904-51b0-4fb3-b957-2f5cf1d0eb06-kube-api-access-2wth6\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:51:23.275404 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:23.275398    4060 reconciler_common.go:299] "Volume detached for volume \"alertmanager-data-science-monitoringstack-db\" (UniqueName: \"kubernetes.io/empty-dir/d5b95904-51b0-4fb3-b957-2f5cf1d0eb06-alertmanager-data-science-monitoringstack-db\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:51:23.275667 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:23.275413    4060 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d5b95904-51b0-4fb3-b957-2f5cf1d0eb06-config-out\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:51:23.275667 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:23.275453    4060 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d5b95904-51b0-4fb3-b957-2f5cf1d0eb06-web-config\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:51:23.275667 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:23.275466    4060 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d5b95904-51b0-4fb3-b957-2f5cf1d0eb06-tls-assets\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:51:23.275667 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:23.275480    4060 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d5b95904-51b0-4fb3-b957-2f5cf1d0eb06-config-volume\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:51:23.275667 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:23.275507    4060 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d5b95904-51b0-4fb3-b957-2f5cf1d0eb06-cluster-tls-config\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:51:23.454242 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:23.454208    4060 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/korrel8r-6644769df5-5lq6h"]
Oct 30 20:51:23.454522 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:23.454510    4060 cpu_manager.go:414] "containerMap: removing container" podUID="05e20f5e-4bd4-4095-8fe6-1d00b118c8cf" containerName="kube-rbac-proxy"
Oct 30 20:51:23.454585 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:23.454523    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="05e20f5e-4bd4-4095-8fe6-1d00b118c8cf" containerName="kube-rbac-proxy"
Oct 30 20:51:23.454585 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:23.454533    4060 cpu_manager.go:414] "containerMap: removing container" podUID="05e20f5e-4bd4-4095-8fe6-1d00b118c8cf" containerName="prom-label-proxy"
Oct 30 20:51:23.454585 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:23.454539    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="05e20f5e-4bd4-4095-8fe6-1d00b118c8cf" containerName="prom-label-proxy"
Oct 30 20:51:23.454585 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:23.454547    4060 cpu_manager.go:414] "containerMap: removing container" podUID="38d3a608-9681-4a78-9cce-b354c5ac720f" containerName="kube-rbac-proxy"
Oct 30 20:51:23.454585 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:23.454552    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="38d3a608-9681-4a78-9cce-b354c5ac720f" containerName="kube-rbac-proxy"
Oct 30 20:51:23.454585 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:23.454558    4060 cpu_manager.go:414] "containerMap: removing container" podUID="d5b95904-51b0-4fb3-b957-2f5cf1d0eb06" containerName="config-reloader"
Oct 30 20:51:23.454585 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:23.454563    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d5b95904-51b0-4fb3-b957-2f5cf1d0eb06" containerName="config-reloader"
Oct 30 20:51:23.454585 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:23.454570    4060 cpu_manager.go:414] "containerMap: removing container" podUID="a45734fd-1c12-4eb5-b572-41a0d3637e46" containerName="otc-container"
Oct 30 20:51:23.454585 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:23.454575    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a45734fd-1c12-4eb5-b572-41a0d3637e46" containerName="otc-container"
Oct 30 20:51:23.454585 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:23.454582    4060 cpu_manager.go:414] "containerMap: removing container" podUID="072f3bfe-ceb8-444d-8f77-780030601722" containerName="korrel8r"
Oct 30 20:51:23.454585 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:23.454587    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="072f3bfe-ceb8-444d-8f77-780030601722" containerName="korrel8r"
Oct 30 20:51:23.454884 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:23.454598    4060 cpu_manager.go:414] "containerMap: removing container" podUID="d5b95904-51b0-4fb3-b957-2f5cf1d0eb06" containerName="init-config-reloader"
Oct 30 20:51:23.454884 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:23.454602    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d5b95904-51b0-4fb3-b957-2f5cf1d0eb06" containerName="init-config-reloader"
Oct 30 20:51:23.454884 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:23.454616    4060 cpu_manager.go:414] "containerMap: removing container" podUID="05e20f5e-4bd4-4095-8fe6-1d00b118c8cf" containerName="method-gate"
Oct 30 20:51:23.454884 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:23.454620    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="05e20f5e-4bd4-4095-8fe6-1d00b118c8cf" containerName="method-gate"
Oct 30 20:51:23.454884 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:23.454626    4060 cpu_manager.go:414] "containerMap: removing container" podUID="d5b95904-51b0-4fb3-b957-2f5cf1d0eb06" containerName="alertmanager"
Oct 30 20:51:23.454884 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:23.454630    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d5b95904-51b0-4fb3-b957-2f5cf1d0eb06" containerName="alertmanager"
Oct 30 20:51:23.454884 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:23.454684    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="05e20f5e-4bd4-4095-8fe6-1d00b118c8cf" containerName="method-gate"
Oct 30 20:51:23.454884 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:23.454692    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="d5b95904-51b0-4fb3-b957-2f5cf1d0eb06" containerName="alertmanager"
Oct 30 20:51:23.454884 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:23.454699    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="05e20f5e-4bd4-4095-8fe6-1d00b118c8cf" containerName="kube-rbac-proxy"
Oct 30 20:51:23.454884 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:23.454705    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="05e20f5e-4bd4-4095-8fe6-1d00b118c8cf" containerName="prom-label-proxy"
Oct 30 20:51:23.454884 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:23.454710    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="38d3a608-9681-4a78-9cce-b354c5ac720f" containerName="kube-rbac-proxy"
Oct 30 20:51:23.454884 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:23.454715    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="d5b95904-51b0-4fb3-b957-2f5cf1d0eb06" containerName="config-reloader"
Oct 30 20:51:23.454884 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:23.454720    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="a45734fd-1c12-4eb5-b572-41a0d3637e46" containerName="otc-container"
Oct 30 20:51:23.454884 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:23.454724    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="072f3bfe-ceb8-444d-8f77-780030601722" containerName="korrel8r"
Oct 30 20:51:23.458017 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:23.458002    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/korrel8r-6644769df5-5lq6h"
Oct 30 20:51:23.477434 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:23.477397    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/67d3dde5-a1a8-4823-bf1a-22be066c0aae-config\") pod \"korrel8r-6644769df5-5lq6h\" (UID: \"67d3dde5-a1a8-4823-bf1a-22be066c0aae\") " pod="redhat-ods-monitoring/korrel8r-6644769df5-5lq6h"
Oct 30 20:51:23.477434 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:23.477435    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/67d3dde5-a1a8-4823-bf1a-22be066c0aae-tls\") pod \"korrel8r-6644769df5-5lq6h\" (UID: \"67d3dde5-a1a8-4823-bf1a-22be066c0aae\") " pod="redhat-ods-monitoring/korrel8r-6644769df5-5lq6h"
Oct 30 20:51:23.477650 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:23.477514    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wm9lv\" (UniqueName: \"kubernetes.io/projected/67d3dde5-a1a8-4823-bf1a-22be066c0aae-kube-api-access-wm9lv\") pod \"korrel8r-6644769df5-5lq6h\" (UID: \"67d3dde5-a1a8-4823-bf1a-22be066c0aae\") " pod="redhat-ods-monitoring/korrel8r-6644769df5-5lq6h"
Oct 30 20:51:23.510357 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:23.510322    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"korrel8r-dockercfg-n9nm8\""
Oct 30 20:51:23.510357 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:23.510354    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"korrel8r-tls\""
Oct 30 20:51:23.510658 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:23.510404    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"korrel8r-config\""
Oct 30 20:51:23.516961 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:23.516935    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/korrel8r-6644769df5-5lq6h"]
Oct 30 20:51:23.578011 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:23.577979    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/67d3dde5-a1a8-4823-bf1a-22be066c0aae-config\") pod \"korrel8r-6644769df5-5lq6h\" (UID: \"67d3dde5-a1a8-4823-bf1a-22be066c0aae\") " pod="redhat-ods-monitoring/korrel8r-6644769df5-5lq6h"
Oct 30 20:51:23.578011 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:23.578014    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/67d3dde5-a1a8-4823-bf1a-22be066c0aae-tls\") pod \"korrel8r-6644769df5-5lq6h\" (UID: \"67d3dde5-a1a8-4823-bf1a-22be066c0aae\") " pod="redhat-ods-monitoring/korrel8r-6644769df5-5lq6h"
Oct 30 20:51:23.578241 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:23.578040    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wm9lv\" (UniqueName: \"kubernetes.io/projected/67d3dde5-a1a8-4823-bf1a-22be066c0aae-kube-api-access-wm9lv\") pod \"korrel8r-6644769df5-5lq6h\" (UID: \"67d3dde5-a1a8-4823-bf1a-22be066c0aae\") " pod="redhat-ods-monitoring/korrel8r-6644769df5-5lq6h"
Oct 30 20:51:23.578950 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:23.578921    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/67d3dde5-a1a8-4823-bf1a-22be066c0aae-config\") pod \"korrel8r-6644769df5-5lq6h\" (UID: \"67d3dde5-a1a8-4823-bf1a-22be066c0aae\") " pod="redhat-ods-monitoring/korrel8r-6644769df5-5lq6h"
Oct 30 20:51:23.580443 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:23.580428    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls\" (UniqueName: \"kubernetes.io/secret/67d3dde5-a1a8-4823-bf1a-22be066c0aae-tls\") pod \"korrel8r-6644769df5-5lq6h\" (UID: \"67d3dde5-a1a8-4823-bf1a-22be066c0aae\") " pod="redhat-ods-monitoring/korrel8r-6644769df5-5lq6h"
Oct 30 20:51:23.640186 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:23.640152    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wm9lv\" (UniqueName: \"kubernetes.io/projected/67d3dde5-a1a8-4823-bf1a-22be066c0aae-kube-api-access-wm9lv\") pod \"korrel8r-6644769df5-5lq6h\" (UID: \"67d3dde5-a1a8-4823-bf1a-22be066c0aae\") " pod="redhat-ods-monitoring/korrel8r-6644769df5-5lq6h"
Oct 30 20:51:23.770090 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:23.770050    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/korrel8r-6644769df5-5lq6h"
Oct 30 20:51:24.026400 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:24.026341    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 20:51:24.026800 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:24.026341    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0" event={"ID":"d5b95904-51b0-4fb3-b957-2f5cf1d0eb06","Type":"ContainerDied","Data":"50c7fc18f93363aba4fa5543fd04d20a9ac0db147ed487b01163d4a9b0afbac4"}
Oct 30 20:51:24.026800 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:24.026477    4060 scope.go:122] "RemoveContainer" containerID="c5321e2563646e702b680eea20b4ec0fe5d0deeb54cf9d7b04554af1b7d8857b"
Oct 30 20:51:24.034827 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:24.034811    4060 scope.go:122] "RemoveContainer" containerID="37a6c153e9d5b68ea93b3230beed78e5a1edf72d2ca59c7f9ba1506cb9d87355"
Oct 30 20:51:24.042128 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:24.042097    4060 scope.go:122] "RemoveContainer" containerID="35d38bab38f5e1ed07391e4e051a8dd16d910b608555c2bcf8d4b93907110744"
Oct 30 20:51:24.141348 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:24.141326    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/korrel8r-6644769df5-5lq6h"]
Oct 30 20:51:24.143802 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:51:24.143774    4060 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67d3dde5_a1a8_4823_bf1a_22be066c0aae.slice/crio-ff07bd56badf592df087d95e4b3ce354dad5407862c4f3730db11001e77fa410 WatchSource:0}: Error finding container ff07bd56badf592df087d95e4b3ce354dad5407862c4f3730db11001e77fa410: Status 404 returned error can't find the container with id ff07bd56badf592df087d95e4b3ce354dad5407862c4f3730db11001e77fa410
Oct 30 20:51:24.191846 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:24.191820    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"]
Oct 30 20:51:24.196297 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:24.196278    4060 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"]
Oct 30 20:51:25.033880 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:25.033842    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/korrel8r-6644769df5-5lq6h" event={"ID":"67d3dde5-a1a8-4823-bf1a-22be066c0aae","Type":"ContainerStarted","Data":"4c3365f81fb911001ab99df5201ba536b952a4c9b66b5d29c796beeb013e44c0"}
Oct 30 20:51:25.034270 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:25.033895    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/korrel8r-6644769df5-5lq6h" event={"ID":"67d3dde5-a1a8-4823-bf1a-22be066c0aae","Type":"ContainerStarted","Data":"ff07bd56badf592df087d95e4b3ce354dad5407862c4f3730db11001e77fa410"}
Oct 30 20:51:25.034270 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:25.033925    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/korrel8r-6644769df5-5lq6h"
Oct 30 20:51:25.151960 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:25.151733    4060 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/korrel8r-6644769df5-5lq6h" podStartSLOduration=2.151720558 podStartE2EDuration="2.151720558s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:51:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:51:25.150384524 +0000 UTC m=+903.907382834" watchObservedRunningTime="2026-10-30 20:51:25.151720558 +0000 UTC m=+903.908718857"
Oct 30 20:51:25.418229 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:25.418145    4060 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 20:51:25.422162 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:25.422132    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:51:25.428328 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:25.428306    4060 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d5b95904-51b0-4fb3-b957-2f5cf1d0eb06" path="/var/lib/kubelet/pods/d5b95904-51b0-4fb3-b957-2f5cf1d0eb06/volumes"
Oct 30 20:51:25.478041 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:25.478010    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-headless-tls\""
Oct 30 20:51:25.478210 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:25.478072    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-af329f19\""
Oct 30 20:51:25.478210 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:25.478187    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-monitoring-tls\""
Oct 30 20:51:25.478312 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:25.478260    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-dockercfg-h8bkr\""
Oct 30 20:51:25.493578 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:25.493547    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/de467ace-6763-4357-a712-edf03d3b6d8b-otlp-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"de467ace-6763-4357-a712-edf03d3b6d8b\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:51:25.493703 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:25.493660    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/de467ace-6763-4357-a712-edf03d3b6d8b-monitoring-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"de467ace-6763-4357-a712-edf03d3b6d8b\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:51:25.493703 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:25.493688    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/de467ace-6763-4357-a712-edf03d3b6d8b-otc-internal\") pod \"data-science-collector-collector-0\" (UID: \"de467ace-6763-4357-a712-edf03d3b6d8b\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:51:25.493822 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:25.493709    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6gwj7\" (UniqueName: \"kubernetes.io/projected/de467ace-6763-4357-a712-edf03d3b6d8b-kube-api-access-6gwj7\") pod \"data-science-collector-collector-0\" (UID: \"de467ace-6763-4357-a712-edf03d3b6d8b\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:51:25.528758 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:25.528724    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 20:51:25.594309 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:25.594275    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/de467ace-6763-4357-a712-edf03d3b6d8b-monitoring-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"de467ace-6763-4357-a712-edf03d3b6d8b\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:51:25.594309 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:25.594316    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/de467ace-6763-4357-a712-edf03d3b6d8b-otc-internal\") pod \"data-science-collector-collector-0\" (UID: \"de467ace-6763-4357-a712-edf03d3b6d8b\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:51:25.594575 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:25.594339    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6gwj7\" (UniqueName: \"kubernetes.io/projected/de467ace-6763-4357-a712-edf03d3b6d8b-kube-api-access-6gwj7\") pod \"data-science-collector-collector-0\" (UID: \"de467ace-6763-4357-a712-edf03d3b6d8b\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:51:25.594575 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:25.594376    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/de467ace-6763-4357-a712-edf03d3b6d8b-otlp-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"de467ace-6763-4357-a712-edf03d3b6d8b\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:51:25.595099 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:25.595075    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/de467ace-6763-4357-a712-edf03d3b6d8b-otc-internal\") pod \"data-science-collector-collector-0\" (UID: \"de467ace-6763-4357-a712-edf03d3b6d8b\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:51:25.596691 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:25.596663    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/de467ace-6763-4357-a712-edf03d3b6d8b-otlp-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"de467ace-6763-4357-a712-edf03d3b6d8b\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:51:25.596781 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:25.596719    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/de467ace-6763-4357-a712-edf03d3b6d8b-monitoring-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"de467ace-6763-4357-a712-edf03d3b6d8b\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:51:25.657128 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:25.657101    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6gwj7\" (UniqueName: \"kubernetes.io/projected/de467ace-6763-4357-a712-edf03d3b6d8b-kube-api-access-6gwj7\") pod \"data-science-collector-collector-0\" (UID: \"de467ace-6763-4357-a712-edf03d3b6d8b\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:51:25.736634 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:25.736600    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:51:26.109377 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:26.109352    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 20:51:26.111009 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:51:26.110985    4060 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde467ace_6763_4357_a712_edf03d3b6d8b.slice/crio-9f576860a9a11e8a5ec869fe2727401b682ebd787f4b126e4747a20fd4ff0c82 WatchSource:0}: Error finding container 9f576860a9a11e8a5ec869fe2727401b682ebd787f4b126e4747a20fd4ff0c82: Status 404 returned error can't find the container with id 9f576860a9a11e8a5ec869fe2727401b682ebd787f4b126e4747a20fd4ff0c82
Oct 30 20:51:26.113164 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:26.113132    4060 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 20:51:26.113252 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:26.113186    4060 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 20:51:27.044366 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:27.044328    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"de467ace-6763-4357-a712-edf03d3b6d8b","Type":"ContainerStarted","Data":"052348df6ddc516d2b2850354e038cbdba9b552db8d76924e6b1ee2d7603cd54"}
Oct 30 20:51:27.044545 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:27.044391    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"de467ace-6763-4357-a712-edf03d3b6d8b","Type":"ContainerStarted","Data":"9f576860a9a11e8a5ec869fe2727401b682ebd787f4b126e4747a20fd4ff0c82"}
Oct 30 20:51:27.175228 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:27.175174    4060 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-collector-0" podStartSLOduration=2.17515892 podStartE2EDuration="2.17515892s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:51:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:51:27.173665281 +0000 UTC m=+905.930663580" watchObservedRunningTime="2026-10-30 20:51:27.17515892 +0000 UTC m=+905.932157218"
Oct 30 20:51:36.040663 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:51:36.040634    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/korrel8r-6644769df5-5lq6h"
Oct 30 20:51:42.149743 ip-10-0-142-4 kubenswrapper[4060]: E1030 20:51:42.149703    4060 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v2f4x" containerName="extractor"
Oct 30 20:52:12.150083 ip-10-0-142-4 kubenswrapper[4060]: E1030 20:52:12.150007    4060 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v2f4x" containerName="extractor"
Oct 30 20:52:22.634681 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:52:22.634651    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/korrel8r-6644769df5-5lq6h"]
Oct 30 20:52:22.635139 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:52:22.634873    4060 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/korrel8r-6644769df5-5lq6h" podUID="67d3dde5-a1a8-4823-bf1a-22be066c0aae" containerName="korrel8r" containerID="cri-o://4c3365f81fb911001ab99df5201ba536b952a4c9b66b5d29c796beeb013e44c0" gracePeriod=30
Oct 30 20:52:22.880659 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:52:22.880632    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/korrel8r-6644769df5-5lq6h"
Oct 30 20:52:23.004723 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:52:23.004694    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/67d3dde5-a1a8-4823-bf1a-22be066c0aae-config\" (UniqueName: \"kubernetes.io/configmap/67d3dde5-a1a8-4823-bf1a-22be066c0aae-config\") pod \"67d3dde5-a1a8-4823-bf1a-22be066c0aae\" (UID: \"67d3dde5-a1a8-4823-bf1a-22be066c0aae\") "
Oct 30 20:52:23.004919 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:52:23.004751    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/67d3dde5-a1a8-4823-bf1a-22be066c0aae-tls\" (UniqueName: \"kubernetes.io/secret/67d3dde5-a1a8-4823-bf1a-22be066c0aae-tls\") pod \"67d3dde5-a1a8-4823-bf1a-22be066c0aae\" (UID: \"67d3dde5-a1a8-4823-bf1a-22be066c0aae\") "
Oct 30 20:52:23.004919 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:52:23.004796    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/67d3dde5-a1a8-4823-bf1a-22be066c0aae-kube-api-access-wm9lv\" (UniqueName: \"kubernetes.io/projected/67d3dde5-a1a8-4823-bf1a-22be066c0aae-kube-api-access-wm9lv\") pod \"67d3dde5-a1a8-4823-bf1a-22be066c0aae\" (UID: \"67d3dde5-a1a8-4823-bf1a-22be066c0aae\") "
Oct 30 20:52:23.005487 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:52:23.005272    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/67d3dde5-a1a8-4823-bf1a-22be066c0aae-config" pod "67d3dde5-a1a8-4823-bf1a-22be066c0aae" (UID: "67d3dde5-a1a8-4823-bf1a-22be066c0aae"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:52:23.005487 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:52:23.005457    4060 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/67d3dde5-a1a8-4823-bf1a-22be066c0aae-config\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:52:23.007525 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:52:23.007470    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/67d3dde5-a1a8-4823-bf1a-22be066c0aae-tls" pod "67d3dde5-a1a8-4823-bf1a-22be066c0aae" (UID: "67d3dde5-a1a8-4823-bf1a-22be066c0aae"). InnerVolumeSpecName "tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:52:23.007628 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:52:23.007603    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/67d3dde5-a1a8-4823-bf1a-22be066c0aae-kube-api-access-wm9lv" pod "67d3dde5-a1a8-4823-bf1a-22be066c0aae" (UID: "67d3dde5-a1a8-4823-bf1a-22be066c0aae"). InnerVolumeSpecName "kube-api-access-wm9lv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:52:23.106798 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:52:23.106763    4060 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wm9lv\" (UniqueName: \"kubernetes.io/projected/67d3dde5-a1a8-4823-bf1a-22be066c0aae-kube-api-access-wm9lv\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:52:23.106798 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:52:23.106791    4060 reconciler_common.go:299] "Volume detached for volume \"tls\" (UniqueName: \"kubernetes.io/secret/67d3dde5-a1a8-4823-bf1a-22be066c0aae-tls\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:52:23.295047 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:52:23.294972    4060 generic.go:356] "Generic (PLEG): container finished" podID="67d3dde5-a1a8-4823-bf1a-22be066c0aae" containerID="4c3365f81fb911001ab99df5201ba536b952a4c9b66b5d29c796beeb013e44c0" exitCode=0
Oct 30 20:52:23.295047 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:52:23.295016    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/korrel8r-6644769df5-5lq6h"
Oct 30 20:52:23.295047 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:52:23.295019    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/korrel8r-6644769df5-5lq6h" event={"ID":"67d3dde5-a1a8-4823-bf1a-22be066c0aae","Type":"ContainerDied","Data":"4c3365f81fb911001ab99df5201ba536b952a4c9b66b5d29c796beeb013e44c0"}
Oct 30 20:52:23.295262 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:52:23.295071    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/korrel8r-6644769df5-5lq6h" event={"ID":"67d3dde5-a1a8-4823-bf1a-22be066c0aae","Type":"ContainerDied","Data":"ff07bd56badf592df087d95e4b3ce354dad5407862c4f3730db11001e77fa410"}
Oct 30 20:52:23.295262 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:52:23.295101    4060 scope.go:122] "RemoveContainer" containerID="4c3365f81fb911001ab99df5201ba536b952a4c9b66b5d29c796beeb013e44c0"
Oct 30 20:52:23.303713 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:52:23.303692    4060 scope.go:122] "RemoveContainer" containerID="4c3365f81fb911001ab99df5201ba536b952a4c9b66b5d29c796beeb013e44c0"
Oct 30 20:52:23.303994 ip-10-0-142-4 kubenswrapper[4060]: E1030 20:52:23.303972    4060 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4c3365f81fb911001ab99df5201ba536b952a4c9b66b5d29c796beeb013e44c0\": container with ID starting with 4c3365f81fb911001ab99df5201ba536b952a4c9b66b5d29c796beeb013e44c0 not found: ID does not exist" containerID="4c3365f81fb911001ab99df5201ba536b952a4c9b66b5d29c796beeb013e44c0"
Oct 30 20:52:23.304041 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:52:23.304003    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c3365f81fb911001ab99df5201ba536b952a4c9b66b5d29c796beeb013e44c0"} err="failed to get container status \"4c3365f81fb911001ab99df5201ba536b952a4c9b66b5d29c796beeb013e44c0\": rpc error: code = NotFound desc = could not find container \"4c3365f81fb911001ab99df5201ba536b952a4c9b66b5d29c796beeb013e44c0\": container with ID starting with 4c3365f81fb911001ab99df5201ba536b952a4c9b66b5d29c796beeb013e44c0 not found: ID does not exist"
Oct 30 20:52:23.468546 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:52:23.468516    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/korrel8r-6644769df5-5lq6h"]
Oct 30 20:52:23.517765 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:52:23.517738    4060 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/korrel8r-6644769df5-5lq6h"]
Oct 30 20:52:24.018668 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:52:24.018638    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 20:52:24.019176 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:52:24.018865    4060 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-collector-0" podUID="de467ace-6763-4357-a712-edf03d3b6d8b" containerName="otc-container" containerID="cri-o://052348df6ddc516d2b2850354e038cbdba9b552db8d76924e6b1ee2d7603cd54" gracePeriod=30
Oct 30 20:52:24.275204 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:52:24.275151    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:52:24.301132 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:52:24.301105    4060 generic.go:356] "Generic (PLEG): container finished" podID="de467ace-6763-4357-a712-edf03d3b6d8b" containerID="052348df6ddc516d2b2850354e038cbdba9b552db8d76924e6b1ee2d7603cd54" exitCode=0
Oct 30 20:52:24.301260 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:52:24.301149    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:52:24.301260 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:52:24.301185    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"de467ace-6763-4357-a712-edf03d3b6d8b","Type":"ContainerDied","Data":"052348df6ddc516d2b2850354e038cbdba9b552db8d76924e6b1ee2d7603cd54"}
Oct 30 20:52:24.301336 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:52:24.301266    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"de467ace-6763-4357-a712-edf03d3b6d8b","Type":"ContainerDied","Data":"9f576860a9a11e8a5ec869fe2727401b682ebd787f4b126e4747a20fd4ff0c82"}
Oct 30 20:52:24.301336 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:52:24.301298    4060 scope.go:122] "RemoveContainer" containerID="052348df6ddc516d2b2850354e038cbdba9b552db8d76924e6b1ee2d7603cd54"
Oct 30 20:52:24.309077 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:52:24.309059    4060 scope.go:122] "RemoveContainer" containerID="052348df6ddc516d2b2850354e038cbdba9b552db8d76924e6b1ee2d7603cd54"
Oct 30 20:52:24.309359 ip-10-0-142-4 kubenswrapper[4060]: E1030 20:52:24.309339    4060 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"052348df6ddc516d2b2850354e038cbdba9b552db8d76924e6b1ee2d7603cd54\": container with ID starting with 052348df6ddc516d2b2850354e038cbdba9b552db8d76924e6b1ee2d7603cd54 not found: ID does not exist" containerID="052348df6ddc516d2b2850354e038cbdba9b552db8d76924e6b1ee2d7603cd54"
Oct 30 20:52:24.309396 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:52:24.309368    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"052348df6ddc516d2b2850354e038cbdba9b552db8d76924e6b1ee2d7603cd54"} err="failed to get container status \"052348df6ddc516d2b2850354e038cbdba9b552db8d76924e6b1ee2d7603cd54\": rpc error: code = NotFound desc = could not find container \"052348df6ddc516d2b2850354e038cbdba9b552db8d76924e6b1ee2d7603cd54\": container with ID starting with 052348df6ddc516d2b2850354e038cbdba9b552db8d76924e6b1ee2d7603cd54 not found: ID does not exist"
Oct 30 20:52:24.416799 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:52:24.416766    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/de467ace-6763-4357-a712-edf03d3b6d8b-otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/de467ace-6763-4357-a712-edf03d3b6d8b-otlp-tls-certs\") pod \"de467ace-6763-4357-a712-edf03d3b6d8b\" (UID: \"de467ace-6763-4357-a712-edf03d3b6d8b\") "
Oct 30 20:52:24.416992 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:52:24.416830    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/de467ace-6763-4357-a712-edf03d3b6d8b-otc-internal\" (UniqueName: \"kubernetes.io/configmap/de467ace-6763-4357-a712-edf03d3b6d8b-otc-internal\") pod \"de467ace-6763-4357-a712-edf03d3b6d8b\" (UID: \"de467ace-6763-4357-a712-edf03d3b6d8b\") "
Oct 30 20:52:24.416992 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:52:24.416935    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/de467ace-6763-4357-a712-edf03d3b6d8b-monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/de467ace-6763-4357-a712-edf03d3b6d8b-monitoring-tls-certs\") pod \"de467ace-6763-4357-a712-edf03d3b6d8b\" (UID: \"de467ace-6763-4357-a712-edf03d3b6d8b\") "
Oct 30 20:52:24.417111 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:52:24.416993    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/de467ace-6763-4357-a712-edf03d3b6d8b-kube-api-access-6gwj7\" (UniqueName: \"kubernetes.io/projected/de467ace-6763-4357-a712-edf03d3b6d8b-kube-api-access-6gwj7\") pod \"de467ace-6763-4357-a712-edf03d3b6d8b\" (UID: \"de467ace-6763-4357-a712-edf03d3b6d8b\") "
Oct 30 20:52:24.417167 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:52:24.417122    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/de467ace-6763-4357-a712-edf03d3b6d8b-otc-internal" pod "de467ace-6763-4357-a712-edf03d3b6d8b" (UID: "de467ace-6763-4357-a712-edf03d3b6d8b"). InnerVolumeSpecName "otc-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:52:24.417279 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:52:24.417250    4060 reconciler_common.go:299] "Volume detached for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/de467ace-6763-4357-a712-edf03d3b6d8b-otc-internal\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:52:24.419141 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:52:24.419110    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/de467ace-6763-4357-a712-edf03d3b6d8b-kube-api-access-6gwj7" pod "de467ace-6763-4357-a712-edf03d3b6d8b" (UID: "de467ace-6763-4357-a712-edf03d3b6d8b"). InnerVolumeSpecName "kube-api-access-6gwj7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:52:24.419426 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:52:24.419402    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/de467ace-6763-4357-a712-edf03d3b6d8b-otlp-tls-certs" pod "de467ace-6763-4357-a712-edf03d3b6d8b" (UID: "de467ace-6763-4357-a712-edf03d3b6d8b"). InnerVolumeSpecName "otlp-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:52:24.419543 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:52:24.419526    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/de467ace-6763-4357-a712-edf03d3b6d8b-monitoring-tls-certs" pod "de467ace-6763-4357-a712-edf03d3b6d8b" (UID: "de467ace-6763-4357-a712-edf03d3b6d8b"). InnerVolumeSpecName "monitoring-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:52:24.518386 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:52:24.518356    4060 reconciler_common.go:299] "Volume detached for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/de467ace-6763-4357-a712-edf03d3b6d8b-monitoring-tls-certs\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:52:24.518386 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:52:24.518378    4060 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6gwj7\" (UniqueName: \"kubernetes.io/projected/de467ace-6763-4357-a712-edf03d3b6d8b-kube-api-access-6gwj7\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:52:24.518386 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:52:24.518390    4060 reconciler_common.go:299] "Volume detached for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/de467ace-6763-4357-a712-edf03d3b6d8b-otlp-tls-certs\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:52:24.726248 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:52:24.726217    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 20:52:24.732974 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:52:24.732947    4060 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 20:52:25.426340 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:52:25.426311    4060 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="67d3dde5-a1a8-4823-bf1a-22be066c0aae" path="/var/lib/kubelet/pods/67d3dde5-a1a8-4823-bf1a-22be066c0aae/volumes"
Oct 30 20:52:25.426749 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:52:25.426693    4060 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="de467ace-6763-4357-a712-edf03d3b6d8b" path="/var/lib/kubelet/pods/de467ace-6763-4357-a712-edf03d3b6d8b/volumes"
Oct 30 20:52:39.549851 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:52:39.549818    4060 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-56cq2"]
Oct 30 20:52:39.550230 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:52:39.550099    4060 cpu_manager.go:414] "containerMap: removing container" podUID="de467ace-6763-4357-a712-edf03d3b6d8b" containerName="otc-container"
Oct 30 20:52:39.550230 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:52:39.550109    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="de467ace-6763-4357-a712-edf03d3b6d8b" containerName="otc-container"
Oct 30 20:52:39.550230 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:52:39.550139    4060 cpu_manager.go:414] "containerMap: removing container" podUID="67d3dde5-a1a8-4823-bf1a-22be066c0aae" containerName="korrel8r"
Oct 30 20:52:39.550230 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:52:39.550144    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="67d3dde5-a1a8-4823-bf1a-22be066c0aae" containerName="korrel8r"
Oct 30 20:52:39.550230 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:52:39.550217    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="67d3dde5-a1a8-4823-bf1a-22be066c0aae" containerName="korrel8r"
Oct 30 20:52:39.550230 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:52:39.550224    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="de467ace-6763-4357-a712-edf03d3b6d8b" containerName="otc-container"
Oct 30 20:52:39.553102 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:52:39.553086    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-56cq2"
Oct 30 20:52:39.637245 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:52:39.637213    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-ca\" (UniqueName: \"kubernetes.io/configmap/ebf65914-66d4-4809-8ad4-0b897de46356-prometheus-ca\") pod \"data-science-prometheus-cluster-proxy-545f759f7c-56cq2\" (UID: \"ebf65914-66d4-4809-8ad4-0b897de46356\") " pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-56cq2"
Oct 30 20:52:39.637417 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:52:39.637252    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ebf65914-66d4-4809-8ad4-0b897de46356-kube-rbac-proxy-config\") pod \"data-science-prometheus-cluster-proxy-545f759f7c-56cq2\" (UID: \"ebf65914-66d4-4809-8ad4-0b897de46356\") " pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-56cq2"
Oct 30 20:52:39.637417 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:52:39.637280    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r2lsr\" (UniqueName: \"kubernetes.io/projected/ebf65914-66d4-4809-8ad4-0b897de46356-kube-api-access-r2lsr\") pod \"data-science-prometheus-cluster-proxy-545f759f7c-56cq2\" (UID: \"ebf65914-66d4-4809-8ad4-0b897de46356\") " pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-56cq2"
Oct 30 20:52:39.637510 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:52:39.637413    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/ebf65914-66d4-4809-8ad4-0b897de46356-tls\") pod \"data-science-prometheus-cluster-proxy-545f759f7c-56cq2\" (UID: \"ebf65914-66d4-4809-8ad4-0b897de46356\") " pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-56cq2"
Oct 30 20:52:39.637510 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:52:39.637451    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-client-cert\" (UniqueName: \"kubernetes.io/secret/ebf65914-66d4-4809-8ad4-0b897de46356-prometheus-client-cert\") pod \"data-science-prometheus-cluster-proxy-545f759f7c-56cq2\" (UID: \"ebf65914-66d4-4809-8ad4-0b897de46356\") " pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-56cq2"
Oct 30 20:52:39.655671 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:52:39.655636    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"openshift-service-ca.crt\""
Oct 30 20:52:39.655671 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:52:39.655660    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"kube-root-ca.crt\""
Oct 30 20:52:39.655671 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:52:39.655636    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"prometheus-operated-tls\""
Oct 30 20:52:39.655885 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:52:39.655636    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-prometheus-cluster-proxy-tls\""
Oct 30 20:52:39.656220 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:52:39.656198    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-prometheus-cluster-proxy-kube-rbac-proxy\""
Oct 30 20:52:39.656220 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:52:39.656208    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-prometheus-cluster-proxy-dockercfg-wmb9h\""
Oct 30 20:52:39.656376 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:52:39.656267    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"prometheus-web-tls-ca\""
Oct 30 20:52:39.658008 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:52:39.657991    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-56cq2"]
Oct 30 20:52:39.738265 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:52:39.738232    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-client-cert\" (UniqueName: \"kubernetes.io/secret/ebf65914-66d4-4809-8ad4-0b897de46356-prometheus-client-cert\") pod \"data-science-prometheus-cluster-proxy-545f759f7c-56cq2\" (UID: \"ebf65914-66d4-4809-8ad4-0b897de46356\") " pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-56cq2"
Oct 30 20:52:39.738429 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:52:39.738283    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-ca\" (UniqueName: \"kubernetes.io/configmap/ebf65914-66d4-4809-8ad4-0b897de46356-prometheus-ca\") pod \"data-science-prometheus-cluster-proxy-545f759f7c-56cq2\" (UID: \"ebf65914-66d4-4809-8ad4-0b897de46356\") " pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-56cq2"
Oct 30 20:52:39.738429 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:52:39.738313    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ebf65914-66d4-4809-8ad4-0b897de46356-kube-rbac-proxy-config\") pod \"data-science-prometheus-cluster-proxy-545f759f7c-56cq2\" (UID: \"ebf65914-66d4-4809-8ad4-0b897de46356\") " pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-56cq2"
Oct 30 20:52:39.738429 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:52:39.738344    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r2lsr\" (UniqueName: \"kubernetes.io/projected/ebf65914-66d4-4809-8ad4-0b897de46356-kube-api-access-r2lsr\") pod \"data-science-prometheus-cluster-proxy-545f759f7c-56cq2\" (UID: \"ebf65914-66d4-4809-8ad4-0b897de46356\") " pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-56cq2"
Oct 30 20:52:39.738429 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:52:39.738375    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/ebf65914-66d4-4809-8ad4-0b897de46356-tls\") pod \"data-science-prometheus-cluster-proxy-545f759f7c-56cq2\" (UID: \"ebf65914-66d4-4809-8ad4-0b897de46356\") " pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-56cq2"
Oct 30 20:52:39.739208 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:52:39.739175    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-ca\" (UniqueName: \"kubernetes.io/configmap/ebf65914-66d4-4809-8ad4-0b897de46356-prometheus-ca\") pod \"data-science-prometheus-cluster-proxy-545f759f7c-56cq2\" (UID: \"ebf65914-66d4-4809-8ad4-0b897de46356\") " pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-56cq2"
Oct 30 20:52:39.740857 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:52:39.740826    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-client-cert\" (UniqueName: \"kubernetes.io/secret/ebf65914-66d4-4809-8ad4-0b897de46356-prometheus-client-cert\") pod \"data-science-prometheus-cluster-proxy-545f759f7c-56cq2\" (UID: \"ebf65914-66d4-4809-8ad4-0b897de46356\") " pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-56cq2"
Oct 30 20:52:39.740972 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:52:39.740951    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ebf65914-66d4-4809-8ad4-0b897de46356-kube-rbac-proxy-config\") pod \"data-science-prometheus-cluster-proxy-545f759f7c-56cq2\" (UID: \"ebf65914-66d4-4809-8ad4-0b897de46356\") " pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-56cq2"
Oct 30 20:52:39.741016 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:52:39.740953    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls\" (UniqueName: \"kubernetes.io/secret/ebf65914-66d4-4809-8ad4-0b897de46356-tls\") pod \"data-science-prometheus-cluster-proxy-545f759f7c-56cq2\" (UID: \"ebf65914-66d4-4809-8ad4-0b897de46356\") " pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-56cq2"
Oct 30 20:52:39.799533 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:52:39.799485    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r2lsr\" (UniqueName: \"kubernetes.io/projected/ebf65914-66d4-4809-8ad4-0b897de46356-kube-api-access-r2lsr\") pod \"data-science-prometheus-cluster-proxy-545f759f7c-56cq2\" (UID: \"ebf65914-66d4-4809-8ad4-0b897de46356\") " pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-56cq2"
Oct 30 20:52:39.864971 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:52:39.864877    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-56cq2"
Oct 30 20:52:39.888259 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:52:39.888229    4060 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/korrel8r-66d6f7f696-tqf4s"]
Oct 30 20:52:39.891764 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:52:39.891736    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/korrel8r-66d6f7f696-tqf4s"
Oct 30 20:52:39.945348 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:52:39.945263    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"korrel8r-tls\""
Oct 30 20:52:39.945348 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:52:39.945273    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"korrel8r-config\""
Oct 30 20:52:39.945583 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:52:39.945462    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"korrel8r-dockercfg-xb4dt\""
Oct 30 20:52:39.950475 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:52:39.950451    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/korrel8r-66d6f7f696-tqf4s"]
Oct 30 20:52:40.040891 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:52:40.040856    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4d103d18-4fcf-4ec0-8d9a-f3d3f170e16e-config\") pod \"korrel8r-66d6f7f696-tqf4s\" (UID: \"4d103d18-4fcf-4ec0-8d9a-f3d3f170e16e\") " pod="redhat-ods-monitoring/korrel8r-66d6f7f696-tqf4s"
Oct 30 20:52:40.041067 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:52:40.040909    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cdbrg\" (UniqueName: \"kubernetes.io/projected/4d103d18-4fcf-4ec0-8d9a-f3d3f170e16e-kube-api-access-cdbrg\") pod \"korrel8r-66d6f7f696-tqf4s\" (UID: \"4d103d18-4fcf-4ec0-8d9a-f3d3f170e16e\") " pod="redhat-ods-monitoring/korrel8r-66d6f7f696-tqf4s"
Oct 30 20:52:40.041067 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:52:40.040987    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/4d103d18-4fcf-4ec0-8d9a-f3d3f170e16e-tls\") pod \"korrel8r-66d6f7f696-tqf4s\" (UID: \"4d103d18-4fcf-4ec0-8d9a-f3d3f170e16e\") " pod="redhat-ods-monitoring/korrel8r-66d6f7f696-tqf4s"
Oct 30 20:52:40.141742 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:52:40.141667    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4d103d18-4fcf-4ec0-8d9a-f3d3f170e16e-config\") pod \"korrel8r-66d6f7f696-tqf4s\" (UID: \"4d103d18-4fcf-4ec0-8d9a-f3d3f170e16e\") " pod="redhat-ods-monitoring/korrel8r-66d6f7f696-tqf4s"
Oct 30 20:52:40.141742 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:52:40.141712    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cdbrg\" (UniqueName: \"kubernetes.io/projected/4d103d18-4fcf-4ec0-8d9a-f3d3f170e16e-kube-api-access-cdbrg\") pod \"korrel8r-66d6f7f696-tqf4s\" (UID: \"4d103d18-4fcf-4ec0-8d9a-f3d3f170e16e\") " pod="redhat-ods-monitoring/korrel8r-66d6f7f696-tqf4s"
Oct 30 20:52:40.141958 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:52:40.141747    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/4d103d18-4fcf-4ec0-8d9a-f3d3f170e16e-tls\") pod \"korrel8r-66d6f7f696-tqf4s\" (UID: \"4d103d18-4fcf-4ec0-8d9a-f3d3f170e16e\") " pod="redhat-ods-monitoring/korrel8r-66d6f7f696-tqf4s"
Oct 30 20:52:40.142413 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:52:40.142391    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4d103d18-4fcf-4ec0-8d9a-f3d3f170e16e-config\") pod \"korrel8r-66d6f7f696-tqf4s\" (UID: \"4d103d18-4fcf-4ec0-8d9a-f3d3f170e16e\") " pod="redhat-ods-monitoring/korrel8r-66d6f7f696-tqf4s"
Oct 30 20:52:40.144118 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:52:40.144098    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls\" (UniqueName: \"kubernetes.io/secret/4d103d18-4fcf-4ec0-8d9a-f3d3f170e16e-tls\") pod \"korrel8r-66d6f7f696-tqf4s\" (UID: \"4d103d18-4fcf-4ec0-8d9a-f3d3f170e16e\") " pod="redhat-ods-monitoring/korrel8r-66d6f7f696-tqf4s"
Oct 30 20:52:40.203104 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:52:40.203070    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cdbrg\" (UniqueName: \"kubernetes.io/projected/4d103d18-4fcf-4ec0-8d9a-f3d3f170e16e-kube-api-access-cdbrg\") pod \"korrel8r-66d6f7f696-tqf4s\" (UID: \"4d103d18-4fcf-4ec0-8d9a-f3d3f170e16e\") " pod="redhat-ods-monitoring/korrel8r-66d6f7f696-tqf4s"
Oct 30 20:52:40.204838 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:52:40.204821    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/korrel8r-66d6f7f696-tqf4s"
Oct 30 20:52:40.243482 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:52:40.243105    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-56cq2"]
Oct 30 20:52:40.245108 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:52:40.245074    4060 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podebf65914_66d4_4809_8ad4_0b897de46356.slice/crio-ed1e000ec0f828df75f19e211d1dd73b521c71e3c1c4404139c280806ee7e0f6 WatchSource:0}: Error finding container ed1e000ec0f828df75f19e211d1dd73b521c71e3c1c4404139c280806ee7e0f6: Status 404 returned error can't find the container with id ed1e000ec0f828df75f19e211d1dd73b521c71e3c1c4404139c280806ee7e0f6
Oct 30 20:52:40.373635 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:52:40.373598    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-56cq2" event={"ID":"ebf65914-66d4-4809-8ad4-0b897de46356","Type":"ContainerStarted","Data":"ed1e000ec0f828df75f19e211d1dd73b521c71e3c1c4404139c280806ee7e0f6"}
Oct 30 20:52:40.595392 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:52:40.595369    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/korrel8r-66d6f7f696-tqf4s"]
Oct 30 20:52:40.597633 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:52:40.597603    4060 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d103d18_4fcf_4ec0_8d9a_f3d3f170e16e.slice/crio-66d8895009de3e6bd878bbd50d91ad92867f197bc9a5999bc25f126e87ae4981 WatchSource:0}: Error finding container 66d8895009de3e6bd878bbd50d91ad92867f197bc9a5999bc25f126e87ae4981: Status 404 returned error can't find the container with id 66d8895009de3e6bd878bbd50d91ad92867f197bc9a5999bc25f126e87ae4981
Oct 30 20:52:41.380749 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:52:41.380720    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-56cq2" event={"ID":"ebf65914-66d4-4809-8ad4-0b897de46356","Type":"ContainerStarted","Data":"38ed6e9f2ab05a8abc1b11738d9531c44febce7083b82fcedb05b1e155e3a5db"}
Oct 30 20:52:41.380914 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:52:41.380783    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-56cq2"
Oct 30 20:52:41.382310 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:52:41.382278    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/korrel8r-66d6f7f696-tqf4s" event={"ID":"4d103d18-4fcf-4ec0-8d9a-f3d3f170e16e","Type":"ContainerStarted","Data":"2c47c8a3986a53bc824b8d68e51d98d49db1c04327d412bd3a9b95320449ed7d"}
Oct 30 20:52:41.382419 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:52:41.382333    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/korrel8r-66d6f7f696-tqf4s" event={"ID":"4d103d18-4fcf-4ec0-8d9a-f3d3f170e16e","Type":"ContainerStarted","Data":"66d8895009de3e6bd878bbd50d91ad92867f197bc9a5999bc25f126e87ae4981"}
Oct 30 20:52:41.382419 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:52:41.382359    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/korrel8r-66d6f7f696-tqf4s"
Oct 30 20:52:41.500276 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:52:41.500230    4060 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-56cq2" podStartSLOduration=2.5002158469999998 podStartE2EDuration="2.500215847s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:52:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:52:41.498651142 +0000 UTC m=+980.255649441" watchObservedRunningTime="2026-10-30 20:52:41.500215847 +0000 UTC m=+980.257214191"
Oct 30 20:52:41.617230 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:52:41.617183    4060 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/korrel8r-66d6f7f696-tqf4s" podStartSLOduration=2.617168398 podStartE2EDuration="2.617168398s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:52:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:52:41.616192368 +0000 UTC m=+980.373190667" watchObservedRunningTime="2026-10-30 20:52:41.617168398 +0000 UTC m=+980.374166694"
Oct 30 20:52:42.154467 ip-10-0-142-4 kubenswrapper[4060]: E1030 20:52:42.154424    4060 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v2f4x" containerName="extractor"
Oct 30 20:52:44.690850 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:52:44.690818    4060 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 20:52:44.694231 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:52:44.694212    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:52:44.779425 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:52:44.779387    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/65767597-b144-419e-90f2-9ee2e5b585a5-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-0\" (UID: \"65767597-b144-419e-90f2-9ee2e5b585a5\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:52:44.779425 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:52:44.779429    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/65767597-b144-419e-90f2-9ee2e5b585a5-otc-internal\") pod \"data-science-collector-collector-0\" (UID: \"65767597-b144-419e-90f2-9ee2e5b585a5\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:52:44.779678 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:52:44.779540    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/65767597-b144-419e-90f2-9ee2e5b585a5-otlp-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"65767597-b144-419e-90f2-9ee2e5b585a5\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:52:44.779678 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:52:44.779577    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/65767597-b144-419e-90f2-9ee2e5b585a5-monitoring-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"65767597-b144-419e-90f2-9ee2e5b585a5\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:52:44.779789 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:52:44.779717    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/65767597-b144-419e-90f2-9ee2e5b585a5-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"65767597-b144-419e-90f2-9ee2e5b585a5\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:52:44.779789 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:52:44.779772    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p7vtr\" (UniqueName: \"kubernetes.io/projected/65767597-b144-419e-90f2-9ee2e5b585a5-kube-api-access-p7vtr\") pod \"data-science-collector-collector-0\" (UID: \"65767597-b144-419e-90f2-9ee2e5b585a5\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:52:44.796186 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:52:44.796155    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-headless-tls\""
Oct 30 20:52:44.796548 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:52:44.796219    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-tls\""
Oct 30 20:52:44.796548 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:52:44.796219    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-monitoring-tls\""
Oct 30 20:52:44.796751 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:52:44.796348    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-ta-client-cert\""
Oct 30 20:52:44.796751 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:52:44.796528    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-dockercfg-vtvlx\""
Oct 30 20:52:44.797387 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:52:44.797370    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-6d9d4583\""
Oct 30 20:52:44.799502 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:52:44.799473    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 20:52:44.880432 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:52:44.880399    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/65767597-b144-419e-90f2-9ee2e5b585a5-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"65767597-b144-419e-90f2-9ee2e5b585a5\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:52:44.880622 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:52:44.880443    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7vtr\" (UniqueName: \"kubernetes.io/projected/65767597-b144-419e-90f2-9ee2e5b585a5-kube-api-access-p7vtr\") pod \"data-science-collector-collector-0\" (UID: \"65767597-b144-419e-90f2-9ee2e5b585a5\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:52:44.880622 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:52:44.880467    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/65767597-b144-419e-90f2-9ee2e5b585a5-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-0\" (UID: \"65767597-b144-419e-90f2-9ee2e5b585a5\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:52:44.880622 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:52:44.880484    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/65767597-b144-419e-90f2-9ee2e5b585a5-otc-internal\") pod \"data-science-collector-collector-0\" (UID: \"65767597-b144-419e-90f2-9ee2e5b585a5\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:52:44.880622 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:52:44.880523    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/65767597-b144-419e-90f2-9ee2e5b585a5-otlp-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"65767597-b144-419e-90f2-9ee2e5b585a5\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:52:44.880622 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:52:44.880546    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/65767597-b144-419e-90f2-9ee2e5b585a5-monitoring-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"65767597-b144-419e-90f2-9ee2e5b585a5\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:52:44.880622 ip-10-0-142-4 kubenswrapper[4060]: E1030 20:52:44.880597    4060 secret.go:189] Couldn't get secret redhat-ods-monitoring/data-science-collector-collector-headless-tls: secret "data-science-collector-collector-headless-tls" not found
Oct 30 20:52:44.880924 ip-10-0-142-4 kubenswrapper[4060]: E1030 20:52:44.880671    4060 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65767597-b144-419e-90f2-9ee2e5b585a5-otlp-tls-certs podName:65767597-b144-419e-90f2-9ee2e5b585a5 nodeName:}" failed. No retries permitted until 2026-10-30 20:52:45.380650775 +0000 UTC m=+984.137649054 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "otlp-tls-certs" (UniqueName: "kubernetes.io/secret/65767597-b144-419e-90f2-9ee2e5b585a5-otlp-tls-certs") pod "data-science-collector-collector-0" (UID: "65767597-b144-419e-90f2-9ee2e5b585a5") : secret "data-science-collector-collector-headless-tls" not found
Oct 30 20:52:44.881262 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:52:44.881239    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/65767597-b144-419e-90f2-9ee2e5b585a5-otc-internal\") pod \"data-science-collector-collector-0\" (UID: \"65767597-b144-419e-90f2-9ee2e5b585a5\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:52:44.882873 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:52:44.882853    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/65767597-b144-419e-90f2-9ee2e5b585a5-monitoring-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"65767597-b144-419e-90f2-9ee2e5b585a5\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:52:44.883428 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:52:44.883408    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/65767597-b144-419e-90f2-9ee2e5b585a5-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"65767597-b144-419e-90f2-9ee2e5b585a5\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:52:44.883538 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:52:44.883466    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/65767597-b144-419e-90f2-9ee2e5b585a5-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-0\" (UID: \"65767597-b144-419e-90f2-9ee2e5b585a5\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:52:44.943020 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:52:44.942942    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p7vtr\" (UniqueName: \"kubernetes.io/projected/65767597-b144-419e-90f2-9ee2e5b585a5-kube-api-access-p7vtr\") pod \"data-science-collector-collector-0\" (UID: \"65767597-b144-419e-90f2-9ee2e5b585a5\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:52:45.385515 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:52:45.385463    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/65767597-b144-419e-90f2-9ee2e5b585a5-otlp-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"65767597-b144-419e-90f2-9ee2e5b585a5\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:52:45.387865 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:52:45.387835    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/65767597-b144-419e-90f2-9ee2e5b585a5-otlp-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"65767597-b144-419e-90f2-9ee2e5b585a5\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:52:45.609631 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:52:45.609595    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:52:45.981690 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:52:45.981611    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 20:52:45.983879 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:52:45.983853    4060 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65767597_b144_419e_90f2_9ee2e5b585a5.slice/crio-d14b8cc3a8739c92ea6cb2e205926a6bb6442e7da5aa3bfc9251bddf1deabbca WatchSource:0}: Error finding container d14b8cc3a8739c92ea6cb2e205926a6bb6442e7da5aa3bfc9251bddf1deabbca: Status 404 returned error can't find the container with id d14b8cc3a8739c92ea6cb2e205926a6bb6442e7da5aa3bfc9251bddf1deabbca
Oct 30 20:52:45.986235 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:52:45.986202    4060 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 20:52:45.986320 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:52:45.986260    4060 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 20:52:46.406014 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:52:46.405927    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"65767597-b144-419e-90f2-9ee2e5b585a5","Type":"ContainerStarted","Data":"93d79b6f882397e4cf67d8b0ef6a71fba3599d19ae1679e1c43af1e6d0683a58"}
Oct 30 20:52:46.406014 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:52:46.405981    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"65767597-b144-419e-90f2-9ee2e5b585a5","Type":"ContainerStarted","Data":"d14b8cc3a8739c92ea6cb2e205926a6bb6442e7da5aa3bfc9251bddf1deabbca"}
Oct 30 20:52:46.528130 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:52:46.528078    4060 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-collector-0" podStartSLOduration=2.5280668139999998 podStartE2EDuration="2.528066814s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:52:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:52:46.527090532 +0000 UTC m=+985.284088829" watchObservedRunningTime="2026-10-30 20:52:46.528066814 +0000 UTC m=+985.285065111"
Oct 30 20:52:47.389659 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:52:47.389631    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-56cq2"
Oct 30 20:52:52.389347 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:52:52.389317    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/korrel8r-66d6f7f696-tqf4s"
Oct 30 20:52:59.082602 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:52:59.082570    4060 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"]
Oct 30 20:52:59.086191 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:52:59.086174    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 20:52:59.138751 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:52:59.138723    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-monitoringstack-alertmanager-dockercfg-g6pst\""
Oct 30 20:52:59.141253 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:52:59.141234    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"alertmanager-data-science-monitoringstack-web-config\""
Oct 30 20:52:59.198288 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:52:59.198253    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6c37f094-5638-43b1-8041-eb7ad63f6530-web-config\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"6c37f094-5638-43b1-8041-eb7ad63f6530\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 20:52:59.198445 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:52:59.198299    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qzfrx\" (UniqueName: \"kubernetes.io/projected/6c37f094-5638-43b1-8041-eb7ad63f6530-kube-api-access-qzfrx\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"6c37f094-5638-43b1-8041-eb7ad63f6530\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 20:52:59.198445 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:52:59.198421    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6c37f094-5638-43b1-8041-eb7ad63f6530-config-volume\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"6c37f094-5638-43b1-8041-eb7ad63f6530\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 20:52:59.198581 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:52:59.198478    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6c37f094-5638-43b1-8041-eb7ad63f6530-tls-assets\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"6c37f094-5638-43b1-8041-eb7ad63f6530\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 20:52:59.198581 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:52:59.198555    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-data-science-monitoringstack-db\" (UniqueName: \"kubernetes.io/empty-dir/6c37f094-5638-43b1-8041-eb7ad63f6530-alertmanager-data-science-monitoringstack-db\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"6c37f094-5638-43b1-8041-eb7ad63f6530\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 20:52:59.198687 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:52:59.198593    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6c37f094-5638-43b1-8041-eb7ad63f6530-config-out\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"6c37f094-5638-43b1-8041-eb7ad63f6530\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 20:52:59.198741 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:52:59.198685    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6c37f094-5638-43b1-8041-eb7ad63f6530-cluster-tls-config\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"6c37f094-5638-43b1-8041-eb7ad63f6530\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 20:52:59.202561 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:52:59.202481    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"]
Oct 30 20:52:59.249141 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:52:59.249070    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"alertmanager-data-science-monitoringstack-cluster-tls-config\""
Oct 30 20:52:59.249141 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:52:59.249082    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"alertmanager-data-science-monitoringstack-generated\""
Oct 30 20:52:59.249141 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:52:59.249078    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"alertmanager-data-science-monitoringstack-tls-assets-0\""
Oct 30 20:52:59.299763 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:52:59.299736    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6c37f094-5638-43b1-8041-eb7ad63f6530-config-volume\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"6c37f094-5638-43b1-8041-eb7ad63f6530\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 20:52:59.299931 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:52:59.299776    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6c37f094-5638-43b1-8041-eb7ad63f6530-tls-assets\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"6c37f094-5638-43b1-8041-eb7ad63f6530\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 20:52:59.299931 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:52:59.299795    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-data-science-monitoringstack-db\" (UniqueName: \"kubernetes.io/empty-dir/6c37f094-5638-43b1-8041-eb7ad63f6530-alertmanager-data-science-monitoringstack-db\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"6c37f094-5638-43b1-8041-eb7ad63f6530\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 20:52:59.299931 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:52:59.299818    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6c37f094-5638-43b1-8041-eb7ad63f6530-config-out\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"6c37f094-5638-43b1-8041-eb7ad63f6530\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 20:52:59.299931 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:52:59.299878    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6c37f094-5638-43b1-8041-eb7ad63f6530-cluster-tls-config\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"6c37f094-5638-43b1-8041-eb7ad63f6530\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 20:52:59.300162 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:52:59.299941    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6c37f094-5638-43b1-8041-eb7ad63f6530-web-config\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"6c37f094-5638-43b1-8041-eb7ad63f6530\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 20:52:59.300162 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:52:59.299961    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qzfrx\" (UniqueName: \"kubernetes.io/projected/6c37f094-5638-43b1-8041-eb7ad63f6530-kube-api-access-qzfrx\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"6c37f094-5638-43b1-8041-eb7ad63f6530\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 20:52:59.300421 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:52:59.300386    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-data-science-monitoringstack-db\" (UniqueName: \"kubernetes.io/empty-dir/6c37f094-5638-43b1-8041-eb7ad63f6530-alertmanager-data-science-monitoringstack-db\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"6c37f094-5638-43b1-8041-eb7ad63f6530\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 20:52:59.302056 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:52:59.302032    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6c37f094-5638-43b1-8041-eb7ad63f6530-config-out\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"6c37f094-5638-43b1-8041-eb7ad63f6530\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 20:52:59.302286 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:52:59.302243    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6c37f094-5638-43b1-8041-eb7ad63f6530-tls-assets\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"6c37f094-5638-43b1-8041-eb7ad63f6530\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 20:52:59.302286 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:52:59.302276    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6c37f094-5638-43b1-8041-eb7ad63f6530-web-config\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"6c37f094-5638-43b1-8041-eb7ad63f6530\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 20:52:59.302668 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:52:59.302649    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6c37f094-5638-43b1-8041-eb7ad63f6530-cluster-tls-config\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"6c37f094-5638-43b1-8041-eb7ad63f6530\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 20:52:59.302713 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:52:59.302658    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6c37f094-5638-43b1-8041-eb7ad63f6530-config-volume\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"6c37f094-5638-43b1-8041-eb7ad63f6530\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 20:52:59.361546 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:52:59.361468    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qzfrx\" (UniqueName: \"kubernetes.io/projected/6c37f094-5638-43b1-8041-eb7ad63f6530-kube-api-access-qzfrx\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"6c37f094-5638-43b1-8041-eb7ad63f6530\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 20:52:59.402099 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:52:59.402069    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 20:52:59.826452 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:52:59.826427    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"]
Oct 30 20:52:59.828248 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:52:59.828219    4060 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c37f094_5638_43b1_8041_eb7ad63f6530.slice/crio-037d775b13ae458ec1599c401ca69af95df100ab66428a7ec6231b86506fcf17 WatchSource:0}: Error finding container 037d775b13ae458ec1599c401ca69af95df100ab66428a7ec6231b86506fcf17: Status 404 returned error can't find the container with id 037d775b13ae458ec1599c401ca69af95df100ab66428a7ec6231b86506fcf17
Oct 30 20:53:00.471094 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:53:00.471056    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0" event={"ID":"6c37f094-5638-43b1-8041-eb7ad63f6530","Type":"ContainerStarted","Data":"b3138688b7a05fa675e01f9abd4dca002adc88258df7c5c5b8992ab9415d0ef6"}
Oct 30 20:53:00.471472 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:53:00.471143    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0" event={"ID":"6c37f094-5638-43b1-8041-eb7ad63f6530","Type":"ContainerStarted","Data":"037d775b13ae458ec1599c401ca69af95df100ab66428a7ec6231b86506fcf17"}
Oct 30 20:53:03.488385 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:53:03.488344    4060 generic.go:356] "Generic (PLEG): container finished" podID="6c37f094-5638-43b1-8041-eb7ad63f6530" containerID="b3138688b7a05fa675e01f9abd4dca002adc88258df7c5c5b8992ab9415d0ef6" exitCode=0
Oct 30 20:53:03.488805 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:53:03.488422    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0" event={"ID":"6c37f094-5638-43b1-8041-eb7ad63f6530","Type":"ContainerDied","Data":"b3138688b7a05fa675e01f9abd4dca002adc88258df7c5c5b8992ab9415d0ef6"}
Oct 30 20:53:04.496878 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:53:04.496847    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0" event={"ID":"6c37f094-5638-43b1-8041-eb7ad63f6530","Type":"ContainerStarted","Data":"dd222882d73961bd6c9de479fb66a6b877edda94fac656b4cdf6daa1e6fdf9ff"}
Oct 30 20:53:04.497303 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:53:04.496907    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0" event={"ID":"6c37f094-5638-43b1-8041-eb7ad63f6530","Type":"ContainerStarted","Data":"620f41b4ac2e77a527d2f8fb391f9f2c68f2d5de9f2630ab43ccdd62b0c02973"}
Oct 30 20:53:04.497303 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:53:04.497091    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 20:53:04.718586 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:53:04.718516    4060 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0" podStartSLOduration=2.533540059 podStartE2EDuration="5.718484921s" totalImagesPullingTime="0s" totalInitContainerRuntime="3.184944862s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:52:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:53:04.668163332 +0000 UTC m=+1003.425161629" watchObservedRunningTime="2026-10-30 20:53:04.718484921 +0000 UTC m=+1003.475483219"
Oct 30 20:53:10.502286 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:53:10.502255    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 20:53:12.150408 ip-10-0-142-4 kubenswrapper[4060]: E1030 20:53:12.150372    4060 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v2f4x" containerName="extractor"
Oct 30 20:53:42.150681 ip-10-0-142-4 kubenswrapper[4060]: E1030 20:53:42.150606    4060 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v2f4x" containerName="extractor"
Oct 30 20:53:43.014176 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:53:43.014138    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-56cq2"]
Oct 30 20:53:43.014392 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:53:43.014354    4060 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-56cq2" podUID="ebf65914-66d4-4809-8ad4-0b897de46356" containerName="kube-rbac-proxy" containerID="cri-o://38ed6e9f2ab05a8abc1b11738d9531c44febce7083b82fcedb05b1e155e3a5db" gracePeriod=30
Oct 30 20:53:43.176799 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:53:43.176767    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/korrel8r-66d6f7f696-tqf4s"]
Oct 30 20:53:43.177195 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:53:43.176970    4060 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/korrel8r-66d6f7f696-tqf4s" podUID="4d103d18-4fcf-4ec0-8d9a-f3d3f170e16e" containerName="korrel8r" containerID="cri-o://2c47c8a3986a53bc824b8d68e51d98d49db1c04327d412bd3a9b95320449ed7d" gracePeriod=30
Oct 30 20:53:43.300583 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:53:43.300561    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-56cq2"
Oct 30 20:53:43.359988 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:53:43.359962    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ebf65914-66d4-4809-8ad4-0b897de46356-prometheus-ca\" (UniqueName: \"kubernetes.io/configmap/ebf65914-66d4-4809-8ad4-0b897de46356-prometheus-ca\") pod \"ebf65914-66d4-4809-8ad4-0b897de46356\" (UID: \"ebf65914-66d4-4809-8ad4-0b897de46356\") "
Oct 30 20:53:43.360146 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:53:43.360008    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ebf65914-66d4-4809-8ad4-0b897de46356-prometheus-client-cert\" (UniqueName: \"kubernetes.io/secret/ebf65914-66d4-4809-8ad4-0b897de46356-prometheus-client-cert\") pod \"ebf65914-66d4-4809-8ad4-0b897de46356\" (UID: \"ebf65914-66d4-4809-8ad4-0b897de46356\") "
Oct 30 20:53:43.360146 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:53:43.360037    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ebf65914-66d4-4809-8ad4-0b897de46356-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ebf65914-66d4-4809-8ad4-0b897de46356-kube-rbac-proxy-config\") pod \"ebf65914-66d4-4809-8ad4-0b897de46356\" (UID: \"ebf65914-66d4-4809-8ad4-0b897de46356\") "
Oct 30 20:53:43.360146 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:53:43.360074    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ebf65914-66d4-4809-8ad4-0b897de46356-kube-api-access-r2lsr\" (UniqueName: \"kubernetes.io/projected/ebf65914-66d4-4809-8ad4-0b897de46356-kube-api-access-r2lsr\") pod \"ebf65914-66d4-4809-8ad4-0b897de46356\" (UID: \"ebf65914-66d4-4809-8ad4-0b897de46356\") "
Oct 30 20:53:43.360146 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:53:43.360112    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ebf65914-66d4-4809-8ad4-0b897de46356-tls\" (UniqueName: \"kubernetes.io/secret/ebf65914-66d4-4809-8ad4-0b897de46356-tls\") pod \"ebf65914-66d4-4809-8ad4-0b897de46356\" (UID: \"ebf65914-66d4-4809-8ad4-0b897de46356\") "
Oct 30 20:53:43.360430 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:53:43.360404    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ebf65914-66d4-4809-8ad4-0b897de46356-prometheus-ca" pod "ebf65914-66d4-4809-8ad4-0b897de46356" (UID: "ebf65914-66d4-4809-8ad4-0b897de46356"). InnerVolumeSpecName "prometheus-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:53:43.362264 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:53:43.362240    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ebf65914-66d4-4809-8ad4-0b897de46356-kube-rbac-proxy-config" pod "ebf65914-66d4-4809-8ad4-0b897de46356" (UID: "ebf65914-66d4-4809-8ad4-0b897de46356"). InnerVolumeSpecName "kube-rbac-proxy-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:53:43.362387 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:53:43.362266    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ebf65914-66d4-4809-8ad4-0b897de46356-tls" pod "ebf65914-66d4-4809-8ad4-0b897de46356" (UID: "ebf65914-66d4-4809-8ad4-0b897de46356"). InnerVolumeSpecName "tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:53:43.362584 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:53:43.362562    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ebf65914-66d4-4809-8ad4-0b897de46356-prometheus-client-cert" pod "ebf65914-66d4-4809-8ad4-0b897de46356" (UID: "ebf65914-66d4-4809-8ad4-0b897de46356"). InnerVolumeSpecName "prometheus-client-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:53:43.362584 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:53:43.362565    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ebf65914-66d4-4809-8ad4-0b897de46356-kube-api-access-r2lsr" pod "ebf65914-66d4-4809-8ad4-0b897de46356" (UID: "ebf65914-66d4-4809-8ad4-0b897de46356"). InnerVolumeSpecName "kube-api-access-r2lsr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:53:43.407731 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:53:43.407708    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/korrel8r-66d6f7f696-tqf4s"
Oct 30 20:53:43.460716 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:53:43.460686    4060 reconciler_common.go:299] "Volume detached for volume \"prometheus-ca\" (UniqueName: \"kubernetes.io/configmap/ebf65914-66d4-4809-8ad4-0b897de46356-prometheus-ca\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:53:43.460716 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:53:43.460710    4060 reconciler_common.go:299] "Volume detached for volume \"prometheus-client-cert\" (UniqueName: \"kubernetes.io/secret/ebf65914-66d4-4809-8ad4-0b897de46356-prometheus-client-cert\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:53:43.460716 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:53:43.460720    4060 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ebf65914-66d4-4809-8ad4-0b897de46356-kube-rbac-proxy-config\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:53:43.460923 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:53:43.460731    4060 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r2lsr\" (UniqueName: \"kubernetes.io/projected/ebf65914-66d4-4809-8ad4-0b897de46356-kube-api-access-r2lsr\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:53:43.460923 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:53:43.460740    4060 reconciler_common.go:299] "Volume detached for volume \"tls\" (UniqueName: \"kubernetes.io/secret/ebf65914-66d4-4809-8ad4-0b897de46356-tls\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:53:43.561436 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:53:43.561359    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/4d103d18-4fcf-4ec0-8d9a-f3d3f170e16e-config\" (UniqueName: \"kubernetes.io/configmap/4d103d18-4fcf-4ec0-8d9a-f3d3f170e16e-config\") pod \"4d103d18-4fcf-4ec0-8d9a-f3d3f170e16e\" (UID: \"4d103d18-4fcf-4ec0-8d9a-f3d3f170e16e\") "
Oct 30 20:53:43.561436 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:53:43.561427    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4d103d18-4fcf-4ec0-8d9a-f3d3f170e16e-kube-api-access-cdbrg\" (UniqueName: \"kubernetes.io/projected/4d103d18-4fcf-4ec0-8d9a-f3d3f170e16e-kube-api-access-cdbrg\") pod \"4d103d18-4fcf-4ec0-8d9a-f3d3f170e16e\" (UID: \"4d103d18-4fcf-4ec0-8d9a-f3d3f170e16e\") "
Oct 30 20:53:43.561642 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:53:43.561484    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/4d103d18-4fcf-4ec0-8d9a-f3d3f170e16e-tls\" (UniqueName: \"kubernetes.io/secret/4d103d18-4fcf-4ec0-8d9a-f3d3f170e16e-tls\") pod \"4d103d18-4fcf-4ec0-8d9a-f3d3f170e16e\" (UID: \"4d103d18-4fcf-4ec0-8d9a-f3d3f170e16e\") "
Oct 30 20:53:43.561797 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:53:43.561772    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4d103d18-4fcf-4ec0-8d9a-f3d3f170e16e-config" pod "4d103d18-4fcf-4ec0-8d9a-f3d3f170e16e" (UID: "4d103d18-4fcf-4ec0-8d9a-f3d3f170e16e"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:53:43.563608 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:53:43.563578    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4d103d18-4fcf-4ec0-8d9a-f3d3f170e16e-tls" pod "4d103d18-4fcf-4ec0-8d9a-f3d3f170e16e" (UID: "4d103d18-4fcf-4ec0-8d9a-f3d3f170e16e"). InnerVolumeSpecName "tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:53:43.563722 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:53:43.563685    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4d103d18-4fcf-4ec0-8d9a-f3d3f170e16e-kube-api-access-cdbrg" pod "4d103d18-4fcf-4ec0-8d9a-f3d3f170e16e" (UID: "4d103d18-4fcf-4ec0-8d9a-f3d3f170e16e"). InnerVolumeSpecName "kube-api-access-cdbrg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:53:43.662281 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:53:43.662247    4060 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cdbrg\" (UniqueName: \"kubernetes.io/projected/4d103d18-4fcf-4ec0-8d9a-f3d3f170e16e-kube-api-access-cdbrg\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:53:43.662281 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:53:43.662275    4060 reconciler_common.go:299] "Volume detached for volume \"tls\" (UniqueName: \"kubernetes.io/secret/4d103d18-4fcf-4ec0-8d9a-f3d3f170e16e-tls\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:53:43.662281 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:53:43.662286    4060 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4d103d18-4fcf-4ec0-8d9a-f3d3f170e16e-config\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:53:43.681426 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:53:43.681390    4060 generic.go:356] "Generic (PLEG): container finished" podID="ebf65914-66d4-4809-8ad4-0b897de46356" containerID="38ed6e9f2ab05a8abc1b11738d9531c44febce7083b82fcedb05b1e155e3a5db" exitCode=0
Oct 30 20:53:43.681634 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:53:43.681434    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-56cq2" event={"ID":"ebf65914-66d4-4809-8ad4-0b897de46356","Type":"ContainerDied","Data":"38ed6e9f2ab05a8abc1b11738d9531c44febce7083b82fcedb05b1e155e3a5db"}
Oct 30 20:53:43.681634 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:53:43.681440    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-56cq2"
Oct 30 20:53:43.681634 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:53:43.681513    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-56cq2" event={"ID":"ebf65914-66d4-4809-8ad4-0b897de46356","Type":"ContainerDied","Data":"ed1e000ec0f828df75f19e211d1dd73b521c71e3c1c4404139c280806ee7e0f6"}
Oct 30 20:53:43.681634 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:53:43.681540    4060 scope.go:122] "RemoveContainer" containerID="38ed6e9f2ab05a8abc1b11738d9531c44febce7083b82fcedb05b1e155e3a5db"
Oct 30 20:53:43.682868 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:53:43.682847    4060 generic.go:356] "Generic (PLEG): container finished" podID="4d103d18-4fcf-4ec0-8d9a-f3d3f170e16e" containerID="2c47c8a3986a53bc824b8d68e51d98d49db1c04327d412bd3a9b95320449ed7d" exitCode=0
Oct 30 20:53:43.682993 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:53:43.682891    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/korrel8r-66d6f7f696-tqf4s" event={"ID":"4d103d18-4fcf-4ec0-8d9a-f3d3f170e16e","Type":"ContainerDied","Data":"2c47c8a3986a53bc824b8d68e51d98d49db1c04327d412bd3a9b95320449ed7d"}
Oct 30 20:53:43.682993 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:53:43.682917    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/korrel8r-66d6f7f696-tqf4s"
Oct 30 20:53:43.682993 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:53:43.682935    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/korrel8r-66d6f7f696-tqf4s" event={"ID":"4d103d18-4fcf-4ec0-8d9a-f3d3f170e16e","Type":"ContainerDied","Data":"66d8895009de3e6bd878bbd50d91ad92867f197bc9a5999bc25f126e87ae4981"}
Oct 30 20:53:43.691999 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:53:43.691978    4060 scope.go:122] "RemoveContainer" containerID="38ed6e9f2ab05a8abc1b11738d9531c44febce7083b82fcedb05b1e155e3a5db"
Oct 30 20:53:43.692368 ip-10-0-142-4 kubenswrapper[4060]: E1030 20:53:43.692342    4060 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"38ed6e9f2ab05a8abc1b11738d9531c44febce7083b82fcedb05b1e155e3a5db\": container with ID starting with 38ed6e9f2ab05a8abc1b11738d9531c44febce7083b82fcedb05b1e155e3a5db not found: ID does not exist" containerID="38ed6e9f2ab05a8abc1b11738d9531c44febce7083b82fcedb05b1e155e3a5db"
Oct 30 20:53:43.692475 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:53:43.692380    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"38ed6e9f2ab05a8abc1b11738d9531c44febce7083b82fcedb05b1e155e3a5db"} err="failed to get container status \"38ed6e9f2ab05a8abc1b11738d9531c44febce7083b82fcedb05b1e155e3a5db\": rpc error: code = NotFound desc = could not find container \"38ed6e9f2ab05a8abc1b11738d9531c44febce7083b82fcedb05b1e155e3a5db\": container with ID starting with 38ed6e9f2ab05a8abc1b11738d9531c44febce7083b82fcedb05b1e155e3a5db not found: ID does not exist"
Oct 30 20:53:43.692475 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:53:43.692407    4060 scope.go:122] "RemoveContainer" containerID="2c47c8a3986a53bc824b8d68e51d98d49db1c04327d412bd3a9b95320449ed7d"
Oct 30 20:53:43.701141 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:53:43.701114    4060 scope.go:122] "RemoveContainer" containerID="2c47c8a3986a53bc824b8d68e51d98d49db1c04327d412bd3a9b95320449ed7d"
Oct 30 20:53:43.701507 ip-10-0-142-4 kubenswrapper[4060]: E1030 20:53:43.701466    4060 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2c47c8a3986a53bc824b8d68e51d98d49db1c04327d412bd3a9b95320449ed7d\": container with ID starting with 2c47c8a3986a53bc824b8d68e51d98d49db1c04327d412bd3a9b95320449ed7d not found: ID does not exist" containerID="2c47c8a3986a53bc824b8d68e51d98d49db1c04327d412bd3a9b95320449ed7d"
Oct 30 20:53:43.701628 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:53:43.701518    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2c47c8a3986a53bc824b8d68e51d98d49db1c04327d412bd3a9b95320449ed7d"} err="failed to get container status \"2c47c8a3986a53bc824b8d68e51d98d49db1c04327d412bd3a9b95320449ed7d\": rpc error: code = NotFound desc = could not find container \"2c47c8a3986a53bc824b8d68e51d98d49db1c04327d412bd3a9b95320449ed7d\": container with ID starting with 2c47c8a3986a53bc824b8d68e51d98d49db1c04327d412bd3a9b95320449ed7d not found: ID does not exist"
Oct 30 20:53:43.846806 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:53:43.846725    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/korrel8r-66d6f7f696-tqf4s"]
Oct 30 20:53:43.852346 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:53:43.852319    4060 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/korrel8r-66d6f7f696-tqf4s"]
Oct 30 20:53:43.964192 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:53:43.964162    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-56cq2"]
Oct 30 20:53:43.969138 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:53:43.969112    4060 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-56cq2"]
Oct 30 20:53:44.411174 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:53:44.411140    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"]
Oct 30 20:53:44.411713 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:53:44.411378    4060 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0" podUID="6c37f094-5638-43b1-8041-eb7ad63f6530" containerName="alertmanager" containerID="cri-o://620f41b4ac2e77a527d2f8fb391f9f2c68f2d5de9f2630ab43ccdd62b0c02973" gracePeriod=120
Oct 30 20:53:44.411713 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:53:44.411428    4060 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0" podUID="6c37f094-5638-43b1-8041-eb7ad63f6530" containerName="config-reloader" containerID="cri-o://dd222882d73961bd6c9de479fb66a6b877edda94fac656b4cdf6daa1e6fdf9ff" gracePeriod=120
Oct 30 20:53:44.690346 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:53:44.690251    4060 generic.go:356] "Generic (PLEG): container finished" podID="6c37f094-5638-43b1-8041-eb7ad63f6530" containerID="dd222882d73961bd6c9de479fb66a6b877edda94fac656b4cdf6daa1e6fdf9ff" exitCode=0
Oct 30 20:53:44.690346 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:53:44.690331    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0" event={"ID":"6c37f094-5638-43b1-8041-eb7ad63f6530","Type":"ContainerDied","Data":"dd222882d73961bd6c9de479fb66a6b877edda94fac656b4cdf6daa1e6fdf9ff"}
Oct 30 20:53:45.426979 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:53:45.426944    4060 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="4d103d18-4fcf-4ec0-8d9a-f3d3f170e16e" path="/var/lib/kubelet/pods/4d103d18-4fcf-4ec0-8d9a-f3d3f170e16e/volumes"
Oct 30 20:53:45.427332 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:53:45.427315    4060 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ebf65914-66d4-4809-8ad4-0b897de46356" path="/var/lib/kubelet/pods/ebf65914-66d4-4809-8ad4-0b897de46356/volumes"
Oct 30 20:53:45.502731 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:53:45.502687    4060 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0" podUID="6c37f094-5638-43b1-8041-eb7ad63f6530" containerName="alertmanager" probeResult="failure" output="Get \"http://10.133.0.50:9093/-/ready\": dial tcp 10.133.0.50:9093: connect: connection refused"
Oct 30 20:53:46.933039 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:53:46.933009    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 20:53:46.933543 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:53:46.933229    4060 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-collector-0" podUID="65767597-b144-419e-90f2-9ee2e5b585a5" containerName="otc-container" containerID="cri-o://93d79b6f882397e4cf67d8b0ef6a71fba3599d19ae1679e1c43af1e6d0683a58" gracePeriod=30
Oct 30 20:53:47.183837 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:53:47.183774    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:53:47.295931 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:53:47.295900    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/65767597-b144-419e-90f2-9ee2e5b585a5-data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/65767597-b144-419e-90f2-9ee2e5b585a5-data-science-collector-ta-client-cert\") pod \"65767597-b144-419e-90f2-9ee2e5b585a5\" (UID: \"65767597-b144-419e-90f2-9ee2e5b585a5\") "
Oct 30 20:53:47.296095 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:53:47.295941    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/65767597-b144-419e-90f2-9ee2e5b585a5-tls-certs\" (UniqueName: \"kubernetes.io/secret/65767597-b144-419e-90f2-9ee2e5b585a5-tls-certs\") pod \"65767597-b144-419e-90f2-9ee2e5b585a5\" (UID: \"65767597-b144-419e-90f2-9ee2e5b585a5\") "
Oct 30 20:53:47.296095 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:53:47.295971    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/65767597-b144-419e-90f2-9ee2e5b585a5-otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/65767597-b144-419e-90f2-9ee2e5b585a5-otlp-tls-certs\") pod \"65767597-b144-419e-90f2-9ee2e5b585a5\" (UID: \"65767597-b144-419e-90f2-9ee2e5b585a5\") "
Oct 30 20:53:47.296095 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:53:47.296014    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/65767597-b144-419e-90f2-9ee2e5b585a5-monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/65767597-b144-419e-90f2-9ee2e5b585a5-monitoring-tls-certs\") pod \"65767597-b144-419e-90f2-9ee2e5b585a5\" (UID: \"65767597-b144-419e-90f2-9ee2e5b585a5\") "
Oct 30 20:53:47.296095 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:53:47.296088    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/65767597-b144-419e-90f2-9ee2e5b585a5-otc-internal\" (UniqueName: \"kubernetes.io/configmap/65767597-b144-419e-90f2-9ee2e5b585a5-otc-internal\") pod \"65767597-b144-419e-90f2-9ee2e5b585a5\" (UID: \"65767597-b144-419e-90f2-9ee2e5b585a5\") "
Oct 30 20:53:47.296316 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:53:47.296116    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/65767597-b144-419e-90f2-9ee2e5b585a5-kube-api-access-p7vtr\" (UniqueName: \"kubernetes.io/projected/65767597-b144-419e-90f2-9ee2e5b585a5-kube-api-access-p7vtr\") pod \"65767597-b144-419e-90f2-9ee2e5b585a5\" (UID: \"65767597-b144-419e-90f2-9ee2e5b585a5\") "
Oct 30 20:53:47.296830 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:53:47.296796    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/65767597-b144-419e-90f2-9ee2e5b585a5-otc-internal" pod "65767597-b144-419e-90f2-9ee2e5b585a5" (UID: "65767597-b144-419e-90f2-9ee2e5b585a5"). InnerVolumeSpecName "otc-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:53:47.298300 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:53:47.298264    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/65767597-b144-419e-90f2-9ee2e5b585a5-monitoring-tls-certs" pod "65767597-b144-419e-90f2-9ee2e5b585a5" (UID: "65767597-b144-419e-90f2-9ee2e5b585a5"). InnerVolumeSpecName "monitoring-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:53:47.298425 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:53:47.298298    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/65767597-b144-419e-90f2-9ee2e5b585a5-otlp-tls-certs" pod "65767597-b144-419e-90f2-9ee2e5b585a5" (UID: "65767597-b144-419e-90f2-9ee2e5b585a5"). InnerVolumeSpecName "otlp-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:53:47.298636 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:53:47.298615    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/65767597-b144-419e-90f2-9ee2e5b585a5-tls-certs" pod "65767597-b144-419e-90f2-9ee2e5b585a5" (UID: "65767597-b144-419e-90f2-9ee2e5b585a5"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:53:47.298728 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:53:47.298644    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/65767597-b144-419e-90f2-9ee2e5b585a5-data-science-collector-ta-client-cert" pod "65767597-b144-419e-90f2-9ee2e5b585a5" (UID: "65767597-b144-419e-90f2-9ee2e5b585a5"). InnerVolumeSpecName "data-science-collector-ta-client-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:53:47.298844 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:53:47.298827    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/65767597-b144-419e-90f2-9ee2e5b585a5-kube-api-access-p7vtr" pod "65767597-b144-419e-90f2-9ee2e5b585a5" (UID: "65767597-b144-419e-90f2-9ee2e5b585a5"). InnerVolumeSpecName "kube-api-access-p7vtr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:53:47.397633 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:53:47.397597    4060 reconciler_common.go:299] "Volume detached for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/65767597-b144-419e-90f2-9ee2e5b585a5-otc-internal\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:53:47.397633 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:53:47.397629    4060 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p7vtr\" (UniqueName: \"kubernetes.io/projected/65767597-b144-419e-90f2-9ee2e5b585a5-kube-api-access-p7vtr\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:53:47.397633 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:53:47.397640    4060 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/65767597-b144-419e-90f2-9ee2e5b585a5-data-science-collector-ta-client-cert\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:53:47.397884 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:53:47.397650    4060 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/65767597-b144-419e-90f2-9ee2e5b585a5-tls-certs\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:53:47.397884 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:53:47.397659    4060 reconciler_common.go:299] "Volume detached for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/65767597-b144-419e-90f2-9ee2e5b585a5-otlp-tls-certs\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:53:47.397884 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:53:47.397668    4060 reconciler_common.go:299] "Volume detached for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/65767597-b144-419e-90f2-9ee2e5b585a5-monitoring-tls-certs\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:53:47.707238 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:53:47.707198    4060 generic.go:356] "Generic (PLEG): container finished" podID="65767597-b144-419e-90f2-9ee2e5b585a5" containerID="93d79b6f882397e4cf67d8b0ef6a71fba3599d19ae1679e1c43af1e6d0683a58" exitCode=0
Oct 30 20:53:47.707396 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:53:47.707247    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:53:47.707396 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:53:47.707290    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"65767597-b144-419e-90f2-9ee2e5b585a5","Type":"ContainerDied","Data":"93d79b6f882397e4cf67d8b0ef6a71fba3599d19ae1679e1c43af1e6d0683a58"}
Oct 30 20:53:47.707396 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:53:47.707337    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"65767597-b144-419e-90f2-9ee2e5b585a5","Type":"ContainerDied","Data":"d14b8cc3a8739c92ea6cb2e205926a6bb6442e7da5aa3bfc9251bddf1deabbca"}
Oct 30 20:53:47.707396 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:53:47.707357    4060 scope.go:122] "RemoveContainer" containerID="93d79b6f882397e4cf67d8b0ef6a71fba3599d19ae1679e1c43af1e6d0683a58"
Oct 30 20:53:47.715707 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:53:47.715683    4060 scope.go:122] "RemoveContainer" containerID="93d79b6f882397e4cf67d8b0ef6a71fba3599d19ae1679e1c43af1e6d0683a58"
Oct 30 20:53:47.716023 ip-10-0-142-4 kubenswrapper[4060]: E1030 20:53:47.716003    4060 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"93d79b6f882397e4cf67d8b0ef6a71fba3599d19ae1679e1c43af1e6d0683a58\": container with ID starting with 93d79b6f882397e4cf67d8b0ef6a71fba3599d19ae1679e1c43af1e6d0683a58 not found: ID does not exist" containerID="93d79b6f882397e4cf67d8b0ef6a71fba3599d19ae1679e1c43af1e6d0683a58"
Oct 30 20:53:47.716083 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:53:47.716036    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93d79b6f882397e4cf67d8b0ef6a71fba3599d19ae1679e1c43af1e6d0683a58"} err="failed to get container status \"93d79b6f882397e4cf67d8b0ef6a71fba3599d19ae1679e1c43af1e6d0683a58\": rpc error: code = NotFound desc = could not find container \"93d79b6f882397e4cf67d8b0ef6a71fba3599d19ae1679e1c43af1e6d0683a58\": container with ID starting with 93d79b6f882397e4cf67d8b0ef6a71fba3599d19ae1679e1c43af1e6d0683a58 not found: ID does not exist"
Oct 30 20:53:47.876459 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:53:47.876423    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 20:53:47.925059 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:53:47.925027    4060 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 20:53:49.429635 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:53:49.429599    4060 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="65767597-b144-419e-90f2-9ee2e5b585a5" path="/var/lib/kubelet/pods/65767597-b144-419e-90f2-9ee2e5b585a5/volumes"
Oct 30 20:53:50.502421 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:53:50.502375    4060 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0" podUID="6c37f094-5638-43b1-8041-eb7ad63f6530" containerName="alertmanager" probeResult="failure" output="Get \"http://10.133.0.50:9093/-/ready\": dial tcp 10.133.0.50:9093: connect: connection refused"
Oct 30 20:53:54.660870 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:53:54.660842    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 20:53:54.745576 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:53:54.745547    4060 generic.go:356] "Generic (PLEG): container finished" podID="6c37f094-5638-43b1-8041-eb7ad63f6530" containerID="620f41b4ac2e77a527d2f8fb391f9f2c68f2d5de9f2630ab43ccdd62b0c02973" exitCode=0
Oct 30 20:53:54.745750 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:53:54.745610    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 20:53:54.745750 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:53:54.745644    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0" event={"ID":"6c37f094-5638-43b1-8041-eb7ad63f6530","Type":"ContainerDied","Data":"620f41b4ac2e77a527d2f8fb391f9f2c68f2d5de9f2630ab43ccdd62b0c02973"}
Oct 30 20:53:54.745750 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:53:54.745706    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0" event={"ID":"6c37f094-5638-43b1-8041-eb7ad63f6530","Type":"ContainerDied","Data":"037d775b13ae458ec1599c401ca69af95df100ab66428a7ec6231b86506fcf17"}
Oct 30 20:53:54.745750 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:53:54.745733    4060 scope.go:122] "RemoveContainer" containerID="dd222882d73961bd6c9de479fb66a6b877edda94fac656b4cdf6daa1e6fdf9ff"
Oct 30 20:53:54.753707 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:53:54.753690    4060 scope.go:122] "RemoveContainer" containerID="620f41b4ac2e77a527d2f8fb391f9f2c68f2d5de9f2630ab43ccdd62b0c02973"
Oct 30 20:53:54.760763 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:53:54.760733    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6c37f094-5638-43b1-8041-eb7ad63f6530-kube-api-access-qzfrx\" (UniqueName: \"kubernetes.io/projected/6c37f094-5638-43b1-8041-eb7ad63f6530-kube-api-access-qzfrx\") pod \"6c37f094-5638-43b1-8041-eb7ad63f6530\" (UID: \"6c37f094-5638-43b1-8041-eb7ad63f6530\") "
Oct 30 20:53:54.760906 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:53:54.760791    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6c37f094-5638-43b1-8041-eb7ad63f6530-tls-assets\" (UniqueName: \"kubernetes.io/projected/6c37f094-5638-43b1-8041-eb7ad63f6530-tls-assets\") pod \"6c37f094-5638-43b1-8041-eb7ad63f6530\" (UID: \"6c37f094-5638-43b1-8041-eb7ad63f6530\") "
Oct 30 20:53:54.760906 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:53:54.760831    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/6c37f094-5638-43b1-8041-eb7ad63f6530-web-config\" (UniqueName: \"kubernetes.io/secret/6c37f094-5638-43b1-8041-eb7ad63f6530-web-config\") pod \"6c37f094-5638-43b1-8041-eb7ad63f6530\" (UID: \"6c37f094-5638-43b1-8041-eb7ad63f6530\") "
Oct 30 20:53:54.761019 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:53:54.760903    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6c37f094-5638-43b1-8041-eb7ad63f6530-alertmanager-data-science-monitoringstack-db\" (UniqueName: \"kubernetes.io/empty-dir/6c37f094-5638-43b1-8041-eb7ad63f6530-alertmanager-data-science-monitoringstack-db\") pod \"6c37f094-5638-43b1-8041-eb7ad63f6530\" (UID: \"6c37f094-5638-43b1-8041-eb7ad63f6530\") "
Oct 30 20:53:54.761019 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:53:54.760934    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/6c37f094-5638-43b1-8041-eb7ad63f6530-cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6c37f094-5638-43b1-8041-eb7ad63f6530-cluster-tls-config\") pod \"6c37f094-5638-43b1-8041-eb7ad63f6530\" (UID: \"6c37f094-5638-43b1-8041-eb7ad63f6530\") "
Oct 30 20:53:54.761019 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:53:54.760982    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/6c37f094-5638-43b1-8041-eb7ad63f6530-config-volume\" (UniqueName: \"kubernetes.io/secret/6c37f094-5638-43b1-8041-eb7ad63f6530-config-volume\") pod \"6c37f094-5638-43b1-8041-eb7ad63f6530\" (UID: \"6c37f094-5638-43b1-8041-eb7ad63f6530\") "
Oct 30 20:53:54.761019 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:53:54.761014    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6c37f094-5638-43b1-8041-eb7ad63f6530-config-out\" (UniqueName: \"kubernetes.io/empty-dir/6c37f094-5638-43b1-8041-eb7ad63f6530-config-out\") pod \"6c37f094-5638-43b1-8041-eb7ad63f6530\" (UID: \"6c37f094-5638-43b1-8041-eb7ad63f6530\") "
Oct 30 20:53:54.761606 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:53:54.761244    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c37f094-5638-43b1-8041-eb7ad63f6530-alertmanager-data-science-monitoringstack-db" pod "6c37f094-5638-43b1-8041-eb7ad63f6530" (UID: "6c37f094-5638-43b1-8041-eb7ad63f6530"). InnerVolumeSpecName "alertmanager-data-science-monitoringstack-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:53:54.761793 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:53:54.761713    4060 scope.go:122] "RemoveContainer" containerID="b3138688b7a05fa675e01f9abd4dca002adc88258df7c5c5b8992ab9415d0ef6"
Oct 30 20:53:54.763292 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:53:54.763250    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6c37f094-5638-43b1-8041-eb7ad63f6530-tls-assets" pod "6c37f094-5638-43b1-8041-eb7ad63f6530" (UID: "6c37f094-5638-43b1-8041-eb7ad63f6530"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:53:54.763739 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:53:54.763710    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c37f094-5638-43b1-8041-eb7ad63f6530-config-out" pod "6c37f094-5638-43b1-8041-eb7ad63f6530" (UID: "6c37f094-5638-43b1-8041-eb7ad63f6530"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:53:54.764297 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:53:54.764258    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6c37f094-5638-43b1-8041-eb7ad63f6530-config-volume" pod "6c37f094-5638-43b1-8041-eb7ad63f6530" (UID: "6c37f094-5638-43b1-8041-eb7ad63f6530"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:53:54.764600 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:53:54.764575    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6c37f094-5638-43b1-8041-eb7ad63f6530-kube-api-access-qzfrx" pod "6c37f094-5638-43b1-8041-eb7ad63f6530" (UID: "6c37f094-5638-43b1-8041-eb7ad63f6530"). InnerVolumeSpecName "kube-api-access-qzfrx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:53:54.767740 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:53:54.767715    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6c37f094-5638-43b1-8041-eb7ad63f6530-cluster-tls-config" pod "6c37f094-5638-43b1-8041-eb7ad63f6530" (UID: "6c37f094-5638-43b1-8041-eb7ad63f6530"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:53:54.775024 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:53:54.774881    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6c37f094-5638-43b1-8041-eb7ad63f6530-web-config" pod "6c37f094-5638-43b1-8041-eb7ad63f6530" (UID: "6c37f094-5638-43b1-8041-eb7ad63f6530"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:53:54.781522 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:53:54.781487    4060 scope.go:122] "RemoveContainer" containerID="dd222882d73961bd6c9de479fb66a6b877edda94fac656b4cdf6daa1e6fdf9ff"
Oct 30 20:53:54.781888 ip-10-0-142-4 kubenswrapper[4060]: E1030 20:53:54.781870    4060 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dd222882d73961bd6c9de479fb66a6b877edda94fac656b4cdf6daa1e6fdf9ff\": container with ID starting with dd222882d73961bd6c9de479fb66a6b877edda94fac656b4cdf6daa1e6fdf9ff not found: ID does not exist" containerID="dd222882d73961bd6c9de479fb66a6b877edda94fac656b4cdf6daa1e6fdf9ff"
Oct 30 20:53:54.781947 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:53:54.781898    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dd222882d73961bd6c9de479fb66a6b877edda94fac656b4cdf6daa1e6fdf9ff"} err="failed to get container status \"dd222882d73961bd6c9de479fb66a6b877edda94fac656b4cdf6daa1e6fdf9ff\": rpc error: code = NotFound desc = could not find container \"dd222882d73961bd6c9de479fb66a6b877edda94fac656b4cdf6daa1e6fdf9ff\": container with ID starting with dd222882d73961bd6c9de479fb66a6b877edda94fac656b4cdf6daa1e6fdf9ff not found: ID does not exist"
Oct 30 20:53:54.781947 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:53:54.781916    4060 scope.go:122] "RemoveContainer" containerID="620f41b4ac2e77a527d2f8fb391f9f2c68f2d5de9f2630ab43ccdd62b0c02973"
Oct 30 20:53:54.782235 ip-10-0-142-4 kubenswrapper[4060]: E1030 20:53:54.782211    4060 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"620f41b4ac2e77a527d2f8fb391f9f2c68f2d5de9f2630ab43ccdd62b0c02973\": container with ID starting with 620f41b4ac2e77a527d2f8fb391f9f2c68f2d5de9f2630ab43ccdd62b0c02973 not found: ID does not exist" containerID="620f41b4ac2e77a527d2f8fb391f9f2c68f2d5de9f2630ab43ccdd62b0c02973"
Oct 30 20:53:54.782320 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:53:54.782239    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"620f41b4ac2e77a527d2f8fb391f9f2c68f2d5de9f2630ab43ccdd62b0c02973"} err="failed to get container status \"620f41b4ac2e77a527d2f8fb391f9f2c68f2d5de9f2630ab43ccdd62b0c02973\": rpc error: code = NotFound desc = could not find container \"620f41b4ac2e77a527d2f8fb391f9f2c68f2d5de9f2630ab43ccdd62b0c02973\": container with ID starting with 620f41b4ac2e77a527d2f8fb391f9f2c68f2d5de9f2630ab43ccdd62b0c02973 not found: ID does not exist"
Oct 30 20:53:54.782320 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:53:54.782257    4060 scope.go:122] "RemoveContainer" containerID="b3138688b7a05fa675e01f9abd4dca002adc88258df7c5c5b8992ab9415d0ef6"
Oct 30 20:53:54.782531 ip-10-0-142-4 kubenswrapper[4060]: E1030 20:53:54.782482    4060 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b3138688b7a05fa675e01f9abd4dca002adc88258df7c5c5b8992ab9415d0ef6\": container with ID starting with b3138688b7a05fa675e01f9abd4dca002adc88258df7c5c5b8992ab9415d0ef6 not found: ID does not exist" containerID="b3138688b7a05fa675e01f9abd4dca002adc88258df7c5c5b8992ab9415d0ef6"
Oct 30 20:53:54.782590 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:53:54.782541    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3138688b7a05fa675e01f9abd4dca002adc88258df7c5c5b8992ab9415d0ef6"} err="failed to get container status \"b3138688b7a05fa675e01f9abd4dca002adc88258df7c5c5b8992ab9415d0ef6\": rpc error: code = NotFound desc = could not find container \"b3138688b7a05fa675e01f9abd4dca002adc88258df7c5c5b8992ab9415d0ef6\": container with ID starting with b3138688b7a05fa675e01f9abd4dca002adc88258df7c5c5b8992ab9415d0ef6 not found: ID does not exist"
Oct 30 20:53:54.862405 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:53:54.862364    4060 reconciler_common.go:299] "Volume detached for volume \"alertmanager-data-science-monitoringstack-db\" (UniqueName: \"kubernetes.io/empty-dir/6c37f094-5638-43b1-8041-eb7ad63f6530-alertmanager-data-science-monitoringstack-db\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:53:54.862405 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:53:54.862399    4060 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6c37f094-5638-43b1-8041-eb7ad63f6530-cluster-tls-config\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:53:54.862405 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:53:54.862412    4060 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6c37f094-5638-43b1-8041-eb7ad63f6530-config-volume\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:53:54.862684 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:53:54.862421    4060 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6c37f094-5638-43b1-8041-eb7ad63f6530-config-out\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:53:54.862684 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:53:54.862431    4060 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qzfrx\" (UniqueName: \"kubernetes.io/projected/6c37f094-5638-43b1-8041-eb7ad63f6530-kube-api-access-qzfrx\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:53:54.862684 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:53:54.862440    4060 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6c37f094-5638-43b1-8041-eb7ad63f6530-tls-assets\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:53:54.862684 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:53:54.862448    4060 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6c37f094-5638-43b1-8041-eb7ad63f6530-web-config\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:53:55.167389 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:53:55.167351    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"]
Oct 30 20:53:55.172705 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:53:55.172682    4060 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"]
Oct 30 20:53:55.427165 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:53:55.427092    4060 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="6c37f094-5638-43b1-8041-eb7ad63f6530" path="/var/lib/kubelet/pods/6c37f094-5638-43b1-8041-eb7ad63f6530/volumes"
Oct 30 20:54:03.948483 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:54:03.948450    4060 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-tctk6"]
Oct 30 20:54:03.948913 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:54:03.948753    4060 cpu_manager.go:414] "containerMap: removing container" podUID="ebf65914-66d4-4809-8ad4-0b897de46356" containerName="kube-rbac-proxy"
Oct 30 20:54:03.948913 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:54:03.948764    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ebf65914-66d4-4809-8ad4-0b897de46356" containerName="kube-rbac-proxy"
Oct 30 20:54:03.948913 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:54:03.948773    4060 cpu_manager.go:414] "containerMap: removing container" podUID="65767597-b144-419e-90f2-9ee2e5b585a5" containerName="otc-container"
Oct 30 20:54:03.948913 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:54:03.948779    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="65767597-b144-419e-90f2-9ee2e5b585a5" containerName="otc-container"
Oct 30 20:54:03.948913 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:54:03.948785    4060 cpu_manager.go:414] "containerMap: removing container" podUID="6c37f094-5638-43b1-8041-eb7ad63f6530" containerName="alertmanager"
Oct 30 20:54:03.948913 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:54:03.948790    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6c37f094-5638-43b1-8041-eb7ad63f6530" containerName="alertmanager"
Oct 30 20:54:03.948913 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:54:03.948796    4060 cpu_manager.go:414] "containerMap: removing container" podUID="6c37f094-5638-43b1-8041-eb7ad63f6530" containerName="config-reloader"
Oct 30 20:54:03.948913 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:54:03.948801    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6c37f094-5638-43b1-8041-eb7ad63f6530" containerName="config-reloader"
Oct 30 20:54:03.948913 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:54:03.948814    4060 cpu_manager.go:414] "containerMap: removing container" podUID="4d103d18-4fcf-4ec0-8d9a-f3d3f170e16e" containerName="korrel8r"
Oct 30 20:54:03.948913 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:54:03.948819    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4d103d18-4fcf-4ec0-8d9a-f3d3f170e16e" containerName="korrel8r"
Oct 30 20:54:03.948913 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:54:03.948827    4060 cpu_manager.go:414] "containerMap: removing container" podUID="6c37f094-5638-43b1-8041-eb7ad63f6530" containerName="init-config-reloader"
Oct 30 20:54:03.948913 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:54:03.948831    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6c37f094-5638-43b1-8041-eb7ad63f6530" containerName="init-config-reloader"
Oct 30 20:54:03.948913 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:54:03.948882    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="ebf65914-66d4-4809-8ad4-0b897de46356" containerName="kube-rbac-proxy"
Oct 30 20:54:03.948913 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:54:03.948888    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="65767597-b144-419e-90f2-9ee2e5b585a5" containerName="otc-container"
Oct 30 20:54:03.948913 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:54:03.948894    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="6c37f094-5638-43b1-8041-eb7ad63f6530" containerName="alertmanager"
Oct 30 20:54:03.948913 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:54:03.948899    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="6c37f094-5638-43b1-8041-eb7ad63f6530" containerName="config-reloader"
Oct 30 20:54:03.948913 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:54:03.948905    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="4d103d18-4fcf-4ec0-8d9a-f3d3f170e16e" containerName="korrel8r"
Oct 30 20:54:03.953244 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:54:03.953225    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-tctk6"
Oct 30 20:54:04.011564 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:54:04.011530    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"prometheus-web-tls-ca\""
Oct 30 20:54:04.060791 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:54:04.060761    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"kube-root-ca.crt\""
Oct 30 20:54:04.060791 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:54:04.060784    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"openshift-service-ca.crt\""
Oct 30 20:54:04.061011 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:54:04.060809    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"prometheus-operated-tls\""
Oct 30 20:54:04.061011 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:54:04.060821    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-prometheus-cluster-proxy-kube-rbac-proxy\""
Oct 30 20:54:04.061011 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:54:04.060884    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-prometheus-cluster-proxy-tls\""
Oct 30 20:54:04.061011 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:54:04.060900    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-prometheus-cluster-proxy-dockercfg-5gsn6\""
Oct 30 20:54:04.062661 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:54:04.062646    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-tctk6"]
Oct 30 20:54:04.133969 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:54:04.133933    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-prrjr\" (UniqueName: \"kubernetes.io/projected/9ed8e0b4-0888-43d8-bae7-a7a201130785-kube-api-access-prrjr\") pod \"data-science-prometheus-cluster-proxy-545f759f7c-tctk6\" (UID: \"9ed8e0b4-0888-43d8-bae7-a7a201130785\") " pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-tctk6"
Oct 30 20:54:04.134183 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:54:04.133986    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9ed8e0b4-0888-43d8-bae7-a7a201130785-kube-rbac-proxy-config\") pod \"data-science-prometheus-cluster-proxy-545f759f7c-tctk6\" (UID: \"9ed8e0b4-0888-43d8-bae7-a7a201130785\") " pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-tctk6"
Oct 30 20:54:04.134183 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:54:04.134082    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/9ed8e0b4-0888-43d8-bae7-a7a201130785-tls\") pod \"data-science-prometheus-cluster-proxy-545f759f7c-tctk6\" (UID: \"9ed8e0b4-0888-43d8-bae7-a7a201130785\") " pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-tctk6"
Oct 30 20:54:04.134183 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:54:04.134134    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-ca\" (UniqueName: \"kubernetes.io/configmap/9ed8e0b4-0888-43d8-bae7-a7a201130785-prometheus-ca\") pod \"data-science-prometheus-cluster-proxy-545f759f7c-tctk6\" (UID: \"9ed8e0b4-0888-43d8-bae7-a7a201130785\") " pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-tctk6"
Oct 30 20:54:04.134183 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:54:04.134153    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-client-cert\" (UniqueName: \"kubernetes.io/secret/9ed8e0b4-0888-43d8-bae7-a7a201130785-prometheus-client-cert\") pod \"data-science-prometheus-cluster-proxy-545f759f7c-tctk6\" (UID: \"9ed8e0b4-0888-43d8-bae7-a7a201130785\") " pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-tctk6"
Oct 30 20:54:04.234894 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:54:04.234857    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/9ed8e0b4-0888-43d8-bae7-a7a201130785-tls\") pod \"data-science-prometheus-cluster-proxy-545f759f7c-tctk6\" (UID: \"9ed8e0b4-0888-43d8-bae7-a7a201130785\") " pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-tctk6"
Oct 30 20:54:04.235071 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:54:04.234907    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-ca\" (UniqueName: \"kubernetes.io/configmap/9ed8e0b4-0888-43d8-bae7-a7a201130785-prometheus-ca\") pod \"data-science-prometheus-cluster-proxy-545f759f7c-tctk6\" (UID: \"9ed8e0b4-0888-43d8-bae7-a7a201130785\") " pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-tctk6"
Oct 30 20:54:04.235071 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:54:04.235020    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-client-cert\" (UniqueName: \"kubernetes.io/secret/9ed8e0b4-0888-43d8-bae7-a7a201130785-prometheus-client-cert\") pod \"data-science-prometheus-cluster-proxy-545f759f7c-tctk6\" (UID: \"9ed8e0b4-0888-43d8-bae7-a7a201130785\") " pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-tctk6"
Oct 30 20:54:04.235071 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:54:04.235065    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-prrjr\" (UniqueName: \"kubernetes.io/projected/9ed8e0b4-0888-43d8-bae7-a7a201130785-kube-api-access-prrjr\") pod \"data-science-prometheus-cluster-proxy-545f759f7c-tctk6\" (UID: \"9ed8e0b4-0888-43d8-bae7-a7a201130785\") " pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-tctk6"
Oct 30 20:54:04.235255 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:54:04.235128    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9ed8e0b4-0888-43d8-bae7-a7a201130785-kube-rbac-proxy-config\") pod \"data-science-prometheus-cluster-proxy-545f759f7c-tctk6\" (UID: \"9ed8e0b4-0888-43d8-bae7-a7a201130785\") " pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-tctk6"
Oct 30 20:54:04.235685 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:54:04.235659    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-ca\" (UniqueName: \"kubernetes.io/configmap/9ed8e0b4-0888-43d8-bae7-a7a201130785-prometheus-ca\") pod \"data-science-prometheus-cluster-proxy-545f759f7c-tctk6\" (UID: \"9ed8e0b4-0888-43d8-bae7-a7a201130785\") " pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-tctk6"
Oct 30 20:54:04.237427 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:54:04.237406    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9ed8e0b4-0888-43d8-bae7-a7a201130785-kube-rbac-proxy-config\") pod \"data-science-prometheus-cluster-proxy-545f759f7c-tctk6\" (UID: \"9ed8e0b4-0888-43d8-bae7-a7a201130785\") " pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-tctk6"
Oct 30 20:54:04.237540 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:54:04.237484    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls\" (UniqueName: \"kubernetes.io/secret/9ed8e0b4-0888-43d8-bae7-a7a201130785-tls\") pod \"data-science-prometheus-cluster-proxy-545f759f7c-tctk6\" (UID: \"9ed8e0b4-0888-43d8-bae7-a7a201130785\") " pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-tctk6"
Oct 30 20:54:04.237540 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:54:04.237515    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-client-cert\" (UniqueName: \"kubernetes.io/secret/9ed8e0b4-0888-43d8-bae7-a7a201130785-prometheus-client-cert\") pod \"data-science-prometheus-cluster-proxy-545f759f7c-tctk6\" (UID: \"9ed8e0b4-0888-43d8-bae7-a7a201130785\") " pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-tctk6"
Oct 30 20:54:04.296141 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:54:04.296111    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-prrjr\" (UniqueName: \"kubernetes.io/projected/9ed8e0b4-0888-43d8-bae7-a7a201130785-kube-api-access-prrjr\") pod \"data-science-prometheus-cluster-proxy-545f759f7c-tctk6\" (UID: \"9ed8e0b4-0888-43d8-bae7-a7a201130785\") " pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-tctk6"
Oct 30 20:54:04.331594 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:54:04.331567    4060 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/korrel8r-5cbcc89b8f-p798g"]
Oct 30 20:54:04.334975 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:54:04.334959    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-p798g"
Oct 30 20:54:04.388349 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:54:04.388314    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"korrel8r-dockercfg-mcjk2\""
Oct 30 20:54:04.388523 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:54:04.388370    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"korrel8r-tls\""
Oct 30 20:54:04.390661 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:54:04.390644    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"korrel8r-config\""
Oct 30 20:54:04.397897 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:54:04.397876    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/korrel8r-5cbcc89b8f-p798g"]
Oct 30 20:54:04.436827 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:54:04.436800    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/7b04b7f4-5662-44de-8831-e9faffcc8da5-tls\") pod \"korrel8r-5cbcc89b8f-p798g\" (UID: \"7b04b7f4-5662-44de-8831-e9faffcc8da5\") " pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-p798g"
Oct 30 20:54:04.436956 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:54:04.436842    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7b04b7f4-5662-44de-8831-e9faffcc8da5-config\") pod \"korrel8r-5cbcc89b8f-p798g\" (UID: \"7b04b7f4-5662-44de-8831-e9faffcc8da5\") " pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-p798g"
Oct 30 20:54:04.436956 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:54:04.436863    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sp7x2\" (UniqueName: \"kubernetes.io/projected/7b04b7f4-5662-44de-8831-e9faffcc8da5-kube-api-access-sp7x2\") pod \"korrel8r-5cbcc89b8f-p798g\" (UID: \"7b04b7f4-5662-44de-8831-e9faffcc8da5\") " pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-p798g"
Oct 30 20:54:04.537632 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:54:04.537551    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/7b04b7f4-5662-44de-8831-e9faffcc8da5-tls\") pod \"korrel8r-5cbcc89b8f-p798g\" (UID: \"7b04b7f4-5662-44de-8831-e9faffcc8da5\") " pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-p798g"
Oct 30 20:54:04.537632 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:54:04.537613    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7b04b7f4-5662-44de-8831-e9faffcc8da5-config\") pod \"korrel8r-5cbcc89b8f-p798g\" (UID: \"7b04b7f4-5662-44de-8831-e9faffcc8da5\") " pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-p798g"
Oct 30 20:54:04.537864 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:54:04.537644    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sp7x2\" (UniqueName: \"kubernetes.io/projected/7b04b7f4-5662-44de-8831-e9faffcc8da5-kube-api-access-sp7x2\") pod \"korrel8r-5cbcc89b8f-p798g\" (UID: \"7b04b7f4-5662-44de-8831-e9faffcc8da5\") " pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-p798g"
Oct 30 20:54:04.538519 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:54:04.538473    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7b04b7f4-5662-44de-8831-e9faffcc8da5-config\") pod \"korrel8r-5cbcc89b8f-p798g\" (UID: \"7b04b7f4-5662-44de-8831-e9faffcc8da5\") " pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-p798g"
Oct 30 20:54:04.540279 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:54:04.540258    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls\" (UniqueName: \"kubernetes.io/secret/7b04b7f4-5662-44de-8831-e9faffcc8da5-tls\") pod \"korrel8r-5cbcc89b8f-p798g\" (UID: \"7b04b7f4-5662-44de-8831-e9faffcc8da5\") " pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-p798g"
Oct 30 20:54:04.565670 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:54:04.565637    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-tctk6"
Oct 30 20:54:04.598741 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:54:04.598714    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sp7x2\" (UniqueName: \"kubernetes.io/projected/7b04b7f4-5662-44de-8831-e9faffcc8da5-kube-api-access-sp7x2\") pod \"korrel8r-5cbcc89b8f-p798g\" (UID: \"7b04b7f4-5662-44de-8831-e9faffcc8da5\") " pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-p798g"
Oct 30 20:54:04.647028 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:54:04.646995    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-p798g"
Oct 30 20:54:04.935541 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:54:04.935484    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-tctk6"]
Oct 30 20:54:04.936506 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:54:04.936466    4060 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ed8e0b4_0888_43d8_bae7_a7a201130785.slice/crio-bd1df7d89731ecef0d11aedcaea0e39a5a150242cb177ab033e75ada5e1fb5e5 WatchSource:0}: Error finding container bd1df7d89731ecef0d11aedcaea0e39a5a150242cb177ab033e75ada5e1fb5e5: Status 404 returned error can't find the container with id bd1df7d89731ecef0d11aedcaea0e39a5a150242cb177ab033e75ada5e1fb5e5
Oct 30 20:54:05.046107 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:54:05.046083    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/korrel8r-5cbcc89b8f-p798g"]
Oct 30 20:54:05.048600 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:54:05.048573    4060 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b04b7f4_5662_44de_8831_e9faffcc8da5.slice/crio-731d759654c9c50ef4c5c84ff00e9fd1114b5472fedb76720907301a0b416d0b WatchSource:0}: Error finding container 731d759654c9c50ef4c5c84ff00e9fd1114b5472fedb76720907301a0b416d0b: Status 404 returned error can't find the container with id 731d759654c9c50ef4c5c84ff00e9fd1114b5472fedb76720907301a0b416d0b
Oct 30 20:54:05.797712 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:54:05.797675    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-tctk6" event={"ID":"9ed8e0b4-0888-43d8-bae7-a7a201130785","Type":"ContainerStarted","Data":"044be665bc939cff522946754f9299fc67d9c9615f32e87f4d881b73065595bc"}
Oct 30 20:54:05.797923 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:54:05.797734    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-tctk6" event={"ID":"9ed8e0b4-0888-43d8-bae7-a7a201130785","Type":"ContainerStarted","Data":"bd1df7d89731ecef0d11aedcaea0e39a5a150242cb177ab033e75ada5e1fb5e5"}
Oct 30 20:54:05.797923 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:54:05.797768    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-tctk6"
Oct 30 20:54:05.799250 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:54:05.799229    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-p798g" event={"ID":"7b04b7f4-5662-44de-8831-e9faffcc8da5","Type":"ContainerStarted","Data":"e8adb8e66ef8fb8f0aed2066521ebc4835dfda936e274cf2c800abf4587b3c47"}
Oct 30 20:54:05.799357 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:54:05.799265    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-p798g" event={"ID":"7b04b7f4-5662-44de-8831-e9faffcc8da5","Type":"ContainerStarted","Data":"731d759654c9c50ef4c5c84ff00e9fd1114b5472fedb76720907301a0b416d0b"}
Oct 30 20:54:05.799357 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:54:05.799319    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-p798g"
Oct 30 20:54:05.915725 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:54:05.915675    4060 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-tctk6" podStartSLOduration=2.91566197 podStartE2EDuration="2.91566197s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:54:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:54:05.914665837 +0000 UTC m=+1064.671664134" watchObservedRunningTime="2026-10-30 20:54:05.91566197 +0000 UTC m=+1064.672660267"
Oct 30 20:54:06.044138 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:54:06.044081    4060 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-p798g" podStartSLOduration=2.04406794 podStartE2EDuration="2.04406794s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:54:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:54:06.041778669 +0000 UTC m=+1064.798776968" watchObservedRunningTime="2026-10-30 20:54:06.04406794 +0000 UTC m=+1064.801066238"
Oct 30 20:54:08.892430 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:54:08.892397    4060 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 20:54:08.895859 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:54:08.895838    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:54:08.972113 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:54:08.972083    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/6afb0f95-fd3f-424b-847a-6dfce8bb8531-otc-internal\") pod \"data-science-collector-collector-0\" (UID: \"6afb0f95-fd3f-424b-847a-6dfce8bb8531\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:54:08.972280 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:54:08.972125    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/6afb0f95-fd3f-424b-847a-6dfce8bb8531-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-0\" (UID: \"6afb0f95-fd3f-424b-847a-6dfce8bb8531\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:54:08.972280 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:54:08.972201    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/6afb0f95-fd3f-424b-847a-6dfce8bb8531-otlp-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"6afb0f95-fd3f-424b-847a-6dfce8bb8531\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:54:08.972280 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:54:08.972234    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/6afb0f95-fd3f-424b-847a-6dfce8bb8531-monitoring-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"6afb0f95-fd3f-424b-847a-6dfce8bb8531\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:54:08.972280 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:54:08.972259    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6afb0f95-fd3f-424b-847a-6dfce8bb8531-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"6afb0f95-fd3f-424b-847a-6dfce8bb8531\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:54:08.972485 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:54:08.972364    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tldtb\" (UniqueName: \"kubernetes.io/projected/6afb0f95-fd3f-424b-847a-6dfce8bb8531-kube-api-access-tldtb\") pod \"data-science-collector-collector-0\" (UID: \"6afb0f95-fd3f-424b-847a-6dfce8bb8531\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:54:09.000160 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:54:09.000074    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-headless-tls\""
Oct 30 20:54:09.000160 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:54:09.000090    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-dockercfg-jqj7h\""
Oct 30 20:54:09.000160 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:54:09.000117    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-monitoring-tls\""
Oct 30 20:54:09.000160 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:54:09.000120    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-ta-client-cert\""
Oct 30 20:54:09.000412 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:54:09.000196    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-tls\""
Oct 30 20:54:09.000412 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:54:09.000228    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-a0f9182a\""
Oct 30 20:54:09.003993 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:54:09.003971    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 20:54:09.073059 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:54:09.073032    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/6afb0f95-fd3f-424b-847a-6dfce8bb8531-otc-internal\") pod \"data-science-collector-collector-0\" (UID: \"6afb0f95-fd3f-424b-847a-6dfce8bb8531\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:54:09.073059 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:54:09.073065    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/6afb0f95-fd3f-424b-847a-6dfce8bb8531-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-0\" (UID: \"6afb0f95-fd3f-424b-847a-6dfce8bb8531\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:54:09.073318 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:54:09.073093    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/6afb0f95-fd3f-424b-847a-6dfce8bb8531-otlp-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"6afb0f95-fd3f-424b-847a-6dfce8bb8531\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:54:09.073318 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:54:09.073232    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/6afb0f95-fd3f-424b-847a-6dfce8bb8531-monitoring-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"6afb0f95-fd3f-424b-847a-6dfce8bb8531\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:54:09.073318 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:54:09.073272    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6afb0f95-fd3f-424b-847a-6dfce8bb8531-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"6afb0f95-fd3f-424b-847a-6dfce8bb8531\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:54:09.073476 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:54:09.073319    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tldtb\" (UniqueName: \"kubernetes.io/projected/6afb0f95-fd3f-424b-847a-6dfce8bb8531-kube-api-access-tldtb\") pod \"data-science-collector-collector-0\" (UID: \"6afb0f95-fd3f-424b-847a-6dfce8bb8531\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:54:09.074019 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:54:09.073994    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/6afb0f95-fd3f-424b-847a-6dfce8bb8531-otc-internal\") pod \"data-science-collector-collector-0\" (UID: \"6afb0f95-fd3f-424b-847a-6dfce8bb8531\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:54:09.075542 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:54:09.075520    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/6afb0f95-fd3f-424b-847a-6dfce8bb8531-otlp-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"6afb0f95-fd3f-424b-847a-6dfce8bb8531\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:54:09.075704 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:54:09.075687    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6afb0f95-fd3f-424b-847a-6dfce8bb8531-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"6afb0f95-fd3f-424b-847a-6dfce8bb8531\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:54:09.075768 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:54:09.075731    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/6afb0f95-fd3f-424b-847a-6dfce8bb8531-monitoring-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"6afb0f95-fd3f-424b-847a-6dfce8bb8531\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:54:09.075768 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:54:09.075739    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/6afb0f95-fd3f-424b-847a-6dfce8bb8531-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-0\" (UID: \"6afb0f95-fd3f-424b-847a-6dfce8bb8531\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:54:09.147134 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:54:09.147058    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tldtb\" (UniqueName: \"kubernetes.io/projected/6afb0f95-fd3f-424b-847a-6dfce8bb8531-kube-api-access-tldtb\") pod \"data-science-collector-collector-0\" (UID: \"6afb0f95-fd3f-424b-847a-6dfce8bb8531\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:54:09.208946 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:54:09.208915    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:54:09.631961 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:54:09.631930    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 20:54:09.635461 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:54:09.635431    4060 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6afb0f95_fd3f_424b_847a_6dfce8bb8531.slice/crio-f702c637be374f7a727a78dd0bb4f7da7fe2d8d9598be16db32c9ffc196b59d4 WatchSource:0}: Error finding container f702c637be374f7a727a78dd0bb4f7da7fe2d8d9598be16db32c9ffc196b59d4: Status 404 returned error can't find the container with id f702c637be374f7a727a78dd0bb4f7da7fe2d8d9598be16db32c9ffc196b59d4
Oct 30 20:54:09.639611 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:54:09.638997    4060 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 20:54:09.639611 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:54:09.639075    4060 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 20:54:09.818925 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:54:09.818887    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"6afb0f95-fd3f-424b-847a-6dfce8bb8531","Type":"ContainerStarted","Data":"792424d2229b9c25cfbd8f72529890182812d8080e04cdaf3e8dfed04c514540"}
Oct 30 20:54:09.819084 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:54:09.818947    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"6afb0f95-fd3f-424b-847a-6dfce8bb8531","Type":"ContainerStarted","Data":"f702c637be374f7a727a78dd0bb4f7da7fe2d8d9598be16db32c9ffc196b59d4"}
Oct 30 20:54:09.944736 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:54:09.944612    4060 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-collector-0" podStartSLOduration=1.944593842 podStartE2EDuration="1.944593842s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:54:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:54:09.94247928 +0000 UTC m=+1068.699477577" watchObservedRunningTime="2026-10-30 20:54:09.944593842 +0000 UTC m=+1068.701592141"
Oct 30 20:54:11.805942 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:54:11.805915    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-tctk6"
Oct 30 20:54:12.152157 ip-10-0-142-4 kubenswrapper[4060]: E1030 20:54:12.152065    4060 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v2f4x" containerName="extractor"
Oct 30 20:54:16.805655 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:54:16.805627    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-p798g"
Oct 30 20:54:22.707363 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:54:22.707327    4060 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"]
Oct 30 20:54:22.712408 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:54:22.712386    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 20:54:22.779896 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:54:22.779860    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b2c848d9-2add-4fde-8575-85ee3a22a1ae-tls-assets\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"b2c848d9-2add-4fde-8575-85ee3a22a1ae\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 20:54:22.780083 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:54:22.780053    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b2c848d9-2add-4fde-8575-85ee3a22a1ae-web-config\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"b2c848d9-2add-4fde-8575-85ee3a22a1ae\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 20:54:22.780159 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:54:22.780106    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b2c848d9-2add-4fde-8575-85ee3a22a1ae-config-volume\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"b2c848d9-2add-4fde-8575-85ee3a22a1ae\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 20:54:22.780159 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:54:22.780146    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b2c848d9-2add-4fde-8575-85ee3a22a1ae-config-out\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"b2c848d9-2add-4fde-8575-85ee3a22a1ae\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 20:54:22.780249 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:54:22.780229    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-data-science-monitoringstack-db\" (UniqueName: \"kubernetes.io/empty-dir/b2c848d9-2add-4fde-8575-85ee3a22a1ae-alertmanager-data-science-monitoringstack-db\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"b2c848d9-2add-4fde-8575-85ee3a22a1ae\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 20:54:22.780294 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:54:22.780276    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qnqjk\" (UniqueName: \"kubernetes.io/projected/b2c848d9-2add-4fde-8575-85ee3a22a1ae-kube-api-access-qnqjk\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"b2c848d9-2add-4fde-8575-85ee3a22a1ae\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 20:54:22.780409 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:54:22.780392    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b2c848d9-2add-4fde-8575-85ee3a22a1ae-cluster-tls-config\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"b2c848d9-2add-4fde-8575-85ee3a22a1ae\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 20:54:22.823396 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:54:22.823350    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"alertmanager-data-science-monitoringstack-web-config\""
Oct 30 20:54:22.823396 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:54:22.823351    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"alertmanager-data-science-monitoringstack-generated\""
Oct 30 20:54:22.823396 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:54:22.823351    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"alertmanager-data-science-monitoringstack-tls-assets-0\""
Oct 30 20:54:22.823396 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:54:22.823391    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"alertmanager-data-science-monitoringstack-cluster-tls-config\""
Oct 30 20:54:22.823695 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:54:22.823413    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-monitoringstack-alertmanager-dockercfg-ch6xk\""
Oct 30 20:54:22.825464 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:54:22.825437    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"]
Oct 30 20:54:22.881036 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:54:22.881008    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b2c848d9-2add-4fde-8575-85ee3a22a1ae-cluster-tls-config\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"b2c848d9-2add-4fde-8575-85ee3a22a1ae\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 20:54:22.881036 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:54:22.881039    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b2c848d9-2add-4fde-8575-85ee3a22a1ae-tls-assets\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"b2c848d9-2add-4fde-8575-85ee3a22a1ae\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 20:54:22.881280 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:54:22.881068    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b2c848d9-2add-4fde-8575-85ee3a22a1ae-web-config\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"b2c848d9-2add-4fde-8575-85ee3a22a1ae\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 20:54:22.881280 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:54:22.881090    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b2c848d9-2add-4fde-8575-85ee3a22a1ae-config-volume\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"b2c848d9-2add-4fde-8575-85ee3a22a1ae\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 20:54:22.881280 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:54:22.881110    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b2c848d9-2add-4fde-8575-85ee3a22a1ae-config-out\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"b2c848d9-2add-4fde-8575-85ee3a22a1ae\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 20:54:22.881280 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:54:22.881128    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-data-science-monitoringstack-db\" (UniqueName: \"kubernetes.io/empty-dir/b2c848d9-2add-4fde-8575-85ee3a22a1ae-alertmanager-data-science-monitoringstack-db\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"b2c848d9-2add-4fde-8575-85ee3a22a1ae\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 20:54:22.881280 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:54:22.881252    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qnqjk\" (UniqueName: \"kubernetes.io/projected/b2c848d9-2add-4fde-8575-85ee3a22a1ae-kube-api-access-qnqjk\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"b2c848d9-2add-4fde-8575-85ee3a22a1ae\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 20:54:22.881613 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:54:22.881575    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-data-science-monitoringstack-db\" (UniqueName: \"kubernetes.io/empty-dir/b2c848d9-2add-4fde-8575-85ee3a22a1ae-alertmanager-data-science-monitoringstack-db\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"b2c848d9-2add-4fde-8575-85ee3a22a1ae\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 20:54:22.884086 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:54:22.883952    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b2c848d9-2add-4fde-8575-85ee3a22a1ae-cluster-tls-config\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"b2c848d9-2add-4fde-8575-85ee3a22a1ae\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 20:54:22.884086 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:54:22.884065    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b2c848d9-2add-4fde-8575-85ee3a22a1ae-tls-assets\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"b2c848d9-2add-4fde-8575-85ee3a22a1ae\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 20:54:22.884254 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:54:22.884065    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b2c848d9-2add-4fde-8575-85ee3a22a1ae-web-config\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"b2c848d9-2add-4fde-8575-85ee3a22a1ae\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 20:54:22.884254 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:54:22.884240    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b2c848d9-2add-4fde-8575-85ee3a22a1ae-config-out\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"b2c848d9-2add-4fde-8575-85ee3a22a1ae\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 20:54:22.884386 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:54:22.884375    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b2c848d9-2add-4fde-8575-85ee3a22a1ae-config-volume\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"b2c848d9-2add-4fde-8575-85ee3a22a1ae\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 20:54:22.942761 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:54:22.942728    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qnqjk\" (UniqueName: \"kubernetes.io/projected/b2c848d9-2add-4fde-8575-85ee3a22a1ae-kube-api-access-qnqjk\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"b2c848d9-2add-4fde-8575-85ee3a22a1ae\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 20:54:23.029400 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:54:23.029276    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 20:54:23.458949 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:54:23.458922    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"]
Oct 30 20:54:23.460749 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:54:23.460727    4060 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2c848d9_2add_4fde_8575_85ee3a22a1ae.slice/crio-da0af607e990ea31b5cc6c2bfa12e2b8235d8f0c95e2ce4affb7243381edc672 WatchSource:0}: Error finding container da0af607e990ea31b5cc6c2bfa12e2b8235d8f0c95e2ce4affb7243381edc672: Status 404 returned error can't find the container with id da0af607e990ea31b5cc6c2bfa12e2b8235d8f0c95e2ce4affb7243381edc672
Oct 30 20:54:23.883566 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:54:23.883527    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0" event={"ID":"b2c848d9-2add-4fde-8575-85ee3a22a1ae","Type":"ContainerStarted","Data":"7cb7950855de335aeb14f1342b34b21a84e791c5bea04a8d31e48e1bd3be9b8f"}
Oct 30 20:54:23.883953 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:54:23.883600    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0" event={"ID":"b2c848d9-2add-4fde-8575-85ee3a22a1ae","Type":"ContainerStarted","Data":"da0af607e990ea31b5cc6c2bfa12e2b8235d8f0c95e2ce4affb7243381edc672"}
Oct 30 20:54:27.902646 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:54:27.902613    4060 generic.go:356] "Generic (PLEG): container finished" podID="b2c848d9-2add-4fde-8575-85ee3a22a1ae" containerID="7cb7950855de335aeb14f1342b34b21a84e791c5bea04a8d31e48e1bd3be9b8f" exitCode=0
Oct 30 20:54:27.903130 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:54:27.902675    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0" event={"ID":"b2c848d9-2add-4fde-8575-85ee3a22a1ae","Type":"ContainerDied","Data":"7cb7950855de335aeb14f1342b34b21a84e791c5bea04a8d31e48e1bd3be9b8f"}
Oct 30 20:54:28.909196 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:54:28.909161    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0" event={"ID":"b2c848d9-2add-4fde-8575-85ee3a22a1ae","Type":"ContainerStarted","Data":"1e63113e2e7320e307ed2b1e4c9c25aefabf40cb29f551014df24c7fb19c0a5c"}
Oct 30 20:54:28.909615 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:54:28.909230    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0" event={"ID":"b2c848d9-2add-4fde-8575-85ee3a22a1ae","Type":"ContainerStarted","Data":"43bff33733df7bfc6815aac83720e28e2f35192df77a3aa4b37139fe9496f9f9"}
Oct 30 20:54:28.909615 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:54:28.909419    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 20:54:29.041436 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:54:29.041367    4060 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0" podStartSLOduration=3.655683642 podStartE2EDuration="7.041349235s" totalImagesPullingTime="0s" totalInitContainerRuntime="3.385665593s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:54:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:54:29.034830819 +0000 UTC m=+1087.791829127" watchObservedRunningTime="2026-10-30 20:54:29.041349235 +0000 UTC m=+1087.798347536"
Oct 30 20:54:34.915180 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:54:34.915148    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 20:54:42.149386 ip-10-0-142-4 kubenswrapper[4060]: E1030 20:54:42.149352    4060 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v2f4x" containerName="extractor"
Oct 30 20:55:12.014753 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:55:12.014675    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 20:55:12.015288 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:55:12.014944    4060 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-collector-0" podUID="6afb0f95-fd3f-424b-847a-6dfce8bb8531" containerName="otc-container" containerID="cri-o://792424d2229b9c25cfbd8f72529890182812d8080e04cdaf3e8dfed04c514540" gracePeriod=30
Oct 30 20:55:12.151661 ip-10-0-142-4 kubenswrapper[4060]: E1030 20:55:12.151628    4060 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v2f4x" containerName="extractor"
Oct 30 20:55:14.362985 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:55:14.362962    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:55:14.412072 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:55:14.411999    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/6afb0f95-fd3f-424b-847a-6dfce8bb8531-data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/6afb0f95-fd3f-424b-847a-6dfce8bb8531-data-science-collector-ta-client-cert\") pod \"6afb0f95-fd3f-424b-847a-6dfce8bb8531\" (UID: \"6afb0f95-fd3f-424b-847a-6dfce8bb8531\") "
Oct 30 20:55:14.412072 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:55:14.412033    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6afb0f95-fd3f-424b-847a-6dfce8bb8531-kube-api-access-tldtb\" (UniqueName: \"kubernetes.io/projected/6afb0f95-fd3f-424b-847a-6dfce8bb8531-kube-api-access-tldtb\") pod \"6afb0f95-fd3f-424b-847a-6dfce8bb8531\" (UID: \"6afb0f95-fd3f-424b-847a-6dfce8bb8531\") "
Oct 30 20:55:14.412072 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:55:14.412052    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/6afb0f95-fd3f-424b-847a-6dfce8bb8531-otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/6afb0f95-fd3f-424b-847a-6dfce8bb8531-otlp-tls-certs\") pod \"6afb0f95-fd3f-424b-847a-6dfce8bb8531\" (UID: \"6afb0f95-fd3f-424b-847a-6dfce8bb8531\") "
Oct 30 20:55:14.412072 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:55:14.412072    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/6afb0f95-fd3f-424b-847a-6dfce8bb8531-tls-certs\" (UniqueName: \"kubernetes.io/secret/6afb0f95-fd3f-424b-847a-6dfce8bb8531-tls-certs\") pod \"6afb0f95-fd3f-424b-847a-6dfce8bb8531\" (UID: \"6afb0f95-fd3f-424b-847a-6dfce8bb8531\") "
Oct 30 20:55:14.412400 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:55:14.412130    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/6afb0f95-fd3f-424b-847a-6dfce8bb8531-monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/6afb0f95-fd3f-424b-847a-6dfce8bb8531-monitoring-tls-certs\") pod \"6afb0f95-fd3f-424b-847a-6dfce8bb8531\" (UID: \"6afb0f95-fd3f-424b-847a-6dfce8bb8531\") "
Oct 30 20:55:14.412400 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:55:14.412181    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/6afb0f95-fd3f-424b-847a-6dfce8bb8531-otc-internal\" (UniqueName: \"kubernetes.io/configmap/6afb0f95-fd3f-424b-847a-6dfce8bb8531-otc-internal\") pod \"6afb0f95-fd3f-424b-847a-6dfce8bb8531\" (UID: \"6afb0f95-fd3f-424b-847a-6dfce8bb8531\") "
Oct 30 20:55:14.412724 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:55:14.412688    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6afb0f95-fd3f-424b-847a-6dfce8bb8531-otc-internal" pod "6afb0f95-fd3f-424b-847a-6dfce8bb8531" (UID: "6afb0f95-fd3f-424b-847a-6dfce8bb8531"). InnerVolumeSpecName "otc-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:55:14.414285 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:55:14.414254    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6afb0f95-fd3f-424b-847a-6dfce8bb8531-otlp-tls-certs" pod "6afb0f95-fd3f-424b-847a-6dfce8bb8531" (UID: "6afb0f95-fd3f-424b-847a-6dfce8bb8531"). InnerVolumeSpecName "otlp-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:55:14.414389 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:55:14.414305    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6afb0f95-fd3f-424b-847a-6dfce8bb8531-tls-certs" pod "6afb0f95-fd3f-424b-847a-6dfce8bb8531" (UID: "6afb0f95-fd3f-424b-847a-6dfce8bb8531"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:55:14.414389 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:55:14.414356    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6afb0f95-fd3f-424b-847a-6dfce8bb8531-kube-api-access-tldtb" pod "6afb0f95-fd3f-424b-847a-6dfce8bb8531" (UID: "6afb0f95-fd3f-424b-847a-6dfce8bb8531"). InnerVolumeSpecName "kube-api-access-tldtb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:55:14.414564 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:55:14.414547    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6afb0f95-fd3f-424b-847a-6dfce8bb8531-data-science-collector-ta-client-cert" pod "6afb0f95-fd3f-424b-847a-6dfce8bb8531" (UID: "6afb0f95-fd3f-424b-847a-6dfce8bb8531"). InnerVolumeSpecName "data-science-collector-ta-client-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:55:14.414613 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:55:14.414590    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6afb0f95-fd3f-424b-847a-6dfce8bb8531-monitoring-tls-certs" pod "6afb0f95-fd3f-424b-847a-6dfce8bb8531" (UID: "6afb0f95-fd3f-424b-847a-6dfce8bb8531"). InnerVolumeSpecName "monitoring-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:55:14.513245 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:55:14.513204    4060 reconciler_common.go:299] "Volume detached for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/6afb0f95-fd3f-424b-847a-6dfce8bb8531-otc-internal\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:55:14.513245 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:55:14.513241    4060 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/6afb0f95-fd3f-424b-847a-6dfce8bb8531-data-science-collector-ta-client-cert\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:55:14.513245 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:55:14.513253    4060 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tldtb\" (UniqueName: \"kubernetes.io/projected/6afb0f95-fd3f-424b-847a-6dfce8bb8531-kube-api-access-tldtb\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:55:14.513550 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:55:14.513265    4060 reconciler_common.go:299] "Volume detached for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/6afb0f95-fd3f-424b-847a-6dfce8bb8531-otlp-tls-certs\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:55:14.513550 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:55:14.513274    4060 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6afb0f95-fd3f-424b-847a-6dfce8bb8531-tls-certs\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:55:14.513550 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:55:14.513282    4060 reconciler_common.go:299] "Volume detached for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/6afb0f95-fd3f-424b-847a-6dfce8bb8531-monitoring-tls-certs\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:55:15.130084 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:55:15.130049    4060 generic.go:356] "Generic (PLEG): container finished" podID="6afb0f95-fd3f-424b-847a-6dfce8bb8531" containerID="792424d2229b9c25cfbd8f72529890182812d8080e04cdaf3e8dfed04c514540" exitCode=0
Oct 30 20:55:15.130262 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:55:15.130099    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:55:15.130262 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:55:15.130107    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"6afb0f95-fd3f-424b-847a-6dfce8bb8531","Type":"ContainerDied","Data":"792424d2229b9c25cfbd8f72529890182812d8080e04cdaf3e8dfed04c514540"}
Oct 30 20:55:15.130262 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:55:15.130158    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"6afb0f95-fd3f-424b-847a-6dfce8bb8531","Type":"ContainerDied","Data":"f702c637be374f7a727a78dd0bb4f7da7fe2d8d9598be16db32c9ffc196b59d4"}
Oct 30 20:55:15.130262 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:55:15.130190    4060 scope.go:122] "RemoveContainer" containerID="792424d2229b9c25cfbd8f72529890182812d8080e04cdaf3e8dfed04c514540"
Oct 30 20:55:15.139210 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:55:15.139188    4060 scope.go:122] "RemoveContainer" containerID="792424d2229b9c25cfbd8f72529890182812d8080e04cdaf3e8dfed04c514540"
Oct 30 20:55:15.139461 ip-10-0-142-4 kubenswrapper[4060]: E1030 20:55:15.139444    4060 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"792424d2229b9c25cfbd8f72529890182812d8080e04cdaf3e8dfed04c514540\": container with ID starting with 792424d2229b9c25cfbd8f72529890182812d8080e04cdaf3e8dfed04c514540 not found: ID does not exist" containerID="792424d2229b9c25cfbd8f72529890182812d8080e04cdaf3e8dfed04c514540"
Oct 30 20:55:15.139611 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:55:15.139474    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"792424d2229b9c25cfbd8f72529890182812d8080e04cdaf3e8dfed04c514540"} err="failed to get container status \"792424d2229b9c25cfbd8f72529890182812d8080e04cdaf3e8dfed04c514540\": rpc error: code = NotFound desc = could not find container \"792424d2229b9c25cfbd8f72529890182812d8080e04cdaf3e8dfed04c514540\": container with ID starting with 792424d2229b9c25cfbd8f72529890182812d8080e04cdaf3e8dfed04c514540 not found: ID does not exist"
Oct 30 20:55:15.345217 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:55:15.345183    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 20:55:15.394377 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:55:15.394301    4060 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 20:55:15.429004 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:55:15.428967    4060 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="6afb0f95-fd3f-424b-847a-6dfce8bb8531" path="/var/lib/kubelet/pods/6afb0f95-fd3f-424b-847a-6dfce8bb8531/volumes"
Oct 30 20:55:15.429342 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:55:15.429324    4060 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 20:55:15.429832 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:55:15.429814    4060 cpu_manager.go:414] "containerMap: removing container" podUID="6afb0f95-fd3f-424b-847a-6dfce8bb8531" containerName="otc-container"
Oct 30 20:55:15.429872 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:55:15.429836    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6afb0f95-fd3f-424b-847a-6dfce8bb8531" containerName="otc-container"
Oct 30 20:55:15.429928 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:55:15.429916    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="6afb0f95-fd3f-424b-847a-6dfce8bb8531" containerName="otc-container"
Oct 30 20:55:15.437008 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:55:15.436987    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:55:15.489284 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:55:15.489242    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-a0f9182a\""
Oct 30 20:55:15.489790 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:55:15.489719    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-monitoring-tls\""
Oct 30 20:55:15.489919 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:55:15.489871    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-dockercfg-jqj7h\""
Oct 30 20:55:15.489919 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:55:15.489872    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-ta-client-cert\""
Oct 30 20:55:15.491278 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:55:15.491252    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 20:55:15.523321 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:55:15.523296    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5edcd213-a230-49ef-b8a9-6afec668f83f-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"5edcd213-a230-49ef-b8a9-6afec668f83f\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:55:15.523448 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:55:15.523327    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/5edcd213-a230-49ef-b8a9-6afec668f83f-otlp-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"5edcd213-a230-49ef-b8a9-6afec668f83f\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:55:15.523448 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:55:15.523357    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/5edcd213-a230-49ef-b8a9-6afec668f83f-otc-internal\") pod \"data-science-collector-collector-0\" (UID: \"5edcd213-a230-49ef-b8a9-6afec668f83f\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:55:15.523448 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:55:15.523436    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/5edcd213-a230-49ef-b8a9-6afec668f83f-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-0\" (UID: \"5edcd213-a230-49ef-b8a9-6afec668f83f\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:55:15.523583 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:55:15.523474    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mf59x\" (UniqueName: \"kubernetes.io/projected/5edcd213-a230-49ef-b8a9-6afec668f83f-kube-api-access-mf59x\") pod \"data-science-collector-collector-0\" (UID: \"5edcd213-a230-49ef-b8a9-6afec668f83f\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:55:15.523583 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:55:15.523536    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/5edcd213-a230-49ef-b8a9-6afec668f83f-monitoring-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"5edcd213-a230-49ef-b8a9-6afec668f83f\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:55:15.537439 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:55:15.537419    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-headless-tls\""
Oct 30 20:55:15.537561 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:55:15.537527    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-tls\""
Oct 30 20:55:15.623884 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:55:15.623854    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/5edcd213-a230-49ef-b8a9-6afec668f83f-otlp-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"5edcd213-a230-49ef-b8a9-6afec668f83f\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:55:15.624059 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:55:15.623897    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/5edcd213-a230-49ef-b8a9-6afec668f83f-otc-internal\") pod \"data-science-collector-collector-0\" (UID: \"5edcd213-a230-49ef-b8a9-6afec668f83f\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:55:15.624059 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:55:15.623925    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/5edcd213-a230-49ef-b8a9-6afec668f83f-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-0\" (UID: \"5edcd213-a230-49ef-b8a9-6afec668f83f\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:55:15.624059 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:55:15.623946    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mf59x\" (UniqueName: \"kubernetes.io/projected/5edcd213-a230-49ef-b8a9-6afec668f83f-kube-api-access-mf59x\") pod \"data-science-collector-collector-0\" (UID: \"5edcd213-a230-49ef-b8a9-6afec668f83f\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:55:15.624059 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:55:15.623966    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/5edcd213-a230-49ef-b8a9-6afec668f83f-monitoring-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"5edcd213-a230-49ef-b8a9-6afec668f83f\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:55:15.624059 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:55:15.624001    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5edcd213-a230-49ef-b8a9-6afec668f83f-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"5edcd213-a230-49ef-b8a9-6afec668f83f\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:55:15.624667 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:55:15.624639    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/5edcd213-a230-49ef-b8a9-6afec668f83f-otc-internal\") pod \"data-science-collector-collector-0\" (UID: \"5edcd213-a230-49ef-b8a9-6afec668f83f\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:55:15.626696 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:55:15.626668    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5edcd213-a230-49ef-b8a9-6afec668f83f-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"5edcd213-a230-49ef-b8a9-6afec668f83f\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:55:15.626696 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:55:15.626689    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/5edcd213-a230-49ef-b8a9-6afec668f83f-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-0\" (UID: \"5edcd213-a230-49ef-b8a9-6afec668f83f\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:55:15.626978 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:55:15.626958    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/5edcd213-a230-49ef-b8a9-6afec668f83f-monitoring-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"5edcd213-a230-49ef-b8a9-6afec668f83f\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:55:15.627019 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:55:15.626966    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/5edcd213-a230-49ef-b8a9-6afec668f83f-otlp-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"5edcd213-a230-49ef-b8a9-6afec668f83f\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:55:15.684972 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:55:15.684907    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mf59x\" (UniqueName: \"kubernetes.io/projected/5edcd213-a230-49ef-b8a9-6afec668f83f-kube-api-access-mf59x\") pod \"data-science-collector-collector-0\" (UID: \"5edcd213-a230-49ef-b8a9-6afec668f83f\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:55:15.752796 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:55:15.752765    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:55:16.124016 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:55:16.123972    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 20:55:16.126945 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:55:16.126918    4060 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5edcd213_a230_49ef_b8a9_6afec668f83f.slice/crio-90129be76310d28451d621d62b29bb92d5f50cbc0b838890ce8b79c53f573a56 WatchSource:0}: Error finding container 90129be76310d28451d621d62b29bb92d5f50cbc0b838890ce8b79c53f573a56: Status 404 returned error can't find the container with id 90129be76310d28451d621d62b29bb92d5f50cbc0b838890ce8b79c53f573a56
Oct 30 20:55:16.129096 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:55:16.129059    4060 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 20:55:16.129181 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:55:16.129125    4060 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 20:55:16.136758 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:55:16.136736    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"5edcd213-a230-49ef-b8a9-6afec668f83f","Type":"ContainerStarted","Data":"90129be76310d28451d621d62b29bb92d5f50cbc0b838890ce8b79c53f573a56"}
Oct 30 20:55:17.143530 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:55:17.143479    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"5edcd213-a230-49ef-b8a9-6afec668f83f","Type":"ContainerStarted","Data":"2e7e0e4d3351bbbdc28935392abe7ae14f0dc273282e9e04af51e2b7a2b3a76f"}
Oct 30 20:55:17.275132 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:55:17.275078    4060 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-collector-0" podStartSLOduration=2.275063296 podStartE2EDuration="2.275063296s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:55:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:55:17.27188114 +0000 UTC m=+1136.028879439" watchObservedRunningTime="2026-10-30 20:55:17.275063296 +0000 UTC m=+1136.032061594"
Oct 30 20:55:42.150210 ip-10-0-142-4 kubenswrapper[4060]: E1030 20:55:42.150178    4060 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v2f4x" containerName="extractor"
Oct 30 20:56:12.150149 ip-10-0-142-4 kubenswrapper[4060]: E1030 20:56:12.150109    4060 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v2f4x" containerName="extractor"
Oct 30 20:56:42.149875 ip-10-0-142-4 kubenswrapper[4060]: E1030 20:56:42.149800    4060 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v2f4x" containerName="extractor"
Oct 30 20:56:44.267641 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:56:44.267606    4060 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/korrel8r-66d6f7f696-hjk49"]
Oct 30 20:56:44.270899 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:56:44.270875    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/korrel8r-66d6f7f696-hjk49"
Oct 30 20:56:44.331311 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:56:44.331284    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/korrel8r-66d6f7f696-hjk49"]
Oct 30 20:56:44.352918 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:56:44.352890    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/656dee2b-a438-429f-859e-e8f57d8ecfa0-config\") pod \"korrel8r-66d6f7f696-hjk49\" (UID: \"656dee2b-a438-429f-859e-e8f57d8ecfa0\") " pod="redhat-ods-monitoring/korrel8r-66d6f7f696-hjk49"
Oct 30 20:56:44.353051 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:56:44.352958    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fglg5\" (UniqueName: \"kubernetes.io/projected/656dee2b-a438-429f-859e-e8f57d8ecfa0-kube-api-access-fglg5\") pod \"korrel8r-66d6f7f696-hjk49\" (UID: \"656dee2b-a438-429f-859e-e8f57d8ecfa0\") " pod="redhat-ods-monitoring/korrel8r-66d6f7f696-hjk49"
Oct 30 20:56:44.353091 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:56:44.353056    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/656dee2b-a438-429f-859e-e8f57d8ecfa0-tls\") pod \"korrel8r-66d6f7f696-hjk49\" (UID: \"656dee2b-a438-429f-859e-e8f57d8ecfa0\") " pod="redhat-ods-monitoring/korrel8r-66d6f7f696-hjk49"
Oct 30 20:56:44.454274 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:56:44.454238    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fglg5\" (UniqueName: \"kubernetes.io/projected/656dee2b-a438-429f-859e-e8f57d8ecfa0-kube-api-access-fglg5\") pod \"korrel8r-66d6f7f696-hjk49\" (UID: \"656dee2b-a438-429f-859e-e8f57d8ecfa0\") " pod="redhat-ods-monitoring/korrel8r-66d6f7f696-hjk49"
Oct 30 20:56:44.454274 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:56:44.454280    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/656dee2b-a438-429f-859e-e8f57d8ecfa0-tls\") pod \"korrel8r-66d6f7f696-hjk49\" (UID: \"656dee2b-a438-429f-859e-e8f57d8ecfa0\") " pod="redhat-ods-monitoring/korrel8r-66d6f7f696-hjk49"
Oct 30 20:56:44.454482 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:56:44.454306    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/656dee2b-a438-429f-859e-e8f57d8ecfa0-config\") pod \"korrel8r-66d6f7f696-hjk49\" (UID: \"656dee2b-a438-429f-859e-e8f57d8ecfa0\") " pod="redhat-ods-monitoring/korrel8r-66d6f7f696-hjk49"
Oct 30 20:56:44.455180 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:56:44.455153    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/656dee2b-a438-429f-859e-e8f57d8ecfa0-config\") pod \"korrel8r-66d6f7f696-hjk49\" (UID: \"656dee2b-a438-429f-859e-e8f57d8ecfa0\") " pod="redhat-ods-monitoring/korrel8r-66d6f7f696-hjk49"
Oct 30 20:56:44.456714 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:56:44.456696    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls\" (UniqueName: \"kubernetes.io/secret/656dee2b-a438-429f-859e-e8f57d8ecfa0-tls\") pod \"korrel8r-66d6f7f696-hjk49\" (UID: \"656dee2b-a438-429f-859e-e8f57d8ecfa0\") " pod="redhat-ods-monitoring/korrel8r-66d6f7f696-hjk49"
Oct 30 20:56:44.515569 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:56:44.515535    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fglg5\" (UniqueName: \"kubernetes.io/projected/656dee2b-a438-429f-859e-e8f57d8ecfa0-kube-api-access-fglg5\") pod \"korrel8r-66d6f7f696-hjk49\" (UID: \"656dee2b-a438-429f-859e-e8f57d8ecfa0\") " pod="redhat-ods-monitoring/korrel8r-66d6f7f696-hjk49"
Oct 30 20:56:44.582998 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:56:44.582928    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/korrel8r-66d6f7f696-hjk49"
Oct 30 20:56:44.953879 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:56:44.953854    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/korrel8r-66d6f7f696-hjk49"]
Oct 30 20:56:44.956258 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:56:44.956221    4060 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod656dee2b_a438_429f_859e_e8f57d8ecfa0.slice/crio-0bf37fdf82c42d937a6ad90b8cb09134d818d4d2514f9f4727947812170cce5a WatchSource:0}: Error finding container 0bf37fdf82c42d937a6ad90b8cb09134d818d4d2514f9f4727947812170cce5a: Status 404 returned error can't find the container with id 0bf37fdf82c42d937a6ad90b8cb09134d818d4d2514f9f4727947812170cce5a
Oct 30 20:56:45.560792 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:56:45.560756    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/korrel8r-66d6f7f696-hjk49" event={"ID":"656dee2b-a438-429f-859e-e8f57d8ecfa0","Type":"ContainerStarted","Data":"2674f8907642f8c8ea0112ff6af026de952f665d352271e8bed36b2954e3a460"}
Oct 30 20:56:45.561205 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:56:45.560807    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/korrel8r-66d6f7f696-hjk49" event={"ID":"656dee2b-a438-429f-859e-e8f57d8ecfa0","Type":"ContainerStarted","Data":"0bf37fdf82c42d937a6ad90b8cb09134d818d4d2514f9f4727947812170cce5a"}
Oct 30 20:56:45.561205 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:56:45.560868    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/korrel8r-66d6f7f696-hjk49"
Oct 30 20:56:45.678343 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:56:45.678284    4060 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/korrel8r-66d6f7f696-hjk49" podStartSLOduration=1.678266456 podStartE2EDuration="1.678266456s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:56:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:56:45.676426731 +0000 UTC m=+1224.433425029" watchObservedRunningTime="2026-10-30 20:56:45.678266456 +0000 UTC m=+1224.435264755"
Oct 30 20:56:54.500933 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:56:54.500893    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 20:56:54.501383 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:56:54.501118    4060 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-collector-0" podUID="5edcd213-a230-49ef-b8a9-6afec668f83f" containerName="otc-container" containerID="cri-o://2e7e0e4d3351bbbdc28935392abe7ae14f0dc273282e9e04af51e2b7a2b3a76f" gracePeriod=30
Oct 30 20:56:56.568034 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:56:56.568006    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/korrel8r-66d6f7f696-hjk49"
Oct 30 20:56:56.737441 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:56:56.737031    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/korrel8r-5cbcc89b8f-p798g"]
Oct 30 20:56:56.737441 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:56:56.737268    4060 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-p798g" podUID="7b04b7f4-5662-44de-8831-e9faffcc8da5" containerName="korrel8r" containerID="cri-o://e8adb8e66ef8fb8f0aed2066521ebc4835dfda936e274cf2c800abf4587b3c47" gracePeriod=30
Oct 30 20:56:56.803861 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:56:56.803800    4060 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-p798g" podUID="7b04b7f4-5662-44de-8831-e9faffcc8da5" containerName="korrel8r" probeResult="failure" output="dial tcp 10.133.0.52:8443: connect: connection refused"
Oct 30 20:56:56.860793 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:56:56.860767    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:56:56.964382 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:56:56.964356    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/5edcd213-a230-49ef-b8a9-6afec668f83f-otc-internal\" (UniqueName: \"kubernetes.io/configmap/5edcd213-a230-49ef-b8a9-6afec668f83f-otc-internal\") pod \"5edcd213-a230-49ef-b8a9-6afec668f83f\" (UID: \"5edcd213-a230-49ef-b8a9-6afec668f83f\") "
Oct 30 20:56:56.964529 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:56:56.964393    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/5edcd213-a230-49ef-b8a9-6afec668f83f-data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/5edcd213-a230-49ef-b8a9-6afec668f83f-data-science-collector-ta-client-cert\") pod \"5edcd213-a230-49ef-b8a9-6afec668f83f\" (UID: \"5edcd213-a230-49ef-b8a9-6afec668f83f\") "
Oct 30 20:56:56.964529 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:56:56.964424    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/5edcd213-a230-49ef-b8a9-6afec668f83f-monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/5edcd213-a230-49ef-b8a9-6afec668f83f-monitoring-tls-certs\") pod \"5edcd213-a230-49ef-b8a9-6afec668f83f\" (UID: \"5edcd213-a230-49ef-b8a9-6afec668f83f\") "
Oct 30 20:56:56.964656 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:56:56.964537    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/5edcd213-a230-49ef-b8a9-6afec668f83f-otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/5edcd213-a230-49ef-b8a9-6afec668f83f-otlp-tls-certs\") pod \"5edcd213-a230-49ef-b8a9-6afec668f83f\" (UID: \"5edcd213-a230-49ef-b8a9-6afec668f83f\") "
Oct 30 20:56:56.964656 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:56:56.964576    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/5edcd213-a230-49ef-b8a9-6afec668f83f-tls-certs\" (UniqueName: \"kubernetes.io/secret/5edcd213-a230-49ef-b8a9-6afec668f83f-tls-certs\") pod \"5edcd213-a230-49ef-b8a9-6afec668f83f\" (UID: \"5edcd213-a230-49ef-b8a9-6afec668f83f\") "
Oct 30 20:56:56.964656 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:56:56.964610    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5edcd213-a230-49ef-b8a9-6afec668f83f-kube-api-access-mf59x\" (UniqueName: \"kubernetes.io/projected/5edcd213-a230-49ef-b8a9-6afec668f83f-kube-api-access-mf59x\") pod \"5edcd213-a230-49ef-b8a9-6afec668f83f\" (UID: \"5edcd213-a230-49ef-b8a9-6afec668f83f\") "
Oct 30 20:56:56.964833 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:56:56.964805    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5edcd213-a230-49ef-b8a9-6afec668f83f-otc-internal" pod "5edcd213-a230-49ef-b8a9-6afec668f83f" (UID: "5edcd213-a230-49ef-b8a9-6afec668f83f"). InnerVolumeSpecName "otc-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:56:56.964941 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:56:56.964914    4060 reconciler_common.go:299] "Volume detached for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/5edcd213-a230-49ef-b8a9-6afec668f83f-otc-internal\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:56:56.966918 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:56:56.966881    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5edcd213-a230-49ef-b8a9-6afec668f83f-monitoring-tls-certs" pod "5edcd213-a230-49ef-b8a9-6afec668f83f" (UID: "5edcd213-a230-49ef-b8a9-6afec668f83f"). InnerVolumeSpecName "monitoring-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:56:56.967113 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:56:56.967084    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5edcd213-a230-49ef-b8a9-6afec668f83f-tls-certs" pod "5edcd213-a230-49ef-b8a9-6afec668f83f" (UID: "5edcd213-a230-49ef-b8a9-6afec668f83f"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:56:56.967194 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:56:56.967117    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5edcd213-a230-49ef-b8a9-6afec668f83f-otlp-tls-certs" pod "5edcd213-a230-49ef-b8a9-6afec668f83f" (UID: "5edcd213-a230-49ef-b8a9-6afec668f83f"). InnerVolumeSpecName "otlp-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:56:56.967194 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:56:56.967154    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5edcd213-a230-49ef-b8a9-6afec668f83f-kube-api-access-mf59x" pod "5edcd213-a230-49ef-b8a9-6afec668f83f" (UID: "5edcd213-a230-49ef-b8a9-6afec668f83f"). InnerVolumeSpecName "kube-api-access-mf59x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:56:56.967582 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:56:56.967563    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5edcd213-a230-49ef-b8a9-6afec668f83f-data-science-collector-ta-client-cert" pod "5edcd213-a230-49ef-b8a9-6afec668f83f" (UID: "5edcd213-a230-49ef-b8a9-6afec668f83f"). InnerVolumeSpecName "data-science-collector-ta-client-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:56:56.972946 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:56:56.972926    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-p798g"
Oct 30 20:56:57.065754 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:56:57.065724    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7b04b7f4-5662-44de-8831-e9faffcc8da5-kube-api-access-sp7x2\" (UniqueName: \"kubernetes.io/projected/7b04b7f4-5662-44de-8831-e9faffcc8da5-kube-api-access-sp7x2\") pod \"7b04b7f4-5662-44de-8831-e9faffcc8da5\" (UID: \"7b04b7f4-5662-44de-8831-e9faffcc8da5\") "
Oct 30 20:56:57.065946 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:56:57.065780    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/7b04b7f4-5662-44de-8831-e9faffcc8da5-config\" (UniqueName: \"kubernetes.io/configmap/7b04b7f4-5662-44de-8831-e9faffcc8da5-config\") pod \"7b04b7f4-5662-44de-8831-e9faffcc8da5\" (UID: \"7b04b7f4-5662-44de-8831-e9faffcc8da5\") "
Oct 30 20:56:57.065946 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:56:57.065845    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/7b04b7f4-5662-44de-8831-e9faffcc8da5-tls\" (UniqueName: \"kubernetes.io/secret/7b04b7f4-5662-44de-8831-e9faffcc8da5-tls\") pod \"7b04b7f4-5662-44de-8831-e9faffcc8da5\" (UID: \"7b04b7f4-5662-44de-8831-e9faffcc8da5\") "
Oct 30 20:56:57.066123 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:56:57.066103    4060 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/5edcd213-a230-49ef-b8a9-6afec668f83f-data-science-collector-ta-client-cert\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:56:57.066192 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:56:57.066131    4060 reconciler_common.go:299] "Volume detached for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/5edcd213-a230-49ef-b8a9-6afec668f83f-monitoring-tls-certs\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:56:57.066192 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:56:57.066146    4060 reconciler_common.go:299] "Volume detached for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/5edcd213-a230-49ef-b8a9-6afec668f83f-otlp-tls-certs\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:56:57.066192 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:56:57.066158    4060 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5edcd213-a230-49ef-b8a9-6afec668f83f-tls-certs\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:56:57.066192 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:56:57.066171    4060 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mf59x\" (UniqueName: \"kubernetes.io/projected/5edcd213-a230-49ef-b8a9-6afec668f83f-kube-api-access-mf59x\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:56:57.066353 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:56:57.066249    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7b04b7f4-5662-44de-8831-e9faffcc8da5-config" pod "7b04b7f4-5662-44de-8831-e9faffcc8da5" (UID: "7b04b7f4-5662-44de-8831-e9faffcc8da5"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:56:57.067908 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:56:57.067882    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7b04b7f4-5662-44de-8831-e9faffcc8da5-kube-api-access-sp7x2" pod "7b04b7f4-5662-44de-8831-e9faffcc8da5" (UID: "7b04b7f4-5662-44de-8831-e9faffcc8da5"). InnerVolumeSpecName "kube-api-access-sp7x2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:56:57.067908 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:56:57.067888    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7b04b7f4-5662-44de-8831-e9faffcc8da5-tls" pod "7b04b7f4-5662-44de-8831-e9faffcc8da5" (UID: "7b04b7f4-5662-44de-8831-e9faffcc8da5"). InnerVolumeSpecName "tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:56:57.166642 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:56:57.166558    4060 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sp7x2\" (UniqueName: \"kubernetes.io/projected/7b04b7f4-5662-44de-8831-e9faffcc8da5-kube-api-access-sp7x2\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:56:57.166642 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:56:57.166583    4060 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7b04b7f4-5662-44de-8831-e9faffcc8da5-config\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:56:57.166642 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:56:57.166594    4060 reconciler_common.go:299] "Volume detached for volume \"tls\" (UniqueName: \"kubernetes.io/secret/7b04b7f4-5662-44de-8831-e9faffcc8da5-tls\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:56:57.621890 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:56:57.621859    4060 generic.go:356] "Generic (PLEG): container finished" podID="7b04b7f4-5662-44de-8831-e9faffcc8da5" containerID="e8adb8e66ef8fb8f0aed2066521ebc4835dfda936e274cf2c800abf4587b3c47" exitCode=0
Oct 30 20:56:57.622352 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:56:57.621918    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-p798g"
Oct 30 20:56:57.622352 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:56:57.621950    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-p798g" event={"ID":"7b04b7f4-5662-44de-8831-e9faffcc8da5","Type":"ContainerDied","Data":"e8adb8e66ef8fb8f0aed2066521ebc4835dfda936e274cf2c800abf4587b3c47"}
Oct 30 20:56:57.622352 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:56:57.622013    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-p798g" event={"ID":"7b04b7f4-5662-44de-8831-e9faffcc8da5","Type":"ContainerDied","Data":"731d759654c9c50ef4c5c84ff00e9fd1114b5472fedb76720907301a0b416d0b"}
Oct 30 20:56:57.622352 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:56:57.622046    4060 scope.go:122] "RemoveContainer" containerID="e8adb8e66ef8fb8f0aed2066521ebc4835dfda936e274cf2c800abf4587b3c47"
Oct 30 20:56:57.623515 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:56:57.623476    4060 generic.go:356] "Generic (PLEG): container finished" podID="5edcd213-a230-49ef-b8a9-6afec668f83f" containerID="2e7e0e4d3351bbbdc28935392abe7ae14f0dc273282e9e04af51e2b7a2b3a76f" exitCode=0
Oct 30 20:56:57.623629 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:56:57.623528    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"5edcd213-a230-49ef-b8a9-6afec668f83f","Type":"ContainerDied","Data":"2e7e0e4d3351bbbdc28935392abe7ae14f0dc273282e9e04af51e2b7a2b3a76f"}
Oct 30 20:56:57.623629 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:56:57.623545    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:56:57.623629 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:56:57.623577    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"5edcd213-a230-49ef-b8a9-6afec668f83f","Type":"ContainerDied","Data":"90129be76310d28451d621d62b29bb92d5f50cbc0b838890ce8b79c53f573a56"}
Oct 30 20:56:57.640515 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:56:57.640477    4060 scope.go:122] "RemoveContainer" containerID="e8adb8e66ef8fb8f0aed2066521ebc4835dfda936e274cf2c800abf4587b3c47"
Oct 30 20:56:57.640886 ip-10-0-142-4 kubenswrapper[4060]: E1030 20:56:57.640867    4060 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e8adb8e66ef8fb8f0aed2066521ebc4835dfda936e274cf2c800abf4587b3c47\": container with ID starting with e8adb8e66ef8fb8f0aed2066521ebc4835dfda936e274cf2c800abf4587b3c47 not found: ID does not exist" containerID="e8adb8e66ef8fb8f0aed2066521ebc4835dfda936e274cf2c800abf4587b3c47"
Oct 30 20:56:57.640947 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:56:57.640896    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e8adb8e66ef8fb8f0aed2066521ebc4835dfda936e274cf2c800abf4587b3c47"} err="failed to get container status \"e8adb8e66ef8fb8f0aed2066521ebc4835dfda936e274cf2c800abf4587b3c47\": rpc error: code = NotFound desc = could not find container \"e8adb8e66ef8fb8f0aed2066521ebc4835dfda936e274cf2c800abf4587b3c47\": container with ID starting with e8adb8e66ef8fb8f0aed2066521ebc4835dfda936e274cf2c800abf4587b3c47 not found: ID does not exist"
Oct 30 20:56:57.640947 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:56:57.640912    4060 scope.go:122] "RemoveContainer" containerID="2e7e0e4d3351bbbdc28935392abe7ae14f0dc273282e9e04af51e2b7a2b3a76f"
Oct 30 20:56:57.648648 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:56:57.648622    4060 scope.go:122] "RemoveContainer" containerID="2e7e0e4d3351bbbdc28935392abe7ae14f0dc273282e9e04af51e2b7a2b3a76f"
Oct 30 20:56:57.648912 ip-10-0-142-4 kubenswrapper[4060]: E1030 20:56:57.648894    4060 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2e7e0e4d3351bbbdc28935392abe7ae14f0dc273282e9e04af51e2b7a2b3a76f\": container with ID starting with 2e7e0e4d3351bbbdc28935392abe7ae14f0dc273282e9e04af51e2b7a2b3a76f not found: ID does not exist" containerID="2e7e0e4d3351bbbdc28935392abe7ae14f0dc273282e9e04af51e2b7a2b3a76f"
Oct 30 20:56:57.648975 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:56:57.648921    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2e7e0e4d3351bbbdc28935392abe7ae14f0dc273282e9e04af51e2b7a2b3a76f"} err="failed to get container status \"2e7e0e4d3351bbbdc28935392abe7ae14f0dc273282e9e04af51e2b7a2b3a76f\": rpc error: code = NotFound desc = could not find container \"2e7e0e4d3351bbbdc28935392abe7ae14f0dc273282e9e04af51e2b7a2b3a76f\": container with ID starting with 2e7e0e4d3351bbbdc28935392abe7ae14f0dc273282e9e04af51e2b7a2b3a76f not found: ID does not exist"
Oct 30 20:56:57.787439 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:56:57.787407    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/korrel8r-5cbcc89b8f-p798g"]
Oct 30 20:56:57.836717 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:56:57.836688    4060 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/korrel8r-5cbcc89b8f-p798g"]
Oct 30 20:56:57.914579 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:56:57.914551    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 20:56:57.918793 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:56:57.918769    4060 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 20:56:57.997218 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:56:57.997180    4060 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 20:56:57.997590 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:56:57.997573    4060 cpu_manager.go:414] "containerMap: removing container" podUID="7b04b7f4-5662-44de-8831-e9faffcc8da5" containerName="korrel8r"
Oct 30 20:56:57.997683 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:56:57.997591    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7b04b7f4-5662-44de-8831-e9faffcc8da5" containerName="korrel8r"
Oct 30 20:56:57.997683 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:56:57.997605    4060 cpu_manager.go:414] "containerMap: removing container" podUID="5edcd213-a230-49ef-b8a9-6afec668f83f" containerName="otc-container"
Oct 30 20:56:57.997683 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:56:57.997612    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5edcd213-a230-49ef-b8a9-6afec668f83f" containerName="otc-container"
Oct 30 20:56:57.997837 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:56:57.997697    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="7b04b7f4-5662-44de-8831-e9faffcc8da5" containerName="korrel8r"
Oct 30 20:56:57.997837 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:56:57.997712    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="5edcd213-a230-49ef-b8a9-6afec668f83f" containerName="otc-container"
Oct 30 20:56:58.002045 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:56:58.002018    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:56:58.055016 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:56:58.054951    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-monitoring-tls\""
Oct 30 20:56:58.055016 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:56:58.054961    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-dockercfg-jqj7h\""
Oct 30 20:56:58.055217 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:56:58.055054    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-headless-tls\""
Oct 30 20:56:58.055217 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:56:58.055060    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-ta-client-cert\""
Oct 30 20:56:58.055217 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:56:58.055124    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-6d9d4583\""
Oct 30 20:56:58.055217 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:56:58.055178    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-tls\""
Oct 30 20:56:58.062373 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:56:58.062348    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 20:56:58.175849 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:56:58.175818    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4fac5b88-40bf-4b94-857a-e41201b35a8d-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"4fac5b88-40bf-4b94-857a-e41201b35a8d\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:56:58.176001 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:56:58.175869    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/4fac5b88-40bf-4b94-857a-e41201b35a8d-otc-internal\") pod \"data-science-collector-collector-0\" (UID: \"4fac5b88-40bf-4b94-857a-e41201b35a8d\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:56:58.176001 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:56:58.175957    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4wb6p\" (UniqueName: \"kubernetes.io/projected/4fac5b88-40bf-4b94-857a-e41201b35a8d-kube-api-access-4wb6p\") pod \"data-science-collector-collector-0\" (UID: \"4fac5b88-40bf-4b94-857a-e41201b35a8d\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:56:58.176092 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:56:58.176015    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/4fac5b88-40bf-4b94-857a-e41201b35a8d-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-0\" (UID: \"4fac5b88-40bf-4b94-857a-e41201b35a8d\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:56:58.176124 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:56:58.176085    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/4fac5b88-40bf-4b94-857a-e41201b35a8d-monitoring-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"4fac5b88-40bf-4b94-857a-e41201b35a8d\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:56:58.176124 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:56:58.176112    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/4fac5b88-40bf-4b94-857a-e41201b35a8d-otlp-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"4fac5b88-40bf-4b94-857a-e41201b35a8d\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:56:58.277223 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:56:58.277194    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/4fac5b88-40bf-4b94-857a-e41201b35a8d-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-0\" (UID: \"4fac5b88-40bf-4b94-857a-e41201b35a8d\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:56:58.277223 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:56:58.277225    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/4fac5b88-40bf-4b94-857a-e41201b35a8d-monitoring-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"4fac5b88-40bf-4b94-857a-e41201b35a8d\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:56:58.277471 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:56:58.277244    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/4fac5b88-40bf-4b94-857a-e41201b35a8d-otlp-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"4fac5b88-40bf-4b94-857a-e41201b35a8d\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:56:58.277471 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:56:58.277266    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4fac5b88-40bf-4b94-857a-e41201b35a8d-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"4fac5b88-40bf-4b94-857a-e41201b35a8d\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:56:58.277471 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:56:58.277295    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/4fac5b88-40bf-4b94-857a-e41201b35a8d-otc-internal\") pod \"data-science-collector-collector-0\" (UID: \"4fac5b88-40bf-4b94-857a-e41201b35a8d\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:56:58.277471 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:56:58.277319    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4wb6p\" (UniqueName: \"kubernetes.io/projected/4fac5b88-40bf-4b94-857a-e41201b35a8d-kube-api-access-4wb6p\") pod \"data-science-collector-collector-0\" (UID: \"4fac5b88-40bf-4b94-857a-e41201b35a8d\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:56:58.278195 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:56:58.278165    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/4fac5b88-40bf-4b94-857a-e41201b35a8d-otc-internal\") pod \"data-science-collector-collector-0\" (UID: \"4fac5b88-40bf-4b94-857a-e41201b35a8d\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:56:58.279844 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:56:58.279822    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/4fac5b88-40bf-4b94-857a-e41201b35a8d-monitoring-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"4fac5b88-40bf-4b94-857a-e41201b35a8d\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:56:58.279947 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:56:58.279881    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4fac5b88-40bf-4b94-857a-e41201b35a8d-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"4fac5b88-40bf-4b94-857a-e41201b35a8d\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:56:58.280055 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:56:58.280023    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/4fac5b88-40bf-4b94-857a-e41201b35a8d-otlp-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"4fac5b88-40bf-4b94-857a-e41201b35a8d\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:56:58.280094 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:56:58.280083    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/4fac5b88-40bf-4b94-857a-e41201b35a8d-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-0\" (UID: \"4fac5b88-40bf-4b94-857a-e41201b35a8d\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:56:58.338836 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:56:58.338765    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4wb6p\" (UniqueName: \"kubernetes.io/projected/4fac5b88-40bf-4b94-857a-e41201b35a8d-kube-api-access-4wb6p\") pod \"data-science-collector-collector-0\" (UID: \"4fac5b88-40bf-4b94-857a-e41201b35a8d\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:56:58.613937 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:56:58.613848    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:56:58.988024 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:56:58.987997    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 20:56:58.989975 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:56:58.989943    4060 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4fac5b88_40bf_4b94_857a_e41201b35a8d.slice/crio-146af227f17dd816a4c1afa0bcdf04e3c593b6bf500b72c6a84fac1d531a03f6 WatchSource:0}: Error finding container 146af227f17dd816a4c1afa0bcdf04e3c593b6bf500b72c6a84fac1d531a03f6: Status 404 returned error can't find the container with id 146af227f17dd816a4c1afa0bcdf04e3c593b6bf500b72c6a84fac1d531a03f6
Oct 30 20:56:58.992366 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:56:58.992332    4060 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 20:56:58.992433 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:56:58.992397    4060 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 20:56:59.427007 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:56:59.426935    4060 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="5edcd213-a230-49ef-b8a9-6afec668f83f" path="/var/lib/kubelet/pods/5edcd213-a230-49ef-b8a9-6afec668f83f/volumes"
Oct 30 20:56:59.427314 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:56:59.427302    4060 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="7b04b7f4-5662-44de-8831-e9faffcc8da5" path="/var/lib/kubelet/pods/7b04b7f4-5662-44de-8831-e9faffcc8da5/volumes"
Oct 30 20:56:59.637189 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:56:59.637150    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"4fac5b88-40bf-4b94-857a-e41201b35a8d","Type":"ContainerStarted","Data":"2b8eb15ec00dc43bd1fbb7dd4e6d9c99ee9200480655059aa0b6477bb9dc817e"}
Oct 30 20:56:59.637377 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:56:59.637206    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"4fac5b88-40bf-4b94-857a-e41201b35a8d","Type":"ContainerStarted","Data":"146af227f17dd816a4c1afa0bcdf04e3c593b6bf500b72c6a84fac1d531a03f6"}
Oct 30 20:56:59.804308 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:56:59.804247    4060 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-collector-0" podStartSLOduration=2.804226839 podStartE2EDuration="2.804226839s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:56:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:56:59.754509392 +0000 UTC m=+1238.511507683" watchObservedRunningTime="2026-10-30 20:56:59.804226839 +0000 UTC m=+1238.561225138"
Oct 30 20:57:12.150459 ip-10-0-142-4 kubenswrapper[4060]: E1030 20:57:12.150417    4060 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v2f4x" containerName="extractor"
Oct 30 20:57:18.005983 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:57:18.005946    4060 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/korrel8r-5cbcc89b8f-bc56n"]
Oct 30 20:57:18.009300 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:57:18.009283    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-bc56n"
Oct 30 20:57:18.041288 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:57:18.041256    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4db9a8e3-31dc-4d8b-8abe-129aee0bc3ab-config\") pod \"korrel8r-5cbcc89b8f-bc56n\" (UID: \"4db9a8e3-31dc-4d8b-8abe-129aee0bc3ab\") " pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-bc56n"
Oct 30 20:57:18.041440 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:57:18.041310    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/4db9a8e3-31dc-4d8b-8abe-129aee0bc3ab-tls\") pod \"korrel8r-5cbcc89b8f-bc56n\" (UID: \"4db9a8e3-31dc-4d8b-8abe-129aee0bc3ab\") " pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-bc56n"
Oct 30 20:57:18.041440 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:57:18.041333    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pspw8\" (UniqueName: \"kubernetes.io/projected/4db9a8e3-31dc-4d8b-8abe-129aee0bc3ab-kube-api-access-pspw8\") pod \"korrel8r-5cbcc89b8f-bc56n\" (UID: \"4db9a8e3-31dc-4d8b-8abe-129aee0bc3ab\") " pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-bc56n"
Oct 30 20:57:18.068214 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:57:18.068172    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/korrel8r-5cbcc89b8f-bc56n"]
Oct 30 20:57:18.142095 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:57:18.142061    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/4db9a8e3-31dc-4d8b-8abe-129aee0bc3ab-tls\") pod \"korrel8r-5cbcc89b8f-bc56n\" (UID: \"4db9a8e3-31dc-4d8b-8abe-129aee0bc3ab\") " pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-bc56n"
Oct 30 20:57:18.142095 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:57:18.142098    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pspw8\" (UniqueName: \"kubernetes.io/projected/4db9a8e3-31dc-4d8b-8abe-129aee0bc3ab-kube-api-access-pspw8\") pod \"korrel8r-5cbcc89b8f-bc56n\" (UID: \"4db9a8e3-31dc-4d8b-8abe-129aee0bc3ab\") " pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-bc56n"
Oct 30 20:57:18.142303 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:57:18.142139    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4db9a8e3-31dc-4d8b-8abe-129aee0bc3ab-config\") pod \"korrel8r-5cbcc89b8f-bc56n\" (UID: \"4db9a8e3-31dc-4d8b-8abe-129aee0bc3ab\") " pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-bc56n"
Oct 30 20:57:18.142876 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:57:18.142857    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4db9a8e3-31dc-4d8b-8abe-129aee0bc3ab-config\") pod \"korrel8r-5cbcc89b8f-bc56n\" (UID: \"4db9a8e3-31dc-4d8b-8abe-129aee0bc3ab\") " pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-bc56n"
Oct 30 20:57:18.144437 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:57:18.144416    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls\" (UniqueName: \"kubernetes.io/secret/4db9a8e3-31dc-4d8b-8abe-129aee0bc3ab-tls\") pod \"korrel8r-5cbcc89b8f-bc56n\" (UID: \"4db9a8e3-31dc-4d8b-8abe-129aee0bc3ab\") " pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-bc56n"
Oct 30 20:57:18.203446 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:57:18.203414    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pspw8\" (UniqueName: \"kubernetes.io/projected/4db9a8e3-31dc-4d8b-8abe-129aee0bc3ab-kube-api-access-pspw8\") pod \"korrel8r-5cbcc89b8f-bc56n\" (UID: \"4db9a8e3-31dc-4d8b-8abe-129aee0bc3ab\") " pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-bc56n"
Oct 30 20:57:18.321233 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:57:18.321152    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-bc56n"
Oct 30 20:57:18.691334 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:57:18.691116    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/korrel8r-5cbcc89b8f-bc56n"]
Oct 30 20:57:18.694072 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:57:18.694046    4060 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4db9a8e3_31dc_4d8b_8abe_129aee0bc3ab.slice/crio-0ce5ab9f394af105f8319d7ba58e505f664441483efb33f6ae87ef91a281ce69 WatchSource:0}: Error finding container 0ce5ab9f394af105f8319d7ba58e505f664441483efb33f6ae87ef91a281ce69: Status 404 returned error can't find the container with id 0ce5ab9f394af105f8319d7ba58e505f664441483efb33f6ae87ef91a281ce69
Oct 30 20:57:18.728460 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:57:18.728424    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-bc56n" event={"ID":"4db9a8e3-31dc-4d8b-8abe-129aee0bc3ab","Type":"ContainerStarted","Data":"0ce5ab9f394af105f8319d7ba58e505f664441483efb33f6ae87ef91a281ce69"}
Oct 30 20:57:19.734514 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:57:19.734463    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-bc56n" event={"ID":"4db9a8e3-31dc-4d8b-8abe-129aee0bc3ab","Type":"ContainerStarted","Data":"7a9ac3fcf6b06d2fd7381f727d6aea47690582f362a68718bf80b1478333c123"}
Oct 30 20:57:19.734920 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:57:19.734669    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-bc56n"
Oct 30 20:57:19.849413 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:57:19.849357    4060 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-bc56n" podStartSLOduration=2.849340942 podStartE2EDuration="2.849340942s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:57:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:57:19.848992719 +0000 UTC m=+1258.605991029" watchObservedRunningTime="2026-10-30 20:57:19.849340942 +0000 UTC m=+1258.606339241"
Oct 30 20:57:27.671027 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:57:27.670986    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 20:57:27.671774 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:57:27.671284    4060 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-collector-0" podUID="4fac5b88-40bf-4b94-857a-e41201b35a8d" containerName="otc-container" containerID="cri-o://2b8eb15ec00dc43bd1fbb7dd4e6d9c99ee9200480655059aa0b6477bb9dc817e" gracePeriod=30
Oct 30 20:57:30.023504 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:57:30.023468    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:57:30.150344 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:57:30.150267    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/4fac5b88-40bf-4b94-857a-e41201b35a8d-otc-internal\" (UniqueName: \"kubernetes.io/configmap/4fac5b88-40bf-4b94-857a-e41201b35a8d-otc-internal\") pod \"4fac5b88-40bf-4b94-857a-e41201b35a8d\" (UID: \"4fac5b88-40bf-4b94-857a-e41201b35a8d\") "
Oct 30 20:57:30.150344 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:57:30.150307    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/4fac5b88-40bf-4b94-857a-e41201b35a8d-tls-certs\" (UniqueName: \"kubernetes.io/secret/4fac5b88-40bf-4b94-857a-e41201b35a8d-tls-certs\") pod \"4fac5b88-40bf-4b94-857a-e41201b35a8d\" (UID: \"4fac5b88-40bf-4b94-857a-e41201b35a8d\") "
Oct 30 20:57:30.150571 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:57:30.150352    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/4fac5b88-40bf-4b94-857a-e41201b35a8d-monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/4fac5b88-40bf-4b94-857a-e41201b35a8d-monitoring-tls-certs\") pod \"4fac5b88-40bf-4b94-857a-e41201b35a8d\" (UID: \"4fac5b88-40bf-4b94-857a-e41201b35a8d\") "
Oct 30 20:57:30.150571 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:57:30.150426    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/4fac5b88-40bf-4b94-857a-e41201b35a8d-otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/4fac5b88-40bf-4b94-857a-e41201b35a8d-otlp-tls-certs\") pod \"4fac5b88-40bf-4b94-857a-e41201b35a8d\" (UID: \"4fac5b88-40bf-4b94-857a-e41201b35a8d\") "
Oct 30 20:57:30.150571 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:57:30.150539    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/4fac5b88-40bf-4b94-857a-e41201b35a8d-data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/4fac5b88-40bf-4b94-857a-e41201b35a8d-data-science-collector-ta-client-cert\") pod \"4fac5b88-40bf-4b94-857a-e41201b35a8d\" (UID: \"4fac5b88-40bf-4b94-857a-e41201b35a8d\") "
Oct 30 20:57:30.150678 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:57:30.150624    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4fac5b88-40bf-4b94-857a-e41201b35a8d-kube-api-access-4wb6p\" (UniqueName: \"kubernetes.io/projected/4fac5b88-40bf-4b94-857a-e41201b35a8d-kube-api-access-4wb6p\") pod \"4fac5b88-40bf-4b94-857a-e41201b35a8d\" (UID: \"4fac5b88-40bf-4b94-857a-e41201b35a8d\") "
Oct 30 20:57:30.150768 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:57:30.150748    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4fac5b88-40bf-4b94-857a-e41201b35a8d-otc-internal" pod "4fac5b88-40bf-4b94-857a-e41201b35a8d" (UID: "4fac5b88-40bf-4b94-857a-e41201b35a8d"). InnerVolumeSpecName "otc-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:57:30.150969 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:57:30.150938    4060 reconciler_common.go:299] "Volume detached for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/4fac5b88-40bf-4b94-857a-e41201b35a8d-otc-internal\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:57:30.153069 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:57:30.153033    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4fac5b88-40bf-4b94-857a-e41201b35a8d-kube-api-access-4wb6p" pod "4fac5b88-40bf-4b94-857a-e41201b35a8d" (UID: "4fac5b88-40bf-4b94-857a-e41201b35a8d"). InnerVolumeSpecName "kube-api-access-4wb6p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:57:30.153171 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:57:30.153121    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4fac5b88-40bf-4b94-857a-e41201b35a8d-data-science-collector-ta-client-cert" pod "4fac5b88-40bf-4b94-857a-e41201b35a8d" (UID: "4fac5b88-40bf-4b94-857a-e41201b35a8d"). InnerVolumeSpecName "data-science-collector-ta-client-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:57:30.153830 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:57:30.153806    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4fac5b88-40bf-4b94-857a-e41201b35a8d-tls-certs" pod "4fac5b88-40bf-4b94-857a-e41201b35a8d" (UID: "4fac5b88-40bf-4b94-857a-e41201b35a8d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:57:30.153972 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:57:30.153940    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4fac5b88-40bf-4b94-857a-e41201b35a8d-otlp-tls-certs" pod "4fac5b88-40bf-4b94-857a-e41201b35a8d" (UID: "4fac5b88-40bf-4b94-857a-e41201b35a8d"). InnerVolumeSpecName "otlp-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:57:30.153972 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:57:30.153957    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4fac5b88-40bf-4b94-857a-e41201b35a8d-monitoring-tls-certs" pod "4fac5b88-40bf-4b94-857a-e41201b35a8d" (UID: "4fac5b88-40bf-4b94-857a-e41201b35a8d"). InnerVolumeSpecName "monitoring-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:57:30.251713 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:57:30.251664    4060 reconciler_common.go:299] "Volume detached for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/4fac5b88-40bf-4b94-857a-e41201b35a8d-otlp-tls-certs\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:57:30.251713 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:57:30.251709    4060 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/4fac5b88-40bf-4b94-857a-e41201b35a8d-data-science-collector-ta-client-cert\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:57:30.251713 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:57:30.251723    4060 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4wb6p\" (UniqueName: \"kubernetes.io/projected/4fac5b88-40bf-4b94-857a-e41201b35a8d-kube-api-access-4wb6p\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:57:30.251958 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:57:30.251737    4060 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4fac5b88-40bf-4b94-857a-e41201b35a8d-tls-certs\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:57:30.251958 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:57:30.251749    4060 reconciler_common.go:299] "Volume detached for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/4fac5b88-40bf-4b94-857a-e41201b35a8d-monitoring-tls-certs\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:57:30.741075 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:57:30.741045    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-bc56n"
Oct 30 20:57:30.787364 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:57:30.787332    4060 generic.go:356] "Generic (PLEG): container finished" podID="4fac5b88-40bf-4b94-857a-e41201b35a8d" containerID="2b8eb15ec00dc43bd1fbb7dd4e6d9c99ee9200480655059aa0b6477bb9dc817e" exitCode=0
Oct 30 20:57:30.787557 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:57:30.787384    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:57:30.787557 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:57:30.787403    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"4fac5b88-40bf-4b94-857a-e41201b35a8d","Type":"ContainerDied","Data":"2b8eb15ec00dc43bd1fbb7dd4e6d9c99ee9200480655059aa0b6477bb9dc817e"}
Oct 30 20:57:30.787557 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:57:30.787444    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"4fac5b88-40bf-4b94-857a-e41201b35a8d","Type":"ContainerDied","Data":"146af227f17dd816a4c1afa0bcdf04e3c593b6bf500b72c6a84fac1d531a03f6"}
Oct 30 20:57:30.787557 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:57:30.787465    4060 scope.go:122] "RemoveContainer" containerID="2b8eb15ec00dc43bd1fbb7dd4e6d9c99ee9200480655059aa0b6477bb9dc817e"
Oct 30 20:57:30.796638 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:57:30.796589    4060 scope.go:122] "RemoveContainer" containerID="2b8eb15ec00dc43bd1fbb7dd4e6d9c99ee9200480655059aa0b6477bb9dc817e"
Oct 30 20:57:30.796875 ip-10-0-142-4 kubenswrapper[4060]: E1030 20:57:30.796850    4060 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2b8eb15ec00dc43bd1fbb7dd4e6d9c99ee9200480655059aa0b6477bb9dc817e\": container with ID starting with 2b8eb15ec00dc43bd1fbb7dd4e6d9c99ee9200480655059aa0b6477bb9dc817e not found: ID does not exist" containerID="2b8eb15ec00dc43bd1fbb7dd4e6d9c99ee9200480655059aa0b6477bb9dc817e"
Oct 30 20:57:30.796927 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:57:30.796886    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2b8eb15ec00dc43bd1fbb7dd4e6d9c99ee9200480655059aa0b6477bb9dc817e"} err="failed to get container status \"2b8eb15ec00dc43bd1fbb7dd4e6d9c99ee9200480655059aa0b6477bb9dc817e\": rpc error: code = NotFound desc = could not find container \"2b8eb15ec00dc43bd1fbb7dd4e6d9c99ee9200480655059aa0b6477bb9dc817e\": container with ID starting with 2b8eb15ec00dc43bd1fbb7dd4e6d9c99ee9200480655059aa0b6477bb9dc817e not found: ID does not exist"
Oct 30 20:57:30.908220 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:57:30.908179    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/korrel8r-66d6f7f696-hjk49"]
Oct 30 20:57:30.908460 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:57:30.908421    4060 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/korrel8r-66d6f7f696-hjk49" podUID="656dee2b-a438-429f-859e-e8f57d8ecfa0" containerName="korrel8r" containerID="cri-o://2674f8907642f8c8ea0112ff6af026de952f665d352271e8bed36b2954e3a460" gracePeriod=30
Oct 30 20:57:30.968321 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:57:30.968290    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 20:57:30.972806 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:57:30.972778    4060 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 20:57:31.049102 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:57:31.049071    4060 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 20:57:31.049485 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:57:31.049397    4060 cpu_manager.go:414] "containerMap: removing container" podUID="4fac5b88-40bf-4b94-857a-e41201b35a8d" containerName="otc-container"
Oct 30 20:57:31.049485 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:57:31.049407    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4fac5b88-40bf-4b94-857a-e41201b35a8d" containerName="otc-container"
Oct 30 20:57:31.049485 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:57:31.049472    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="4fac5b88-40bf-4b94-857a-e41201b35a8d" containerName="otc-container"
Oct 30 20:57:31.052358 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:57:31.052343    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:57:31.105430 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:57:31.105395    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-dockercfg-jqj7h\""
Oct 30 20:57:31.105653 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:57:31.105471    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-monitoring-tls\""
Oct 30 20:57:31.105653 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:57:31.105482    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-ta-client-cert\""
Oct 30 20:57:31.105653 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:57:31.105532    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-a0f9182a\""
Oct 30 20:57:31.105653 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:57:31.105607    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-headless-tls\""
Oct 30 20:57:31.105889 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:57:31.105687    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-tls\""
Oct 30 20:57:31.114340 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:57:31.114315    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 20:57:31.152770 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:57:31.152747    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/korrel8r-66d6f7f696-hjk49"
Oct 30 20:57:31.157790 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:57:31.157771    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/9fee43b7-7f15-4492-97a3-86f69e3fb744-otlp-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"9fee43b7-7f15-4492-97a3-86f69e3fb744\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:57:31.157846 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:57:31.157804    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wpsvz\" (UniqueName: \"kubernetes.io/projected/9fee43b7-7f15-4492-97a3-86f69e3fb744-kube-api-access-wpsvz\") pod \"data-science-collector-collector-0\" (UID: \"9fee43b7-7f15-4492-97a3-86f69e3fb744\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:57:31.157899 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:57:31.157882    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/9fee43b7-7f15-4492-97a3-86f69e3fb744-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-0\" (UID: \"9fee43b7-7f15-4492-97a3-86f69e3fb744\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:57:31.157945 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:57:31.157933    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/9fee43b7-7f15-4492-97a3-86f69e3fb744-monitoring-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"9fee43b7-7f15-4492-97a3-86f69e3fb744\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:57:31.157979 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:57:31.157959    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/9fee43b7-7f15-4492-97a3-86f69e3fb744-otc-internal\") pod \"data-science-collector-collector-0\" (UID: \"9fee43b7-7f15-4492-97a3-86f69e3fb744\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:57:31.158012 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:57:31.157982    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9fee43b7-7f15-4492-97a3-86f69e3fb744-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"9fee43b7-7f15-4492-97a3-86f69e3fb744\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:57:31.259322 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:57:31.259292    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/656dee2b-a438-429f-859e-e8f57d8ecfa0-config\" (UniqueName: \"kubernetes.io/configmap/656dee2b-a438-429f-859e-e8f57d8ecfa0-config\") pod \"656dee2b-a438-429f-859e-e8f57d8ecfa0\" (UID: \"656dee2b-a438-429f-859e-e8f57d8ecfa0\") "
Oct 30 20:57:31.259547 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:57:31.259346    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/656dee2b-a438-429f-859e-e8f57d8ecfa0-tls\" (UniqueName: \"kubernetes.io/secret/656dee2b-a438-429f-859e-e8f57d8ecfa0-tls\") pod \"656dee2b-a438-429f-859e-e8f57d8ecfa0\" (UID: \"656dee2b-a438-429f-859e-e8f57d8ecfa0\") "
Oct 30 20:57:31.259547 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:57:31.259383    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/656dee2b-a438-429f-859e-e8f57d8ecfa0-kube-api-access-fglg5\" (UniqueName: \"kubernetes.io/projected/656dee2b-a438-429f-859e-e8f57d8ecfa0-kube-api-access-fglg5\") pod \"656dee2b-a438-429f-859e-e8f57d8ecfa0\" (UID: \"656dee2b-a438-429f-859e-e8f57d8ecfa0\") "
Oct 30 20:57:31.259687 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:57:31.259547    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/9fee43b7-7f15-4492-97a3-86f69e3fb744-monitoring-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"9fee43b7-7f15-4492-97a3-86f69e3fb744\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:57:31.259687 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:57:31.259572    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/9fee43b7-7f15-4492-97a3-86f69e3fb744-otc-internal\") pod \"data-science-collector-collector-0\" (UID: \"9fee43b7-7f15-4492-97a3-86f69e3fb744\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:57:31.259687 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:57:31.259596    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9fee43b7-7f15-4492-97a3-86f69e3fb744-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"9fee43b7-7f15-4492-97a3-86f69e3fb744\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:57:31.259687 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:57:31.259643    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/9fee43b7-7f15-4492-97a3-86f69e3fb744-otlp-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"9fee43b7-7f15-4492-97a3-86f69e3fb744\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:57:31.259687 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:57:31.259660    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wpsvz\" (UniqueName: \"kubernetes.io/projected/9fee43b7-7f15-4492-97a3-86f69e3fb744-kube-api-access-wpsvz\") pod \"data-science-collector-collector-0\" (UID: \"9fee43b7-7f15-4492-97a3-86f69e3fb744\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:57:31.259927 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:57:31.259701    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/9fee43b7-7f15-4492-97a3-86f69e3fb744-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-0\" (UID: \"9fee43b7-7f15-4492-97a3-86f69e3fb744\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:57:31.259927 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:57:31.259776    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/656dee2b-a438-429f-859e-e8f57d8ecfa0-config" pod "656dee2b-a438-429f-859e-e8f57d8ecfa0" (UID: "656dee2b-a438-429f-859e-e8f57d8ecfa0"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:57:31.260338 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:57:31.260316    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/9fee43b7-7f15-4492-97a3-86f69e3fb744-otc-internal\") pod \"data-science-collector-collector-0\" (UID: \"9fee43b7-7f15-4492-97a3-86f69e3fb744\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:57:31.261937 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:57:31.261908    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/656dee2b-a438-429f-859e-e8f57d8ecfa0-kube-api-access-fglg5" pod "656dee2b-a438-429f-859e-e8f57d8ecfa0" (UID: "656dee2b-a438-429f-859e-e8f57d8ecfa0"). InnerVolumeSpecName "kube-api-access-fglg5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:57:31.262127 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:57:31.262103    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/656dee2b-a438-429f-859e-e8f57d8ecfa0-tls" pod "656dee2b-a438-429f-859e-e8f57d8ecfa0" (UID: "656dee2b-a438-429f-859e-e8f57d8ecfa0"). InnerVolumeSpecName "tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:57:31.262269 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:57:31.262250    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9fee43b7-7f15-4492-97a3-86f69e3fb744-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"9fee43b7-7f15-4492-97a3-86f69e3fb744\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:57:31.262712 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:57:31.262687    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/9fee43b7-7f15-4492-97a3-86f69e3fb744-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-0\" (UID: \"9fee43b7-7f15-4492-97a3-86f69e3fb744\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:57:31.262815 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:57:31.262693    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/9fee43b7-7f15-4492-97a3-86f69e3fb744-otlp-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"9fee43b7-7f15-4492-97a3-86f69e3fb744\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:57:31.262903 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:57:31.262877    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/9fee43b7-7f15-4492-97a3-86f69e3fb744-monitoring-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"9fee43b7-7f15-4492-97a3-86f69e3fb744\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:57:31.321122 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:57:31.321049    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wpsvz\" (UniqueName: \"kubernetes.io/projected/9fee43b7-7f15-4492-97a3-86f69e3fb744-kube-api-access-wpsvz\") pod \"data-science-collector-collector-0\" (UID: \"9fee43b7-7f15-4492-97a3-86f69e3fb744\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:57:31.360425 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:57:31.360390    4060 reconciler_common.go:299] "Volume detached for volume \"tls\" (UniqueName: \"kubernetes.io/secret/656dee2b-a438-429f-859e-e8f57d8ecfa0-tls\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:57:31.360425 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:57:31.360423    4060 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fglg5\" (UniqueName: \"kubernetes.io/projected/656dee2b-a438-429f-859e-e8f57d8ecfa0-kube-api-access-fglg5\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:57:31.360643 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:57:31.360439    4060 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/656dee2b-a438-429f-859e-e8f57d8ecfa0-config\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:57:31.366344 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:57:31.366320    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:57:31.431020 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:57:31.430974    4060 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="4fac5b88-40bf-4b94-857a-e41201b35a8d" path="/var/lib/kubelet/pods/4fac5b88-40bf-4b94-857a-e41201b35a8d/volumes"
Oct 30 20:57:31.741052 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:57:31.741010    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 20:57:31.743195 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:57:31.743169    4060 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9fee43b7_7f15_4492_97a3_86f69e3fb744.slice/crio-5f63d56a8080c8d922f95eefc5f100a17f3257d3a7bc4059766169a7b04d3398 WatchSource:0}: Error finding container 5f63d56a8080c8d922f95eefc5f100a17f3257d3a7bc4059766169a7b04d3398: Status 404 returned error can't find the container with id 5f63d56a8080c8d922f95eefc5f100a17f3257d3a7bc4059766169a7b04d3398
Oct 30 20:57:31.745307 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:57:31.745275    4060 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 20:57:31.745362 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:57:31.745337    4060 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 20:57:31.792785 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:57:31.792760    4060 generic.go:356] "Generic (PLEG): container finished" podID="656dee2b-a438-429f-859e-e8f57d8ecfa0" containerID="2674f8907642f8c8ea0112ff6af026de952f665d352271e8bed36b2954e3a460" exitCode=0
Oct 30 20:57:31.792931 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:57:31.792807    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/korrel8r-66d6f7f696-hjk49"
Oct 30 20:57:31.792931 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:57:31.792857    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/korrel8r-66d6f7f696-hjk49" event={"ID":"656dee2b-a438-429f-859e-e8f57d8ecfa0","Type":"ContainerDied","Data":"2674f8907642f8c8ea0112ff6af026de952f665d352271e8bed36b2954e3a460"}
Oct 30 20:57:31.792931 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:57:31.792914    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/korrel8r-66d6f7f696-hjk49" event={"ID":"656dee2b-a438-429f-859e-e8f57d8ecfa0","Type":"ContainerDied","Data":"0bf37fdf82c42d937a6ad90b8cb09134d818d4d2514f9f4727947812170cce5a"}
Oct 30 20:57:31.793096 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:57:31.792943    4060 scope.go:122] "RemoveContainer" containerID="2674f8907642f8c8ea0112ff6af026de952f665d352271e8bed36b2954e3a460"
Oct 30 20:57:31.795353 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:57:31.795334    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"9fee43b7-7f15-4492-97a3-86f69e3fb744","Type":"ContainerStarted","Data":"5f63d56a8080c8d922f95eefc5f100a17f3257d3a7bc4059766169a7b04d3398"}
Oct 30 20:57:31.801231 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:57:31.801206    4060 scope.go:122] "RemoveContainer" containerID="2674f8907642f8c8ea0112ff6af026de952f665d352271e8bed36b2954e3a460"
Oct 30 20:57:31.801526 ip-10-0-142-4 kubenswrapper[4060]: E1030 20:57:31.801486    4060 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2674f8907642f8c8ea0112ff6af026de952f665d352271e8bed36b2954e3a460\": container with ID starting with 2674f8907642f8c8ea0112ff6af026de952f665d352271e8bed36b2954e3a460 not found: ID does not exist" containerID="2674f8907642f8c8ea0112ff6af026de952f665d352271e8bed36b2954e3a460"
Oct 30 20:57:31.801609 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:57:31.801537    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2674f8907642f8c8ea0112ff6af026de952f665d352271e8bed36b2954e3a460"} err="failed to get container status \"2674f8907642f8c8ea0112ff6af026de952f665d352271e8bed36b2954e3a460\": rpc error: code = NotFound desc = could not find container \"2674f8907642f8c8ea0112ff6af026de952f665d352271e8bed36b2954e3a460\": container with ID starting with 2674f8907642f8c8ea0112ff6af026de952f665d352271e8bed36b2954e3a460 not found: ID does not exist"
Oct 30 20:57:31.962566 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:57:31.957592    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/korrel8r-66d6f7f696-hjk49"]
Oct 30 20:57:31.966335 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:57:31.966309    4060 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/korrel8r-66d6f7f696-hjk49"]
Oct 30 20:57:32.805155 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:57:32.805103    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"9fee43b7-7f15-4492-97a3-86f69e3fb744","Type":"ContainerStarted","Data":"29dee81989ab520fde5ca452dbc5b2c21c028bd2264a0f21e685366930694b4d"}
Oct 30 20:57:32.973343 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:57:32.973278    4060 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-collector-0" podStartSLOduration=1.9732546370000001 podStartE2EDuration="1.973254637s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:57:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:57:32.922557468 +0000 UTC m=+1271.679555770" watchObservedRunningTime="2026-10-30 20:57:32.973254637 +0000 UTC m=+1271.730252937"
Oct 30 20:57:33.427629 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:57:33.427596    4060 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="656dee2b-a438-429f-859e-e8f57d8ecfa0" path="/var/lib/kubelet/pods/656dee2b-a438-429f-859e-e8f57d8ecfa0/volumes"
Oct 30 20:57:42.150025 ip-10-0-142-4 kubenswrapper[4060]: E1030 20:57:42.149989    4060 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v2f4x" containerName="extractor"
Oct 30 20:57:50.779873 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:57:50.779831    4060 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/korrel8r-66d6f7f696-48lsj"]
Oct 30 20:57:50.780321 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:57:50.780200    4060 cpu_manager.go:414] "containerMap: removing container" podUID="656dee2b-a438-429f-859e-e8f57d8ecfa0" containerName="korrel8r"
Oct 30 20:57:50.780321 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:57:50.780212    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="656dee2b-a438-429f-859e-e8f57d8ecfa0" containerName="korrel8r"
Oct 30 20:57:50.780321 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:57:50.780301    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="656dee2b-a438-429f-859e-e8f57d8ecfa0" containerName="korrel8r"
Oct 30 20:57:50.783523 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:57:50.783505    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/korrel8r-66d6f7f696-48lsj"
Oct 30 20:57:50.846252 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:57:50.846201    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/korrel8r-66d6f7f696-48lsj"]
Oct 30 20:57:50.928791 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:57:50.928759    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e371e621-9e3b-461c-8505-968f6631d1fe-config\") pod \"korrel8r-66d6f7f696-48lsj\" (UID: \"e371e621-9e3b-461c-8505-968f6631d1fe\") " pod="redhat-ods-monitoring/korrel8r-66d6f7f696-48lsj"
Oct 30 20:57:50.928981 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:57:50.928805    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tnh2g\" (UniqueName: \"kubernetes.io/projected/e371e621-9e3b-461c-8505-968f6631d1fe-kube-api-access-tnh2g\") pod \"korrel8r-66d6f7f696-48lsj\" (UID: \"e371e621-9e3b-461c-8505-968f6631d1fe\") " pod="redhat-ods-monitoring/korrel8r-66d6f7f696-48lsj"
Oct 30 20:57:50.928981 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:57:50.928825    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/e371e621-9e3b-461c-8505-968f6631d1fe-tls\") pod \"korrel8r-66d6f7f696-48lsj\" (UID: \"e371e621-9e3b-461c-8505-968f6631d1fe\") " pod="redhat-ods-monitoring/korrel8r-66d6f7f696-48lsj"
Oct 30 20:57:51.030212 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:57:51.030121    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e371e621-9e3b-461c-8505-968f6631d1fe-config\") pod \"korrel8r-66d6f7f696-48lsj\" (UID: \"e371e621-9e3b-461c-8505-968f6631d1fe\") " pod="redhat-ods-monitoring/korrel8r-66d6f7f696-48lsj"
Oct 30 20:57:51.030212 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:57:51.030176    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tnh2g\" (UniqueName: \"kubernetes.io/projected/e371e621-9e3b-461c-8505-968f6631d1fe-kube-api-access-tnh2g\") pod \"korrel8r-66d6f7f696-48lsj\" (UID: \"e371e621-9e3b-461c-8505-968f6631d1fe\") " pod="redhat-ods-monitoring/korrel8r-66d6f7f696-48lsj"
Oct 30 20:57:51.030212 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:57:51.030203    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/e371e621-9e3b-461c-8505-968f6631d1fe-tls\") pod \"korrel8r-66d6f7f696-48lsj\" (UID: \"e371e621-9e3b-461c-8505-968f6631d1fe\") " pod="redhat-ods-monitoring/korrel8r-66d6f7f696-48lsj"
Oct 30 20:57:51.030935 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:57:51.030913    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e371e621-9e3b-461c-8505-968f6631d1fe-config\") pod \"korrel8r-66d6f7f696-48lsj\" (UID: \"e371e621-9e3b-461c-8505-968f6631d1fe\") " pod="redhat-ods-monitoring/korrel8r-66d6f7f696-48lsj"
Oct 30 20:57:51.032773 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:57:51.032742    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls\" (UniqueName: \"kubernetes.io/secret/e371e621-9e3b-461c-8505-968f6631d1fe-tls\") pod \"korrel8r-66d6f7f696-48lsj\" (UID: \"e371e621-9e3b-461c-8505-968f6631d1fe\") " pod="redhat-ods-monitoring/korrel8r-66d6f7f696-48lsj"
Oct 30 20:57:51.091818 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:57:51.091790    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tnh2g\" (UniqueName: \"kubernetes.io/projected/e371e621-9e3b-461c-8505-968f6631d1fe-kube-api-access-tnh2g\") pod \"korrel8r-66d6f7f696-48lsj\" (UID: \"e371e621-9e3b-461c-8505-968f6631d1fe\") " pod="redhat-ods-monitoring/korrel8r-66d6f7f696-48lsj"
Oct 30 20:57:51.096451 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:57:51.096428    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/korrel8r-66d6f7f696-48lsj"
Oct 30 20:57:51.466989 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:57:51.466960    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/korrel8r-66d6f7f696-48lsj"]
Oct 30 20:57:51.469534 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:57:51.469504    4060 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode371e621_9e3b_461c_8505_968f6631d1fe.slice/crio-be506d1a21b9ee6ca4800dd1f58a91eb9848b7eb9f9b584670f9b2e76a705673 WatchSource:0}: Error finding container be506d1a21b9ee6ca4800dd1f58a91eb9848b7eb9f9b584670f9b2e76a705673: Status 404 returned error can't find the container with id be506d1a21b9ee6ca4800dd1f58a91eb9848b7eb9f9b584670f9b2e76a705673
Oct 30 20:57:51.900302 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:57:51.900212    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/korrel8r-66d6f7f696-48lsj" event={"ID":"e371e621-9e3b-461c-8505-968f6631d1fe","Type":"ContainerStarted","Data":"62deece3175b49cff145edcb58399e1a6c9a80b40d2f49e7cd08ad59604f76e3"}
Oct 30 20:57:51.900302 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:57:51.900266    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/korrel8r-66d6f7f696-48lsj" event={"ID":"e371e621-9e3b-461c-8505-968f6631d1fe","Type":"ContainerStarted","Data":"be506d1a21b9ee6ca4800dd1f58a91eb9848b7eb9f9b584670f9b2e76a705673"}
Oct 30 20:57:51.900844 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:57:51.900322    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/korrel8r-66d6f7f696-48lsj"
Oct 30 20:57:52.020535 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:57:52.020462    4060 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/korrel8r-66d6f7f696-48lsj" podStartSLOduration=2.020444226 podStartE2EDuration="2.020444226s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:57:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:57:52.018010838 +0000 UTC m=+1290.775009137" watchObservedRunningTime="2026-10-30 20:57:52.020444226 +0000 UTC m=+1290.777442526"
Oct 30 20:58:00.834699 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:00.834662    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 20:58:00.835129 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:00.834924    4060 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-collector-0" podUID="9fee43b7-7f15-4492-97a3-86f69e3fb744" containerName="otc-container" containerID="cri-o://29dee81989ab520fde5ca452dbc5b2c21c028bd2264a0f21e685366930694b4d" gracePeriod=30
Oct 30 20:58:02.906882 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:02.906802    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/korrel8r-66d6f7f696-48lsj"
Oct 30 20:58:03.079819 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:03.079212    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/korrel8r-5cbcc89b8f-bc56n"]
Oct 30 20:58:03.080082 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:03.080033    4060 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-bc56n" podUID="4db9a8e3-31dc-4d8b-8abe-129aee0bc3ab" containerName="korrel8r" containerID="cri-o://7a9ac3fcf6b06d2fd7381f727d6aea47690582f362a68718bf80b1478333c123" gracePeriod=30
Oct 30 20:58:03.202618 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:03.202592    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:58:03.324400 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:03.324377    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-bc56n"
Oct 30 20:58:03.334391 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:03.334362    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/9fee43b7-7f15-4492-97a3-86f69e3fb744-monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/9fee43b7-7f15-4492-97a3-86f69e3fb744-monitoring-tls-certs\") pod \"9fee43b7-7f15-4492-97a3-86f69e3fb744\" (UID: \"9fee43b7-7f15-4492-97a3-86f69e3fb744\") "
Oct 30 20:58:03.334559 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:03.334475    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9fee43b7-7f15-4492-97a3-86f69e3fb744-kube-api-access-wpsvz\" (UniqueName: \"kubernetes.io/projected/9fee43b7-7f15-4492-97a3-86f69e3fb744-kube-api-access-wpsvz\") pod \"9fee43b7-7f15-4492-97a3-86f69e3fb744\" (UID: \"9fee43b7-7f15-4492-97a3-86f69e3fb744\") "
Oct 30 20:58:03.334559 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:03.334522    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/9fee43b7-7f15-4492-97a3-86f69e3fb744-data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/9fee43b7-7f15-4492-97a3-86f69e3fb744-data-science-collector-ta-client-cert\") pod \"9fee43b7-7f15-4492-97a3-86f69e3fb744\" (UID: \"9fee43b7-7f15-4492-97a3-86f69e3fb744\") "
Oct 30 20:58:03.334559 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:03.334554    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/9fee43b7-7f15-4492-97a3-86f69e3fb744-otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/9fee43b7-7f15-4492-97a3-86f69e3fb744-otlp-tls-certs\") pod \"9fee43b7-7f15-4492-97a3-86f69e3fb744\" (UID: \"9fee43b7-7f15-4492-97a3-86f69e3fb744\") "
Oct 30 20:58:03.334727 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:03.334593    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/9fee43b7-7f15-4492-97a3-86f69e3fb744-tls-certs\" (UniqueName: \"kubernetes.io/secret/9fee43b7-7f15-4492-97a3-86f69e3fb744-tls-certs\") pod \"9fee43b7-7f15-4492-97a3-86f69e3fb744\" (UID: \"9fee43b7-7f15-4492-97a3-86f69e3fb744\") "
Oct 30 20:58:03.334727 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:03.334626    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9fee43b7-7f15-4492-97a3-86f69e3fb744-otc-internal\" (UniqueName: \"kubernetes.io/configmap/9fee43b7-7f15-4492-97a3-86f69e3fb744-otc-internal\") pod \"9fee43b7-7f15-4492-97a3-86f69e3fb744\" (UID: \"9fee43b7-7f15-4492-97a3-86f69e3fb744\") "
Oct 30 20:58:03.335190 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:03.335160    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9fee43b7-7f15-4492-97a3-86f69e3fb744-otc-internal" pod "9fee43b7-7f15-4492-97a3-86f69e3fb744" (UID: "9fee43b7-7f15-4492-97a3-86f69e3fb744"). InnerVolumeSpecName "otc-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:58:03.337133 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:03.337100    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9fee43b7-7f15-4492-97a3-86f69e3fb744-otlp-tls-certs" pod "9fee43b7-7f15-4492-97a3-86f69e3fb744" (UID: "9fee43b7-7f15-4492-97a3-86f69e3fb744"). InnerVolumeSpecName "otlp-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:58:03.337449 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:03.337429    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9fee43b7-7f15-4492-97a3-86f69e3fb744-monitoring-tls-certs" pod "9fee43b7-7f15-4492-97a3-86f69e3fb744" (UID: "9fee43b7-7f15-4492-97a3-86f69e3fb744"). InnerVolumeSpecName "monitoring-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:58:03.337563 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:03.337467    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9fee43b7-7f15-4492-97a3-86f69e3fb744-kube-api-access-wpsvz" pod "9fee43b7-7f15-4492-97a3-86f69e3fb744" (UID: "9fee43b7-7f15-4492-97a3-86f69e3fb744"). InnerVolumeSpecName "kube-api-access-wpsvz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:58:03.337664 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:03.337639    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9fee43b7-7f15-4492-97a3-86f69e3fb744-data-science-collector-ta-client-cert" pod "9fee43b7-7f15-4492-97a3-86f69e3fb744" (UID: "9fee43b7-7f15-4492-97a3-86f69e3fb744"). InnerVolumeSpecName "data-science-collector-ta-client-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:58:03.337705 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:03.337692    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9fee43b7-7f15-4492-97a3-86f69e3fb744-tls-certs" pod "9fee43b7-7f15-4492-97a3-86f69e3fb744" (UID: "9fee43b7-7f15-4492-97a3-86f69e3fb744"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:58:03.435094 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:03.435062    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/4db9a8e3-31dc-4d8b-8abe-129aee0bc3ab-tls\" (UniqueName: \"kubernetes.io/secret/4db9a8e3-31dc-4d8b-8abe-129aee0bc3ab-tls\") pod \"4db9a8e3-31dc-4d8b-8abe-129aee0bc3ab\" (UID: \"4db9a8e3-31dc-4d8b-8abe-129aee0bc3ab\") "
Oct 30 20:58:03.435269 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:03.435153    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/4db9a8e3-31dc-4d8b-8abe-129aee0bc3ab-config\" (UniqueName: \"kubernetes.io/configmap/4db9a8e3-31dc-4d8b-8abe-129aee0bc3ab-config\") pod \"4db9a8e3-31dc-4d8b-8abe-129aee0bc3ab\" (UID: \"4db9a8e3-31dc-4d8b-8abe-129aee0bc3ab\") "
Oct 30 20:58:03.435269 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:03.435184    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4db9a8e3-31dc-4d8b-8abe-129aee0bc3ab-kube-api-access-pspw8\" (UniqueName: \"kubernetes.io/projected/4db9a8e3-31dc-4d8b-8abe-129aee0bc3ab-kube-api-access-pspw8\") pod \"4db9a8e3-31dc-4d8b-8abe-129aee0bc3ab\" (UID: \"4db9a8e3-31dc-4d8b-8abe-129aee0bc3ab\") "
Oct 30 20:58:03.435397 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:03.435360    4060 reconciler_common.go:299] "Volume detached for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/9fee43b7-7f15-4492-97a3-86f69e3fb744-otlp-tls-certs\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:58:03.435397 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:03.435378    4060 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9fee43b7-7f15-4492-97a3-86f69e3fb744-tls-certs\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:58:03.435397 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:03.435392    4060 reconciler_common.go:299] "Volume detached for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/9fee43b7-7f15-4492-97a3-86f69e3fb744-otc-internal\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:58:03.435538 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:03.435409    4060 reconciler_common.go:299] "Volume detached for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/9fee43b7-7f15-4492-97a3-86f69e3fb744-monitoring-tls-certs\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:58:03.435538 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:03.435424    4060 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wpsvz\" (UniqueName: \"kubernetes.io/projected/9fee43b7-7f15-4492-97a3-86f69e3fb744-kube-api-access-wpsvz\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:58:03.435538 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:03.435439    4060 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/9fee43b7-7f15-4492-97a3-86f69e3fb744-data-science-collector-ta-client-cert\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:58:03.435666 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:03.435582    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4db9a8e3-31dc-4d8b-8abe-129aee0bc3ab-config" pod "4db9a8e3-31dc-4d8b-8abe-129aee0bc3ab" (UID: "4db9a8e3-31dc-4d8b-8abe-129aee0bc3ab"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:58:03.437198 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:03.437176    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4db9a8e3-31dc-4d8b-8abe-129aee0bc3ab-tls" pod "4db9a8e3-31dc-4d8b-8abe-129aee0bc3ab" (UID: "4db9a8e3-31dc-4d8b-8abe-129aee0bc3ab"). InnerVolumeSpecName "tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:58:03.437339 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:03.437320    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4db9a8e3-31dc-4d8b-8abe-129aee0bc3ab-kube-api-access-pspw8" pod "4db9a8e3-31dc-4d8b-8abe-129aee0bc3ab" (UID: "4db9a8e3-31dc-4d8b-8abe-129aee0bc3ab"). InnerVolumeSpecName "kube-api-access-pspw8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:58:03.536796 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:03.536754    4060 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4db9a8e3-31dc-4d8b-8abe-129aee0bc3ab-config\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:58:03.536796 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:03.536794    4060 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pspw8\" (UniqueName: \"kubernetes.io/projected/4db9a8e3-31dc-4d8b-8abe-129aee0bc3ab-kube-api-access-pspw8\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:58:03.537012 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:03.536807    4060 reconciler_common.go:299] "Volume detached for volume \"tls\" (UniqueName: \"kubernetes.io/secret/4db9a8e3-31dc-4d8b-8abe-129aee0bc3ab-tls\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:58:03.956656 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:03.956627    4060 generic.go:356] "Generic (PLEG): container finished" podID="4db9a8e3-31dc-4d8b-8abe-129aee0bc3ab" containerID="7a9ac3fcf6b06d2fd7381f727d6aea47690582f362a68718bf80b1478333c123" exitCode=0
Oct 30 20:58:03.957104 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:03.956689    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-bc56n"
Oct 30 20:58:03.957104 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:03.956711    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-bc56n" event={"ID":"4db9a8e3-31dc-4d8b-8abe-129aee0bc3ab","Type":"ContainerDied","Data":"7a9ac3fcf6b06d2fd7381f727d6aea47690582f362a68718bf80b1478333c123"}
Oct 30 20:58:03.957104 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:03.956763    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-bc56n" event={"ID":"4db9a8e3-31dc-4d8b-8abe-129aee0bc3ab","Type":"ContainerDied","Data":"0ce5ab9f394af105f8319d7ba58e505f664441483efb33f6ae87ef91a281ce69"}
Oct 30 20:58:03.957104 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:03.956793    4060 scope.go:122] "RemoveContainer" containerID="7a9ac3fcf6b06d2fd7381f727d6aea47690582f362a68718bf80b1478333c123"
Oct 30 20:58:03.958225 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:03.958201    4060 generic.go:356] "Generic (PLEG): container finished" podID="9fee43b7-7f15-4492-97a3-86f69e3fb744" containerID="29dee81989ab520fde5ca452dbc5b2c21c028bd2264a0f21e685366930694b4d" exitCode=0
Oct 30 20:58:03.958343 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:03.958227    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"9fee43b7-7f15-4492-97a3-86f69e3fb744","Type":"ContainerDied","Data":"29dee81989ab520fde5ca452dbc5b2c21c028bd2264a0f21e685366930694b4d"}
Oct 30 20:58:03.958343 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:03.958245    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:58:03.958343 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:03.958278    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"9fee43b7-7f15-4492-97a3-86f69e3fb744","Type":"ContainerDied","Data":"5f63d56a8080c8d922f95eefc5f100a17f3257d3a7bc4059766169a7b04d3398"}
Oct 30 20:58:03.973869 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:03.973852    4060 scope.go:122] "RemoveContainer" containerID="7a9ac3fcf6b06d2fd7381f727d6aea47690582f362a68718bf80b1478333c123"
Oct 30 20:58:03.974117 ip-10-0-142-4 kubenswrapper[4060]: E1030 20:58:03.974100    4060 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7a9ac3fcf6b06d2fd7381f727d6aea47690582f362a68718bf80b1478333c123\": container with ID starting with 7a9ac3fcf6b06d2fd7381f727d6aea47690582f362a68718bf80b1478333c123 not found: ID does not exist" containerID="7a9ac3fcf6b06d2fd7381f727d6aea47690582f362a68718bf80b1478333c123"
Oct 30 20:58:03.974176 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:03.974125    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7a9ac3fcf6b06d2fd7381f727d6aea47690582f362a68718bf80b1478333c123"} err="failed to get container status \"7a9ac3fcf6b06d2fd7381f727d6aea47690582f362a68718bf80b1478333c123\": rpc error: code = NotFound desc = could not find container \"7a9ac3fcf6b06d2fd7381f727d6aea47690582f362a68718bf80b1478333c123\": container with ID starting with 7a9ac3fcf6b06d2fd7381f727d6aea47690582f362a68718bf80b1478333c123 not found: ID does not exist"
Oct 30 20:58:03.974176 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:03.974141    4060 scope.go:122] "RemoveContainer" containerID="29dee81989ab520fde5ca452dbc5b2c21c028bd2264a0f21e685366930694b4d"
Oct 30 20:58:03.981871 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:03.981844    4060 scope.go:122] "RemoveContainer" containerID="29dee81989ab520fde5ca452dbc5b2c21c028bd2264a0f21e685366930694b4d"
Oct 30 20:58:03.982115 ip-10-0-142-4 kubenswrapper[4060]: E1030 20:58:03.982098    4060 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"29dee81989ab520fde5ca452dbc5b2c21c028bd2264a0f21e685366930694b4d\": container with ID starting with 29dee81989ab520fde5ca452dbc5b2c21c028bd2264a0f21e685366930694b4d not found: ID does not exist" containerID="29dee81989ab520fde5ca452dbc5b2c21c028bd2264a0f21e685366930694b4d"
Oct 30 20:58:03.982173 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:03.982122    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"29dee81989ab520fde5ca452dbc5b2c21c028bd2264a0f21e685366930694b4d"} err="failed to get container status \"29dee81989ab520fde5ca452dbc5b2c21c028bd2264a0f21e685366930694b4d\": rpc error: code = NotFound desc = could not find container \"29dee81989ab520fde5ca452dbc5b2c21c028bd2264a0f21e685366930694b4d\": container with ID starting with 29dee81989ab520fde5ca452dbc5b2c21c028bd2264a0f21e685366930694b4d not found: ID does not exist"
Oct 30 20:58:04.125603 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:04.125569    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/korrel8r-5cbcc89b8f-bc56n"]
Oct 30 20:58:04.174876 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:04.174851    4060 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/korrel8r-5cbcc89b8f-bc56n"]
Oct 30 20:58:04.237916 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:04.237842    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 20:58:04.241891 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:04.241868    4060 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 20:58:04.320708 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:04.320675    4060 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 20:58:04.321034 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:04.321022    4060 cpu_manager.go:414] "containerMap: removing container" podUID="9fee43b7-7f15-4492-97a3-86f69e3fb744" containerName="otc-container"
Oct 30 20:58:04.321090 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:04.321035    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9fee43b7-7f15-4492-97a3-86f69e3fb744" containerName="otc-container"
Oct 30 20:58:04.321090 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:04.321058    4060 cpu_manager.go:414] "containerMap: removing container" podUID="4db9a8e3-31dc-4d8b-8abe-129aee0bc3ab" containerName="korrel8r"
Oct 30 20:58:04.321090 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:04.321063    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4db9a8e3-31dc-4d8b-8abe-129aee0bc3ab" containerName="korrel8r"
Oct 30 20:58:04.321196 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:04.321117    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="9fee43b7-7f15-4492-97a3-86f69e3fb744" containerName="otc-container"
Oct 30 20:58:04.321196 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:04.321128    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="4db9a8e3-31dc-4d8b-8abe-129aee0bc3ab" containerName="korrel8r"
Oct 30 20:58:04.325525 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:04.325505    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:58:04.378138 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:04.378109    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-headless-tls\""
Oct 30 20:58:04.378311 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:04.378175    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-tls\""
Oct 30 20:58:04.378360 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:04.378331    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-6d9d4583\""
Oct 30 20:58:04.378360 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:04.378333    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-ta-client-cert\""
Oct 30 20:58:04.378419 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:04.378378    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-monitoring-tls\""
Oct 30 20:58:04.378419 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:04.378378    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-dockercfg-jqj7h\""
Oct 30 20:58:04.385020 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:04.384997    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 20:58:04.444155 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:04.444122    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/c70613bc-413a-4a21-96ff-a1a69e21af33-otlp-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"c70613bc-413a-4a21-96ff-a1a69e21af33\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:58:04.444297 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:04.444167    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/c70613bc-413a-4a21-96ff-a1a69e21af33-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-0\" (UID: \"c70613bc-413a-4a21-96ff-a1a69e21af33\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:58:04.444297 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:04.444200    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4nrhr\" (UniqueName: \"kubernetes.io/projected/c70613bc-413a-4a21-96ff-a1a69e21af33-kube-api-access-4nrhr\") pod \"data-science-collector-collector-0\" (UID: \"c70613bc-413a-4a21-96ff-a1a69e21af33\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:58:04.444386 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:04.444315    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/c70613bc-413a-4a21-96ff-a1a69e21af33-monitoring-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"c70613bc-413a-4a21-96ff-a1a69e21af33\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:58:04.444448 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:04.444380    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c70613bc-413a-4a21-96ff-a1a69e21af33-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"c70613bc-413a-4a21-96ff-a1a69e21af33\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:58:04.444448 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:04.444428    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/c70613bc-413a-4a21-96ff-a1a69e21af33-otc-internal\") pod \"data-science-collector-collector-0\" (UID: \"c70613bc-413a-4a21-96ff-a1a69e21af33\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:58:04.544926 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:04.544837    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/c70613bc-413a-4a21-96ff-a1a69e21af33-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-0\" (UID: \"c70613bc-413a-4a21-96ff-a1a69e21af33\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:58:04.544926 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:04.544873    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4nrhr\" (UniqueName: \"kubernetes.io/projected/c70613bc-413a-4a21-96ff-a1a69e21af33-kube-api-access-4nrhr\") pod \"data-science-collector-collector-0\" (UID: \"c70613bc-413a-4a21-96ff-a1a69e21af33\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:58:04.544926 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:04.544906    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/c70613bc-413a-4a21-96ff-a1a69e21af33-monitoring-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"c70613bc-413a-4a21-96ff-a1a69e21af33\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:58:04.545203 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:04.544946    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c70613bc-413a-4a21-96ff-a1a69e21af33-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"c70613bc-413a-4a21-96ff-a1a69e21af33\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:58:04.545203 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:04.544971    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/c70613bc-413a-4a21-96ff-a1a69e21af33-otc-internal\") pod \"data-science-collector-collector-0\" (UID: \"c70613bc-413a-4a21-96ff-a1a69e21af33\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:58:04.545203 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:04.545001    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/c70613bc-413a-4a21-96ff-a1a69e21af33-otlp-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"c70613bc-413a-4a21-96ff-a1a69e21af33\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:58:04.545683 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:04.545659    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/c70613bc-413a-4a21-96ff-a1a69e21af33-otc-internal\") pod \"data-science-collector-collector-0\" (UID: \"c70613bc-413a-4a21-96ff-a1a69e21af33\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:58:04.547604 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:04.547569    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/c70613bc-413a-4a21-96ff-a1a69e21af33-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-0\" (UID: \"c70613bc-413a-4a21-96ff-a1a69e21af33\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:58:04.547710 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:04.547613    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/c70613bc-413a-4a21-96ff-a1a69e21af33-otlp-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"c70613bc-413a-4a21-96ff-a1a69e21af33\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:58:04.547823 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:04.547805    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c70613bc-413a-4a21-96ff-a1a69e21af33-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"c70613bc-413a-4a21-96ff-a1a69e21af33\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:58:04.547879 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:04.547824    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/c70613bc-413a-4a21-96ff-a1a69e21af33-monitoring-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"c70613bc-413a-4a21-96ff-a1a69e21af33\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:58:04.605531 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:04.605482    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4nrhr\" (UniqueName: \"kubernetes.io/projected/c70613bc-413a-4a21-96ff-a1a69e21af33-kube-api-access-4nrhr\") pod \"data-science-collector-collector-0\" (UID: \"c70613bc-413a-4a21-96ff-a1a69e21af33\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:58:04.638500 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:04.638468    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:58:05.015751 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:05.015727    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 20:58:05.017535 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:58:05.017509    4060 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc70613bc_413a_4a21_96ff_a1a69e21af33.slice/crio-8e5e632810305a5dd17b30e76f568f1d8599b51a8d0d9e1dc8af670ddaab469c WatchSource:0}: Error finding container 8e5e632810305a5dd17b30e76f568f1d8599b51a8d0d9e1dc8af670ddaab469c: Status 404 returned error can't find the container with id 8e5e632810305a5dd17b30e76f568f1d8599b51a8d0d9e1dc8af670ddaab469c
Oct 30 20:58:05.019486 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:05.019455    4060 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 20:58:05.019573 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:05.019543    4060 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 20:58:05.427563 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:05.427474    4060 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="4db9a8e3-31dc-4d8b-8abe-129aee0bc3ab" path="/var/lib/kubelet/pods/4db9a8e3-31dc-4d8b-8abe-129aee0bc3ab/volumes"
Oct 30 20:58:05.427873 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:05.427860    4060 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9fee43b7-7f15-4492-97a3-86f69e3fb744" path="/var/lib/kubelet/pods/9fee43b7-7f15-4492-97a3-86f69e3fb744/volumes"
Oct 30 20:58:05.973544 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:05.973483    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"c70613bc-413a-4a21-96ff-a1a69e21af33","Type":"ContainerStarted","Data":"2feba9dae7dbef37d0c28645fa5f108b8e6f9a7869e5aa8ae030074c7c118a44"}
Oct 30 20:58:05.973749 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:05.973570    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"c70613bc-413a-4a21-96ff-a1a69e21af33","Type":"ContainerStarted","Data":"8e5e632810305a5dd17b30e76f568f1d8599b51a8d0d9e1dc8af670ddaab469c"}
Oct 30 20:58:06.093014 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:06.092960    4060 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-collector-0" podStartSLOduration=2.092945743 podStartE2EDuration="2.092945743s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:58:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:58:06.090742609 +0000 UTC m=+1304.847740917" watchObservedRunningTime="2026-10-30 20:58:06.092945743 +0000 UTC m=+1304.849944119"
Oct 30 20:58:12.149653 ip-10-0-142-4 kubenswrapper[4060]: E1030 20:58:12.149616    4060 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v2f4x" containerName="extractor"
Oct 30 20:58:24.394582 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:24.394546    4060 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/korrel8r-5cbcc89b8f-chqpk"]
Oct 30 20:58:24.399200 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:24.399181    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-chqpk"
Oct 30 20:58:24.459136 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:24.459108    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/korrel8r-5cbcc89b8f-chqpk"]
Oct 30 20:58:24.497138 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:24.497103    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5xx29\" (UniqueName: \"kubernetes.io/projected/8a130d0e-60fe-4947-8362-5c376a721af3-kube-api-access-5xx29\") pod \"korrel8r-5cbcc89b8f-chqpk\" (UID: \"8a130d0e-60fe-4947-8362-5c376a721af3\") " pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-chqpk"
Oct 30 20:58:24.497294 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:24.497145    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8a130d0e-60fe-4947-8362-5c376a721af3-config\") pod \"korrel8r-5cbcc89b8f-chqpk\" (UID: \"8a130d0e-60fe-4947-8362-5c376a721af3\") " pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-chqpk"
Oct 30 20:58:24.497294 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:24.497274    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/8a130d0e-60fe-4947-8362-5c376a721af3-tls\") pod \"korrel8r-5cbcc89b8f-chqpk\" (UID: \"8a130d0e-60fe-4947-8362-5c376a721af3\") " pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-chqpk"
Oct 30 20:58:24.597866 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:24.597834    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8a130d0e-60fe-4947-8362-5c376a721af3-config\") pod \"korrel8r-5cbcc89b8f-chqpk\" (UID: \"8a130d0e-60fe-4947-8362-5c376a721af3\") " pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-chqpk"
Oct 30 20:58:24.598038 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:24.597896    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/8a130d0e-60fe-4947-8362-5c376a721af3-tls\") pod \"korrel8r-5cbcc89b8f-chqpk\" (UID: \"8a130d0e-60fe-4947-8362-5c376a721af3\") " pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-chqpk"
Oct 30 20:58:24.598038 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:24.597928    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5xx29\" (UniqueName: \"kubernetes.io/projected/8a130d0e-60fe-4947-8362-5c376a721af3-kube-api-access-5xx29\") pod \"korrel8r-5cbcc89b8f-chqpk\" (UID: \"8a130d0e-60fe-4947-8362-5c376a721af3\") " pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-chqpk"
Oct 30 20:58:24.598680 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:24.598658    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8a130d0e-60fe-4947-8362-5c376a721af3-config\") pod \"korrel8r-5cbcc89b8f-chqpk\" (UID: \"8a130d0e-60fe-4947-8362-5c376a721af3\") " pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-chqpk"
Oct 30 20:58:24.600261 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:24.600243    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls\" (UniqueName: \"kubernetes.io/secret/8a130d0e-60fe-4947-8362-5c376a721af3-tls\") pod \"korrel8r-5cbcc89b8f-chqpk\" (UID: \"8a130d0e-60fe-4947-8362-5c376a721af3\") " pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-chqpk"
Oct 30 20:58:24.658618 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:24.658564    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5xx29\" (UniqueName: \"kubernetes.io/projected/8a130d0e-60fe-4947-8362-5c376a721af3-kube-api-access-5xx29\") pod \"korrel8r-5cbcc89b8f-chqpk\" (UID: \"8a130d0e-60fe-4947-8362-5c376a721af3\") " pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-chqpk"
Oct 30 20:58:24.711603 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:24.711569    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-chqpk"
Oct 30 20:58:25.081913 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:25.081778    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/korrel8r-5cbcc89b8f-chqpk"]
Oct 30 20:58:25.084204 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:58:25.084178    4060 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a130d0e_60fe_4947_8362_5c376a721af3.slice/crio-325c37b3f49ce54c4b87d5799b6f9eb90b1275165b4c1b0b5abc75f6c48c42b3 WatchSource:0}: Error finding container 325c37b3f49ce54c4b87d5799b6f9eb90b1275165b4c1b0b5abc75f6c48c42b3: Status 404 returned error can't find the container with id 325c37b3f49ce54c4b87d5799b6f9eb90b1275165b4c1b0b5abc75f6c48c42b3
Oct 30 20:58:26.071237 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:26.071196    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-chqpk" event={"ID":"8a130d0e-60fe-4947-8362-5c376a721af3","Type":"ContainerStarted","Data":"c565e561e6c83da8c3aca9c4adaa6cc7aadda4cac0c4bccdb0113bc042184fe1"}
Oct 30 20:58:26.071634 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:26.071259    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-chqpk" event={"ID":"8a130d0e-60fe-4947-8362-5c376a721af3","Type":"ContainerStarted","Data":"325c37b3f49ce54c4b87d5799b6f9eb90b1275165b4c1b0b5abc75f6c48c42b3"}
Oct 30 20:58:26.071634 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:26.071297    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-chqpk"
Oct 30 20:58:26.190771 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:26.190719    4060 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-chqpk" podStartSLOduration=2.190704739 podStartE2EDuration="2.190704739s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:58:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:58:26.190665399 +0000 UTC m=+1324.947663696" watchObservedRunningTime="2026-10-30 20:58:26.190704739 +0000 UTC m=+1324.947703035"
Oct 30 20:58:34.234840 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:34.234807    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 20:58:34.235321 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:34.235076    4060 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-collector-0" podUID="c70613bc-413a-4a21-96ff-a1a69e21af33" containerName="otc-container" containerID="cri-o://2feba9dae7dbef37d0c28645fa5f108b8e6f9a7869e5aa8ae030074c7c118a44" gracePeriod=30
Oct 30 20:58:36.579428 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:36.579405    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:58:36.595016 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:36.594939    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/c70613bc-413a-4a21-96ff-a1a69e21af33-data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/c70613bc-413a-4a21-96ff-a1a69e21af33-data-science-collector-ta-client-cert\") pod \"c70613bc-413a-4a21-96ff-a1a69e21af33\" (UID: \"c70613bc-413a-4a21-96ff-a1a69e21af33\") "
Oct 30 20:58:36.595016 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:36.594999    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/c70613bc-413a-4a21-96ff-a1a69e21af33-otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/c70613bc-413a-4a21-96ff-a1a69e21af33-otlp-tls-certs\") pod \"c70613bc-413a-4a21-96ff-a1a69e21af33\" (UID: \"c70613bc-413a-4a21-96ff-a1a69e21af33\") "
Oct 30 20:58:36.595192 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:36.595027    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/c70613bc-413a-4a21-96ff-a1a69e21af33-monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/c70613bc-413a-4a21-96ff-a1a69e21af33-monitoring-tls-certs\") pod \"c70613bc-413a-4a21-96ff-a1a69e21af33\" (UID: \"c70613bc-413a-4a21-96ff-a1a69e21af33\") "
Oct 30 20:58:36.595192 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:36.595060    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c70613bc-413a-4a21-96ff-a1a69e21af33-otc-internal\" (UniqueName: \"kubernetes.io/configmap/c70613bc-413a-4a21-96ff-a1a69e21af33-otc-internal\") pod \"c70613bc-413a-4a21-96ff-a1a69e21af33\" (UID: \"c70613bc-413a-4a21-96ff-a1a69e21af33\") "
Oct 30 20:58:36.595192 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:36.595101    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c70613bc-413a-4a21-96ff-a1a69e21af33-kube-api-access-4nrhr\" (UniqueName: \"kubernetes.io/projected/c70613bc-413a-4a21-96ff-a1a69e21af33-kube-api-access-4nrhr\") pod \"c70613bc-413a-4a21-96ff-a1a69e21af33\" (UID: \"c70613bc-413a-4a21-96ff-a1a69e21af33\") "
Oct 30 20:58:36.595192 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:36.595141    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/c70613bc-413a-4a21-96ff-a1a69e21af33-tls-certs\" (UniqueName: \"kubernetes.io/secret/c70613bc-413a-4a21-96ff-a1a69e21af33-tls-certs\") pod \"c70613bc-413a-4a21-96ff-a1a69e21af33\" (UID: \"c70613bc-413a-4a21-96ff-a1a69e21af33\") "
Oct 30 20:58:36.595923 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:36.595884    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c70613bc-413a-4a21-96ff-a1a69e21af33-otc-internal" pod "c70613bc-413a-4a21-96ff-a1a69e21af33" (UID: "c70613bc-413a-4a21-96ff-a1a69e21af33"). InnerVolumeSpecName "otc-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:58:36.597731 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:36.597698    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c70613bc-413a-4a21-96ff-a1a69e21af33-monitoring-tls-certs" pod "c70613bc-413a-4a21-96ff-a1a69e21af33" (UID: "c70613bc-413a-4a21-96ff-a1a69e21af33"). InnerVolumeSpecName "monitoring-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:58:36.598522 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:36.598215    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c70613bc-413a-4a21-96ff-a1a69e21af33-data-science-collector-ta-client-cert" pod "c70613bc-413a-4a21-96ff-a1a69e21af33" (UID: "c70613bc-413a-4a21-96ff-a1a69e21af33"). InnerVolumeSpecName "data-science-collector-ta-client-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:58:36.599539 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:36.598597    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c70613bc-413a-4a21-96ff-a1a69e21af33-otlp-tls-certs" pod "c70613bc-413a-4a21-96ff-a1a69e21af33" (UID: "c70613bc-413a-4a21-96ff-a1a69e21af33"). InnerVolumeSpecName "otlp-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:58:36.605132 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:36.605104    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c70613bc-413a-4a21-96ff-a1a69e21af33-tls-certs" pod "c70613bc-413a-4a21-96ff-a1a69e21af33" (UID: "c70613bc-413a-4a21-96ff-a1a69e21af33"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:58:36.605232 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:36.605137    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c70613bc-413a-4a21-96ff-a1a69e21af33-kube-api-access-4nrhr" pod "c70613bc-413a-4a21-96ff-a1a69e21af33" (UID: "c70613bc-413a-4a21-96ff-a1a69e21af33"). InnerVolumeSpecName "kube-api-access-4nrhr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:58:36.696613 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:36.696580    4060 reconciler_common.go:299] "Volume detached for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/c70613bc-413a-4a21-96ff-a1a69e21af33-otlp-tls-certs\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:58:36.696613 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:36.696605    4060 reconciler_common.go:299] "Volume detached for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/c70613bc-413a-4a21-96ff-a1a69e21af33-monitoring-tls-certs\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:58:36.696613 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:36.696615    4060 reconciler_common.go:299] "Volume detached for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/c70613bc-413a-4a21-96ff-a1a69e21af33-otc-internal\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:58:36.696819 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:36.696624    4060 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4nrhr\" (UniqueName: \"kubernetes.io/projected/c70613bc-413a-4a21-96ff-a1a69e21af33-kube-api-access-4nrhr\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:58:36.696819 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:36.696633    4060 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c70613bc-413a-4a21-96ff-a1a69e21af33-tls-certs\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:58:36.696819 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:36.696643    4060 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/c70613bc-413a-4a21-96ff-a1a69e21af33-data-science-collector-ta-client-cert\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:58:37.079367 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:37.079341    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-chqpk"
Oct 30 20:58:37.129754 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:37.129722    4060 generic.go:356] "Generic (PLEG): container finished" podID="c70613bc-413a-4a21-96ff-a1a69e21af33" containerID="2feba9dae7dbef37d0c28645fa5f108b8e6f9a7869e5aa8ae030074c7c118a44" exitCode=0
Oct 30 20:58:37.129922 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:37.129797    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:58:37.129922 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:37.129798    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"c70613bc-413a-4a21-96ff-a1a69e21af33","Type":"ContainerDied","Data":"2feba9dae7dbef37d0c28645fa5f108b8e6f9a7869e5aa8ae030074c7c118a44"}
Oct 30 20:58:37.129995 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:37.129934    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"c70613bc-413a-4a21-96ff-a1a69e21af33","Type":"ContainerDied","Data":"8e5e632810305a5dd17b30e76f568f1d8599b51a8d0d9e1dc8af670ddaab469c"}
Oct 30 20:58:37.129995 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:37.129955    4060 scope.go:122] "RemoveContainer" containerID="2feba9dae7dbef37d0c28645fa5f108b8e6f9a7869e5aa8ae030074c7c118a44"
Oct 30 20:58:37.138691 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:37.138661    4060 scope.go:122] "RemoveContainer" containerID="2feba9dae7dbef37d0c28645fa5f108b8e6f9a7869e5aa8ae030074c7c118a44"
Oct 30 20:58:37.139226 ip-10-0-142-4 kubenswrapper[4060]: E1030 20:58:37.139190    4060 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2feba9dae7dbef37d0c28645fa5f108b8e6f9a7869e5aa8ae030074c7c118a44\": container with ID starting with 2feba9dae7dbef37d0c28645fa5f108b8e6f9a7869e5aa8ae030074c7c118a44 not found: ID does not exist" containerID="2feba9dae7dbef37d0c28645fa5f108b8e6f9a7869e5aa8ae030074c7c118a44"
Oct 30 20:58:37.139313 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:37.139245    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2feba9dae7dbef37d0c28645fa5f108b8e6f9a7869e5aa8ae030074c7c118a44"} err="failed to get container status \"2feba9dae7dbef37d0c28645fa5f108b8e6f9a7869e5aa8ae030074c7c118a44\": rpc error: code = NotFound desc = could not find container \"2feba9dae7dbef37d0c28645fa5f108b8e6f9a7869e5aa8ae030074c7c118a44\": container with ID starting with 2feba9dae7dbef37d0c28645fa5f108b8e6f9a7869e5aa8ae030074c7c118a44 not found: ID does not exist"
Oct 30 20:58:37.226940 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:37.226900    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/korrel8r-66d6f7f696-48lsj"]
Oct 30 20:58:37.227214 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:37.227167    4060 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/korrel8r-66d6f7f696-48lsj" podUID="e371e621-9e3b-461c-8505-968f6631d1fe" containerName="korrel8r" containerID="cri-o://62deece3175b49cff145edcb58399e1a6c9a80b40d2f49e7cd08ad59604f76e3" gracePeriod=30
Oct 30 20:58:37.306648 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:37.306619    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 20:58:37.310482 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:37.310458    4060 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 20:58:37.387536 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:37.387487    4060 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 20:58:37.387842 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:37.387830    4060 cpu_manager.go:414] "containerMap: removing container" podUID="c70613bc-413a-4a21-96ff-a1a69e21af33" containerName="otc-container"
Oct 30 20:58:37.387883 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:37.387843    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c70613bc-413a-4a21-96ff-a1a69e21af33" containerName="otc-container"
Oct 30 20:58:37.387920 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:37.387903    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="c70613bc-413a-4a21-96ff-a1a69e21af33" containerName="otc-container"
Oct 30 20:58:37.390824 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:37.390805    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:58:37.428458 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:37.428426    4060 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c70613bc-413a-4a21-96ff-a1a69e21af33" path="/var/lib/kubelet/pods/c70613bc-413a-4a21-96ff-a1a69e21af33/volumes"
Oct 30 20:58:37.443586 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:37.443548    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-a0f9182a\""
Oct 30 20:58:37.443728 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:37.443671    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-monitoring-tls\""
Oct 30 20:58:37.443728 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:37.443684    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-dockercfg-jqj7h\""
Oct 30 20:58:37.443728 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:37.443695    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-tls\""
Oct 30 20:58:37.443865 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:37.443757    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-ta-client-cert\""
Oct 30 20:58:37.443865 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:37.443827    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-headless-tls\""
Oct 30 20:58:37.452195 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:37.452169    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 20:58:37.468537 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:37.468514    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/korrel8r-66d6f7f696-48lsj"
Oct 30 20:58:37.502169 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:37.502136    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e371e621-9e3b-461c-8505-968f6631d1fe-kube-api-access-tnh2g\" (UniqueName: \"kubernetes.io/projected/e371e621-9e3b-461c-8505-968f6631d1fe-kube-api-access-tnh2g\") pod \"e371e621-9e3b-461c-8505-968f6631d1fe\" (UID: \"e371e621-9e3b-461c-8505-968f6631d1fe\") "
Oct 30 20:58:37.502323 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:37.502203    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/e371e621-9e3b-461c-8505-968f6631d1fe-config\" (UniqueName: \"kubernetes.io/configmap/e371e621-9e3b-461c-8505-968f6631d1fe-config\") pod \"e371e621-9e3b-461c-8505-968f6631d1fe\" (UID: \"e371e621-9e3b-461c-8505-968f6631d1fe\") "
Oct 30 20:58:37.502323 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:37.502250    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/e371e621-9e3b-461c-8505-968f6631d1fe-tls\" (UniqueName: \"kubernetes.io/secret/e371e621-9e3b-461c-8505-968f6631d1fe-tls\") pod \"e371e621-9e3b-461c-8505-968f6631d1fe\" (UID: \"e371e621-9e3b-461c-8505-968f6631d1fe\") "
Oct 30 20:58:37.502439 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:37.502419    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-59gtn\" (UniqueName: \"kubernetes.io/projected/de7f0012-384a-4b06-86a2-c7581cb3dd55-kube-api-access-59gtn\") pod \"data-science-collector-collector-0\" (UID: \"de7f0012-384a-4b06-86a2-c7581cb3dd55\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:58:37.502551 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:37.502484    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/de7f0012-384a-4b06-86a2-c7581cb3dd55-monitoring-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"de7f0012-384a-4b06-86a2-c7581cb3dd55\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:58:37.502551 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:37.502521    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/de7f0012-384a-4b06-86a2-c7581cb3dd55-otlp-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"de7f0012-384a-4b06-86a2-c7581cb3dd55\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:58:37.502686 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:37.502555    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e371e621-9e3b-461c-8505-968f6631d1fe-config" pod "e371e621-9e3b-461c-8505-968f6631d1fe" (UID: "e371e621-9e3b-461c-8505-968f6631d1fe"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:58:37.502830 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:37.502805    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/de7f0012-384a-4b06-86a2-c7581cb3dd55-otc-internal\") pod \"data-science-collector-collector-0\" (UID: \"de7f0012-384a-4b06-86a2-c7581cb3dd55\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:58:37.502890 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:37.502871    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/de7f0012-384a-4b06-86a2-c7581cb3dd55-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-0\" (UID: \"de7f0012-384a-4b06-86a2-c7581cb3dd55\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:58:37.502963 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:37.502919    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/de7f0012-384a-4b06-86a2-c7581cb3dd55-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"de7f0012-384a-4b06-86a2-c7581cb3dd55\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:58:37.503066 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:37.503048    4060 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e371e621-9e3b-461c-8505-968f6631d1fe-config\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:58:37.504386 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:37.504366    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e371e621-9e3b-461c-8505-968f6631d1fe-tls" pod "e371e621-9e3b-461c-8505-968f6631d1fe" (UID: "e371e621-9e3b-461c-8505-968f6631d1fe"). InnerVolumeSpecName "tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:58:37.504447 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:37.504421    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e371e621-9e3b-461c-8505-968f6631d1fe-kube-api-access-tnh2g" pod "e371e621-9e3b-461c-8505-968f6631d1fe" (UID: "e371e621-9e3b-461c-8505-968f6631d1fe"). InnerVolumeSpecName "kube-api-access-tnh2g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:58:37.604002 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:37.603911    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/de7f0012-384a-4b06-86a2-c7581cb3dd55-otc-internal\") pod \"data-science-collector-collector-0\" (UID: \"de7f0012-384a-4b06-86a2-c7581cb3dd55\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:58:37.604002 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:37.603964    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/de7f0012-384a-4b06-86a2-c7581cb3dd55-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-0\" (UID: \"de7f0012-384a-4b06-86a2-c7581cb3dd55\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:58:37.604537 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:37.604079    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/de7f0012-384a-4b06-86a2-c7581cb3dd55-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"de7f0012-384a-4b06-86a2-c7581cb3dd55\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:58:37.604537 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:37.604130    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-59gtn\" (UniqueName: \"kubernetes.io/projected/de7f0012-384a-4b06-86a2-c7581cb3dd55-kube-api-access-59gtn\") pod \"data-science-collector-collector-0\" (UID: \"de7f0012-384a-4b06-86a2-c7581cb3dd55\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:58:37.604537 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:37.604176    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/de7f0012-384a-4b06-86a2-c7581cb3dd55-monitoring-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"de7f0012-384a-4b06-86a2-c7581cb3dd55\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:58:37.604537 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:37.604191    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/de7f0012-384a-4b06-86a2-c7581cb3dd55-otlp-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"de7f0012-384a-4b06-86a2-c7581cb3dd55\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:58:37.604537 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:37.604261    4060 reconciler_common.go:299] "Volume detached for volume \"tls\" (UniqueName: \"kubernetes.io/secret/e371e621-9e3b-461c-8505-968f6631d1fe-tls\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:58:37.604537 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:37.604279    4060 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tnh2g\" (UniqueName: \"kubernetes.io/projected/e371e621-9e3b-461c-8505-968f6631d1fe-kube-api-access-tnh2g\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:58:37.604837 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:37.604687    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/de7f0012-384a-4b06-86a2-c7581cb3dd55-otc-internal\") pod \"data-science-collector-collector-0\" (UID: \"de7f0012-384a-4b06-86a2-c7581cb3dd55\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:58:37.606557 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:37.606535    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/de7f0012-384a-4b06-86a2-c7581cb3dd55-otlp-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"de7f0012-384a-4b06-86a2-c7581cb3dd55\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:58:37.606654 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:37.606560    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/de7f0012-384a-4b06-86a2-c7581cb3dd55-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-0\" (UID: \"de7f0012-384a-4b06-86a2-c7581cb3dd55\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:58:37.606756 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:37.606740    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/de7f0012-384a-4b06-86a2-c7581cb3dd55-monitoring-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"de7f0012-384a-4b06-86a2-c7581cb3dd55\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:58:37.606795 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:37.606784    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/de7f0012-384a-4b06-86a2-c7581cb3dd55-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"de7f0012-384a-4b06-86a2-c7581cb3dd55\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:58:37.665365 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:37.665337    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-59gtn\" (UniqueName: \"kubernetes.io/projected/de7f0012-384a-4b06-86a2-c7581cb3dd55-kube-api-access-59gtn\") pod \"data-science-collector-collector-0\" (UID: \"de7f0012-384a-4b06-86a2-c7581cb3dd55\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:58:37.707126 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:37.707102    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:58:38.080417 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:38.080306    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 20:58:38.082466 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:58:38.082437    4060 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde7f0012_384a_4b06_86a2_c7581cb3dd55.slice/crio-11232f0e9e7e21bf278eaeba69d56b621e209f5fac31f3cdd3d025f81c394691 WatchSource:0}: Error finding container 11232f0e9e7e21bf278eaeba69d56b621e209f5fac31f3cdd3d025f81c394691: Status 404 returned error can't find the container with id 11232f0e9e7e21bf278eaeba69d56b621e209f5fac31f3cdd3d025f81c394691
Oct 30 20:58:38.084796 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:38.084762    4060 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 20:58:38.084892 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:38.084824    4060 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 20:58:38.135377 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:38.135354    4060 generic.go:356] "Generic (PLEG): container finished" podID="e371e621-9e3b-461c-8505-968f6631d1fe" containerID="62deece3175b49cff145edcb58399e1a6c9a80b40d2f49e7cd08ad59604f76e3" exitCode=0
Oct 30 20:58:38.135516 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:38.135436    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/korrel8r-66d6f7f696-48lsj"
Oct 30 20:58:38.135516 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:38.135440    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/korrel8r-66d6f7f696-48lsj" event={"ID":"e371e621-9e3b-461c-8505-968f6631d1fe","Type":"ContainerDied","Data":"62deece3175b49cff145edcb58399e1a6c9a80b40d2f49e7cd08ad59604f76e3"}
Oct 30 20:58:38.135516 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:38.135487    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/korrel8r-66d6f7f696-48lsj" event={"ID":"e371e621-9e3b-461c-8505-968f6631d1fe","Type":"ContainerDied","Data":"be506d1a21b9ee6ca4800dd1f58a91eb9848b7eb9f9b584670f9b2e76a705673"}
Oct 30 20:58:38.135674 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:38.135530    4060 scope.go:122] "RemoveContainer" containerID="62deece3175b49cff145edcb58399e1a6c9a80b40d2f49e7cd08ad59604f76e3"
Oct 30 20:58:38.137151 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:38.137132    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"de7f0012-384a-4b06-86a2-c7581cb3dd55","Type":"ContainerStarted","Data":"11232f0e9e7e21bf278eaeba69d56b621e209f5fac31f3cdd3d025f81c394691"}
Oct 30 20:58:38.144980 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:38.144965    4060 scope.go:122] "RemoveContainer" containerID="62deece3175b49cff145edcb58399e1a6c9a80b40d2f49e7cd08ad59604f76e3"
Oct 30 20:58:38.145282 ip-10-0-142-4 kubenswrapper[4060]: E1030 20:58:38.145265    4060 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"62deece3175b49cff145edcb58399e1a6c9a80b40d2f49e7cd08ad59604f76e3\": container with ID starting with 62deece3175b49cff145edcb58399e1a6c9a80b40d2f49e7cd08ad59604f76e3 not found: ID does not exist" containerID="62deece3175b49cff145edcb58399e1a6c9a80b40d2f49e7cd08ad59604f76e3"
Oct 30 20:58:38.145349 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:38.145291    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"62deece3175b49cff145edcb58399e1a6c9a80b40d2f49e7cd08ad59604f76e3"} err="failed to get container status \"62deece3175b49cff145edcb58399e1a6c9a80b40d2f49e7cd08ad59604f76e3\": rpc error: code = NotFound desc = could not find container \"62deece3175b49cff145edcb58399e1a6c9a80b40d2f49e7cd08ad59604f76e3\": container with ID starting with 62deece3175b49cff145edcb58399e1a6c9a80b40d2f49e7cd08ad59604f76e3 not found: ID does not exist"
Oct 30 20:58:38.298272 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:38.298237    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/korrel8r-66d6f7f696-48lsj"]
Oct 30 20:58:38.302677 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:38.302653    4060 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/korrel8r-66d6f7f696-48lsj"]
Oct 30 20:58:39.145775 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:39.145742    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"de7f0012-384a-4b06-86a2-c7581cb3dd55","Type":"ContainerStarted","Data":"22c5c884faa4cd9b82f39e111074e3b82dc9b167c0e7737927f42b1dd223d475"}
Oct 30 20:58:39.265295 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:39.265235    4060 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-collector-0" podStartSLOduration=2.265218212 podStartE2EDuration="2.265218212s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:58:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:58:39.263446576 +0000 UTC m=+1338.020444885" watchObservedRunningTime="2026-10-30 20:58:39.265218212 +0000 UTC m=+1338.022216510"
Oct 30 20:58:39.426800 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:39.426724    4060 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="e371e621-9e3b-461c-8505-968f6631d1fe" path="/var/lib/kubelet/pods/e371e621-9e3b-461c-8505-968f6631d1fe/volumes"
Oct 30 20:58:42.150449 ip-10-0-142-4 kubenswrapper[4060]: E1030 20:58:42.150404    4060 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v2f4x" containerName="extractor"
Oct 30 20:58:45.178540 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:45.178442    4060 generic.go:356] "Generic (PLEG): container finished" podID="cc6aeef9-afb1-4052-91eb-76d3d3a3427a" containerID="4bb24a3af92c97102b47314019e0a5683c03e153ecf04972d55c9910b9db0cf4" exitCode=137
Oct 30 20:58:45.178540 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:45.178515    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-observability-system/odh-observability-6f5479fd64-7gfbz" event={"ID":"cc6aeef9-afb1-4052-91eb-76d3d3a3427a","Type":"ContainerDied","Data":"4bb24a3af92c97102b47314019e0a5683c03e153ecf04972d55c9910b9db0cf4"}
Oct 30 20:58:45.179030 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:45.178572    4060 scope.go:122] "RemoveContainer" containerID="c78ecfa1e03cb7bc96c931f72fb494c48214ec5d6580bf4c4d29cfe4d61fbb6f"
Oct 30 20:58:45.179030 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:45.178913    4060 scope.go:122] "RemoveContainer" containerID="4bb24a3af92c97102b47314019e0a5683c03e153ecf04972d55c9910b9db0cf4"
Oct 30 20:58:45.179166 ip-10-0-142-4 kubenswrapper[4060]: E1030 20:58:45.179148    4060 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=odh-observability-6f5479fd64-7gfbz_odh-observability-system(cc6aeef9-afb1-4052-91eb-76d3d3a3427a)\"" pod="odh-observability-system/odh-observability-6f5479fd64-7gfbz" podUID="cc6aeef9-afb1-4052-91eb-76d3d3a3427a"
Oct 30 20:58:49.794293 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:49.794243    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-observability-system/odh-observability-6f5479fd64-7gfbz"
Oct 30 20:58:49.794735 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:49.794642    4060 scope.go:122] "RemoveContainer" containerID="4bb24a3af92c97102b47314019e0a5683c03e153ecf04972d55c9910b9db0cf4"
Oct 30 20:58:49.794882 ip-10-0-142-4 kubenswrapper[4060]: E1030 20:58:49.794860    4060 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=odh-observability-6f5479fd64-7gfbz_odh-observability-system(cc6aeef9-afb1-4052-91eb-76d3d3a3427a)\"" pod="odh-observability-system/odh-observability-6f5479fd64-7gfbz" podUID="cc6aeef9-afb1-4052-91eb-76d3d3a3427a"
Oct 30 20:58:53.690086 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:53.690053    4060 kubelet.go:2727] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-observability-system/odh-observability-6f5479fd64-7gfbz"
Oct 30 20:58:53.690525 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:53.690466    4060 scope.go:122] "RemoveContainer" containerID="4bb24a3af92c97102b47314019e0a5683c03e153ecf04972d55c9910b9db0cf4"
Oct 30 20:58:53.690693 ip-10-0-142-4 kubenswrapper[4060]: E1030 20:58:53.690665    4060 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=odh-observability-6f5479fd64-7gfbz_odh-observability-system(cc6aeef9-afb1-4052-91eb-76d3d3a3427a)\"" pod="odh-observability-system/odh-observability-6f5479fd64-7gfbz" podUID="cc6aeef9-afb1-4052-91eb-76d3d3a3427a"
Oct 30 20:58:55.427399 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:55.427370    4060 scope.go:122] "RemoveContainer" containerID="4bb24a3af92c97102b47314019e0a5683c03e153ecf04972d55c9910b9db0cf4"
Oct 30 20:58:55.427811 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:55.427733    4060 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 20:58:57.240787 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:57.240754    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-observability-system/odh-observability-6f5479fd64-7gfbz" event={"ID":"cc6aeef9-afb1-4052-91eb-76d3d3a3427a","Type":"ContainerStarted","Data":"53d48b7a825de1df676d12cc8b8840e22d6ac7974c9768034b751fcb8c68ffef"}
Oct 30 20:58:57.241194 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:58:57.240991    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-observability-system/odh-observability-6f5479fd64-7gfbz"
Oct 30 20:59:08.247767 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:59:08.247733    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-observability-system/odh-observability-6f5479fd64-7gfbz"
Oct 30 20:59:12.151177 ip-10-0-142-4 kubenswrapper[4060]: E1030 20:59:12.151141    4060 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v2f4x" containerName="extractor"
Oct 30 20:59:18.228614 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:59:18.228578    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 20:59:18.229219 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:59:18.228829    4060 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-collector-0" podUID="de7f0012-384a-4b06-86a2-c7581cb3dd55" containerName="otc-container" containerID="cri-o://22c5c884faa4cd9b82f39e111074e3b82dc9b167c0e7737927f42b1dd223d475" gracePeriod=30
Oct 30 20:59:20.573521 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:59:20.573476    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:59:20.577485 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:59:20.577453    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/de7f0012-384a-4b06-86a2-c7581cb3dd55-kube-api-access-59gtn\" (UniqueName: \"kubernetes.io/projected/de7f0012-384a-4b06-86a2-c7581cb3dd55-kube-api-access-59gtn\") pod \"de7f0012-384a-4b06-86a2-c7581cb3dd55\" (UID: \"de7f0012-384a-4b06-86a2-c7581cb3dd55\") "
Oct 30 20:59:20.577585 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:59:20.577541    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/de7f0012-384a-4b06-86a2-c7581cb3dd55-otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/de7f0012-384a-4b06-86a2-c7581cb3dd55-otlp-tls-certs\") pod \"de7f0012-384a-4b06-86a2-c7581cb3dd55\" (UID: \"de7f0012-384a-4b06-86a2-c7581cb3dd55\") "
Oct 30 20:59:20.577661 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:59:20.577641    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/de7f0012-384a-4b06-86a2-c7581cb3dd55-otc-internal\" (UniqueName: \"kubernetes.io/configmap/de7f0012-384a-4b06-86a2-c7581cb3dd55-otc-internal\") pod \"de7f0012-384a-4b06-86a2-c7581cb3dd55\" (UID: \"de7f0012-384a-4b06-86a2-c7581cb3dd55\") "
Oct 30 20:59:20.577697 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:59:20.577676    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/de7f0012-384a-4b06-86a2-c7581cb3dd55-tls-certs\" (UniqueName: \"kubernetes.io/secret/de7f0012-384a-4b06-86a2-c7581cb3dd55-tls-certs\") pod \"de7f0012-384a-4b06-86a2-c7581cb3dd55\" (UID: \"de7f0012-384a-4b06-86a2-c7581cb3dd55\") "
Oct 30 20:59:20.577783 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:59:20.577766    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/de7f0012-384a-4b06-86a2-c7581cb3dd55-monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/de7f0012-384a-4b06-86a2-c7581cb3dd55-monitoring-tls-certs\") pod \"de7f0012-384a-4b06-86a2-c7581cb3dd55\" (UID: \"de7f0012-384a-4b06-86a2-c7581cb3dd55\") "
Oct 30 20:59:20.577826 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:59:20.577804    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/de7f0012-384a-4b06-86a2-c7581cb3dd55-data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/de7f0012-384a-4b06-86a2-c7581cb3dd55-data-science-collector-ta-client-cert\") pod \"de7f0012-384a-4b06-86a2-c7581cb3dd55\" (UID: \"de7f0012-384a-4b06-86a2-c7581cb3dd55\") "
Oct 30 20:59:20.578052 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:59:20.578006    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/de7f0012-384a-4b06-86a2-c7581cb3dd55-otc-internal" pod "de7f0012-384a-4b06-86a2-c7581cb3dd55" (UID: "de7f0012-384a-4b06-86a2-c7581cb3dd55"). InnerVolumeSpecName "otc-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:59:20.578189 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:59:20.578109    4060 reconciler_common.go:299] "Volume detached for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/de7f0012-384a-4b06-86a2-c7581cb3dd55-otc-internal\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:59:20.580061 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:59:20.580000    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/de7f0012-384a-4b06-86a2-c7581cb3dd55-data-science-collector-ta-client-cert" pod "de7f0012-384a-4b06-86a2-c7581cb3dd55" (UID: "de7f0012-384a-4b06-86a2-c7581cb3dd55"). InnerVolumeSpecName "data-science-collector-ta-client-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:59:20.580174 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:59:20.580110    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/de7f0012-384a-4b06-86a2-c7581cb3dd55-kube-api-access-59gtn" pod "de7f0012-384a-4b06-86a2-c7581cb3dd55" (UID: "de7f0012-384a-4b06-86a2-c7581cb3dd55"). InnerVolumeSpecName "kube-api-access-59gtn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:59:20.580242 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:59:20.580174    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/de7f0012-384a-4b06-86a2-c7581cb3dd55-otlp-tls-certs" pod "de7f0012-384a-4b06-86a2-c7581cb3dd55" (UID: "de7f0012-384a-4b06-86a2-c7581cb3dd55"). InnerVolumeSpecName "otlp-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:59:20.580242 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:59:20.580169    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/de7f0012-384a-4b06-86a2-c7581cb3dd55-tls-certs" pod "de7f0012-384a-4b06-86a2-c7581cb3dd55" (UID: "de7f0012-384a-4b06-86a2-c7581cb3dd55"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:59:20.580242 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:59:20.580227    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/de7f0012-384a-4b06-86a2-c7581cb3dd55-monitoring-tls-certs" pod "de7f0012-384a-4b06-86a2-c7581cb3dd55" (UID: "de7f0012-384a-4b06-86a2-c7581cb3dd55"). InnerVolumeSpecName "monitoring-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:59:20.679359 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:59:20.679275    4060 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-59gtn\" (UniqueName: \"kubernetes.io/projected/de7f0012-384a-4b06-86a2-c7581cb3dd55-kube-api-access-59gtn\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:59:20.679359 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:59:20.679307    4060 reconciler_common.go:299] "Volume detached for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/de7f0012-384a-4b06-86a2-c7581cb3dd55-otlp-tls-certs\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:59:20.679359 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:59:20.679317    4060 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/de7f0012-384a-4b06-86a2-c7581cb3dd55-tls-certs\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:59:20.679359 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:59:20.679325    4060 reconciler_common.go:299] "Volume detached for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/de7f0012-384a-4b06-86a2-c7581cb3dd55-monitoring-tls-certs\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:59:20.679359 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:59:20.679334    4060 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/de7f0012-384a-4b06-86a2-c7581cb3dd55-data-science-collector-ta-client-cert\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:59:21.358646 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:59:21.358606    4060 generic.go:356] "Generic (PLEG): container finished" podID="de7f0012-384a-4b06-86a2-c7581cb3dd55" containerID="22c5c884faa4cd9b82f39e111074e3b82dc9b167c0e7737927f42b1dd223d475" exitCode=0
Oct 30 20:59:21.358822 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:59:21.358676    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:59:21.358822 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:59:21.358687    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"de7f0012-384a-4b06-86a2-c7581cb3dd55","Type":"ContainerDied","Data":"22c5c884faa4cd9b82f39e111074e3b82dc9b167c0e7737927f42b1dd223d475"}
Oct 30 20:59:21.358822 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:59:21.358771    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"de7f0012-384a-4b06-86a2-c7581cb3dd55","Type":"ContainerDied","Data":"11232f0e9e7e21bf278eaeba69d56b621e209f5fac31f3cdd3d025f81c394691"}
Oct 30 20:59:21.358822 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:59:21.358794    4060 scope.go:122] "RemoveContainer" containerID="22c5c884faa4cd9b82f39e111074e3b82dc9b167c0e7737927f42b1dd223d475"
Oct 30 20:59:21.368478 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:59:21.368460    4060 scope.go:122] "RemoveContainer" containerID="22c5c884faa4cd9b82f39e111074e3b82dc9b167c0e7737927f42b1dd223d475"
Oct 30 20:59:21.368787 ip-10-0-142-4 kubenswrapper[4060]: E1030 20:59:21.368767    4060 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"22c5c884faa4cd9b82f39e111074e3b82dc9b167c0e7737927f42b1dd223d475\": container with ID starting with 22c5c884faa4cd9b82f39e111074e3b82dc9b167c0e7737927f42b1dd223d475 not found: ID does not exist" containerID="22c5c884faa4cd9b82f39e111074e3b82dc9b167c0e7737927f42b1dd223d475"
Oct 30 20:59:21.368837 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:59:21.368796    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"22c5c884faa4cd9b82f39e111074e3b82dc9b167c0e7737927f42b1dd223d475"} err="failed to get container status \"22c5c884faa4cd9b82f39e111074e3b82dc9b167c0e7737927f42b1dd223d475\": rpc error: code = NotFound desc = could not find container \"22c5c884faa4cd9b82f39e111074e3b82dc9b167c0e7737927f42b1dd223d475\": container with ID starting with 22c5c884faa4cd9b82f39e111074e3b82dc9b167c0e7737927f42b1dd223d475 not found: ID does not exist"
Oct 30 20:59:21.522789 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:59:21.522755    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 20:59:21.571937 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:59:21.571908    4060 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 20:59:21.604337 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:59:21.604306    4060 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 20:59:21.604710 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:59:21.604621    4060 cpu_manager.go:414] "containerMap: removing container" podUID="de7f0012-384a-4b06-86a2-c7581cb3dd55" containerName="otc-container"
Oct 30 20:59:21.604710 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:59:21.604633    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="de7f0012-384a-4b06-86a2-c7581cb3dd55" containerName="otc-container"
Oct 30 20:59:21.604710 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:59:21.604652    4060 cpu_manager.go:414] "containerMap: removing container" podUID="e371e621-9e3b-461c-8505-968f6631d1fe" containerName="korrel8r"
Oct 30 20:59:21.604710 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:59:21.604658    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e371e621-9e3b-461c-8505-968f6631d1fe" containerName="korrel8r"
Oct 30 20:59:21.604890 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:59:21.604732    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="de7f0012-384a-4b06-86a2-c7581cb3dd55" containerName="otc-container"
Oct 30 20:59:21.604890 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:59:21.604742    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="e371e621-9e3b-461c-8505-968f6631d1fe" containerName="korrel8r"
Oct 30 20:59:21.609009 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:59:21.608964    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:59:21.661805 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:59:21.661780    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-770491e3\""
Oct 30 20:59:21.661911 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:59:21.661856    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-tls\""
Oct 30 20:59:21.661987 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:59:21.661962    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-headless-tls\""
Oct 30 20:59:21.662105 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:59:21.662063    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-monitoring-tls\""
Oct 30 20:59:21.662175 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:59:21.662106    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-ta-client-cert\""
Oct 30 20:59:21.662175 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:59:21.662149    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-dockercfg-jqj7h\""
Oct 30 20:59:21.688078 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:59:21.688047    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/58e81691-da6f-4423-b1ba-1ee33f40f650-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"58e81691-da6f-4423-b1ba-1ee33f40f650\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:59:21.688078 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:59:21.688088    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/58e81691-da6f-4423-b1ba-1ee33f40f650-otlp-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"58e81691-da6f-4423-b1ba-1ee33f40f650\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:59:21.688285 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:59:21.688227    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/58e81691-da6f-4423-b1ba-1ee33f40f650-monitoring-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"58e81691-da6f-4423-b1ba-1ee33f40f650\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:59:21.688285 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:59:21.688264    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/58e81691-da6f-4423-b1ba-1ee33f40f650-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-0\" (UID: \"58e81691-da6f-4423-b1ba-1ee33f40f650\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:59:21.688285 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:59:21.688283    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tcswz\" (UniqueName: \"kubernetes.io/projected/58e81691-da6f-4423-b1ba-1ee33f40f650-kube-api-access-tcswz\") pod \"data-science-collector-collector-0\" (UID: \"58e81691-da6f-4423-b1ba-1ee33f40f650\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:59:21.688413 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:59:21.688351    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/58e81691-da6f-4423-b1ba-1ee33f40f650-otc-internal\") pod \"data-science-collector-collector-0\" (UID: \"58e81691-da6f-4423-b1ba-1ee33f40f650\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:59:21.712541 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:59:21.712510    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 20:59:21.788926 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:59:21.788886    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/58e81691-da6f-4423-b1ba-1ee33f40f650-monitoring-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"58e81691-da6f-4423-b1ba-1ee33f40f650\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:59:21.788926 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:59:21.788933    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/58e81691-da6f-4423-b1ba-1ee33f40f650-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-0\" (UID: \"58e81691-da6f-4423-b1ba-1ee33f40f650\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:59:21.789145 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:59:21.788952    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tcswz\" (UniqueName: \"kubernetes.io/projected/58e81691-da6f-4423-b1ba-1ee33f40f650-kube-api-access-tcswz\") pod \"data-science-collector-collector-0\" (UID: \"58e81691-da6f-4423-b1ba-1ee33f40f650\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:59:21.789145 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:59:21.789073    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/58e81691-da6f-4423-b1ba-1ee33f40f650-otc-internal\") pod \"data-science-collector-collector-0\" (UID: \"58e81691-da6f-4423-b1ba-1ee33f40f650\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:59:21.789145 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:59:21.789135    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/58e81691-da6f-4423-b1ba-1ee33f40f650-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"58e81691-da6f-4423-b1ba-1ee33f40f650\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:59:21.789269 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:59:21.789161    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/58e81691-da6f-4423-b1ba-1ee33f40f650-otlp-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"58e81691-da6f-4423-b1ba-1ee33f40f650\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:59:21.789819 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:59:21.789790    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/58e81691-da6f-4423-b1ba-1ee33f40f650-otc-internal\") pod \"data-science-collector-collector-0\" (UID: \"58e81691-da6f-4423-b1ba-1ee33f40f650\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:59:21.791623 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:59:21.791602    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/58e81691-da6f-4423-b1ba-1ee33f40f650-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"58e81691-da6f-4423-b1ba-1ee33f40f650\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:59:21.791730 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:59:21.791695    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/58e81691-da6f-4423-b1ba-1ee33f40f650-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-0\" (UID: \"58e81691-da6f-4423-b1ba-1ee33f40f650\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:59:21.791973 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:59:21.791953    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/58e81691-da6f-4423-b1ba-1ee33f40f650-otlp-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"58e81691-da6f-4423-b1ba-1ee33f40f650\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:59:21.792017 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:59:21.791957    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/58e81691-da6f-4423-b1ba-1ee33f40f650-monitoring-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"58e81691-da6f-4423-b1ba-1ee33f40f650\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:59:21.850177 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:59:21.850135    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tcswz\" (UniqueName: \"kubernetes.io/projected/58e81691-da6f-4423-b1ba-1ee33f40f650-kube-api-access-tcswz\") pod \"data-science-collector-collector-0\" (UID: \"58e81691-da6f-4423-b1ba-1ee33f40f650\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:59:21.922657 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:59:21.922576    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:59:22.296978 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:59:22.296954    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 20:59:22.299388 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:59:22.299366    4060 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58e81691_da6f_4423_b1ba_1ee33f40f650.slice/crio-9ea1b18ea3b22d3f944749e3e35db6ca8d817775705b421292a6060c956ba11c WatchSource:0}: Error finding container 9ea1b18ea3b22d3f944749e3e35db6ca8d817775705b421292a6060c956ba11c: Status 404 returned error can't find the container with id 9ea1b18ea3b22d3f944749e3e35db6ca8d817775705b421292a6060c956ba11c
Oct 30 20:59:22.301648 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:59:22.301614    4060 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 20:59:22.301748 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:59:22.301690    4060 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 20:59:22.366528 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:59:22.366475    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"58e81691-da6f-4423-b1ba-1ee33f40f650","Type":"ContainerStarted","Data":"2270ac8b2d97577e464188733488255fc803b937bdddbd2133c31858c42fed05"}
Oct 30 20:59:22.366686 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:59:22.366552    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"58e81691-da6f-4423-b1ba-1ee33f40f650","Type":"ContainerStarted","Data":"9ea1b18ea3b22d3f944749e3e35db6ca8d817775705b421292a6060c956ba11c"}
Oct 30 20:59:22.484937 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:59:22.484874    4060 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-collector-0" podStartSLOduration=1.484855611 podStartE2EDuration="1.484855611s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:59:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:59:22.484057639 +0000 UTC m=+1381.241055936" watchObservedRunningTime="2026-10-30 20:59:22.484855611 +0000 UTC m=+1381.241853909"
Oct 30 20:59:23.426937 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:59:23.426896    4060 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="de7f0012-384a-4b06-86a2-c7581cb3dd55" path="/var/lib/kubelet/pods/de7f0012-384a-4b06-86a2-c7581cb3dd55/volumes"
Oct 30 20:59:42.150469 ip-10-0-142-4 kubenswrapper[4060]: E1030 20:59:42.150394    4060 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v2f4x" containerName="extractor"
Oct 30 20:59:48.403940 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:59:48.403901    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 20:59:48.404348 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:59:48.404164    4060 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-collector-0" podUID="58e81691-da6f-4423-b1ba-1ee33f40f650" containerName="otc-container" containerID="cri-o://2270ac8b2d97577e464188733488255fc803b937bdddbd2133c31858c42fed05" gracePeriod=30
Oct 30 20:59:50.751347 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:59:50.751323    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:59:50.828060 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:59:50.827973    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/58e81691-da6f-4423-b1ba-1ee33f40f650-data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/58e81691-da6f-4423-b1ba-1ee33f40f650-data-science-collector-ta-client-cert\") pod \"58e81691-da6f-4423-b1ba-1ee33f40f650\" (UID: \"58e81691-da6f-4423-b1ba-1ee33f40f650\") "
Oct 30 20:59:50.828060 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:59:50.828028    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/58e81691-da6f-4423-b1ba-1ee33f40f650-otc-internal\" (UniqueName: \"kubernetes.io/configmap/58e81691-da6f-4423-b1ba-1ee33f40f650-otc-internal\") pod \"58e81691-da6f-4423-b1ba-1ee33f40f650\" (UID: \"58e81691-da6f-4423-b1ba-1ee33f40f650\") "
Oct 30 20:59:50.828288 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:59:50.828087    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/58e81691-da6f-4423-b1ba-1ee33f40f650-otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/58e81691-da6f-4423-b1ba-1ee33f40f650-otlp-tls-certs\") pod \"58e81691-da6f-4423-b1ba-1ee33f40f650\" (UID: \"58e81691-da6f-4423-b1ba-1ee33f40f650\") "
Oct 30 20:59:50.828288 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:59:50.828125    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/58e81691-da6f-4423-b1ba-1ee33f40f650-monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/58e81691-da6f-4423-b1ba-1ee33f40f650-monitoring-tls-certs\") pod \"58e81691-da6f-4423-b1ba-1ee33f40f650\" (UID: \"58e81691-da6f-4423-b1ba-1ee33f40f650\") "
Oct 30 20:59:50.828288 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:59:50.828179    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/58e81691-da6f-4423-b1ba-1ee33f40f650-kube-api-access-tcswz\" (UniqueName: \"kubernetes.io/projected/58e81691-da6f-4423-b1ba-1ee33f40f650-kube-api-access-tcswz\") pod \"58e81691-da6f-4423-b1ba-1ee33f40f650\" (UID: \"58e81691-da6f-4423-b1ba-1ee33f40f650\") "
Oct 30 20:59:50.828288 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:59:50.828226    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/58e81691-da6f-4423-b1ba-1ee33f40f650-tls-certs\" (UniqueName: \"kubernetes.io/secret/58e81691-da6f-4423-b1ba-1ee33f40f650-tls-certs\") pod \"58e81691-da6f-4423-b1ba-1ee33f40f650\" (UID: \"58e81691-da6f-4423-b1ba-1ee33f40f650\") "
Oct 30 20:59:50.828488 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:59:50.828396    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/58e81691-da6f-4423-b1ba-1ee33f40f650-otc-internal" pod "58e81691-da6f-4423-b1ba-1ee33f40f650" (UID: "58e81691-da6f-4423-b1ba-1ee33f40f650"). InnerVolumeSpecName "otc-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:59:50.828488 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:59:50.828467    4060 reconciler_common.go:299] "Volume detached for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/58e81691-da6f-4423-b1ba-1ee33f40f650-otc-internal\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:59:50.830283 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:59:50.830253    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/58e81691-da6f-4423-b1ba-1ee33f40f650-kube-api-access-tcswz" pod "58e81691-da6f-4423-b1ba-1ee33f40f650" (UID: "58e81691-da6f-4423-b1ba-1ee33f40f650"). InnerVolumeSpecName "kube-api-access-tcswz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:59:50.830675 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:59:50.830656    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/58e81691-da6f-4423-b1ba-1ee33f40f650-otlp-tls-certs" pod "58e81691-da6f-4423-b1ba-1ee33f40f650" (UID: "58e81691-da6f-4423-b1ba-1ee33f40f650"). InnerVolumeSpecName "otlp-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:59:50.830764 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:59:50.830690    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/58e81691-da6f-4423-b1ba-1ee33f40f650-tls-certs" pod "58e81691-da6f-4423-b1ba-1ee33f40f650" (UID: "58e81691-da6f-4423-b1ba-1ee33f40f650"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:59:50.830805 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:59:50.830768    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/58e81691-da6f-4423-b1ba-1ee33f40f650-monitoring-tls-certs" pod "58e81691-da6f-4423-b1ba-1ee33f40f650" (UID: "58e81691-da6f-4423-b1ba-1ee33f40f650"). InnerVolumeSpecName "monitoring-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:59:50.830805 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:59:50.830778    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/58e81691-da6f-4423-b1ba-1ee33f40f650-data-science-collector-ta-client-cert" pod "58e81691-da6f-4423-b1ba-1ee33f40f650" (UID: "58e81691-da6f-4423-b1ba-1ee33f40f650"). InnerVolumeSpecName "data-science-collector-ta-client-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:59:50.929856 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:59:50.929826    4060 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/58e81691-da6f-4423-b1ba-1ee33f40f650-data-science-collector-ta-client-cert\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:59:50.929856 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:59:50.929854    4060 reconciler_common.go:299] "Volume detached for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/58e81691-da6f-4423-b1ba-1ee33f40f650-otlp-tls-certs\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:59:50.929856 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:59:50.929864    4060 reconciler_common.go:299] "Volume detached for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/58e81691-da6f-4423-b1ba-1ee33f40f650-monitoring-tls-certs\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:59:50.930083 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:59:50.929873    4060 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tcswz\" (UniqueName: \"kubernetes.io/projected/58e81691-da6f-4423-b1ba-1ee33f40f650-kube-api-access-tcswz\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:59:50.930083 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:59:50.929884    4060 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/58e81691-da6f-4423-b1ba-1ee33f40f650-tls-certs\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:59:51.495570 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:59:51.495537    4060 generic.go:356] "Generic (PLEG): container finished" podID="58e81691-da6f-4423-b1ba-1ee33f40f650" containerID="2270ac8b2d97577e464188733488255fc803b937bdddbd2133c31858c42fed05" exitCode=0
Oct 30 20:59:51.495766 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:59:51.495598    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:59:51.495766 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:59:51.495614    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"58e81691-da6f-4423-b1ba-1ee33f40f650","Type":"ContainerDied","Data":"2270ac8b2d97577e464188733488255fc803b937bdddbd2133c31858c42fed05"}
Oct 30 20:59:51.495766 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:59:51.495656    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"58e81691-da6f-4423-b1ba-1ee33f40f650","Type":"ContainerDied","Data":"9ea1b18ea3b22d3f944749e3e35db6ca8d817775705b421292a6060c956ba11c"}
Oct 30 20:59:51.495766 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:59:51.495677    4060 scope.go:122] "RemoveContainer" containerID="2270ac8b2d97577e464188733488255fc803b937bdddbd2133c31858c42fed05"
Oct 30 20:59:51.504148 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:59:51.504126    4060 scope.go:122] "RemoveContainer" containerID="2270ac8b2d97577e464188733488255fc803b937bdddbd2133c31858c42fed05"
Oct 30 20:59:51.504438 ip-10-0-142-4 kubenswrapper[4060]: E1030 20:59:51.504416    4060 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2270ac8b2d97577e464188733488255fc803b937bdddbd2133c31858c42fed05\": container with ID starting with 2270ac8b2d97577e464188733488255fc803b937bdddbd2133c31858c42fed05 not found: ID does not exist" containerID="2270ac8b2d97577e464188733488255fc803b937bdddbd2133c31858c42fed05"
Oct 30 20:59:51.504523 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:59:51.504446    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2270ac8b2d97577e464188733488255fc803b937bdddbd2133c31858c42fed05"} err="failed to get container status \"2270ac8b2d97577e464188733488255fc803b937bdddbd2133c31858c42fed05\": rpc error: code = NotFound desc = could not find container \"2270ac8b2d97577e464188733488255fc803b937bdddbd2133c31858c42fed05\": container with ID starting with 2270ac8b2d97577e464188733488255fc803b937bdddbd2133c31858c42fed05 not found: ID does not exist"
Oct 30 20:59:51.659835 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:59:51.659800    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 20:59:51.709080 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:59:51.709051    4060 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 20:59:51.740656 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:59:51.740628    4060 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 20:59:51.740953 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:59:51.740941    4060 cpu_manager.go:414] "containerMap: removing container" podUID="58e81691-da6f-4423-b1ba-1ee33f40f650" containerName="otc-container"
Oct 30 20:59:51.740995 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:59:51.740954    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="58e81691-da6f-4423-b1ba-1ee33f40f650" containerName="otc-container"
Oct 30 20:59:51.741030 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:59:51.741013    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="58e81691-da6f-4423-b1ba-1ee33f40f650" containerName="otc-container"
Oct 30 20:59:51.745402 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:59:51.745378    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:59:51.798625 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:59:51.798582    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-dockercfg-jqj7h\""
Oct 30 20:59:51.798625 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:59:51.798601    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-monitoring-tls\""
Oct 30 20:59:51.799152 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:59:51.798639    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-tls\""
Oct 30 20:59:51.799152 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:59:51.798669    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-headless-tls\""
Oct 30 20:59:51.799152 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:59:51.798758    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-ta-client-cert\""
Oct 30 20:59:51.799983 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:59:51.799964    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-a0f9182a\""
Oct 30 20:59:51.805996 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:59:51.805969    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 20:59:51.838100 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:59:51.838072    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/32f3cc91-3ae2-40c0-87ae-53c032c3ed54-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-0\" (UID: \"32f3cc91-3ae2-40c0-87ae-53c032c3ed54\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:59:51.838100 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:59:51.838099    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/32f3cc91-3ae2-40c0-87ae-53c032c3ed54-otlp-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"32f3cc91-3ae2-40c0-87ae-53c032c3ed54\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:59:51.838294 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:59:51.838145    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/32f3cc91-3ae2-40c0-87ae-53c032c3ed54-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"32f3cc91-3ae2-40c0-87ae-53c032c3ed54\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:59:51.838294 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:59:51.838270    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/32f3cc91-3ae2-40c0-87ae-53c032c3ed54-monitoring-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"32f3cc91-3ae2-40c0-87ae-53c032c3ed54\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:59:51.838377 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:59:51.838298    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c8f49\" (UniqueName: \"kubernetes.io/projected/32f3cc91-3ae2-40c0-87ae-53c032c3ed54-kube-api-access-c8f49\") pod \"data-science-collector-collector-0\" (UID: \"32f3cc91-3ae2-40c0-87ae-53c032c3ed54\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:59:51.838377 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:59:51.838339    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/32f3cc91-3ae2-40c0-87ae-53c032c3ed54-otc-internal\") pod \"data-science-collector-collector-0\" (UID: \"32f3cc91-3ae2-40c0-87ae-53c032c3ed54\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:59:51.938768 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:59:51.938735    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/32f3cc91-3ae2-40c0-87ae-53c032c3ed54-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-0\" (UID: \"32f3cc91-3ae2-40c0-87ae-53c032c3ed54\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:59:51.938768 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:59:51.938765    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/32f3cc91-3ae2-40c0-87ae-53c032c3ed54-otlp-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"32f3cc91-3ae2-40c0-87ae-53c032c3ed54\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:59:51.939027 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:59:51.938808    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/32f3cc91-3ae2-40c0-87ae-53c032c3ed54-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"32f3cc91-3ae2-40c0-87ae-53c032c3ed54\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:59:51.939027 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:59:51.938828    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/32f3cc91-3ae2-40c0-87ae-53c032c3ed54-monitoring-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"32f3cc91-3ae2-40c0-87ae-53c032c3ed54\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:59:51.939027 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:59:51.938849    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c8f49\" (UniqueName: \"kubernetes.io/projected/32f3cc91-3ae2-40c0-87ae-53c032c3ed54-kube-api-access-c8f49\") pod \"data-science-collector-collector-0\" (UID: \"32f3cc91-3ae2-40c0-87ae-53c032c3ed54\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:59:51.939027 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:59:51.939000    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/32f3cc91-3ae2-40c0-87ae-53c032c3ed54-otc-internal\") pod \"data-science-collector-collector-0\" (UID: \"32f3cc91-3ae2-40c0-87ae-53c032c3ed54\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:59:51.939694 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:59:51.939666    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/32f3cc91-3ae2-40c0-87ae-53c032c3ed54-otc-internal\") pod \"data-science-collector-collector-0\" (UID: \"32f3cc91-3ae2-40c0-87ae-53c032c3ed54\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:59:51.941285 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:59:51.941257    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/32f3cc91-3ae2-40c0-87ae-53c032c3ed54-monitoring-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"32f3cc91-3ae2-40c0-87ae-53c032c3ed54\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:59:51.941379 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:59:51.941361    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/32f3cc91-3ae2-40c0-87ae-53c032c3ed54-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"32f3cc91-3ae2-40c0-87ae-53c032c3ed54\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:59:51.941646 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:59:51.941631    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/32f3cc91-3ae2-40c0-87ae-53c032c3ed54-otlp-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"32f3cc91-3ae2-40c0-87ae-53c032c3ed54\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:59:51.941646 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:59:51.941639    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/32f3cc91-3ae2-40c0-87ae-53c032c3ed54-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-0\" (UID: \"32f3cc91-3ae2-40c0-87ae-53c032c3ed54\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:59:51.999968 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:59:51.999901    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c8f49\" (UniqueName: \"kubernetes.io/projected/32f3cc91-3ae2-40c0-87ae-53c032c3ed54-kube-api-access-c8f49\") pod \"data-science-collector-collector-0\" (UID: \"32f3cc91-3ae2-40c0-87ae-53c032c3ed54\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:59:52.058875 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:59:52.058846    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 20:59:52.434043 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:59:52.434018    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 20:59:52.435882 ip-10-0-142-4 kubenswrapper[4060]: W1030 20:59:52.435854    4060 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32f3cc91_3ae2_40c0_87ae_53c032c3ed54.slice/crio-10facaa6a94fb4d202b129e1a5f4f102753b1bd77d2ca9226f207610361d11e2 WatchSource:0}: Error finding container 10facaa6a94fb4d202b129e1a5f4f102753b1bd77d2ca9226f207610361d11e2: Status 404 returned error can't find the container with id 10facaa6a94fb4d202b129e1a5f4f102753b1bd77d2ca9226f207610361d11e2
Oct 30 20:59:52.438006 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:59:52.437975    4060 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 20:59:52.438080 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:59:52.438033    4060 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 20:59:52.502730 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:59:52.502703    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"32f3cc91-3ae2-40c0-87ae-53c032c3ed54","Type":"ContainerStarted","Data":"a1265afbeb9f7ee8a46db9c75291718e9b0e1bfa27b29b4458636ac65cac0d17"}
Oct 30 20:59:52.502828 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:59:52.502763    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"32f3cc91-3ae2-40c0-87ae-53c032c3ed54","Type":"ContainerStarted","Data":"10facaa6a94fb4d202b129e1a5f4f102753b1bd77d2ca9226f207610361d11e2"}
Oct 30 20:59:52.620862 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:59:52.620815    4060 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-collector-0" podStartSLOduration=1.620799841 podStartE2EDuration="1.620799841s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:59:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:59:52.62052202 +0000 UTC m=+1411.377520310" watchObservedRunningTime="2026-10-30 20:59:52.620799841 +0000 UTC m=+1411.377798137"
Oct 30 20:59:53.432104 ip-10-0-142-4 kubenswrapper[4060]: I1030 20:59:53.432067    4060 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="58e81691-da6f-4423-b1ba-1ee33f40f650" path="/var/lib/kubelet/pods/58e81691-da6f-4423-b1ba-1ee33f40f650/volumes"
Oct 30 21:00:12.150595 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:00:12.150560    4060 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v2f4x" containerName="extractor"
Oct 30 21:00:12.429010 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:12.428934    4060 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/korrel8r-66d6f7f696-szm9c"]
Oct 30 21:00:12.432204 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:12.432187    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/korrel8r-66d6f7f696-szm9c"
Oct 30 21:00:12.492296 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:12.492262    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/korrel8r-66d6f7f696-szm9c"]
Oct 30 21:00:12.508417 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:12.508384    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/a073f6bb-592d-47b4-8ff0-bd99122fa385-tls\") pod \"korrel8r-66d6f7f696-szm9c\" (UID: \"a073f6bb-592d-47b4-8ff0-bd99122fa385\") " pod="redhat-ods-monitoring/korrel8r-66d6f7f696-szm9c"
Oct 30 21:00:12.508583 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:12.508454    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a073f6bb-592d-47b4-8ff0-bd99122fa385-config\") pod \"korrel8r-66d6f7f696-szm9c\" (UID: \"a073f6bb-592d-47b4-8ff0-bd99122fa385\") " pod="redhat-ods-monitoring/korrel8r-66d6f7f696-szm9c"
Oct 30 21:00:12.508583 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:12.508537    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-knnh4\" (UniqueName: \"kubernetes.io/projected/a073f6bb-592d-47b4-8ff0-bd99122fa385-kube-api-access-knnh4\") pod \"korrel8r-66d6f7f696-szm9c\" (UID: \"a073f6bb-592d-47b4-8ff0-bd99122fa385\") " pod="redhat-ods-monitoring/korrel8r-66d6f7f696-szm9c"
Oct 30 21:00:12.609648 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:12.609617    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-knnh4\" (UniqueName: \"kubernetes.io/projected/a073f6bb-592d-47b4-8ff0-bd99122fa385-kube-api-access-knnh4\") pod \"korrel8r-66d6f7f696-szm9c\" (UID: \"a073f6bb-592d-47b4-8ff0-bd99122fa385\") " pod="redhat-ods-monitoring/korrel8r-66d6f7f696-szm9c"
Oct 30 21:00:12.609839 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:12.609685    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/a073f6bb-592d-47b4-8ff0-bd99122fa385-tls\") pod \"korrel8r-66d6f7f696-szm9c\" (UID: \"a073f6bb-592d-47b4-8ff0-bd99122fa385\") " pod="redhat-ods-monitoring/korrel8r-66d6f7f696-szm9c"
Oct 30 21:00:12.609839 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:12.609722    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a073f6bb-592d-47b4-8ff0-bd99122fa385-config\") pod \"korrel8r-66d6f7f696-szm9c\" (UID: \"a073f6bb-592d-47b4-8ff0-bd99122fa385\") " pod="redhat-ods-monitoring/korrel8r-66d6f7f696-szm9c"
Oct 30 21:00:12.610480 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:12.610455    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a073f6bb-592d-47b4-8ff0-bd99122fa385-config\") pod \"korrel8r-66d6f7f696-szm9c\" (UID: \"a073f6bb-592d-47b4-8ff0-bd99122fa385\") " pod="redhat-ods-monitoring/korrel8r-66d6f7f696-szm9c"
Oct 30 21:00:12.612042 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:12.612018    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls\" (UniqueName: \"kubernetes.io/secret/a073f6bb-592d-47b4-8ff0-bd99122fa385-tls\") pod \"korrel8r-66d6f7f696-szm9c\" (UID: \"a073f6bb-592d-47b4-8ff0-bd99122fa385\") " pod="redhat-ods-monitoring/korrel8r-66d6f7f696-szm9c"
Oct 30 21:00:12.670815 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:12.670790    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-knnh4\" (UniqueName: \"kubernetes.io/projected/a073f6bb-592d-47b4-8ff0-bd99122fa385-kube-api-access-knnh4\") pod \"korrel8r-66d6f7f696-szm9c\" (UID: \"a073f6bb-592d-47b4-8ff0-bd99122fa385\") " pod="redhat-ods-monitoring/korrel8r-66d6f7f696-szm9c"
Oct 30 21:00:12.744116 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:12.744079    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/korrel8r-66d6f7f696-szm9c"
Oct 30 21:00:13.115462 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:13.115439    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/korrel8r-66d6f7f696-szm9c"]
Oct 30 21:00:13.117364 ip-10-0-142-4 kubenswrapper[4060]: W1030 21:00:13.117331    4060 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda073f6bb_592d_47b4_8ff0_bd99122fa385.slice/crio-9a9475c42619f8ebc35a1df4007f32de598490ee19ab8484c71840a8815c8581 WatchSource:0}: Error finding container 9a9475c42619f8ebc35a1df4007f32de598490ee19ab8484c71840a8815c8581: Status 404 returned error can't find the container with id 9a9475c42619f8ebc35a1df4007f32de598490ee19ab8484c71840a8815c8581
Oct 30 21:00:13.606349 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:13.606313    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/korrel8r-66d6f7f696-szm9c" event={"ID":"a073f6bb-592d-47b4-8ff0-bd99122fa385","Type":"ContainerStarted","Data":"43f03630a7c8ae7f576c328775b23e6f75b7a16d3a439635a0e4011ef9e19fd2"}
Oct 30 21:00:13.606782 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:13.606385    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/korrel8r-66d6f7f696-szm9c" event={"ID":"a073f6bb-592d-47b4-8ff0-bd99122fa385","Type":"ContainerStarted","Data":"9a9475c42619f8ebc35a1df4007f32de598490ee19ab8484c71840a8815c8581"}
Oct 30 21:00:13.606782 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:13.606475    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/korrel8r-66d6f7f696-szm9c"
Oct 30 21:00:13.722366 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:13.722316    4060 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/korrel8r-66d6f7f696-szm9c" podStartSLOduration=1.7223028889999998 podStartE2EDuration="1.722302889s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:00:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:00:13.72165349 +0000 UTC m=+1432.478651789" watchObservedRunningTime="2026-10-30 21:00:13.722302889 +0000 UTC m=+1432.479301232"
Oct 30 21:00:20.231356 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:20.231316    4060 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"]
Oct 30 21:00:20.235228 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:20.235205    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 21:00:20.279296 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:20.279262    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"]
Oct 30 21:00:20.326665 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:20.326621    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"tempo-data-science-tempomonolithic-gateway-serving-cert\""
Oct 30 21:00:20.326852 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:20.326704    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"tempo-data-science-tempomonolithic-gateway\""
Oct 30 21:00:20.326852 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:20.326747    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"tempo-data-science-tempomonolithic-mtls\""
Oct 30 21:00:20.326852 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:20.326753    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"tempo-data-science-tempomonolithic-gateway\""
Oct 30 21:00:20.326852 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:20.326806    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"tempo-data-science-tempomonolithic-ca-bundle\""
Oct 30 21:00:20.326852 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:20.326838    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"tempo-data-science-tempomonolithic-dockercfg-csvjb\""
Oct 30 21:00:20.326852 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:20.326849    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"tempo-data-science-tempomonolithic-serving-cabundle\""
Oct 30 21:00:20.327177 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:20.326862    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"tempo-data-science-tempomonolithic-config\""
Oct 30 21:00:20.469812 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:20.469767    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tempo-data-science-tempomonolithic-gateway-serving-cert\" (UniqueName: \"kubernetes.io/secret/defb3992-166d-496c-ae4f-860264dda4f6-tempo-data-science-tempomonolithic-gateway-serving-cert\") pod \"tempo-data-science-tempomonolithic-0\" (UID: \"defb3992-166d-496c-ae4f-860264dda4f6\") " pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 21:00:20.469812 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:20.469812    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zzpks\" (UniqueName: \"kubernetes.io/projected/defb3992-166d-496c-ae4f-860264dda4f6-kube-api-access-zzpks\") pod \"tempo-data-science-tempomonolithic-0\" (UID: \"defb3992-166d-496c-ae4f-860264dda4f6\") " pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 21:00:20.470077 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:20.469902    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tempo-conf\" (UniqueName: \"kubernetes.io/configmap/defb3992-166d-496c-ae4f-860264dda4f6-tempo-conf\") pod \"tempo-data-science-tempomonolithic-0\" (UID: \"defb3992-166d-496c-ae4f-860264dda4f6\") " pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 21:00:20.470077 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:20.469941    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"gateway-tenants\" (UniqueName: \"kubernetes.io/secret/defb3992-166d-496c-ae4f-860264dda4f6-gateway-tenants\") pod \"tempo-data-science-tempomonolithic-0\" (UID: \"defb3992-166d-496c-ae4f-860264dda4f6\") " pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 21:00:20.470077 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:20.469992    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"gateway-rbac\" (UniqueName: \"kubernetes.io/configmap/defb3992-166d-496c-ae4f-860264dda4f6-gateway-rbac\") pod \"tempo-data-science-tempomonolithic-0\" (UID: \"defb3992-166d-496c-ae4f-860264dda4f6\") " pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 21:00:20.470077 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:20.470023    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tempo-data-science-tempomonolithic-serving-cabundle\" (UniqueName: \"kubernetes.io/configmap/defb3992-166d-496c-ae4f-860264dda4f6-tempo-data-science-tempomonolithic-serving-cabundle\") pod \"tempo-data-science-tempomonolithic-0\" (UID: \"defb3992-166d-496c-ae4f-860264dda4f6\") " pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 21:00:20.470077 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:20.470048    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tempo-data-science-tempomonolithic-mtls\" (UniqueName: \"kubernetes.io/secret/defb3992-166d-496c-ae4f-860264dda4f6-tempo-data-science-tempomonolithic-mtls\") pod \"tempo-data-science-tempomonolithic-0\" (UID: \"defb3992-166d-496c-ae4f-860264dda4f6\") " pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 21:00:20.470077 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:20.470076    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tempo-data-science-tempomonolithic-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/defb3992-166d-496c-ae4f-860264dda4f6-tempo-data-science-tempomonolithic-ca-bundle\") pod \"tempo-data-science-tempomonolithic-0\" (UID: \"defb3992-166d-496c-ae4f-860264dda4f6\") " pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 21:00:20.571554 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:20.571467    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tempo-data-science-tempomonolithic-gateway-serving-cert\" (UniqueName: \"kubernetes.io/secret/defb3992-166d-496c-ae4f-860264dda4f6-tempo-data-science-tempomonolithic-gateway-serving-cert\") pod \"tempo-data-science-tempomonolithic-0\" (UID: \"defb3992-166d-496c-ae4f-860264dda4f6\") " pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 21:00:20.571554 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:20.571529    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zzpks\" (UniqueName: \"kubernetes.io/projected/defb3992-166d-496c-ae4f-860264dda4f6-kube-api-access-zzpks\") pod \"tempo-data-science-tempomonolithic-0\" (UID: \"defb3992-166d-496c-ae4f-860264dda4f6\") " pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 21:00:20.571756 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:20.571557    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tempo-conf\" (UniqueName: \"kubernetes.io/configmap/defb3992-166d-496c-ae4f-860264dda4f6-tempo-conf\") pod \"tempo-data-science-tempomonolithic-0\" (UID: \"defb3992-166d-496c-ae4f-860264dda4f6\") " pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 21:00:20.571756 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:20.571580    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"gateway-tenants\" (UniqueName: \"kubernetes.io/secret/defb3992-166d-496c-ae4f-860264dda4f6-gateway-tenants\") pod \"tempo-data-science-tempomonolithic-0\" (UID: \"defb3992-166d-496c-ae4f-860264dda4f6\") " pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 21:00:20.571756 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:20.571599    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"gateway-rbac\" (UniqueName: \"kubernetes.io/configmap/defb3992-166d-496c-ae4f-860264dda4f6-gateway-rbac\") pod \"tempo-data-science-tempomonolithic-0\" (UID: \"defb3992-166d-496c-ae4f-860264dda4f6\") " pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 21:00:20.571756 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:20.571617    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tempo-data-science-tempomonolithic-serving-cabundle\" (UniqueName: \"kubernetes.io/configmap/defb3992-166d-496c-ae4f-860264dda4f6-tempo-data-science-tempomonolithic-serving-cabundle\") pod \"tempo-data-science-tempomonolithic-0\" (UID: \"defb3992-166d-496c-ae4f-860264dda4f6\") " pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 21:00:20.571756 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:20.571636    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tempo-data-science-tempomonolithic-mtls\" (UniqueName: \"kubernetes.io/secret/defb3992-166d-496c-ae4f-860264dda4f6-tempo-data-science-tempomonolithic-mtls\") pod \"tempo-data-science-tempomonolithic-0\" (UID: \"defb3992-166d-496c-ae4f-860264dda4f6\") " pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 21:00:20.571984 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:20.571803    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tempo-data-science-tempomonolithic-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/defb3992-166d-496c-ae4f-860264dda4f6-tempo-data-science-tempomonolithic-ca-bundle\") pod \"tempo-data-science-tempomonolithic-0\" (UID: \"defb3992-166d-496c-ae4f-860264dda4f6\") " pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 21:00:20.572457 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:20.572429    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tempo-data-science-tempomonolithic-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/defb3992-166d-496c-ae4f-860264dda4f6-tempo-data-science-tempomonolithic-ca-bundle\") pod \"tempo-data-science-tempomonolithic-0\" (UID: \"defb3992-166d-496c-ae4f-860264dda4f6\") " pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 21:00:20.572639 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:20.572550    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tempo-data-science-tempomonolithic-serving-cabundle\" (UniqueName: \"kubernetes.io/configmap/defb3992-166d-496c-ae4f-860264dda4f6-tempo-data-science-tempomonolithic-serving-cabundle\") pod \"tempo-data-science-tempomonolithic-0\" (UID: \"defb3992-166d-496c-ae4f-860264dda4f6\") " pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 21:00:20.572639 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:20.572559    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"gateway-rbac\" (UniqueName: \"kubernetes.io/configmap/defb3992-166d-496c-ae4f-860264dda4f6-gateway-rbac\") pod \"tempo-data-science-tempomonolithic-0\" (UID: \"defb3992-166d-496c-ae4f-860264dda4f6\") " pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 21:00:20.573049 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:20.573025    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tempo-conf\" (UniqueName: \"kubernetes.io/configmap/defb3992-166d-496c-ae4f-860264dda4f6-tempo-conf\") pod \"tempo-data-science-tempomonolithic-0\" (UID: \"defb3992-166d-496c-ae4f-860264dda4f6\") " pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 21:00:20.574069 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:20.574047    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"gateway-tenants\" (UniqueName: \"kubernetes.io/secret/defb3992-166d-496c-ae4f-860264dda4f6-gateway-tenants\") pod \"tempo-data-science-tempomonolithic-0\" (UID: \"defb3992-166d-496c-ae4f-860264dda4f6\") " pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 21:00:20.574272 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:20.574250    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tempo-data-science-tempomonolithic-mtls\" (UniqueName: \"kubernetes.io/secret/defb3992-166d-496c-ae4f-860264dda4f6-tempo-data-science-tempomonolithic-mtls\") pod \"tempo-data-science-tempomonolithic-0\" (UID: \"defb3992-166d-496c-ae4f-860264dda4f6\") " pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 21:00:20.574272 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:20.574262    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tempo-data-science-tempomonolithic-gateway-serving-cert\" (UniqueName: \"kubernetes.io/secret/defb3992-166d-496c-ae4f-860264dda4f6-tempo-data-science-tempomonolithic-gateway-serving-cert\") pod \"tempo-data-science-tempomonolithic-0\" (UID: \"defb3992-166d-496c-ae4f-860264dda4f6\") " pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 21:00:20.633965 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:20.633935    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zzpks\" (UniqueName: \"kubernetes.io/projected/defb3992-166d-496c-ae4f-860264dda4f6-kube-api-access-zzpks\") pod \"tempo-data-science-tempomonolithic-0\" (UID: \"defb3992-166d-496c-ae4f-860264dda4f6\") " pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 21:00:22.560060 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:22.559443    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:00:22.560060 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:22.559689    4060 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-collector-0" podUID="32f3cc91-3ae2-40c0-87ae-53c032c3ed54" containerName="otc-container" containerID="cri-o://a1265afbeb9f7ee8a46db9c75291718e9b0e1bfa27b29b4458636ac65cac0d17" gracePeriod=30
Oct 30 21:00:23.899204 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:23.899169    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-e7fabdfe-f269-407c-827e-7980f4596959\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0de7fcc7e4205ee06\") pod \"tempo-data-science-tempomonolithic-0\" (UID: \"defb3992-166d-496c-ae4f-860264dda4f6\") " pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 21:00:24.003088 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:24.003054    4060 operation_generator.go:1464] "Controller attach succeeded for volume \"pvc-e7fabdfe-f269-407c-827e-7980f4596959\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0de7fcc7e4205ee06\") pod \"tempo-data-science-tempomonolithic-0\" (UID: \"defb3992-166d-496c-ae4f-860264dda4f6\") device path: \"\"" pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 21:00:24.100947 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:24.100913    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"pvc-e7fabdfe-f269-407c-827e-7980f4596959\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0de7fcc7e4205ee06\") pod \"tempo-data-science-tempomonolithic-0\" (UID: \"defb3992-166d-496c-ae4f-860264dda4f6\") " pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 21:00:24.101107 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:24.101056    4060 operation_generator.go:515] "MountVolume.WaitForAttach entering for volume \"pvc-e7fabdfe-f269-407c-827e-7980f4596959\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0de7fcc7e4205ee06\") pod \"tempo-data-science-tempomonolithic-0\" (UID: \"defb3992-166d-496c-ae4f-860264dda4f6\") DevicePath \"\"" pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 21:00:24.152905 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:24.152833    4060 operation_generator.go:525] "MountVolume.WaitForAttach succeeded for volume \"pvc-e7fabdfe-f269-407c-827e-7980f4596959\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0de7fcc7e4205ee06\") pod \"tempo-data-science-tempomonolithic-0\" (UID: \"defb3992-166d-496c-ae4f-860264dda4f6\") DevicePath \"csi-b6da660721bdc621eb68dfde1eb42e71e74391b5f0d9eaa78eea6b8a48f796bd\"" pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 21:00:24.296908 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:24.296880    4060 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"pvc-e7fabdfe-f269-407c-827e-7980f4596959\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0de7fcc7e4205ee06\") pod \"tempo-data-science-tempomonolithic-0\" (UID: \"defb3992-166d-496c-ae4f-860264dda4f6\") device mount path \"/var/lib/kubelet/plugins/kubernetes.io/csi/ebs.csi.aws.com/9da1b29e6f97cbef8aa0879e8d7bcaa22b72d8e13243848f419dad2d056ca757/globalmount\"" pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 21:00:24.361800 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:24.361772    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pvc-e7fabdfe-f269-407c-827e-7980f4596959\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0de7fcc7e4205ee06\") pod \"tempo-data-science-tempomonolithic-0\" (UID: \"defb3992-166d-496c-ae4f-860264dda4f6\") " pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 21:00:24.504452 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:24.504413    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"tempo-data-science-tempomonolithic-dockercfg-csvjb\""
Oct 30 21:00:24.514008 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:24.513982    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 21:00:24.613474 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:24.613438    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/korrel8r-66d6f7f696-szm9c"
Oct 30 21:00:24.759572 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:24.759477    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/korrel8r-5cbcc89b8f-chqpk"]
Oct 30 21:00:24.759784 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:24.759757    4060 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-chqpk" podUID="8a130d0e-60fe-4947-8362-5c376a721af3" containerName="korrel8r" containerID="cri-o://c565e561e6c83da8c3aca9c4adaa6cc7aadda4cac0c4bccdb0113bc042184fe1" gracePeriod=30
Oct 30 21:00:24.898740 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:24.898718    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:00:24.906746 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:24.906719    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/32f3cc91-3ae2-40c0-87ae-53c032c3ed54-monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/32f3cc91-3ae2-40c0-87ae-53c032c3ed54-monitoring-tls-certs\") pod \"32f3cc91-3ae2-40c0-87ae-53c032c3ed54\" (UID: \"32f3cc91-3ae2-40c0-87ae-53c032c3ed54\") "
Oct 30 21:00:24.907176 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:24.906758    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/32f3cc91-3ae2-40c0-87ae-53c032c3ed54-otc-internal\" (UniqueName: \"kubernetes.io/configmap/32f3cc91-3ae2-40c0-87ae-53c032c3ed54-otc-internal\") pod \"32f3cc91-3ae2-40c0-87ae-53c032c3ed54\" (UID: \"32f3cc91-3ae2-40c0-87ae-53c032c3ed54\") "
Oct 30 21:00:24.907176 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:24.906807    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/32f3cc91-3ae2-40c0-87ae-53c032c3ed54-kube-api-access-c8f49\" (UniqueName: \"kubernetes.io/projected/32f3cc91-3ae2-40c0-87ae-53c032c3ed54-kube-api-access-c8f49\") pod \"32f3cc91-3ae2-40c0-87ae-53c032c3ed54\" (UID: \"32f3cc91-3ae2-40c0-87ae-53c032c3ed54\") "
Oct 30 21:00:24.907176 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:24.906839    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/32f3cc91-3ae2-40c0-87ae-53c032c3ed54-otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/32f3cc91-3ae2-40c0-87ae-53c032c3ed54-otlp-tls-certs\") pod \"32f3cc91-3ae2-40c0-87ae-53c032c3ed54\" (UID: \"32f3cc91-3ae2-40c0-87ae-53c032c3ed54\") "
Oct 30 21:00:24.907176 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:24.906896    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/32f3cc91-3ae2-40c0-87ae-53c032c3ed54-data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/32f3cc91-3ae2-40c0-87ae-53c032c3ed54-data-science-collector-ta-client-cert\") pod \"32f3cc91-3ae2-40c0-87ae-53c032c3ed54\" (UID: \"32f3cc91-3ae2-40c0-87ae-53c032c3ed54\") "
Oct 30 21:00:24.907176 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:24.906967    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/32f3cc91-3ae2-40c0-87ae-53c032c3ed54-tls-certs\" (UniqueName: \"kubernetes.io/secret/32f3cc91-3ae2-40c0-87ae-53c032c3ed54-tls-certs\") pod \"32f3cc91-3ae2-40c0-87ae-53c032c3ed54\" (UID: \"32f3cc91-3ae2-40c0-87ae-53c032c3ed54\") "
Oct 30 21:00:24.907572 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:24.907537    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/32f3cc91-3ae2-40c0-87ae-53c032c3ed54-otc-internal" pod "32f3cc91-3ae2-40c0-87ae-53c032c3ed54" (UID: "32f3cc91-3ae2-40c0-87ae-53c032c3ed54"). InnerVolumeSpecName "otc-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:00:24.909275 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:24.909253    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/32f3cc91-3ae2-40c0-87ae-53c032c3ed54-monitoring-tls-certs" pod "32f3cc91-3ae2-40c0-87ae-53c032c3ed54" (UID: "32f3cc91-3ae2-40c0-87ae-53c032c3ed54"). InnerVolumeSpecName "monitoring-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:00:24.909534 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:24.909484    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/32f3cc91-3ae2-40c0-87ae-53c032c3ed54-otlp-tls-certs" pod "32f3cc91-3ae2-40c0-87ae-53c032c3ed54" (UID: "32f3cc91-3ae2-40c0-87ae-53c032c3ed54"). InnerVolumeSpecName "otlp-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:00:24.909657 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:24.909627    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/32f3cc91-3ae2-40c0-87ae-53c032c3ed54-data-science-collector-ta-client-cert" pod "32f3cc91-3ae2-40c0-87ae-53c032c3ed54" (UID: "32f3cc91-3ae2-40c0-87ae-53c032c3ed54"). InnerVolumeSpecName "data-science-collector-ta-client-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:00:24.909797 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:24.909760    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/32f3cc91-3ae2-40c0-87ae-53c032c3ed54-kube-api-access-c8f49" pod "32f3cc91-3ae2-40c0-87ae-53c032c3ed54" (UID: "32f3cc91-3ae2-40c0-87ae-53c032c3ed54"). InnerVolumeSpecName "kube-api-access-c8f49". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:00:24.909929 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:24.909898    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/32f3cc91-3ae2-40c0-87ae-53c032c3ed54-tls-certs" pod "32f3cc91-3ae2-40c0-87ae-53c032c3ed54" (UID: "32f3cc91-3ae2-40c0-87ae-53c032c3ed54"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:00:24.940372 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:24.940346    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"]
Oct 30 21:00:24.941863 ip-10-0-142-4 kubenswrapper[4060]: W1030 21:00:24.941835    4060 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddefb3992_166d_496c_ae4f_860264dda4f6.slice/crio-31eaf4aa8758c29c589f0ee952e7b150108451d47ec04b7e72822b0cfa9f6b2d WatchSource:0}: Error finding container 31eaf4aa8758c29c589f0ee952e7b150108451d47ec04b7e72822b0cfa9f6b2d: Status 404 returned error can't find the container with id 31eaf4aa8758c29c589f0ee952e7b150108451d47ec04b7e72822b0cfa9f6b2d
Oct 30 21:00:24.997565 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:24.997535    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-chqpk"
Oct 30 21:00:25.007931 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:25.007908    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8a130d0e-60fe-4947-8362-5c376a721af3-kube-api-access-5xx29\" (UniqueName: \"kubernetes.io/projected/8a130d0e-60fe-4947-8362-5c376a721af3-kube-api-access-5xx29\") pod \"8a130d0e-60fe-4947-8362-5c376a721af3\" (UID: \"8a130d0e-60fe-4947-8362-5c376a721af3\") "
Oct 30 21:00:25.008027 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:25.007940    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/8a130d0e-60fe-4947-8362-5c376a721af3-tls\" (UniqueName: \"kubernetes.io/secret/8a130d0e-60fe-4947-8362-5c376a721af3-tls\") pod \"8a130d0e-60fe-4947-8362-5c376a721af3\" (UID: \"8a130d0e-60fe-4947-8362-5c376a721af3\") "
Oct 30 21:00:25.008027 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:25.007997    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/8a130d0e-60fe-4947-8362-5c376a721af3-config\" (UniqueName: \"kubernetes.io/configmap/8a130d0e-60fe-4947-8362-5c376a721af3-config\") pod \"8a130d0e-60fe-4947-8362-5c376a721af3\" (UID: \"8a130d0e-60fe-4947-8362-5c376a721af3\") "
Oct 30 21:00:25.008199 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:25.008183    4060 reconciler_common.go:299] "Volume detached for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/32f3cc91-3ae2-40c0-87ae-53c032c3ed54-monitoring-tls-certs\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:00:25.008236 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:25.008205    4060 reconciler_common.go:299] "Volume detached for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/32f3cc91-3ae2-40c0-87ae-53c032c3ed54-otc-internal\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:00:25.008236 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:25.008221    4060 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c8f49\" (UniqueName: \"kubernetes.io/projected/32f3cc91-3ae2-40c0-87ae-53c032c3ed54-kube-api-access-c8f49\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:00:25.008298 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:25.008237    4060 reconciler_common.go:299] "Volume detached for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/32f3cc91-3ae2-40c0-87ae-53c032c3ed54-otlp-tls-certs\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:00:25.008298 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:25.008252    4060 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/32f3cc91-3ae2-40c0-87ae-53c032c3ed54-data-science-collector-ta-client-cert\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:00:25.008298 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:25.008265    4060 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/32f3cc91-3ae2-40c0-87ae-53c032c3ed54-tls-certs\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:00:25.008420 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:25.008404    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8a130d0e-60fe-4947-8362-5c376a721af3-config" pod "8a130d0e-60fe-4947-8362-5c376a721af3" (UID: "8a130d0e-60fe-4947-8362-5c376a721af3"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:00:25.009892 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:25.009838    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8a130d0e-60fe-4947-8362-5c376a721af3-tls" pod "8a130d0e-60fe-4947-8362-5c376a721af3" (UID: "8a130d0e-60fe-4947-8362-5c376a721af3"). InnerVolumeSpecName "tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:00:25.009984 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:25.009914    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a130d0e-60fe-4947-8362-5c376a721af3-kube-api-access-5xx29" pod "8a130d0e-60fe-4947-8362-5c376a721af3" (UID: "8a130d0e-60fe-4947-8362-5c376a721af3"). InnerVolumeSpecName "kube-api-access-5xx29". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:00:25.109211 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:25.109182    4060 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5xx29\" (UniqueName: \"kubernetes.io/projected/8a130d0e-60fe-4947-8362-5c376a721af3-kube-api-access-5xx29\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:00:25.109211 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:25.109207    4060 reconciler_common.go:299] "Volume detached for volume \"tls\" (UniqueName: \"kubernetes.io/secret/8a130d0e-60fe-4947-8362-5c376a721af3-tls\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:00:25.109211 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:25.109218    4060 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8a130d0e-60fe-4947-8362-5c376a721af3-config\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:00:25.665831 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:25.665745    4060 generic.go:356] "Generic (PLEG): container finished" podID="32f3cc91-3ae2-40c0-87ae-53c032c3ed54" containerID="a1265afbeb9f7ee8a46db9c75291718e9b0e1bfa27b29b4458636ac65cac0d17" exitCode=0
Oct 30 21:00:25.665831 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:25.665801    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:00:25.666037 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:25.665828    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"32f3cc91-3ae2-40c0-87ae-53c032c3ed54","Type":"ContainerDied","Data":"a1265afbeb9f7ee8a46db9c75291718e9b0e1bfa27b29b4458636ac65cac0d17"}
Oct 30 21:00:25.666037 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:25.665888    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"32f3cc91-3ae2-40c0-87ae-53c032c3ed54","Type":"ContainerDied","Data":"10facaa6a94fb4d202b129e1a5f4f102753b1bd77d2ca9226f207610361d11e2"}
Oct 30 21:00:25.666037 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:25.665917    4060 scope.go:122] "RemoveContainer" containerID="a1265afbeb9f7ee8a46db9c75291718e9b0e1bfa27b29b4458636ac65cac0d17"
Oct 30 21:00:25.667331 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:25.667027    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0" event={"ID":"defb3992-166d-496c-ae4f-860264dda4f6","Type":"ContainerStarted","Data":"31eaf4aa8758c29c589f0ee952e7b150108451d47ec04b7e72822b0cfa9f6b2d"}
Oct 30 21:00:25.668737 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:25.668712    4060 generic.go:356] "Generic (PLEG): container finished" podID="8a130d0e-60fe-4947-8362-5c376a721af3" containerID="c565e561e6c83da8c3aca9c4adaa6cc7aadda4cac0c4bccdb0113bc042184fe1" exitCode=0
Oct 30 21:00:25.668864 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:25.668761    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-chqpk"
Oct 30 21:00:25.668864 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:25.668798    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-chqpk" event={"ID":"8a130d0e-60fe-4947-8362-5c376a721af3","Type":"ContainerDied","Data":"c565e561e6c83da8c3aca9c4adaa6cc7aadda4cac0c4bccdb0113bc042184fe1"}
Oct 30 21:00:25.668864 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:25.668833    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-chqpk" event={"ID":"8a130d0e-60fe-4947-8362-5c376a721af3","Type":"ContainerDied","Data":"325c37b3f49ce54c4b87d5799b6f9eb90b1275165b4c1b0b5abc75f6c48c42b3"}
Oct 30 21:00:25.674808 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:25.674787    4060 scope.go:122] "RemoveContainer" containerID="a1265afbeb9f7ee8a46db9c75291718e9b0e1bfa27b29b4458636ac65cac0d17"
Oct 30 21:00:25.675082 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:00:25.675061    4060 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a1265afbeb9f7ee8a46db9c75291718e9b0e1bfa27b29b4458636ac65cac0d17\": container with ID starting with a1265afbeb9f7ee8a46db9c75291718e9b0e1bfa27b29b4458636ac65cac0d17 not found: ID does not exist" containerID="a1265afbeb9f7ee8a46db9c75291718e9b0e1bfa27b29b4458636ac65cac0d17"
Oct 30 21:00:25.675147 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:25.675093    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a1265afbeb9f7ee8a46db9c75291718e9b0e1bfa27b29b4458636ac65cac0d17"} err="failed to get container status \"a1265afbeb9f7ee8a46db9c75291718e9b0e1bfa27b29b4458636ac65cac0d17\": rpc error: code = NotFound desc = could not find container \"a1265afbeb9f7ee8a46db9c75291718e9b0e1bfa27b29b4458636ac65cac0d17\": container with ID starting with a1265afbeb9f7ee8a46db9c75291718e9b0e1bfa27b29b4458636ac65cac0d17 not found: ID does not exist"
Oct 30 21:00:25.675147 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:25.675112    4060 scope.go:122] "RemoveContainer" containerID="c565e561e6c83da8c3aca9c4adaa6cc7aadda4cac0c4bccdb0113bc042184fe1"
Oct 30 21:00:25.683070 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:25.683045    4060 scope.go:122] "RemoveContainer" containerID="c565e561e6c83da8c3aca9c4adaa6cc7aadda4cac0c4bccdb0113bc042184fe1"
Oct 30 21:00:25.683308 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:00:25.683289    4060 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c565e561e6c83da8c3aca9c4adaa6cc7aadda4cac0c4bccdb0113bc042184fe1\": container with ID starting with c565e561e6c83da8c3aca9c4adaa6cc7aadda4cac0c4bccdb0113bc042184fe1 not found: ID does not exist" containerID="c565e561e6c83da8c3aca9c4adaa6cc7aadda4cac0c4bccdb0113bc042184fe1"
Oct 30 21:00:25.683365 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:25.683318    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c565e561e6c83da8c3aca9c4adaa6cc7aadda4cac0c4bccdb0113bc042184fe1"} err="failed to get container status \"c565e561e6c83da8c3aca9c4adaa6cc7aadda4cac0c4bccdb0113bc042184fe1\": rpc error: code = NotFound desc = could not find container \"c565e561e6c83da8c3aca9c4adaa6cc7aadda4cac0c4bccdb0113bc042184fe1\": container with ID starting with c565e561e6c83da8c3aca9c4adaa6cc7aadda4cac0c4bccdb0113bc042184fe1 not found: ID does not exist"
Oct 30 21:00:25.828996 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:25.828965    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/korrel8r-5cbcc89b8f-chqpk"]
Oct 30 21:00:25.833286 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:25.833264    4060 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/korrel8r-5cbcc89b8f-chqpk"]
Oct 30 21:00:25.942742 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:25.942669    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:00:25.946034 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:25.946012    4060 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:00:26.022033 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:26.022003    4060 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:00:26.022315 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:26.022303    4060 cpu_manager.go:414] "containerMap: removing container" podUID="32f3cc91-3ae2-40c0-87ae-53c032c3ed54" containerName="otc-container"
Oct 30 21:00:26.022357 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:26.022316    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="32f3cc91-3ae2-40c0-87ae-53c032c3ed54" containerName="otc-container"
Oct 30 21:00:26.022357 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:26.022336    4060 cpu_manager.go:414] "containerMap: removing container" podUID="8a130d0e-60fe-4947-8362-5c376a721af3" containerName="korrel8r"
Oct 30 21:00:26.022357 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:26.022341    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8a130d0e-60fe-4947-8362-5c376a721af3" containerName="korrel8r"
Oct 30 21:00:26.022455 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:26.022398    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="8a130d0e-60fe-4947-8362-5c376a721af3" containerName="korrel8r"
Oct 30 21:00:26.022455 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:26.022411    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="32f3cc91-3ae2-40c0-87ae-53c032c3ed54" containerName="otc-container"
Oct 30 21:00:26.026924 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:26.026893    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:00:26.079725 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:26.079693    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-tls\""
Oct 30 21:00:26.079725 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:26.079707    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-monitoring-tls\""
Oct 30 21:00:26.079725 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:26.079709    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-headless-tls\""
Oct 30 21:00:26.079941 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:26.079766    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-dockercfg-jqj7h\""
Oct 30 21:00:26.079941 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:26.079773    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-ta-client-cert\""
Oct 30 21:00:26.079941 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:26.079817    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-50fd48e3\""
Oct 30 21:00:26.086788 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:26.086766    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:00:26.117408 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:26.117369    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4df2354f-6747-42f4-9767-d0cd45c503fd-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"4df2354f-6747-42f4-9767-d0cd45c503fd\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:00:26.117596 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:26.117421    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/4df2354f-6747-42f4-9767-d0cd45c503fd-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-0\" (UID: \"4df2354f-6747-42f4-9767-d0cd45c503fd\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:00:26.117596 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:26.117527    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/4df2354f-6747-42f4-9767-d0cd45c503fd-monitoring-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"4df2354f-6747-42f4-9767-d0cd45c503fd\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:00:26.117596 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:26.117553    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/4df2354f-6747-42f4-9767-d0cd45c503fd-otc-internal\") pod \"data-science-collector-collector-0\" (UID: \"4df2354f-6747-42f4-9767-d0cd45c503fd\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:00:26.117596 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:26.117579    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/4df2354f-6747-42f4-9767-d0cd45c503fd-otlp-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"4df2354f-6747-42f4-9767-d0cd45c503fd\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:00:26.117737 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:26.117687    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d6p6r\" (UniqueName: \"kubernetes.io/projected/4df2354f-6747-42f4-9767-d0cd45c503fd-kube-api-access-d6p6r\") pod \"data-science-collector-collector-0\" (UID: \"4df2354f-6747-42f4-9767-d0cd45c503fd\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:00:26.218260 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:26.218231    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/4df2354f-6747-42f4-9767-d0cd45c503fd-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-0\" (UID: \"4df2354f-6747-42f4-9767-d0cd45c503fd\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:00:26.218439 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:26.218271    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/4df2354f-6747-42f4-9767-d0cd45c503fd-monitoring-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"4df2354f-6747-42f4-9767-d0cd45c503fd\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:00:26.218439 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:26.218295    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/4df2354f-6747-42f4-9767-d0cd45c503fd-otc-internal\") pod \"data-science-collector-collector-0\" (UID: \"4df2354f-6747-42f4-9767-d0cd45c503fd\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:00:26.218439 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:26.218322    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/4df2354f-6747-42f4-9767-d0cd45c503fd-otlp-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"4df2354f-6747-42f4-9767-d0cd45c503fd\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:00:26.218439 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:26.218352    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d6p6r\" (UniqueName: \"kubernetes.io/projected/4df2354f-6747-42f4-9767-d0cd45c503fd-kube-api-access-d6p6r\") pod \"data-science-collector-collector-0\" (UID: \"4df2354f-6747-42f4-9767-d0cd45c503fd\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:00:26.218439 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:26.218421    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4df2354f-6747-42f4-9767-d0cd45c503fd-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"4df2354f-6747-42f4-9767-d0cd45c503fd\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:00:26.219229 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:26.219201    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/4df2354f-6747-42f4-9767-d0cd45c503fd-otc-internal\") pod \"data-science-collector-collector-0\" (UID: \"4df2354f-6747-42f4-9767-d0cd45c503fd\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:00:26.220909 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:26.220882    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/4df2354f-6747-42f4-9767-d0cd45c503fd-otlp-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"4df2354f-6747-42f4-9767-d0cd45c503fd\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:00:26.220909 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:26.220899    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4df2354f-6747-42f4-9767-d0cd45c503fd-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"4df2354f-6747-42f4-9767-d0cd45c503fd\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:00:26.221082 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:26.220917    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/4df2354f-6747-42f4-9767-d0cd45c503fd-monitoring-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"4df2354f-6747-42f4-9767-d0cd45c503fd\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:00:26.221082 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:26.220939    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/4df2354f-6747-42f4-9767-d0cd45c503fd-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-0\" (UID: \"4df2354f-6747-42f4-9767-d0cd45c503fd\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:00:26.279262 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:26.279227    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d6p6r\" (UniqueName: \"kubernetes.io/projected/4df2354f-6747-42f4-9767-d0cd45c503fd-kube-api-access-d6p6r\") pod \"data-science-collector-collector-0\" (UID: \"4df2354f-6747-42f4-9767-d0cd45c503fd\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:00:26.339702 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:26.339670    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:00:26.713712 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:26.713691    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:00:26.715774 ip-10-0-142-4 kubenswrapper[4060]: W1030 21:00:26.715740    4060 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4df2354f_6747_42f4_9767_d0cd45c503fd.slice/crio-360c7f2308ba84a033e27166ee4175d03352f561bafcb73d62ab52c49e287e57 WatchSource:0}: Error finding container 360c7f2308ba84a033e27166ee4175d03352f561bafcb73d62ab52c49e287e57: Status 404 returned error can't find the container with id 360c7f2308ba84a033e27166ee4175d03352f561bafcb73d62ab52c49e287e57
Oct 30 21:00:26.718090 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:26.718054    4060 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 21:00:26.718195 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:26.718133    4060 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 21:00:27.429522 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:27.429460    4060 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="32f3cc91-3ae2-40c0-87ae-53c032c3ed54" path="/var/lib/kubelet/pods/32f3cc91-3ae2-40c0-87ae-53c032c3ed54/volumes"
Oct 30 21:00:27.430038 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:27.430016    4060 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="8a130d0e-60fe-4947-8362-5c376a721af3" path="/var/lib/kubelet/pods/8a130d0e-60fe-4947-8362-5c376a721af3/volumes"
Oct 30 21:00:27.688209 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:27.688119    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"4df2354f-6747-42f4-9767-d0cd45c503fd","Type":"ContainerStarted","Data":"a6127958874f1bb35e9e1ea765634b05ec3f4995aa82c70916b40401ef73ff68"}
Oct 30 21:00:27.688209 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:27.688175    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"4df2354f-6747-42f4-9767-d0cd45c503fd","Type":"ContainerStarted","Data":"360c7f2308ba84a033e27166ee4175d03352f561bafcb73d62ab52c49e287e57"}
Oct 30 21:00:27.807715 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:27.807656    4060 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-collector-0" podStartSLOduration=2.8076406990000002 podStartE2EDuration="2.807640699s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:00:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:00:27.805702747 +0000 UTC m=+1446.562701048" watchObservedRunningTime="2026-10-30 21:00:27.807640699 +0000 UTC m=+1446.564638997"
Oct 30 21:00:29.702368 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:29.702336    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0" event={"ID":"defb3992-166d-496c-ae4f-860264dda4f6","Type":"ContainerStarted","Data":"0f5242f8584fc6474e7e1a6c95325e3b05a3eb7c64e01806d0056b67a25aad40"}
Oct 30 21:00:33.725092 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:33.725059    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0" event={"ID":"defb3992-166d-496c-ae4f-860264dda4f6","Type":"ContainerStarted","Data":"3b1ebb4290534a132ced103c188a02fd421f2bd5f806dcacb6d6ea5ef5ca6b15"}
Oct 30 21:00:36.743154 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:36.743116    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0" event={"ID":"defb3992-166d-496c-ae4f-860264dda4f6","Type":"ContainerStarted","Data":"77a4ece7addae6ed8597591b814ca303c29131d77fb6bc9568b3ce018193560f"}
Oct 30 21:00:36.743582 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:36.743393    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 21:00:36.746227 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:36.746207    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 21:00:36.965722 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:36.965659    4060 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0" podStartSLOduration=5.897682875 podStartE2EDuration="16.965642619s" totalImagesPullingTime="11.067959744s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 21:00:20 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:00:36.915169264 +0000 UTC m=+1455.672167563" watchObservedRunningTime="2026-10-30 21:00:36.965642619 +0000 UTC m=+1455.722640997"
Oct 30 21:00:37.747653 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:37.747611    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 21:00:37.748109 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:37.747665    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 21:00:37.755448 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:37.755421    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 21:00:42.151606 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:00:42.151560    4060 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v2f4x" containerName="extractor"
Oct 30 21:00:46.248546 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:46.248487    4060 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/korrel8r-5cbcc89b8f-mg9mm"]
Oct 30 21:00:46.251888 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:46.251864    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-mg9mm"
Oct 30 21:00:46.278276 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:46.278250    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/dc2a888c-b107-4cc7-823f-51bda67f9992-tls\") pod \"korrel8r-5cbcc89b8f-mg9mm\" (UID: \"dc2a888c-b107-4cc7-823f-51bda67f9992\") " pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-mg9mm"
Oct 30 21:00:46.278419 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:46.278283    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/dc2a888c-b107-4cc7-823f-51bda67f9992-config\") pod \"korrel8r-5cbcc89b8f-mg9mm\" (UID: \"dc2a888c-b107-4cc7-823f-51bda67f9992\") " pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-mg9mm"
Oct 30 21:00:46.278419 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:46.278364    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hl7sv\" (UniqueName: \"kubernetes.io/projected/dc2a888c-b107-4cc7-823f-51bda67f9992-kube-api-access-hl7sv\") pod \"korrel8r-5cbcc89b8f-mg9mm\" (UID: \"dc2a888c-b107-4cc7-823f-51bda67f9992\") " pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-mg9mm"
Oct 30 21:00:46.311725 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:46.311694    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/korrel8r-5cbcc89b8f-mg9mm"]
Oct 30 21:00:46.378825 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:46.378791    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/dc2a888c-b107-4cc7-823f-51bda67f9992-tls\") pod \"korrel8r-5cbcc89b8f-mg9mm\" (UID: \"dc2a888c-b107-4cc7-823f-51bda67f9992\") " pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-mg9mm"
Oct 30 21:00:46.378825 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:46.378825    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/dc2a888c-b107-4cc7-823f-51bda67f9992-config\") pod \"korrel8r-5cbcc89b8f-mg9mm\" (UID: \"dc2a888c-b107-4cc7-823f-51bda67f9992\") " pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-mg9mm"
Oct 30 21:00:46.379089 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:46.378914    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hl7sv\" (UniqueName: \"kubernetes.io/projected/dc2a888c-b107-4cc7-823f-51bda67f9992-kube-api-access-hl7sv\") pod \"korrel8r-5cbcc89b8f-mg9mm\" (UID: \"dc2a888c-b107-4cc7-823f-51bda67f9992\") " pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-mg9mm"
Oct 30 21:00:46.379916 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:46.379888    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/dc2a888c-b107-4cc7-823f-51bda67f9992-config\") pod \"korrel8r-5cbcc89b8f-mg9mm\" (UID: \"dc2a888c-b107-4cc7-823f-51bda67f9992\") " pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-mg9mm"
Oct 30 21:00:46.381253 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:46.381232    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls\" (UniqueName: \"kubernetes.io/secret/dc2a888c-b107-4cc7-823f-51bda67f9992-tls\") pod \"korrel8r-5cbcc89b8f-mg9mm\" (UID: \"dc2a888c-b107-4cc7-823f-51bda67f9992\") " pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-mg9mm"
Oct 30 21:00:46.439915 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:46.439881    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hl7sv\" (UniqueName: \"kubernetes.io/projected/dc2a888c-b107-4cc7-823f-51bda67f9992-kube-api-access-hl7sv\") pod \"korrel8r-5cbcc89b8f-mg9mm\" (UID: \"dc2a888c-b107-4cc7-823f-51bda67f9992\") " pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-mg9mm"
Oct 30 21:00:46.563925 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:46.563834    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-mg9mm"
Oct 30 21:00:46.935676 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:46.935652    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/korrel8r-5cbcc89b8f-mg9mm"]
Oct 30 21:00:46.937583 ip-10-0-142-4 kubenswrapper[4060]: W1030 21:00:46.937553    4060 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc2a888c_b107_4cc7_823f_51bda67f9992.slice/crio-4347e00adbc0e8eb9394060a84b52bd0e8836abe82545be21b38ce4200487b53 WatchSource:0}: Error finding container 4347e00adbc0e8eb9394060a84b52bd0e8836abe82545be21b38ce4200487b53: Status 404 returned error can't find the container with id 4347e00adbc0e8eb9394060a84b52bd0e8836abe82545be21b38ce4200487b53
Oct 30 21:00:47.795815 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:47.795780    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-mg9mm" event={"ID":"dc2a888c-b107-4cc7-823f-51bda67f9992","Type":"ContainerStarted","Data":"e237c8c08b29fa4dc0e6b99e71a606cf7bd5fa2dfc19359ef5fdeea316a6f723"}
Oct 30 21:00:47.796242 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:47.795832    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-mg9mm" event={"ID":"dc2a888c-b107-4cc7-823f-51bda67f9992","Type":"ContainerStarted","Data":"4347e00adbc0e8eb9394060a84b52bd0e8836abe82545be21b38ce4200487b53"}
Oct 30 21:00:47.796242 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:47.795871    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-mg9mm"
Oct 30 21:00:47.915877 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:47.915815    4060 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-mg9mm" podStartSLOduration=1.9157986729999998 podStartE2EDuration="1.915798673s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:00:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:00:47.913642038 +0000 UTC m=+1466.670640335" watchObservedRunningTime="2026-10-30 21:00:47.915798673 +0000 UTC m=+1466.672796970"
Oct 30 21:00:49.760270 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:49.760229    4060 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0" podUID="defb3992-166d-496c-ae4f-860264dda4f6" containerName="tempo" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 21:00:53.684139 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:53.684098    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"]
Oct 30 21:00:53.684717 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:53.684414    4060 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0" podUID="defb3992-166d-496c-ae4f-860264dda4f6" containerName="tempo" containerID="cri-o://0f5242f8584fc6474e7e1a6c95325e3b05a3eb7c64e01806d0056b67a25aad40" gracePeriod=30
Oct 30 21:00:53.684717 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:53.684438    4060 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0" podUID="defb3992-166d-496c-ae4f-860264dda4f6" containerName="tempo-gateway-opa" containerID="cri-o://77a4ece7addae6ed8597591b814ca303c29131d77fb6bc9568b3ce018193560f" gracePeriod=30
Oct 30 21:00:53.684717 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:53.684463    4060 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0" podUID="defb3992-166d-496c-ae4f-860264dda4f6" containerName="tempo-gateway" containerID="cri-o://3b1ebb4290534a132ced103c188a02fd421f2bd5f806dcacb6d6ea5ef5ca6b15" gracePeriod=30
Oct 30 21:00:53.686090 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:53.686051    4060 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0" podUID="defb3992-166d-496c-ae4f-860264dda4f6" containerName="tempo" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 21:00:53.828558 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:53.828527    4060 generic.go:356] "Generic (PLEG): container finished" podID="defb3992-166d-496c-ae4f-860264dda4f6" containerID="77a4ece7addae6ed8597591b814ca303c29131d77fb6bc9568b3ce018193560f" exitCode=0
Oct 30 21:00:53.828734 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:53.828601    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0" event={"ID":"defb3992-166d-496c-ae4f-860264dda4f6","Type":"ContainerDied","Data":"77a4ece7addae6ed8597591b814ca303c29131d77fb6bc9568b3ce018193560f"}
Oct 30 21:00:54.728273 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:54.728238    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:00:54.728761 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:54.728434    4060 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-collector-0" podUID="4df2354f-6747-42f4-9767-d0cd45c503fd" containerName="otc-container" containerID="cri-o://a6127958874f1bb35e9e1ea765634b05ec3f4995aa82c70916b40401ef73ff68" gracePeriod=30
Oct 30 21:00:54.836627 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:54.836583    4060 generic.go:356] "Generic (PLEG): container finished" podID="defb3992-166d-496c-ae4f-860264dda4f6" containerID="3b1ebb4290534a132ced103c188a02fd421f2bd5f806dcacb6d6ea5ef5ca6b15" exitCode=0
Oct 30 21:00:54.836627 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:54.836610    4060 generic.go:356] "Generic (PLEG): container finished" podID="defb3992-166d-496c-ae4f-860264dda4f6" containerID="0f5242f8584fc6474e7e1a6c95325e3b05a3eb7c64e01806d0056b67a25aad40" exitCode=0
Oct 30 21:00:54.836872 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:54.836618    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0" event={"ID":"defb3992-166d-496c-ae4f-860264dda4f6","Type":"ContainerDied","Data":"3b1ebb4290534a132ced103c188a02fd421f2bd5f806dcacb6d6ea5ef5ca6b15"}
Oct 30 21:00:54.836872 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:54.836702    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0" event={"ID":"defb3992-166d-496c-ae4f-860264dda4f6","Type":"ContainerDied","Data":"0f5242f8584fc6474e7e1a6c95325e3b05a3eb7c64e01806d0056b67a25aad40"}
Oct 30 21:00:54.948583 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:54.948558    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 21:00:55.040002 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:55.039913    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/defb3992-166d-496c-ae4f-860264dda4f6-tempo-data-science-tempomonolithic-mtls\" (UniqueName: \"kubernetes.io/secret/defb3992-166d-496c-ae4f-860264dda4f6-tempo-data-science-tempomonolithic-mtls\") pod \"defb3992-166d-496c-ae4f-860264dda4f6\" (UID: \"defb3992-166d-496c-ae4f-860264dda4f6\") "
Oct 30 21:00:55.040168 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:55.040066    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/csi/ebs.csi.aws.com^vol-0de7fcc7e4205ee06\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0de7fcc7e4205ee06\") pod \"defb3992-166d-496c-ae4f-860264dda4f6\" (UID: \"defb3992-166d-496c-ae4f-860264dda4f6\") "
Oct 30 21:00:55.040168 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:55.040098    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/defb3992-166d-496c-ae4f-860264dda4f6-kube-api-access-zzpks\" (UniqueName: \"kubernetes.io/projected/defb3992-166d-496c-ae4f-860264dda4f6-kube-api-access-zzpks\") pod \"defb3992-166d-496c-ae4f-860264dda4f6\" (UID: \"defb3992-166d-496c-ae4f-860264dda4f6\") "
Oct 30 21:00:55.040168 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:55.040144    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/defb3992-166d-496c-ae4f-860264dda4f6-tempo-data-science-tempomonolithic-gateway-serving-cert\" (UniqueName: \"kubernetes.io/secret/defb3992-166d-496c-ae4f-860264dda4f6-tempo-data-science-tempomonolithic-gateway-serving-cert\") pod \"defb3992-166d-496c-ae4f-860264dda4f6\" (UID: \"defb3992-166d-496c-ae4f-860264dda4f6\") "
Oct 30 21:00:55.040349 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:55.040172    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/defb3992-166d-496c-ae4f-860264dda4f6-tempo-data-science-tempomonolithic-serving-cabundle\" (UniqueName: \"kubernetes.io/configmap/defb3992-166d-496c-ae4f-860264dda4f6-tempo-data-science-tempomonolithic-serving-cabundle\") pod \"defb3992-166d-496c-ae4f-860264dda4f6\" (UID: \"defb3992-166d-496c-ae4f-860264dda4f6\") "
Oct 30 21:00:55.040349 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:55.040210    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/defb3992-166d-496c-ae4f-860264dda4f6-gateway-tenants\" (UniqueName: \"kubernetes.io/secret/defb3992-166d-496c-ae4f-860264dda4f6-gateway-tenants\") pod \"defb3992-166d-496c-ae4f-860264dda4f6\" (UID: \"defb3992-166d-496c-ae4f-860264dda4f6\") "
Oct 30 21:00:55.040349 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:55.040302    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/defb3992-166d-496c-ae4f-860264dda4f6-tempo-conf\" (UniqueName: \"kubernetes.io/configmap/defb3992-166d-496c-ae4f-860264dda4f6-tempo-conf\") pod \"defb3992-166d-496c-ae4f-860264dda4f6\" (UID: \"defb3992-166d-496c-ae4f-860264dda4f6\") "
Oct 30 21:00:55.040349 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:55.040339    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/defb3992-166d-496c-ae4f-860264dda4f6-gateway-rbac\" (UniqueName: \"kubernetes.io/configmap/defb3992-166d-496c-ae4f-860264dda4f6-gateway-rbac\") pod \"defb3992-166d-496c-ae4f-860264dda4f6\" (UID: \"defb3992-166d-496c-ae4f-860264dda4f6\") "
Oct 30 21:00:55.040595 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:55.040388    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/defb3992-166d-496c-ae4f-860264dda4f6-tempo-data-science-tempomonolithic-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/defb3992-166d-496c-ae4f-860264dda4f6-tempo-data-science-tempomonolithic-ca-bundle\") pod \"defb3992-166d-496c-ae4f-860264dda4f6\" (UID: \"defb3992-166d-496c-ae4f-860264dda4f6\") "
Oct 30 21:00:55.041160 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:55.041059    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/defb3992-166d-496c-ae4f-860264dda4f6-tempo-conf" pod "defb3992-166d-496c-ae4f-860264dda4f6" (UID: "defb3992-166d-496c-ae4f-860264dda4f6"). InnerVolumeSpecName "tempo-conf". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:00:55.041160 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:55.040980    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/defb3992-166d-496c-ae4f-860264dda4f6-tempo-data-science-tempomonolithic-serving-cabundle" pod "defb3992-166d-496c-ae4f-860264dda4f6" (UID: "defb3992-166d-496c-ae4f-860264dda4f6"). InnerVolumeSpecName "tempo-data-science-tempomonolithic-serving-cabundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:00:55.041355 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:55.041204    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/defb3992-166d-496c-ae4f-860264dda4f6-tempo-data-science-tempomonolithic-ca-bundle" pod "defb3992-166d-496c-ae4f-860264dda4f6" (UID: "defb3992-166d-496c-ae4f-860264dda4f6"). InnerVolumeSpecName "tempo-data-science-tempomonolithic-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:00:55.041355 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:55.041322    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/defb3992-166d-496c-ae4f-860264dda4f6-gateway-rbac" pod "defb3992-166d-496c-ae4f-860264dda4f6" (UID: "defb3992-166d-496c-ae4f-860264dda4f6"). InnerVolumeSpecName "gateway-rbac". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:00:55.042859 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:55.042829    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/defb3992-166d-496c-ae4f-860264dda4f6-kube-api-access-zzpks" pod "defb3992-166d-496c-ae4f-860264dda4f6" (UID: "defb3992-166d-496c-ae4f-860264dda4f6"). InnerVolumeSpecName "kube-api-access-zzpks". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:00:55.043205 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:55.043181    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/defb3992-166d-496c-ae4f-860264dda4f6-gateway-tenants" pod "defb3992-166d-496c-ae4f-860264dda4f6" (UID: "defb3992-166d-496c-ae4f-860264dda4f6"). InnerVolumeSpecName "gateway-tenants". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:00:55.043464 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:55.043443    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/defb3992-166d-496c-ae4f-860264dda4f6-tempo-data-science-tempomonolithic-gateway-serving-cert" pod "defb3992-166d-496c-ae4f-860264dda4f6" (UID: "defb3992-166d-496c-ae4f-860264dda4f6"). InnerVolumeSpecName "tempo-data-science-tempomonolithic-gateway-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:00:55.043563 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:55.043539    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/defb3992-166d-496c-ae4f-860264dda4f6-tempo-data-science-tempomonolithic-mtls" pod "defb3992-166d-496c-ae4f-860264dda4f6" (UID: "defb3992-166d-496c-ae4f-860264dda4f6"). InnerVolumeSpecName "tempo-data-science-tempomonolithic-mtls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:00:55.044732 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:55.044708    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/csi/ebs.csi.aws.com^vol-0de7fcc7e4205ee06" pod "defb3992-166d-496c-ae4f-860264dda4f6" (UID: "defb3992-166d-496c-ae4f-860264dda4f6"). InnerVolumeSpecName "pvc-e7fabdfe-f269-407c-827e-7980f4596959". PluginName "kubernetes.io/csi", VolumeGIDValue ""
Oct 30 21:00:55.141597 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:55.141562    4060 reconciler_common.go:299] "Volume detached for volume \"gateway-tenants\" (UniqueName: \"kubernetes.io/secret/defb3992-166d-496c-ae4f-860264dda4f6-gateway-tenants\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:00:55.141597 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:55.141590    4060 reconciler_common.go:299] "Volume detached for volume \"tempo-conf\" (UniqueName: \"kubernetes.io/configmap/defb3992-166d-496c-ae4f-860264dda4f6-tempo-conf\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:00:55.141597 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:55.141600    4060 reconciler_common.go:299] "Volume detached for volume \"gateway-rbac\" (UniqueName: \"kubernetes.io/configmap/defb3992-166d-496c-ae4f-860264dda4f6-gateway-rbac\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:00:55.141837 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:55.141610    4060 reconciler_common.go:299] "Volume detached for volume \"tempo-data-science-tempomonolithic-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/defb3992-166d-496c-ae4f-860264dda4f6-tempo-data-science-tempomonolithic-ca-bundle\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:00:55.141837 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:55.141621    4060 reconciler_common.go:299] "Volume detached for volume \"tempo-data-science-tempomonolithic-mtls\" (UniqueName: \"kubernetes.io/secret/defb3992-166d-496c-ae4f-860264dda4f6-tempo-data-science-tempomonolithic-mtls\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:00:55.141837 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:55.141653    4060 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"pvc-e7fabdfe-f269-407c-827e-7980f4596959\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0de7fcc7e4205ee06\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" "
Oct 30 21:00:55.141837 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:55.141666    4060 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zzpks\" (UniqueName: \"kubernetes.io/projected/defb3992-166d-496c-ae4f-860264dda4f6-kube-api-access-zzpks\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:00:55.141837 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:55.141675    4060 reconciler_common.go:299] "Volume detached for volume \"tempo-data-science-tempomonolithic-gateway-serving-cert\" (UniqueName: \"kubernetes.io/secret/defb3992-166d-496c-ae4f-860264dda4f6-tempo-data-science-tempomonolithic-gateway-serving-cert\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:00:55.141837 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:55.141685    4060 reconciler_common.go:299] "Volume detached for volume \"tempo-data-science-tempomonolithic-serving-cabundle\" (UniqueName: \"kubernetes.io/configmap/defb3992-166d-496c-ae4f-860264dda4f6-tempo-data-science-tempomonolithic-serving-cabundle\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:00:55.150564 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:55.150544    4060 operation_generator.go:893] UnmountDevice succeeded for volume "pvc-e7fabdfe-f269-407c-827e-7980f4596959" (UniqueName: "kubernetes.io/csi/ebs.csi.aws.com^vol-0de7fcc7e4205ee06") on node "ip-10-0-142-4.us-west-1.compute.internal"
Oct 30 21:00:55.242944 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:55.242911    4060 reconciler_common.go:299] "Volume detached for volume \"pvc-e7fabdfe-f269-407c-827e-7980f4596959\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0de7fcc7e4205ee06\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"csi-b6da660721bdc621eb68dfde1eb42e71e74391b5f0d9eaa78eea6b8a48f796bd\""
Oct 30 21:00:55.843371 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:55.843345    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"
Oct 30 21:00:55.843846 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:55.843347    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/tempo-data-science-tempomonolithic-0" event={"ID":"defb3992-166d-496c-ae4f-860264dda4f6","Type":"ContainerDied","Data":"31eaf4aa8758c29c589f0ee952e7b150108451d47ec04b7e72822b0cfa9f6b2d"}
Oct 30 21:00:55.843846 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:55.843482    4060 scope.go:122] "RemoveContainer" containerID="77a4ece7addae6ed8597591b814ca303c29131d77fb6bc9568b3ce018193560f"
Oct 30 21:00:55.851872 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:55.851855    4060 scope.go:122] "RemoveContainer" containerID="3b1ebb4290534a132ced103c188a02fd421f2bd5f806dcacb6d6ea5ef5ca6b15"
Oct 30 21:00:55.859681 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:55.859645    4060 scope.go:122] "RemoveContainer" containerID="0f5242f8584fc6474e7e1a6c95325e3b05a3eb7c64e01806d0056b67a25aad40"
Oct 30 21:00:56.008665 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:56.008633    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"]
Oct 30 21:00:56.058296 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:56.058226    4060 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/tempo-data-science-tempomonolithic-0"]
Oct 30 21:00:57.074860 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:57.074833    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:00:57.158735 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:57.158644    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/4df2354f-6747-42f4-9767-d0cd45c503fd-tls-certs\" (UniqueName: \"kubernetes.io/secret/4df2354f-6747-42f4-9767-d0cd45c503fd-tls-certs\") pod \"4df2354f-6747-42f4-9767-d0cd45c503fd\" (UID: \"4df2354f-6747-42f4-9767-d0cd45c503fd\") "
Oct 30 21:00:57.158735 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:57.158677    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/4df2354f-6747-42f4-9767-d0cd45c503fd-monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/4df2354f-6747-42f4-9767-d0cd45c503fd-monitoring-tls-certs\") pod \"4df2354f-6747-42f4-9767-d0cd45c503fd\" (UID: \"4df2354f-6747-42f4-9767-d0cd45c503fd\") "
Oct 30 21:00:57.158735 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:57.158728    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4df2354f-6747-42f4-9767-d0cd45c503fd-kube-api-access-d6p6r\" (UniqueName: \"kubernetes.io/projected/4df2354f-6747-42f4-9767-d0cd45c503fd-kube-api-access-d6p6r\") pod \"4df2354f-6747-42f4-9767-d0cd45c503fd\" (UID: \"4df2354f-6747-42f4-9767-d0cd45c503fd\") "
Oct 30 21:00:57.159001 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:57.158756    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/4df2354f-6747-42f4-9767-d0cd45c503fd-otc-internal\" (UniqueName: \"kubernetes.io/configmap/4df2354f-6747-42f4-9767-d0cd45c503fd-otc-internal\") pod \"4df2354f-6747-42f4-9767-d0cd45c503fd\" (UID: \"4df2354f-6747-42f4-9767-d0cd45c503fd\") "
Oct 30 21:00:57.159001 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:57.158822    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/4df2354f-6747-42f4-9767-d0cd45c503fd-otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/4df2354f-6747-42f4-9767-d0cd45c503fd-otlp-tls-certs\") pod \"4df2354f-6747-42f4-9767-d0cd45c503fd\" (UID: \"4df2354f-6747-42f4-9767-d0cd45c503fd\") "
Oct 30 21:00:57.159001 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:57.158876    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/4df2354f-6747-42f4-9767-d0cd45c503fd-data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/4df2354f-6747-42f4-9767-d0cd45c503fd-data-science-collector-ta-client-cert\") pod \"4df2354f-6747-42f4-9767-d0cd45c503fd\" (UID: \"4df2354f-6747-42f4-9767-d0cd45c503fd\") "
Oct 30 21:00:57.159281 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:57.159247    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4df2354f-6747-42f4-9767-d0cd45c503fd-otc-internal" pod "4df2354f-6747-42f4-9767-d0cd45c503fd" (UID: "4df2354f-6747-42f4-9767-d0cd45c503fd"). InnerVolumeSpecName "otc-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:00:57.161041 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:57.161010    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4df2354f-6747-42f4-9767-d0cd45c503fd-monitoring-tls-certs" pod "4df2354f-6747-42f4-9767-d0cd45c503fd" (UID: "4df2354f-6747-42f4-9767-d0cd45c503fd"). InnerVolumeSpecName "monitoring-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:00:57.161166 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:57.161042    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4df2354f-6747-42f4-9767-d0cd45c503fd-otlp-tls-certs" pod "4df2354f-6747-42f4-9767-d0cd45c503fd" (UID: "4df2354f-6747-42f4-9767-d0cd45c503fd"). InnerVolumeSpecName "otlp-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:00:57.161352 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:57.161325    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4df2354f-6747-42f4-9767-d0cd45c503fd-kube-api-access-d6p6r" pod "4df2354f-6747-42f4-9767-d0cd45c503fd" (UID: "4df2354f-6747-42f4-9767-d0cd45c503fd"). InnerVolumeSpecName "kube-api-access-d6p6r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:00:57.161437 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:57.161377    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4df2354f-6747-42f4-9767-d0cd45c503fd-tls-certs" pod "4df2354f-6747-42f4-9767-d0cd45c503fd" (UID: "4df2354f-6747-42f4-9767-d0cd45c503fd"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:00:57.161437 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:57.161418    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4df2354f-6747-42f4-9767-d0cd45c503fd-data-science-collector-ta-client-cert" pod "4df2354f-6747-42f4-9767-d0cd45c503fd" (UID: "4df2354f-6747-42f4-9767-d0cd45c503fd"). InnerVolumeSpecName "data-science-collector-ta-client-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:00:57.260504 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:57.260456    4060 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/4df2354f-6747-42f4-9767-d0cd45c503fd-data-science-collector-ta-client-cert\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:00:57.260680 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:57.260515    4060 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4df2354f-6747-42f4-9767-d0cd45c503fd-tls-certs\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:00:57.260680 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:57.260533    4060 reconciler_common.go:299] "Volume detached for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/4df2354f-6747-42f4-9767-d0cd45c503fd-monitoring-tls-certs\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:00:57.260680 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:57.260547    4060 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d6p6r\" (UniqueName: \"kubernetes.io/projected/4df2354f-6747-42f4-9767-d0cd45c503fd-kube-api-access-d6p6r\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:00:57.260680 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:57.260562    4060 reconciler_common.go:299] "Volume detached for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/4df2354f-6747-42f4-9767-d0cd45c503fd-otc-internal\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:00:57.260680 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:57.260576    4060 reconciler_common.go:299] "Volume detached for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/4df2354f-6747-42f4-9767-d0cd45c503fd-otlp-tls-certs\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:00:57.428359 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:57.428279    4060 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="defb3992-166d-496c-ae4f-860264dda4f6" path="/var/lib/kubelet/pods/defb3992-166d-496c-ae4f-860264dda4f6/volumes"
Oct 30 21:00:57.861018 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:57.860979    4060 generic.go:356] "Generic (PLEG): container finished" podID="4df2354f-6747-42f4-9767-d0cd45c503fd" containerID="a6127958874f1bb35e9e1ea765634b05ec3f4995aa82c70916b40401ef73ff68" exitCode=0
Oct 30 21:00:57.861219 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:57.861035    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:00:57.861219 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:57.861069    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"4df2354f-6747-42f4-9767-d0cd45c503fd","Type":"ContainerDied","Data":"a6127958874f1bb35e9e1ea765634b05ec3f4995aa82c70916b40401ef73ff68"}
Oct 30 21:00:57.861219 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:57.861123    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"4df2354f-6747-42f4-9767-d0cd45c503fd","Type":"ContainerDied","Data":"360c7f2308ba84a033e27166ee4175d03352f561bafcb73d62ab52c49e287e57"}
Oct 30 21:00:57.861219 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:57.861148    4060 scope.go:122] "RemoveContainer" containerID="a6127958874f1bb35e9e1ea765634b05ec3f4995aa82c70916b40401ef73ff68"
Oct 30 21:00:57.869687 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:57.869663    4060 scope.go:122] "RemoveContainer" containerID="a6127958874f1bb35e9e1ea765634b05ec3f4995aa82c70916b40401ef73ff68"
Oct 30 21:00:57.869976 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:00:57.869954    4060 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a6127958874f1bb35e9e1ea765634b05ec3f4995aa82c70916b40401ef73ff68\": container with ID starting with a6127958874f1bb35e9e1ea765634b05ec3f4995aa82c70916b40401ef73ff68 not found: ID does not exist" containerID="a6127958874f1bb35e9e1ea765634b05ec3f4995aa82c70916b40401ef73ff68"
Oct 30 21:00:57.870020 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:57.869984    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a6127958874f1bb35e9e1ea765634b05ec3f4995aa82c70916b40401ef73ff68"} err="failed to get container status \"a6127958874f1bb35e9e1ea765634b05ec3f4995aa82c70916b40401ef73ff68\": rpc error: code = NotFound desc = could not find container \"a6127958874f1bb35e9e1ea765634b05ec3f4995aa82c70916b40401ef73ff68\": container with ID starting with a6127958874f1bb35e9e1ea765634b05ec3f4995aa82c70916b40401ef73ff68 not found: ID does not exist"
Oct 30 21:00:58.025296 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:58.025262    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:00:58.074760 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:58.074727    4060 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:00:58.104408 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:58.104376    4060 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:00:58.104890 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:58.104870    4060 cpu_manager.go:414] "containerMap: removing container" podUID="4df2354f-6747-42f4-9767-d0cd45c503fd" containerName="otc-container"
Oct 30 21:00:58.104890 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:58.104887    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4df2354f-6747-42f4-9767-d0cd45c503fd" containerName="otc-container"
Oct 30 21:00:58.105006 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:58.104899    4060 cpu_manager.go:414] "containerMap: removing container" podUID="defb3992-166d-496c-ae4f-860264dda4f6" containerName="tempo-gateway-opa"
Oct 30 21:00:58.105006 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:58.104907    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="defb3992-166d-496c-ae4f-860264dda4f6" containerName="tempo-gateway-opa"
Oct 30 21:00:58.105006 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:58.104935    4060 cpu_manager.go:414] "containerMap: removing container" podUID="defb3992-166d-496c-ae4f-860264dda4f6" containerName="tempo"
Oct 30 21:00:58.105006 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:58.104944    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="defb3992-166d-496c-ae4f-860264dda4f6" containerName="tempo"
Oct 30 21:00:58.105006 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:58.104960    4060 cpu_manager.go:414] "containerMap: removing container" podUID="defb3992-166d-496c-ae4f-860264dda4f6" containerName="tempo-gateway"
Oct 30 21:00:58.105006 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:58.104967    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="defb3992-166d-496c-ae4f-860264dda4f6" containerName="tempo-gateway"
Oct 30 21:00:58.105282 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:58.105047    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="4df2354f-6747-42f4-9767-d0cd45c503fd" containerName="otc-container"
Oct 30 21:00:58.105282 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:58.105061    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="defb3992-166d-496c-ae4f-860264dda4f6" containerName="tempo-gateway-opa"
Oct 30 21:00:58.105282 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:58.105075    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="defb3992-166d-496c-ae4f-860264dda4f6" containerName="tempo"
Oct 30 21:00:58.105282 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:58.105083    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="defb3992-166d-496c-ae4f-860264dda4f6" containerName="tempo-gateway"
Oct 30 21:00:58.110022 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:58.110001    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:00:58.162392 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:58.162361    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-tls\""
Oct 30 21:00:58.162567 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:58.162414    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-a0f9182a\""
Oct 30 21:00:58.162968 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:58.162951    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-headless-tls\""
Oct 30 21:00:58.163046 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:58.163032    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-ta-client-cert\""
Oct 30 21:00:58.163105 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:58.163082    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-dockercfg-jqj7h\""
Oct 30 21:00:58.167521 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:58.167471    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/a00f6701-b181-4f6e-aa67-4d543aa1ac34-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-0\" (UID: \"a00f6701-b181-4f6e-aa67-4d543aa1ac34\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:00:58.167703 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:58.167625    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nqhxb\" (UniqueName: \"kubernetes.io/projected/a00f6701-b181-4f6e-aa67-4d543aa1ac34-kube-api-access-nqhxb\") pod \"data-science-collector-collector-0\" (UID: \"a00f6701-b181-4f6e-aa67-4d543aa1ac34\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:00:58.167801 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:58.167732    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/a00f6701-b181-4f6e-aa67-4d543aa1ac34-monitoring-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"a00f6701-b181-4f6e-aa67-4d543aa1ac34\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:00:58.167801 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:58.167779    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/a00f6701-b181-4f6e-aa67-4d543aa1ac34-otlp-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"a00f6701-b181-4f6e-aa67-4d543aa1ac34\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:00:58.167907 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:58.167813    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/a00f6701-b181-4f6e-aa67-4d543aa1ac34-otc-internal\") pod \"data-science-collector-collector-0\" (UID: \"a00f6701-b181-4f6e-aa67-4d543aa1ac34\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:00:58.167975 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:58.167958    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a00f6701-b181-4f6e-aa67-4d543aa1ac34-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"a00f6701-b181-4f6e-aa67-4d543aa1ac34\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:00:58.211609 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:58.211576    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-monitoring-tls\""
Oct 30 21:00:58.213465 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:58.213444    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:00:58.268560 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:58.268524    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a00f6701-b181-4f6e-aa67-4d543aa1ac34-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"a00f6701-b181-4f6e-aa67-4d543aa1ac34\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:00:58.268722 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:58.268583    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/a00f6701-b181-4f6e-aa67-4d543aa1ac34-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-0\" (UID: \"a00f6701-b181-4f6e-aa67-4d543aa1ac34\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:00:58.268722 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:58.268618    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nqhxb\" (UniqueName: \"kubernetes.io/projected/a00f6701-b181-4f6e-aa67-4d543aa1ac34-kube-api-access-nqhxb\") pod \"data-science-collector-collector-0\" (UID: \"a00f6701-b181-4f6e-aa67-4d543aa1ac34\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:00:58.268722 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:58.268669    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/a00f6701-b181-4f6e-aa67-4d543aa1ac34-monitoring-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"a00f6701-b181-4f6e-aa67-4d543aa1ac34\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:00:58.268722 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:58.268703    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/a00f6701-b181-4f6e-aa67-4d543aa1ac34-otlp-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"a00f6701-b181-4f6e-aa67-4d543aa1ac34\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:00:58.268946 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:58.268735    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/a00f6701-b181-4f6e-aa67-4d543aa1ac34-otc-internal\") pod \"data-science-collector-collector-0\" (UID: \"a00f6701-b181-4f6e-aa67-4d543aa1ac34\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:00:58.269472 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:58.269445    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/a00f6701-b181-4f6e-aa67-4d543aa1ac34-otc-internal\") pod \"data-science-collector-collector-0\" (UID: \"a00f6701-b181-4f6e-aa67-4d543aa1ac34\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:00:58.271280 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:58.271253    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/a00f6701-b181-4f6e-aa67-4d543aa1ac34-monitoring-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"a00f6701-b181-4f6e-aa67-4d543aa1ac34\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:00:58.271402 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:58.271301    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/a00f6701-b181-4f6e-aa67-4d543aa1ac34-otlp-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"a00f6701-b181-4f6e-aa67-4d543aa1ac34\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:00:58.271455 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:58.271402    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/a00f6701-b181-4f6e-aa67-4d543aa1ac34-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-0\" (UID: \"a00f6701-b181-4f6e-aa67-4d543aa1ac34\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:00:58.271523 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:58.271460    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a00f6701-b181-4f6e-aa67-4d543aa1ac34-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"a00f6701-b181-4f6e-aa67-4d543aa1ac34\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:00:58.329836 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:58.329804    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nqhxb\" (UniqueName: \"kubernetes.io/projected/a00f6701-b181-4f6e-aa67-4d543aa1ac34-kube-api-access-nqhxb\") pod \"data-science-collector-collector-0\" (UID: \"a00f6701-b181-4f6e-aa67-4d543aa1ac34\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:00:58.422400 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:58.422330    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:00:58.796209 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:58.796181    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:00:58.797920 ip-10-0-142-4 kubenswrapper[4060]: W1030 21:00:58.797892    4060 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda00f6701_b181_4f6e_aa67_4d543aa1ac34.slice/crio-e9b328c309b597bab651348439f561d4ea32809447b93b527a3fbafd05563870 WatchSource:0}: Error finding container e9b328c309b597bab651348439f561d4ea32809447b93b527a3fbafd05563870: Status 404 returned error can't find the container with id e9b328c309b597bab651348439f561d4ea32809447b93b527a3fbafd05563870
Oct 30 21:00:58.800218 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:58.800184    4060 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 21:00:58.800341 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:58.800255    4060 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 21:00:58.803858 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:58.803839    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-mg9mm"
Oct 30 21:00:58.870377 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:58.870345    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"a00f6701-b181-4f6e-aa67-4d543aa1ac34","Type":"ContainerStarted","Data":"3fd91063e3d00ce68c5125eaecb08b94785e59edeca9689c16a4d94c167b7755"}
Oct 30 21:00:58.870544 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:58.870408    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"a00f6701-b181-4f6e-aa67-4d543aa1ac34","Type":"ContainerStarted","Data":"e9b328c309b597bab651348439f561d4ea32809447b93b527a3fbafd05563870"}
Oct 30 21:00:58.961208 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:58.961175    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/korrel8r-66d6f7f696-szm9c"]
Oct 30 21:00:58.961413 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:58.961374    4060 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/korrel8r-66d6f7f696-szm9c" podUID="a073f6bb-592d-47b4-8ff0-bd99122fa385" containerName="korrel8r" containerID="cri-o://43f03630a7c8ae7f576c328775b23e6f75b7a16d3a439635a0e4011ef9e19fd2" gracePeriod=30
Oct 30 21:00:59.036671 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:59.036621    4060 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-collector-0" podStartSLOduration=1.036605507 podStartE2EDuration="1.036605507s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:00:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:00:59.035590807 +0000 UTC m=+1477.792589116" watchObservedRunningTime="2026-10-30 21:00:59.036605507 +0000 UTC m=+1477.793603855"
Oct 30 21:00:59.200847 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:59.200821    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/korrel8r-66d6f7f696-szm9c"
Oct 30 21:00:59.279385 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:59.279355    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a073f6bb-592d-47b4-8ff0-bd99122fa385-kube-api-access-knnh4\" (UniqueName: \"kubernetes.io/projected/a073f6bb-592d-47b4-8ff0-bd99122fa385-kube-api-access-knnh4\") pod \"a073f6bb-592d-47b4-8ff0-bd99122fa385\" (UID: \"a073f6bb-592d-47b4-8ff0-bd99122fa385\") "
Oct 30 21:00:59.279542 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:59.279464    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a073f6bb-592d-47b4-8ff0-bd99122fa385-config\" (UniqueName: \"kubernetes.io/configmap/a073f6bb-592d-47b4-8ff0-bd99122fa385-config\") pod \"a073f6bb-592d-47b4-8ff0-bd99122fa385\" (UID: \"a073f6bb-592d-47b4-8ff0-bd99122fa385\") "
Oct 30 21:00:59.279616 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:59.279564    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/a073f6bb-592d-47b4-8ff0-bd99122fa385-tls\" (UniqueName: \"kubernetes.io/secret/a073f6bb-592d-47b4-8ff0-bd99122fa385-tls\") pod \"a073f6bb-592d-47b4-8ff0-bd99122fa385\" (UID: \"a073f6bb-592d-47b4-8ff0-bd99122fa385\") "
Oct 30 21:00:59.279875 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:59.279852    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a073f6bb-592d-47b4-8ff0-bd99122fa385-config" pod "a073f6bb-592d-47b4-8ff0-bd99122fa385" (UID: "a073f6bb-592d-47b4-8ff0-bd99122fa385"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:00:59.281709 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:59.281682    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a073f6bb-592d-47b4-8ff0-bd99122fa385-tls" pod "a073f6bb-592d-47b4-8ff0-bd99122fa385" (UID: "a073f6bb-592d-47b4-8ff0-bd99122fa385"). InnerVolumeSpecName "tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:00:59.281805 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:59.281730    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a073f6bb-592d-47b4-8ff0-bd99122fa385-kube-api-access-knnh4" pod "a073f6bb-592d-47b4-8ff0-bd99122fa385" (UID: "a073f6bb-592d-47b4-8ff0-bd99122fa385"). InnerVolumeSpecName "kube-api-access-knnh4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:00:59.381035 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:59.380956    4060 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a073f6bb-592d-47b4-8ff0-bd99122fa385-config\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:00:59.381035 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:59.380985    4060 reconciler_common.go:299] "Volume detached for volume \"tls\" (UniqueName: \"kubernetes.io/secret/a073f6bb-592d-47b4-8ff0-bd99122fa385-tls\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:00:59.381035 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:59.380996    4060 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-knnh4\" (UniqueName: \"kubernetes.io/projected/a073f6bb-592d-47b4-8ff0-bd99122fa385-kube-api-access-knnh4\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:00:59.427836 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:59.427802    4060 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="4df2354f-6747-42f4-9767-d0cd45c503fd" path="/var/lib/kubelet/pods/4df2354f-6747-42f4-9767-d0cd45c503fd/volumes"
Oct 30 21:00:59.877404 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:59.877367    4060 generic.go:356] "Generic (PLEG): container finished" podID="a073f6bb-592d-47b4-8ff0-bd99122fa385" containerID="43f03630a7c8ae7f576c328775b23e6f75b7a16d3a439635a0e4011ef9e19fd2" exitCode=0
Oct 30 21:00:59.877639 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:59.877413    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/korrel8r-66d6f7f696-szm9c"
Oct 30 21:00:59.877639 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:59.877458    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/korrel8r-66d6f7f696-szm9c" event={"ID":"a073f6bb-592d-47b4-8ff0-bd99122fa385","Type":"ContainerDied","Data":"43f03630a7c8ae7f576c328775b23e6f75b7a16d3a439635a0e4011ef9e19fd2"}
Oct 30 21:00:59.877639 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:59.877526    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/korrel8r-66d6f7f696-szm9c" event={"ID":"a073f6bb-592d-47b4-8ff0-bd99122fa385","Type":"ContainerDied","Data":"9a9475c42619f8ebc35a1df4007f32de598490ee19ab8484c71840a8815c8581"}
Oct 30 21:00:59.877639 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:59.877547    4060 scope.go:122] "RemoveContainer" containerID="43f03630a7c8ae7f576c328775b23e6f75b7a16d3a439635a0e4011ef9e19fd2"
Oct 30 21:00:59.885698 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:59.885680    4060 scope.go:122] "RemoveContainer" containerID="43f03630a7c8ae7f576c328775b23e6f75b7a16d3a439635a0e4011ef9e19fd2"
Oct 30 21:00:59.885975 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:00:59.885957    4060 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"43f03630a7c8ae7f576c328775b23e6f75b7a16d3a439635a0e4011ef9e19fd2\": container with ID starting with 43f03630a7c8ae7f576c328775b23e6f75b7a16d3a439635a0e4011ef9e19fd2 not found: ID does not exist" containerID="43f03630a7c8ae7f576c328775b23e6f75b7a16d3a439635a0e4011ef9e19fd2"
Oct 30 21:00:59.886049 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:00:59.885987    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"43f03630a7c8ae7f576c328775b23e6f75b7a16d3a439635a0e4011ef9e19fd2"} err="failed to get container status \"43f03630a7c8ae7f576c328775b23e6f75b7a16d3a439635a0e4011ef9e19fd2\": rpc error: code = NotFound desc = could not find container \"43f03630a7c8ae7f576c328775b23e6f75b7a16d3a439635a0e4011ef9e19fd2\": container with ID starting with 43f03630a7c8ae7f576c328775b23e6f75b7a16d3a439635a0e4011ef9e19fd2 not found: ID does not exist"
Oct 30 21:01:00.041340 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:01:00.041307    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/korrel8r-66d6f7f696-szm9c"]
Oct 30 21:01:00.090554 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:01:00.090523    4060 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/korrel8r-66d6f7f696-szm9c"]
Oct 30 21:01:01.427460 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:01:01.427425    4060 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a073f6bb-592d-47b4-8ff0-bd99122fa385" path="/var/lib/kubelet/pods/a073f6bb-592d-47b4-8ff0-bd99122fa385/volumes"
Oct 30 21:01:12.150487 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:01:12.150405    4060 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v2f4x" containerName="extractor"
Oct 30 21:01:27.889553 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:01:27.889521    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:01:27.890154 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:01:27.889788    4060 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-collector-0" podUID="a00f6701-b181-4f6e-aa67-4d543aa1ac34" containerName="otc-container" containerID="cri-o://3fd91063e3d00ce68c5125eaecb08b94785e59edeca9689c16a4d94c167b7755" gracePeriod=30
Oct 30 21:01:30.237669 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:01:30.237646    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:01:30.347243 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:01:30.347166    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/a00f6701-b181-4f6e-aa67-4d543aa1ac34-data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/a00f6701-b181-4f6e-aa67-4d543aa1ac34-data-science-collector-ta-client-cert\") pod \"a00f6701-b181-4f6e-aa67-4d543aa1ac34\" (UID: \"a00f6701-b181-4f6e-aa67-4d543aa1ac34\") "
Oct 30 21:01:30.347390 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:01:30.347265    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/a00f6701-b181-4f6e-aa67-4d543aa1ac34-tls-certs\" (UniqueName: \"kubernetes.io/secret/a00f6701-b181-4f6e-aa67-4d543aa1ac34-tls-certs\") pod \"a00f6701-b181-4f6e-aa67-4d543aa1ac34\" (UID: \"a00f6701-b181-4f6e-aa67-4d543aa1ac34\") "
Oct 30 21:01:30.347390 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:01:30.347299    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/a00f6701-b181-4f6e-aa67-4d543aa1ac34-monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/a00f6701-b181-4f6e-aa67-4d543aa1ac34-monitoring-tls-certs\") pod \"a00f6701-b181-4f6e-aa67-4d543aa1ac34\" (UID: \"a00f6701-b181-4f6e-aa67-4d543aa1ac34\") "
Oct 30 21:01:30.347390 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:01:30.347339    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a00f6701-b181-4f6e-aa67-4d543aa1ac34-otc-internal\" (UniqueName: \"kubernetes.io/configmap/a00f6701-b181-4f6e-aa67-4d543aa1ac34-otc-internal\") pod \"a00f6701-b181-4f6e-aa67-4d543aa1ac34\" (UID: \"a00f6701-b181-4f6e-aa67-4d543aa1ac34\") "
Oct 30 21:01:30.347390 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:01:30.347373    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/a00f6701-b181-4f6e-aa67-4d543aa1ac34-otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/a00f6701-b181-4f6e-aa67-4d543aa1ac34-otlp-tls-certs\") pod \"a00f6701-b181-4f6e-aa67-4d543aa1ac34\" (UID: \"a00f6701-b181-4f6e-aa67-4d543aa1ac34\") "
Oct 30 21:01:30.347642 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:01:30.347414    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a00f6701-b181-4f6e-aa67-4d543aa1ac34-kube-api-access-nqhxb\" (UniqueName: \"kubernetes.io/projected/a00f6701-b181-4f6e-aa67-4d543aa1ac34-kube-api-access-nqhxb\") pod \"a00f6701-b181-4f6e-aa67-4d543aa1ac34\" (UID: \"a00f6701-b181-4f6e-aa67-4d543aa1ac34\") "
Oct 30 21:01:30.347783 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:01:30.347752    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a00f6701-b181-4f6e-aa67-4d543aa1ac34-otc-internal" pod "a00f6701-b181-4f6e-aa67-4d543aa1ac34" (UID: "a00f6701-b181-4f6e-aa67-4d543aa1ac34"). InnerVolumeSpecName "otc-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:01:30.349676 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:01:30.349641    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a00f6701-b181-4f6e-aa67-4d543aa1ac34-data-science-collector-ta-client-cert" pod "a00f6701-b181-4f6e-aa67-4d543aa1ac34" (UID: "a00f6701-b181-4f6e-aa67-4d543aa1ac34"). InnerVolumeSpecName "data-science-collector-ta-client-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:01:30.349776 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:01:30.349647    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a00f6701-b181-4f6e-aa67-4d543aa1ac34-kube-api-access-nqhxb" pod "a00f6701-b181-4f6e-aa67-4d543aa1ac34" (UID: "a00f6701-b181-4f6e-aa67-4d543aa1ac34"). InnerVolumeSpecName "kube-api-access-nqhxb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:01:30.349776 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:01:30.349753    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a00f6701-b181-4f6e-aa67-4d543aa1ac34-monitoring-tls-certs" pod "a00f6701-b181-4f6e-aa67-4d543aa1ac34" (UID: "a00f6701-b181-4f6e-aa67-4d543aa1ac34"). InnerVolumeSpecName "monitoring-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:01:30.349910 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:01:30.349889    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a00f6701-b181-4f6e-aa67-4d543aa1ac34-otlp-tls-certs" pod "a00f6701-b181-4f6e-aa67-4d543aa1ac34" (UID: "a00f6701-b181-4f6e-aa67-4d543aa1ac34"). InnerVolumeSpecName "otlp-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:01:30.349970 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:01:30.349949    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a00f6701-b181-4f6e-aa67-4d543aa1ac34-tls-certs" pod "a00f6701-b181-4f6e-aa67-4d543aa1ac34" (UID: "a00f6701-b181-4f6e-aa67-4d543aa1ac34"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:01:30.448393 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:01:30.448359    4060 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/a00f6701-b181-4f6e-aa67-4d543aa1ac34-data-science-collector-ta-client-cert\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:01:30.448393 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:01:30.448387    4060 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a00f6701-b181-4f6e-aa67-4d543aa1ac34-tls-certs\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:01:30.448393 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:01:30.448397    4060 reconciler_common.go:299] "Volume detached for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/a00f6701-b181-4f6e-aa67-4d543aa1ac34-monitoring-tls-certs\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:01:30.448655 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:01:30.448406    4060 reconciler_common.go:299] "Volume detached for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/a00f6701-b181-4f6e-aa67-4d543aa1ac34-otc-internal\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:01:30.448655 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:01:30.448414    4060 reconciler_common.go:299] "Volume detached for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/a00f6701-b181-4f6e-aa67-4d543aa1ac34-otlp-tls-certs\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:01:30.448655 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:01:30.448423    4060 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nqhxb\" (UniqueName: \"kubernetes.io/projected/a00f6701-b181-4f6e-aa67-4d543aa1ac34-kube-api-access-nqhxb\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:01:31.032126 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:01:31.032094    4060 generic.go:356] "Generic (PLEG): container finished" podID="a00f6701-b181-4f6e-aa67-4d543aa1ac34" containerID="3fd91063e3d00ce68c5125eaecb08b94785e59edeca9689c16a4d94c167b7755" exitCode=0
Oct 30 21:01:31.032273 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:01:31.032176    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"a00f6701-b181-4f6e-aa67-4d543aa1ac34","Type":"ContainerDied","Data":"3fd91063e3d00ce68c5125eaecb08b94785e59edeca9689c16a4d94c167b7755"}
Oct 30 21:01:31.032273 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:01:31.032197    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:01:31.032273 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:01:31.032220    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"a00f6701-b181-4f6e-aa67-4d543aa1ac34","Type":"ContainerDied","Data":"e9b328c309b597bab651348439f561d4ea32809447b93b527a3fbafd05563870"}
Oct 30 21:01:31.032273 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:01:31.032251    4060 scope.go:122] "RemoveContainer" containerID="3fd91063e3d00ce68c5125eaecb08b94785e59edeca9689c16a4d94c167b7755"
Oct 30 21:01:31.041093 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:01:31.041069    4060 scope.go:122] "RemoveContainer" containerID="3fd91063e3d00ce68c5125eaecb08b94785e59edeca9689c16a4d94c167b7755"
Oct 30 21:01:31.041379 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:01:31.041360    4060 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3fd91063e3d00ce68c5125eaecb08b94785e59edeca9689c16a4d94c167b7755\": container with ID starting with 3fd91063e3d00ce68c5125eaecb08b94785e59edeca9689c16a4d94c167b7755 not found: ID does not exist" containerID="3fd91063e3d00ce68c5125eaecb08b94785e59edeca9689c16a4d94c167b7755"
Oct 30 21:01:31.041458 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:01:31.041388    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3fd91063e3d00ce68c5125eaecb08b94785e59edeca9689c16a4d94c167b7755"} err="failed to get container status \"3fd91063e3d00ce68c5125eaecb08b94785e59edeca9689c16a4d94c167b7755\": rpc error: code = NotFound desc = could not find container \"3fd91063e3d00ce68c5125eaecb08b94785e59edeca9689c16a4d94c167b7755\": container with ID starting with 3fd91063e3d00ce68c5125eaecb08b94785e59edeca9689c16a4d94c167b7755 not found: ID does not exist"
Oct 30 21:01:31.196038 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:01:31.196003    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:01:31.245571 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:01:31.245534    4060 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:01:31.284737 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:01:31.284669    4060 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:01:31.284983 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:01:31.284971    4060 cpu_manager.go:414] "containerMap: removing container" podUID="a00f6701-b181-4f6e-aa67-4d543aa1ac34" containerName="otc-container"
Oct 30 21:01:31.285025 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:01:31.284984    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a00f6701-b181-4f6e-aa67-4d543aa1ac34" containerName="otc-container"
Oct 30 21:01:31.285025 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:01:31.284998    4060 cpu_manager.go:414] "containerMap: removing container" podUID="a073f6bb-592d-47b4-8ff0-bd99122fa385" containerName="korrel8r"
Oct 30 21:01:31.285025 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:01:31.285003    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a073f6bb-592d-47b4-8ff0-bd99122fa385" containerName="korrel8r"
Oct 30 21:01:31.285124 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:01:31.285071    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="a00f6701-b181-4f6e-aa67-4d543aa1ac34" containerName="otc-container"
Oct 30 21:01:31.285124 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:01:31.285079    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="a073f6bb-592d-47b4-8ff0-bd99122fa385" containerName="korrel8r"
Oct 30 21:01:31.289271 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:01:31.289252    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:01:31.343087 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:01:31.343063    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-headless-tls\""
Oct 30 21:01:31.343087 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:01:31.343070    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-ta-client-cert\""
Oct 30 21:01:31.343270 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:01:31.343129    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-tls\""
Oct 30 21:01:31.345758 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:01:31.345737    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-dockercfg-jqj7h\""
Oct 30 21:01:31.346317 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:01:31.346301    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-a0f9182a\""
Oct 30 21:01:31.348338 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:01:31.348317    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:01:31.427503 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:01:31.427468    4060 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a00f6701-b181-4f6e-aa67-4d543aa1ac34" path="/var/lib/kubelet/pods/a00f6701-b181-4f6e-aa67-4d543aa1ac34/volumes"
Oct 30 21:01:31.443775 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:01:31.443750    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-monitoring-tls\""
Oct 30 21:01:31.456097 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:01:31.456071    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/6c49d501-35e6-4ce8-8b4f-a5db59206a6f-otlp-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"6c49d501-35e6-4ce8-8b4f-a5db59206a6f\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:01:31.456186 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:01:31.456113    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6c49d501-35e6-4ce8-8b4f-a5db59206a6f-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"6c49d501-35e6-4ce8-8b4f-a5db59206a6f\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:01:31.456186 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:01:31.456134    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v6jcf\" (UniqueName: \"kubernetes.io/projected/6c49d501-35e6-4ce8-8b4f-a5db59206a6f-kube-api-access-v6jcf\") pod \"data-science-collector-collector-0\" (UID: \"6c49d501-35e6-4ce8-8b4f-a5db59206a6f\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:01:31.456259 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:01:31.456242    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/6c49d501-35e6-4ce8-8b4f-a5db59206a6f-monitoring-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"6c49d501-35e6-4ce8-8b4f-a5db59206a6f\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:01:31.456316 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:01:31.456301    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/6c49d501-35e6-4ce8-8b4f-a5db59206a6f-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-0\" (UID: \"6c49d501-35e6-4ce8-8b4f-a5db59206a6f\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:01:31.456398 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:01:31.456379    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/6c49d501-35e6-4ce8-8b4f-a5db59206a6f-otc-internal\") pod \"data-science-collector-collector-0\" (UID: \"6c49d501-35e6-4ce8-8b4f-a5db59206a6f\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:01:31.557230 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:01:31.557155    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6c49d501-35e6-4ce8-8b4f-a5db59206a6f-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"6c49d501-35e6-4ce8-8b4f-a5db59206a6f\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:01:31.557230 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:01:31.557187    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v6jcf\" (UniqueName: \"kubernetes.io/projected/6c49d501-35e6-4ce8-8b4f-a5db59206a6f-kube-api-access-v6jcf\") pod \"data-science-collector-collector-0\" (UID: \"6c49d501-35e6-4ce8-8b4f-a5db59206a6f\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:01:31.557230 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:01:31.557209    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/6c49d501-35e6-4ce8-8b4f-a5db59206a6f-monitoring-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"6c49d501-35e6-4ce8-8b4f-a5db59206a6f\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:01:31.557439 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:01:31.557253    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/6c49d501-35e6-4ce8-8b4f-a5db59206a6f-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-0\" (UID: \"6c49d501-35e6-4ce8-8b4f-a5db59206a6f\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:01:31.557439 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:01:31.557416    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/6c49d501-35e6-4ce8-8b4f-a5db59206a6f-otc-internal\") pod \"data-science-collector-collector-0\" (UID: \"6c49d501-35e6-4ce8-8b4f-a5db59206a6f\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:01:31.557554 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:01:31.557473    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/6c49d501-35e6-4ce8-8b4f-a5db59206a6f-otlp-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"6c49d501-35e6-4ce8-8b4f-a5db59206a6f\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:01:31.558223 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:01:31.558191    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/6c49d501-35e6-4ce8-8b4f-a5db59206a6f-otc-internal\") pod \"data-science-collector-collector-0\" (UID: \"6c49d501-35e6-4ce8-8b4f-a5db59206a6f\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:01:31.559823 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:01:31.559800    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/6c49d501-35e6-4ce8-8b4f-a5db59206a6f-monitoring-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"6c49d501-35e6-4ce8-8b4f-a5db59206a6f\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:01:31.559941 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:01:31.559911    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6c49d501-35e6-4ce8-8b4f-a5db59206a6f-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"6c49d501-35e6-4ce8-8b4f-a5db59206a6f\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:01:31.560006 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:01:31.559965    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/6c49d501-35e6-4ce8-8b4f-a5db59206a6f-otlp-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"6c49d501-35e6-4ce8-8b4f-a5db59206a6f\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:01:31.560120 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:01:31.560097    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/6c49d501-35e6-4ce8-8b4f-a5db59206a6f-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-0\" (UID: \"6c49d501-35e6-4ce8-8b4f-a5db59206a6f\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:01:31.619101 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:01:31.619062    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v6jcf\" (UniqueName: \"kubernetes.io/projected/6c49d501-35e6-4ce8-8b4f-a5db59206a6f-kube-api-access-v6jcf\") pod \"data-science-collector-collector-0\" (UID: \"6c49d501-35e6-4ce8-8b4f-a5db59206a6f\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:01:31.901307 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:01:31.901219    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:01:32.274710 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:01:32.274669    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:01:32.305733 ip-10-0-142-4 kubenswrapper[4060]: W1030 21:01:32.305702    4060 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c49d501_35e6_4ce8_8b4f_a5db59206a6f.slice/crio-cf4c11ee22ea66a6da7623da503de56d19795d28b17d01e4d21f4271f83f653e WatchSource:0}: Error finding container cf4c11ee22ea66a6da7623da503de56d19795d28b17d01e4d21f4271f83f653e: Status 404 returned error can't find the container with id cf4c11ee22ea66a6da7623da503de56d19795d28b17d01e4d21f4271f83f653e
Oct 30 21:01:32.307874 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:01:32.307832    4060 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 21:01:32.307999 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:01:32.307911    4060 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 21:01:33.049724 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:01:33.049684    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"6c49d501-35e6-4ce8-8b4f-a5db59206a6f","Type":"ContainerStarted","Data":"23b5630d4ef1760b41719090b893585e351d692042089ccb39189592222d01fe"}
Oct 30 21:01:33.049927 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:01:33.049745    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"6c49d501-35e6-4ce8-8b4f-a5db59206a6f","Type":"ContainerStarted","Data":"cf4c11ee22ea66a6da7623da503de56d19795d28b17d01e4d21f4271f83f653e"}
Oct 30 21:01:33.170032 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:01:33.169984    4060 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-collector-0" podStartSLOduration=2.169970622 podStartE2EDuration="2.169970622s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:01:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:01:33.169273103 +0000 UTC m=+1511.926271401" watchObservedRunningTime="2026-10-30 21:01:33.169970622 +0000 UTC m=+1511.926968920"
Oct 30 21:01:42.149985 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:01:42.149951    4060 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v2f4x" containerName="extractor"
Oct 30 21:01:59.047260 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:01:59.047223    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:01:59.047856 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:01:59.047436    4060 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-collector-0" podUID="6c49d501-35e6-4ce8-8b4f-a5db59206a6f" containerName="otc-container" containerID="cri-o://23b5630d4ef1760b41719090b893585e351d692042089ccb39189592222d01fe" gracePeriod=30
Oct 30 21:02:01.388555 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:02:01.388529    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:02:01.485960 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:02:01.485928    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/6c49d501-35e6-4ce8-8b4f-a5db59206a6f-tls-certs\" (UniqueName: \"kubernetes.io/secret/6c49d501-35e6-4ce8-8b4f-a5db59206a6f-tls-certs\") pod \"6c49d501-35e6-4ce8-8b4f-a5db59206a6f\" (UID: \"6c49d501-35e6-4ce8-8b4f-a5db59206a6f\") "
Oct 30 21:02:01.486138 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:02:01.485965    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/6c49d501-35e6-4ce8-8b4f-a5db59206a6f-monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/6c49d501-35e6-4ce8-8b4f-a5db59206a6f-monitoring-tls-certs\") pod \"6c49d501-35e6-4ce8-8b4f-a5db59206a6f\" (UID: \"6c49d501-35e6-4ce8-8b4f-a5db59206a6f\") "
Oct 30 21:02:01.486138 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:02:01.485991    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/6c49d501-35e6-4ce8-8b4f-a5db59206a6f-data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/6c49d501-35e6-4ce8-8b4f-a5db59206a6f-data-science-collector-ta-client-cert\") pod \"6c49d501-35e6-4ce8-8b4f-a5db59206a6f\" (UID: \"6c49d501-35e6-4ce8-8b4f-a5db59206a6f\") "
Oct 30 21:02:01.486138 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:02:01.486008    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/6c49d501-35e6-4ce8-8b4f-a5db59206a6f-otc-internal\" (UniqueName: \"kubernetes.io/configmap/6c49d501-35e6-4ce8-8b4f-a5db59206a6f-otc-internal\") pod \"6c49d501-35e6-4ce8-8b4f-a5db59206a6f\" (UID: \"6c49d501-35e6-4ce8-8b4f-a5db59206a6f\") "
Oct 30 21:02:01.486138 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:02:01.486056    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6c49d501-35e6-4ce8-8b4f-a5db59206a6f-kube-api-access-v6jcf\" (UniqueName: \"kubernetes.io/projected/6c49d501-35e6-4ce8-8b4f-a5db59206a6f-kube-api-access-v6jcf\") pod \"6c49d501-35e6-4ce8-8b4f-a5db59206a6f\" (UID: \"6c49d501-35e6-4ce8-8b4f-a5db59206a6f\") "
Oct 30 21:02:01.486138 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:02:01.486091    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/6c49d501-35e6-4ce8-8b4f-a5db59206a6f-otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/6c49d501-35e6-4ce8-8b4f-a5db59206a6f-otlp-tls-certs\") pod \"6c49d501-35e6-4ce8-8b4f-a5db59206a6f\" (UID: \"6c49d501-35e6-4ce8-8b4f-a5db59206a6f\") "
Oct 30 21:02:01.486577 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:02:01.486541    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6c49d501-35e6-4ce8-8b4f-a5db59206a6f-otc-internal" pod "6c49d501-35e6-4ce8-8b4f-a5db59206a6f" (UID: "6c49d501-35e6-4ce8-8b4f-a5db59206a6f"). InnerVolumeSpecName "otc-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:02:01.488234 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:02:01.488202    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6c49d501-35e6-4ce8-8b4f-a5db59206a6f-data-science-collector-ta-client-cert" pod "6c49d501-35e6-4ce8-8b4f-a5db59206a6f" (UID: "6c49d501-35e6-4ce8-8b4f-a5db59206a6f"). InnerVolumeSpecName "data-science-collector-ta-client-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:02:01.488234 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:02:01.488220    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6c49d501-35e6-4ce8-8b4f-a5db59206a6f-tls-certs" pod "6c49d501-35e6-4ce8-8b4f-a5db59206a6f" (UID: "6c49d501-35e6-4ce8-8b4f-a5db59206a6f"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:02:01.488360 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:02:01.488269    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6c49d501-35e6-4ce8-8b4f-a5db59206a6f-otlp-tls-certs" pod "6c49d501-35e6-4ce8-8b4f-a5db59206a6f" (UID: "6c49d501-35e6-4ce8-8b4f-a5db59206a6f"). InnerVolumeSpecName "otlp-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:02:01.488603 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:02:01.488585    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6c49d501-35e6-4ce8-8b4f-a5db59206a6f-kube-api-access-v6jcf" pod "6c49d501-35e6-4ce8-8b4f-a5db59206a6f" (UID: "6c49d501-35e6-4ce8-8b4f-a5db59206a6f"). InnerVolumeSpecName "kube-api-access-v6jcf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:02:01.488603 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:02:01.488593    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6c49d501-35e6-4ce8-8b4f-a5db59206a6f-monitoring-tls-certs" pod "6c49d501-35e6-4ce8-8b4f-a5db59206a6f" (UID: "6c49d501-35e6-4ce8-8b4f-a5db59206a6f"). InnerVolumeSpecName "monitoring-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:02:01.586711 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:02:01.586676    4060 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v6jcf\" (UniqueName: \"kubernetes.io/projected/6c49d501-35e6-4ce8-8b4f-a5db59206a6f-kube-api-access-v6jcf\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:02:01.586711 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:02:01.586705    4060 reconciler_common.go:299] "Volume detached for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/6c49d501-35e6-4ce8-8b4f-a5db59206a6f-otlp-tls-certs\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:02:01.586711 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:02:01.586716    4060 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6c49d501-35e6-4ce8-8b4f-a5db59206a6f-tls-certs\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:02:01.586965 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:02:01.586727    4060 reconciler_common.go:299] "Volume detached for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/6c49d501-35e6-4ce8-8b4f-a5db59206a6f-monitoring-tls-certs\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:02:01.586965 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:02:01.586737    4060 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/6c49d501-35e6-4ce8-8b4f-a5db59206a6f-data-science-collector-ta-client-cert\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:02:01.586965 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:02:01.586745    4060 reconciler_common.go:299] "Volume detached for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/6c49d501-35e6-4ce8-8b4f-a5db59206a6f-otc-internal\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:02:02.186202 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:02:02.186167    4060 generic.go:356] "Generic (PLEG): container finished" podID="6c49d501-35e6-4ce8-8b4f-a5db59206a6f" containerID="23b5630d4ef1760b41719090b893585e351d692042089ccb39189592222d01fe" exitCode=0
Oct 30 21:02:02.186409 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:02:02.186218    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:02:02.186409 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:02:02.186225    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"6c49d501-35e6-4ce8-8b4f-a5db59206a6f","Type":"ContainerDied","Data":"23b5630d4ef1760b41719090b893585e351d692042089ccb39189592222d01fe"}
Oct 30 21:02:02.186409 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:02:02.186267    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"6c49d501-35e6-4ce8-8b4f-a5db59206a6f","Type":"ContainerDied","Data":"cf4c11ee22ea66a6da7623da503de56d19795d28b17d01e4d21f4271f83f653e"}
Oct 30 21:02:02.186409 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:02:02.186289    4060 scope.go:122] "RemoveContainer" containerID="23b5630d4ef1760b41719090b893585e351d692042089ccb39189592222d01fe"
Oct 30 21:02:02.195533 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:02:02.195512    4060 scope.go:122] "RemoveContainer" containerID="23b5630d4ef1760b41719090b893585e351d692042089ccb39189592222d01fe"
Oct 30 21:02:02.195818 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:02:02.195799    4060 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"23b5630d4ef1760b41719090b893585e351d692042089ccb39189592222d01fe\": container with ID starting with 23b5630d4ef1760b41719090b893585e351d692042089ccb39189592222d01fe not found: ID does not exist" containerID="23b5630d4ef1760b41719090b893585e351d692042089ccb39189592222d01fe"
Oct 30 21:02:02.195899 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:02:02.195830    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"23b5630d4ef1760b41719090b893585e351d692042089ccb39189592222d01fe"} err="failed to get container status \"23b5630d4ef1760b41719090b893585e351d692042089ccb39189592222d01fe\": rpc error: code = NotFound desc = could not find container \"23b5630d4ef1760b41719090b893585e351d692042089ccb39189592222d01fe\": container with ID starting with 23b5630d4ef1760b41719090b893585e351d692042089ccb39189592222d01fe not found: ID does not exist"
Oct 30 21:02:02.350987 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:02:02.350946    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:02:02.400486 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:02:02.400440    4060 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:02:02.432122 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:02:02.432090    4060 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:02:02.432451 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:02:02.432435    4060 cpu_manager.go:414] "containerMap: removing container" podUID="6c49d501-35e6-4ce8-8b4f-a5db59206a6f" containerName="otc-container"
Oct 30 21:02:02.432525 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:02:02.432454    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6c49d501-35e6-4ce8-8b4f-a5db59206a6f" containerName="otc-container"
Oct 30 21:02:02.432575 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:02:02.432550    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="6c49d501-35e6-4ce8-8b4f-a5db59206a6f" containerName="otc-container"
Oct 30 21:02:02.437178 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:02:02.436933    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:02:02.490960 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:02:02.490932    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-tls\""
Oct 30 21:02:02.491128 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:02:02.491001    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-ta-client-cert\""
Oct 30 21:02:02.491128 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:02:02.491018    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-monitoring-tls\""
Oct 30 21:02:02.491128 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:02:02.491025    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-dockercfg-jqj7h\""
Oct 30 21:02:02.491128 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:02:02.491035    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-headless-tls\""
Oct 30 21:02:02.491128 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:02:02.491067    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-a0f9182a\""
Oct 30 21:02:02.494924 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:02:02.494901    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/21b6a997-ab27-4e2c-9271-146d75b6c9d6-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"21b6a997-ab27-4e2c-9271-146d75b6c9d6\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:02:02.495058 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:02:02.494931    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wt9pf\" (UniqueName: \"kubernetes.io/projected/21b6a997-ab27-4e2c-9271-146d75b6c9d6-kube-api-access-wt9pf\") pod \"data-science-collector-collector-0\" (UID: \"21b6a997-ab27-4e2c-9271-146d75b6c9d6\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:02:02.495058 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:02:02.494952    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/21b6a997-ab27-4e2c-9271-146d75b6c9d6-monitoring-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"21b6a997-ab27-4e2c-9271-146d75b6c9d6\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:02:02.495148 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:02:02.495104    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/21b6a997-ab27-4e2c-9271-146d75b6c9d6-otlp-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"21b6a997-ab27-4e2c-9271-146d75b6c9d6\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:02:02.495148 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:02:02.495139    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/21b6a997-ab27-4e2c-9271-146d75b6c9d6-otc-internal\") pod \"data-science-collector-collector-0\" (UID: \"21b6a997-ab27-4e2c-9271-146d75b6c9d6\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:02:02.495228 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:02:02.495171    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/21b6a997-ab27-4e2c-9271-146d75b6c9d6-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-0\" (UID: \"21b6a997-ab27-4e2c-9271-146d75b6c9d6\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:02:02.496796 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:02:02.496770    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:02:02.596429 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:02:02.596392    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/21b6a997-ab27-4e2c-9271-146d75b6c9d6-otlp-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"21b6a997-ab27-4e2c-9271-146d75b6c9d6\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:02:02.596652 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:02:02.596438    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/21b6a997-ab27-4e2c-9271-146d75b6c9d6-otc-internal\") pod \"data-science-collector-collector-0\" (UID: \"21b6a997-ab27-4e2c-9271-146d75b6c9d6\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:02:02.596652 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:02:02.596468    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/21b6a997-ab27-4e2c-9271-146d75b6c9d6-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-0\" (UID: \"21b6a997-ab27-4e2c-9271-146d75b6c9d6\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:02:02.596652 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:02:02.596522    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/21b6a997-ab27-4e2c-9271-146d75b6c9d6-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"21b6a997-ab27-4e2c-9271-146d75b6c9d6\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:02:02.596652 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:02:02.596541    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wt9pf\" (UniqueName: \"kubernetes.io/projected/21b6a997-ab27-4e2c-9271-146d75b6c9d6-kube-api-access-wt9pf\") pod \"data-science-collector-collector-0\" (UID: \"21b6a997-ab27-4e2c-9271-146d75b6c9d6\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:02:02.596652 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:02:02.596568    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/21b6a997-ab27-4e2c-9271-146d75b6c9d6-monitoring-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"21b6a997-ab27-4e2c-9271-146d75b6c9d6\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:02:02.597301 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:02:02.597274    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/21b6a997-ab27-4e2c-9271-146d75b6c9d6-otc-internal\") pod \"data-science-collector-collector-0\" (UID: \"21b6a997-ab27-4e2c-9271-146d75b6c9d6\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:02:02.599185 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:02:02.599148    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/21b6a997-ab27-4e2c-9271-146d75b6c9d6-otlp-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"21b6a997-ab27-4e2c-9271-146d75b6c9d6\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:02:02.599301 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:02:02.599151    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/21b6a997-ab27-4e2c-9271-146d75b6c9d6-monitoring-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"21b6a997-ab27-4e2c-9271-146d75b6c9d6\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:02:02.599301 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:02:02.599232    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/21b6a997-ab27-4e2c-9271-146d75b6c9d6-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-0\" (UID: \"21b6a997-ab27-4e2c-9271-146d75b6c9d6\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:02:02.599301 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:02:02.599277    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/21b6a997-ab27-4e2c-9271-146d75b6c9d6-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"21b6a997-ab27-4e2c-9271-146d75b6c9d6\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:02:02.660060 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:02:02.660029    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wt9pf\" (UniqueName: \"kubernetes.io/projected/21b6a997-ab27-4e2c-9271-146d75b6c9d6-kube-api-access-wt9pf\") pod \"data-science-collector-collector-0\" (UID: \"21b6a997-ab27-4e2c-9271-146d75b6c9d6\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:02:02.752091 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:02:02.752057    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:02:03.125562 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:02:03.125485    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:02:03.127763 ip-10-0-142-4 kubenswrapper[4060]: W1030 21:02:03.127733    4060 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21b6a997_ab27_4e2c_9271_146d75b6c9d6.slice/crio-324ccddda1b72873ddb2688e8775f056e3631c879b9ad0382ba1d00d8b4cd6d0 WatchSource:0}: Error finding container 324ccddda1b72873ddb2688e8775f056e3631c879b9ad0382ba1d00d8b4cd6d0: Status 404 returned error can't find the container with id 324ccddda1b72873ddb2688e8775f056e3631c879b9ad0382ba1d00d8b4cd6d0
Oct 30 21:02:03.129886 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:02:03.129854    4060 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 21:02:03.129966 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:02:03.129916    4060 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 21:02:03.194425 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:02:03.194391    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"21b6a997-ab27-4e2c-9271-146d75b6c9d6","Type":"ContainerStarted","Data":"6436e84223ae5c64b3c319843fff3e2a08b0a487d5f47e718d24a93f2cfea89f"}
Oct 30 21:02:03.194568 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:02:03.194485    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"21b6a997-ab27-4e2c-9271-146d75b6c9d6","Type":"ContainerStarted","Data":"324ccddda1b72873ddb2688e8775f056e3631c879b9ad0382ba1d00d8b4cd6d0"}
Oct 30 21:02:03.427181 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:02:03.427102    4060 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="6c49d501-35e6-4ce8-8b4f-a5db59206a6f" path="/var/lib/kubelet/pods/6c49d501-35e6-4ce8-8b4f-a5db59206a6f/volumes"
Oct 30 21:02:12.149724 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:02:12.149680    4060 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v2f4x" containerName="extractor"
Oct 30 21:02:37.234771 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:02:37.234679    4060 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-collector-0" podStartSLOduration=35.234663566 podStartE2EDuration="35.234663566s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:02:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:02:03.311219946 +0000 UTC m=+1542.068218245" watchObservedRunningTime="2026-10-30 21:02:37.234663566 +0000 UTC m=+1575.991661862"
Oct 30 21:02:37.235776 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:02:37.235752    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:02:37.235980 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:02:37.235958    4060 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-collector-0" podUID="21b6a997-ab27-4e2c-9271-146d75b6c9d6" containerName="otc-container" containerID="cri-o://6436e84223ae5c64b3c319843fff3e2a08b0a487d5f47e718d24a93f2cfea89f" gracePeriod=30
Oct 30 21:02:39.572406 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:02:39.572380    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:02:39.712106 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:02:39.712076    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/21b6a997-ab27-4e2c-9271-146d75b6c9d6-tls-certs\" (UniqueName: \"kubernetes.io/secret/21b6a997-ab27-4e2c-9271-146d75b6c9d6-tls-certs\") pod \"21b6a997-ab27-4e2c-9271-146d75b6c9d6\" (UID: \"21b6a997-ab27-4e2c-9271-146d75b6c9d6\") "
Oct 30 21:02:39.712282 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:02:39.712141    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/21b6a997-ab27-4e2c-9271-146d75b6c9d6-kube-api-access-wt9pf\" (UniqueName: \"kubernetes.io/projected/21b6a997-ab27-4e2c-9271-146d75b6c9d6-kube-api-access-wt9pf\") pod \"21b6a997-ab27-4e2c-9271-146d75b6c9d6\" (UID: \"21b6a997-ab27-4e2c-9271-146d75b6c9d6\") "
Oct 30 21:02:39.712282 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:02:39.712229    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/21b6a997-ab27-4e2c-9271-146d75b6c9d6-otc-internal\" (UniqueName: \"kubernetes.io/configmap/21b6a997-ab27-4e2c-9271-146d75b6c9d6-otc-internal\") pod \"21b6a997-ab27-4e2c-9271-146d75b6c9d6\" (UID: \"21b6a997-ab27-4e2c-9271-146d75b6c9d6\") "
Oct 30 21:02:39.712282 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:02:39.712275    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/21b6a997-ab27-4e2c-9271-146d75b6c9d6-monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/21b6a997-ab27-4e2c-9271-146d75b6c9d6-monitoring-tls-certs\") pod \"21b6a997-ab27-4e2c-9271-146d75b6c9d6\" (UID: \"21b6a997-ab27-4e2c-9271-146d75b6c9d6\") "
Oct 30 21:02:39.712449 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:02:39.712304    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/21b6a997-ab27-4e2c-9271-146d75b6c9d6-data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/21b6a997-ab27-4e2c-9271-146d75b6c9d6-data-science-collector-ta-client-cert\") pod \"21b6a997-ab27-4e2c-9271-146d75b6c9d6\" (UID: \"21b6a997-ab27-4e2c-9271-146d75b6c9d6\") "
Oct 30 21:02:39.712449 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:02:39.712352    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/21b6a997-ab27-4e2c-9271-146d75b6c9d6-otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/21b6a997-ab27-4e2c-9271-146d75b6c9d6-otlp-tls-certs\") pod \"21b6a997-ab27-4e2c-9271-146d75b6c9d6\" (UID: \"21b6a997-ab27-4e2c-9271-146d75b6c9d6\") "
Oct 30 21:02:39.712650 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:02:39.712626    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/21b6a997-ab27-4e2c-9271-146d75b6c9d6-otc-internal" pod "21b6a997-ab27-4e2c-9271-146d75b6c9d6" (UID: "21b6a997-ab27-4e2c-9271-146d75b6c9d6"). InnerVolumeSpecName "otc-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:02:39.714476 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:02:39.714440    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/21b6a997-ab27-4e2c-9271-146d75b6c9d6-monitoring-tls-certs" pod "21b6a997-ab27-4e2c-9271-146d75b6c9d6" (UID: "21b6a997-ab27-4e2c-9271-146d75b6c9d6"). InnerVolumeSpecName "monitoring-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:02:39.714681 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:02:39.714485    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/21b6a997-ab27-4e2c-9271-146d75b6c9d6-data-science-collector-ta-client-cert" pod "21b6a997-ab27-4e2c-9271-146d75b6c9d6" (UID: "21b6a997-ab27-4e2c-9271-146d75b6c9d6"). InnerVolumeSpecName "data-science-collector-ta-client-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:02:39.714736 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:02:39.714679    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/21b6a997-ab27-4e2c-9271-146d75b6c9d6-tls-certs" pod "21b6a997-ab27-4e2c-9271-146d75b6c9d6" (UID: "21b6a997-ab27-4e2c-9271-146d75b6c9d6"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:02:39.714791 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:02:39.714775    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/21b6a997-ab27-4e2c-9271-146d75b6c9d6-otlp-tls-certs" pod "21b6a997-ab27-4e2c-9271-146d75b6c9d6" (UID: "21b6a997-ab27-4e2c-9271-146d75b6c9d6"). InnerVolumeSpecName "otlp-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:02:39.714874 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:02:39.714858    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/21b6a997-ab27-4e2c-9271-146d75b6c9d6-kube-api-access-wt9pf" pod "21b6a997-ab27-4e2c-9271-146d75b6c9d6" (UID: "21b6a997-ab27-4e2c-9271-146d75b6c9d6"). InnerVolumeSpecName "kube-api-access-wt9pf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:02:39.813204 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:02:39.813172    4060 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/21b6a997-ab27-4e2c-9271-146d75b6c9d6-tls-certs\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:02:39.813204 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:02:39.813200    4060 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wt9pf\" (UniqueName: \"kubernetes.io/projected/21b6a997-ab27-4e2c-9271-146d75b6c9d6-kube-api-access-wt9pf\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:02:39.813204 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:02:39.813209    4060 reconciler_common.go:299] "Volume detached for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/21b6a997-ab27-4e2c-9271-146d75b6c9d6-otc-internal\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:02:39.813425 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:02:39.813220    4060 reconciler_common.go:299] "Volume detached for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/21b6a997-ab27-4e2c-9271-146d75b6c9d6-monitoring-tls-certs\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:02:39.813425 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:02:39.813229    4060 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/21b6a997-ab27-4e2c-9271-146d75b6c9d6-data-science-collector-ta-client-cert\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:02:39.813425 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:02:39.813237    4060 reconciler_common.go:299] "Volume detached for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/21b6a997-ab27-4e2c-9271-146d75b6c9d6-otlp-tls-certs\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:02:40.376763 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:02:40.376726    4060 generic.go:356] "Generic (PLEG): container finished" podID="21b6a997-ab27-4e2c-9271-146d75b6c9d6" containerID="6436e84223ae5c64b3c319843fff3e2a08b0a487d5f47e718d24a93f2cfea89f" exitCode=0
Oct 30 21:02:40.376942 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:02:40.376778    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:02:40.376942 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:02:40.376780    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"21b6a997-ab27-4e2c-9271-146d75b6c9d6","Type":"ContainerDied","Data":"6436e84223ae5c64b3c319843fff3e2a08b0a487d5f47e718d24a93f2cfea89f"}
Oct 30 21:02:40.376942 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:02:40.376833    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"21b6a997-ab27-4e2c-9271-146d75b6c9d6","Type":"ContainerDied","Data":"324ccddda1b72873ddb2688e8775f056e3631c879b9ad0382ba1d00d8b4cd6d0"}
Oct 30 21:02:40.376942 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:02:40.376863    4060 scope.go:122] "RemoveContainer" containerID="6436e84223ae5c64b3c319843fff3e2a08b0a487d5f47e718d24a93f2cfea89f"
Oct 30 21:02:40.386244 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:02:40.386226    4060 scope.go:122] "RemoveContainer" containerID="6436e84223ae5c64b3c319843fff3e2a08b0a487d5f47e718d24a93f2cfea89f"
Oct 30 21:02:40.386523 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:02:40.386482    4060 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6436e84223ae5c64b3c319843fff3e2a08b0a487d5f47e718d24a93f2cfea89f\": container with ID starting with 6436e84223ae5c64b3c319843fff3e2a08b0a487d5f47e718d24a93f2cfea89f not found: ID does not exist" containerID="6436e84223ae5c64b3c319843fff3e2a08b0a487d5f47e718d24a93f2cfea89f"
Oct 30 21:02:40.386598 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:02:40.386538    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6436e84223ae5c64b3c319843fff3e2a08b0a487d5f47e718d24a93f2cfea89f"} err="failed to get container status \"6436e84223ae5c64b3c319843fff3e2a08b0a487d5f47e718d24a93f2cfea89f\": rpc error: code = NotFound desc = could not find container \"6436e84223ae5c64b3c319843fff3e2a08b0a487d5f47e718d24a93f2cfea89f\": container with ID starting with 6436e84223ae5c64b3c319843fff3e2a08b0a487d5f47e718d24a93f2cfea89f not found: ID does not exist"
Oct 30 21:02:40.541049 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:02:40.541018    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:02:40.590305 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:02:40.590275    4060 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:02:40.624248 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:02:40.624215    4060 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:02:40.624566 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:02:40.624553    4060 cpu_manager.go:414] "containerMap: removing container" podUID="21b6a997-ab27-4e2c-9271-146d75b6c9d6" containerName="otc-container"
Oct 30 21:02:40.624607 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:02:40.624566    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="21b6a997-ab27-4e2c-9271-146d75b6c9d6" containerName="otc-container"
Oct 30 21:02:40.624652 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:02:40.624629    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="21b6a997-ab27-4e2c-9271-146d75b6c9d6" containerName="otc-container"
Oct 30 21:02:40.629018 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:02:40.628952    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:02:40.681771 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:02:40.681743    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-dockercfg-jqj7h\""
Oct 30 21:02:40.681771 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:02:40.681748    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-ta-client-cert\""
Oct 30 21:02:40.681974 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:02:40.681770    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-tls\""
Oct 30 21:02:40.681974 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:02:40.681845    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-monitoring-tls\""
Oct 30 21:02:40.681974 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:02:40.681848    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-headless-tls\""
Oct 30 21:02:40.681974 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:02:40.681936    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-a0f9182a\""
Oct 30 21:02:40.690438 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:02:40.690414    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:02:40.822457 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:02:40.822423    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/43ad29dd-e4ec-405f-8e7a-d566efa136b6-otc-internal\") pod \"data-science-collector-collector-0\" (UID: \"43ad29dd-e4ec-405f-8e7a-d566efa136b6\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:02:40.822658 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:02:40.822488    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/43ad29dd-e4ec-405f-8e7a-d566efa136b6-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-0\" (UID: \"43ad29dd-e4ec-405f-8e7a-d566efa136b6\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:02:40.822658 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:02:40.822595    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/43ad29dd-e4ec-405f-8e7a-d566efa136b6-monitoring-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"43ad29dd-e4ec-405f-8e7a-d566efa136b6\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:02:40.822658 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:02:40.822620    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/43ad29dd-e4ec-405f-8e7a-d566efa136b6-otlp-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"43ad29dd-e4ec-405f-8e7a-d566efa136b6\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:02:40.822658 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:02:40.822654    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n8bsj\" (UniqueName: \"kubernetes.io/projected/43ad29dd-e4ec-405f-8e7a-d566efa136b6-kube-api-access-n8bsj\") pod \"data-science-collector-collector-0\" (UID: \"43ad29dd-e4ec-405f-8e7a-d566efa136b6\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:02:40.822823 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:02:40.822714    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/43ad29dd-e4ec-405f-8e7a-d566efa136b6-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"43ad29dd-e4ec-405f-8e7a-d566efa136b6\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:02:40.923170 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:02:40.923091    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/43ad29dd-e4ec-405f-8e7a-d566efa136b6-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-0\" (UID: \"43ad29dd-e4ec-405f-8e7a-d566efa136b6\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:02:40.923170 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:02:40.923129    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/43ad29dd-e4ec-405f-8e7a-d566efa136b6-monitoring-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"43ad29dd-e4ec-405f-8e7a-d566efa136b6\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:02:40.923170 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:02:40.923146    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/43ad29dd-e4ec-405f-8e7a-d566efa136b6-otlp-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"43ad29dd-e4ec-405f-8e7a-d566efa136b6\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:02:40.923405 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:02:40.923200    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n8bsj\" (UniqueName: \"kubernetes.io/projected/43ad29dd-e4ec-405f-8e7a-d566efa136b6-kube-api-access-n8bsj\") pod \"data-science-collector-collector-0\" (UID: \"43ad29dd-e4ec-405f-8e7a-d566efa136b6\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:02:40.923405 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:02:40.923232    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/43ad29dd-e4ec-405f-8e7a-d566efa136b6-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"43ad29dd-e4ec-405f-8e7a-d566efa136b6\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:02:40.923405 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:02:40.923294    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/43ad29dd-e4ec-405f-8e7a-d566efa136b6-otc-internal\") pod \"data-science-collector-collector-0\" (UID: \"43ad29dd-e4ec-405f-8e7a-d566efa136b6\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:02:40.924092 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:02:40.924064    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/43ad29dd-e4ec-405f-8e7a-d566efa136b6-otc-internal\") pod \"data-science-collector-collector-0\" (UID: \"43ad29dd-e4ec-405f-8e7a-d566efa136b6\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:02:40.925696 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:02:40.925671    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/43ad29dd-e4ec-405f-8e7a-d566efa136b6-monitoring-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"43ad29dd-e4ec-405f-8e7a-d566efa136b6\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:02:40.925791 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:02:40.925740    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/43ad29dd-e4ec-405f-8e7a-d566efa136b6-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"43ad29dd-e4ec-405f-8e7a-d566efa136b6\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:02:40.925831 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:02:40.925817    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/43ad29dd-e4ec-405f-8e7a-d566efa136b6-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-0\" (UID: \"43ad29dd-e4ec-405f-8e7a-d566efa136b6\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:02:40.925927 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:02:40.925904    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/43ad29dd-e4ec-405f-8e7a-d566efa136b6-otlp-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"43ad29dd-e4ec-405f-8e7a-d566efa136b6\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:02:40.984135 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:02:40.984105    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n8bsj\" (UniqueName: \"kubernetes.io/projected/43ad29dd-e4ec-405f-8e7a-d566efa136b6-kube-api-access-n8bsj\") pod \"data-science-collector-collector-0\" (UID: \"43ad29dd-e4ec-405f-8e7a-d566efa136b6\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:02:41.241538 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:02:41.241507    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:02:41.427050 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:02:41.427018    4060 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="21b6a997-ab27-4e2c-9271-146d75b6c9d6" path="/var/lib/kubelet/pods/21b6a997-ab27-4e2c-9271-146d75b6c9d6/volumes"
Oct 30 21:02:41.615867 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:02:41.615793    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:02:41.645592 ip-10-0-142-4 kubenswrapper[4060]: W1030 21:02:41.645556    4060 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43ad29dd_e4ec_405f_8e7a_d566efa136b6.slice/crio-5bcc71c63c86568d1889591365f677881180527d5cbf661333113e68e8153d9e WatchSource:0}: Error finding container 5bcc71c63c86568d1889591365f677881180527d5cbf661333113e68e8153d9e: Status 404 returned error can't find the container with id 5bcc71c63c86568d1889591365f677881180527d5cbf661333113e68e8153d9e
Oct 30 21:02:41.647598 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:02:41.647563    4060 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 21:02:41.647690 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:02:41.647624    4060 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 21:02:42.150837 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:02:42.150795    4060 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v2f4x" containerName="extractor"
Oct 30 21:02:42.394176 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:02:42.394144    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"43ad29dd-e4ec-405f-8e7a-d566efa136b6","Type":"ContainerStarted","Data":"b34f5e00bc9ce617b2d70a6acfb4d32c2189c1b507ab512c5b7a3a1ffcf43ba4"}
Oct 30 21:02:42.394386 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:02:42.394205    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"43ad29dd-e4ec-405f-8e7a-d566efa136b6","Type":"ContainerStarted","Data":"5bcc71c63c86568d1889591365f677881180527d5cbf661333113e68e8153d9e"}
Oct 30 21:02:42.512045 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:02:42.511986    4060 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-collector-0" podStartSLOduration=2.511970024 podStartE2EDuration="2.511970024s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:02:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:02:42.511140787 +0000 UTC m=+1581.268139097" watchObservedRunningTime="2026-10-30 21:02:42.511970024 +0000 UTC m=+1581.268968322"
Oct 30 21:03:03.379481 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:03:03.379433    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:03:03.379944 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:03:03.379720    4060 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-collector-0" podUID="43ad29dd-e4ec-405f-8e7a-d566efa136b6" containerName="otc-container" containerID="cri-o://b34f5e00bc9ce617b2d70a6acfb4d32c2189c1b507ab512c5b7a3a1ffcf43ba4" gracePeriod=30
Oct 30 21:03:05.719147 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:03:05.719117    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:03:05.814359 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:03:05.814279    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/43ad29dd-e4ec-405f-8e7a-d566efa136b6-otc-internal\" (UniqueName: \"kubernetes.io/configmap/43ad29dd-e4ec-405f-8e7a-d566efa136b6-otc-internal\") pod \"43ad29dd-e4ec-405f-8e7a-d566efa136b6\" (UID: \"43ad29dd-e4ec-405f-8e7a-d566efa136b6\") "
Oct 30 21:03:05.814359 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:03:05.814337    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/43ad29dd-e4ec-405f-8e7a-d566efa136b6-kube-api-access-n8bsj\" (UniqueName: \"kubernetes.io/projected/43ad29dd-e4ec-405f-8e7a-d566efa136b6-kube-api-access-n8bsj\") pod \"43ad29dd-e4ec-405f-8e7a-d566efa136b6\" (UID: \"43ad29dd-e4ec-405f-8e7a-d566efa136b6\") "
Oct 30 21:03:05.814618 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:03:05.814378    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/43ad29dd-e4ec-405f-8e7a-d566efa136b6-tls-certs\" (UniqueName: \"kubernetes.io/secret/43ad29dd-e4ec-405f-8e7a-d566efa136b6-tls-certs\") pod \"43ad29dd-e4ec-405f-8e7a-d566efa136b6\" (UID: \"43ad29dd-e4ec-405f-8e7a-d566efa136b6\") "
Oct 30 21:03:05.814618 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:03:05.814409    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/43ad29dd-e4ec-405f-8e7a-d566efa136b6-data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/43ad29dd-e4ec-405f-8e7a-d566efa136b6-data-science-collector-ta-client-cert\") pod \"43ad29dd-e4ec-405f-8e7a-d566efa136b6\" (UID: \"43ad29dd-e4ec-405f-8e7a-d566efa136b6\") "
Oct 30 21:03:05.814618 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:03:05.814440    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/43ad29dd-e4ec-405f-8e7a-d566efa136b6-otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/43ad29dd-e4ec-405f-8e7a-d566efa136b6-otlp-tls-certs\") pod \"43ad29dd-e4ec-405f-8e7a-d566efa136b6\" (UID: \"43ad29dd-e4ec-405f-8e7a-d566efa136b6\") "
Oct 30 21:03:05.814618 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:03:05.814485    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/43ad29dd-e4ec-405f-8e7a-d566efa136b6-monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/43ad29dd-e4ec-405f-8e7a-d566efa136b6-monitoring-tls-certs\") pod \"43ad29dd-e4ec-405f-8e7a-d566efa136b6\" (UID: \"43ad29dd-e4ec-405f-8e7a-d566efa136b6\") "
Oct 30 21:03:05.814798 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:03:05.814708    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/43ad29dd-e4ec-405f-8e7a-d566efa136b6-otc-internal" pod "43ad29dd-e4ec-405f-8e7a-d566efa136b6" (UID: "43ad29dd-e4ec-405f-8e7a-d566efa136b6"). InnerVolumeSpecName "otc-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:03:05.814873 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:03:05.814804    4060 reconciler_common.go:299] "Volume detached for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/43ad29dd-e4ec-405f-8e7a-d566efa136b6-otc-internal\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:03:05.816791 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:03:05.816761    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/43ad29dd-e4ec-405f-8e7a-d566efa136b6-otlp-tls-certs" pod "43ad29dd-e4ec-405f-8e7a-d566efa136b6" (UID: "43ad29dd-e4ec-405f-8e7a-d566efa136b6"). InnerVolumeSpecName "otlp-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:03:05.816932 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:03:05.816782    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/43ad29dd-e4ec-405f-8e7a-d566efa136b6-monitoring-tls-certs" pod "43ad29dd-e4ec-405f-8e7a-d566efa136b6" (UID: "43ad29dd-e4ec-405f-8e7a-d566efa136b6"). InnerVolumeSpecName "monitoring-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:03:05.816932 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:03:05.816857    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/43ad29dd-e4ec-405f-8e7a-d566efa136b6-kube-api-access-n8bsj" pod "43ad29dd-e4ec-405f-8e7a-d566efa136b6" (UID: "43ad29dd-e4ec-405f-8e7a-d566efa136b6"). InnerVolumeSpecName "kube-api-access-n8bsj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:03:05.817042 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:03:05.816984    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/43ad29dd-e4ec-405f-8e7a-d566efa136b6-tls-certs" pod "43ad29dd-e4ec-405f-8e7a-d566efa136b6" (UID: "43ad29dd-e4ec-405f-8e7a-d566efa136b6"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:03:05.817086 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:03:05.817038    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/43ad29dd-e4ec-405f-8e7a-d566efa136b6-data-science-collector-ta-client-cert" pod "43ad29dd-e4ec-405f-8e7a-d566efa136b6" (UID: "43ad29dd-e4ec-405f-8e7a-d566efa136b6"). InnerVolumeSpecName "data-science-collector-ta-client-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:03:05.915487 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:03:05.915456    4060 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n8bsj\" (UniqueName: \"kubernetes.io/projected/43ad29dd-e4ec-405f-8e7a-d566efa136b6-kube-api-access-n8bsj\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:03:05.915487 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:03:05.915484    4060 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/43ad29dd-e4ec-405f-8e7a-d566efa136b6-tls-certs\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:03:05.915701 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:03:05.915510    4060 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/43ad29dd-e4ec-405f-8e7a-d566efa136b6-data-science-collector-ta-client-cert\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:03:05.915701 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:03:05.915520    4060 reconciler_common.go:299] "Volume detached for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/43ad29dd-e4ec-405f-8e7a-d566efa136b6-otlp-tls-certs\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:03:05.915701 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:03:05.915530    4060 reconciler_common.go:299] "Volume detached for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/43ad29dd-e4ec-405f-8e7a-d566efa136b6-monitoring-tls-certs\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:03:06.511723 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:03:06.511692    4060 generic.go:356] "Generic (PLEG): container finished" podID="43ad29dd-e4ec-405f-8e7a-d566efa136b6" containerID="b34f5e00bc9ce617b2d70a6acfb4d32c2189c1b507ab512c5b7a3a1ffcf43ba4" exitCode=0
Oct 30 21:03:06.511908 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:03:06.511741    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:03:06.511908 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:03:06.511769    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"43ad29dd-e4ec-405f-8e7a-d566efa136b6","Type":"ContainerDied","Data":"b34f5e00bc9ce617b2d70a6acfb4d32c2189c1b507ab512c5b7a3a1ffcf43ba4"}
Oct 30 21:03:06.511908 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:03:06.511822    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"43ad29dd-e4ec-405f-8e7a-d566efa136b6","Type":"ContainerDied","Data":"5bcc71c63c86568d1889591365f677881180527d5cbf661333113e68e8153d9e"}
Oct 30 21:03:06.511908 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:03:06.511842    4060 scope.go:122] "RemoveContainer" containerID="b34f5e00bc9ce617b2d70a6acfb4d32c2189c1b507ab512c5b7a3a1ffcf43ba4"
Oct 30 21:03:06.523657 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:03:06.523635    4060 scope.go:122] "RemoveContainer" containerID="b34f5e00bc9ce617b2d70a6acfb4d32c2189c1b507ab512c5b7a3a1ffcf43ba4"
Oct 30 21:03:06.524152 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:03:06.524133    4060 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b34f5e00bc9ce617b2d70a6acfb4d32c2189c1b507ab512c5b7a3a1ffcf43ba4\": container with ID starting with b34f5e00bc9ce617b2d70a6acfb4d32c2189c1b507ab512c5b7a3a1ffcf43ba4 not found: ID does not exist" containerID="b34f5e00bc9ce617b2d70a6acfb4d32c2189c1b507ab512c5b7a3a1ffcf43ba4"
Oct 30 21:03:06.524249 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:03:06.524161    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b34f5e00bc9ce617b2d70a6acfb4d32c2189c1b507ab512c5b7a3a1ffcf43ba4"} err="failed to get container status \"b34f5e00bc9ce617b2d70a6acfb4d32c2189c1b507ab512c5b7a3a1ffcf43ba4\": rpc error: code = NotFound desc = could not find container \"b34f5e00bc9ce617b2d70a6acfb4d32c2189c1b507ab512c5b7a3a1ffcf43ba4\": container with ID starting with b34f5e00bc9ce617b2d70a6acfb4d32c2189c1b507ab512c5b7a3a1ffcf43ba4 not found: ID does not exist"
Oct 30 21:03:06.675573 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:03:06.675539    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:03:06.724988 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:03:06.724958    4060 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:03:06.755659 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:03:06.755632    4060 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:03:06.755941 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:03:06.755930    4060 cpu_manager.go:414] "containerMap: removing container" podUID="43ad29dd-e4ec-405f-8e7a-d566efa136b6" containerName="otc-container"
Oct 30 21:03:06.755980 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:03:06.755943    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="43ad29dd-e4ec-405f-8e7a-d566efa136b6" containerName="otc-container"
Oct 30 21:03:06.756027 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:03:06.756018    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="43ad29dd-e4ec-405f-8e7a-d566efa136b6" containerName="otc-container"
Oct 30 21:03:06.765108 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:03:06.765054    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:03:06.818228 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:03:06.818197    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-tls\""
Oct 30 21:03:06.818449 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:03:06.818429    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-ta-client-cert\""
Oct 30 21:03:06.818581 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:03:06.818444    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-dockercfg-jqj7h\""
Oct 30 21:03:06.818581 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:03:06.818459    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-headless-tls\""
Oct 30 21:03:06.818581 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:03:06.818558    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-monitoring-tls\""
Oct 30 21:03:06.818581 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:03:06.818563    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-a0f9182a\""
Oct 30 21:03:06.820612 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:03:06.820589    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:03:06.822014 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:03:06.821985    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/67da0bc1-7480-4c70-9365-e9cd407cdf3b-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-0\" (UID: \"67da0bc1-7480-4c70-9365-e9cd407cdf3b\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:03:06.822117 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:03:06.822053    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/67da0bc1-7480-4c70-9365-e9cd407cdf3b-otc-internal\") pod \"data-science-collector-collector-0\" (UID: \"67da0bc1-7480-4c70-9365-e9cd407cdf3b\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:03:06.822179 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:03:06.822110    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/67da0bc1-7480-4c70-9365-e9cd407cdf3b-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"67da0bc1-7480-4c70-9365-e9cd407cdf3b\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:03:06.822179 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:03:06.822136    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/67da0bc1-7480-4c70-9365-e9cd407cdf3b-otlp-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"67da0bc1-7480-4c70-9365-e9cd407cdf3b\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:03:06.822285 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:03:06.822219    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2jt55\" (UniqueName: \"kubernetes.io/projected/67da0bc1-7480-4c70-9365-e9cd407cdf3b-kube-api-access-2jt55\") pod \"data-science-collector-collector-0\" (UID: \"67da0bc1-7480-4c70-9365-e9cd407cdf3b\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:03:06.822339 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:03:06.822296    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/67da0bc1-7480-4c70-9365-e9cd407cdf3b-monitoring-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"67da0bc1-7480-4c70-9365-e9cd407cdf3b\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:03:06.923331 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:03:06.923299    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/67da0bc1-7480-4c70-9365-e9cd407cdf3b-monitoring-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"67da0bc1-7480-4c70-9365-e9cd407cdf3b\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:03:06.923544 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:03:06.923343    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/67da0bc1-7480-4c70-9365-e9cd407cdf3b-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-0\" (UID: \"67da0bc1-7480-4c70-9365-e9cd407cdf3b\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:03:06.923544 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:03:06.923372    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/67da0bc1-7480-4c70-9365-e9cd407cdf3b-otc-internal\") pod \"data-science-collector-collector-0\" (UID: \"67da0bc1-7480-4c70-9365-e9cd407cdf3b\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:03:06.923544 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:03:06.923402    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/67da0bc1-7480-4c70-9365-e9cd407cdf3b-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"67da0bc1-7480-4c70-9365-e9cd407cdf3b\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:03:06.923544 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:03:06.923418    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/67da0bc1-7480-4c70-9365-e9cd407cdf3b-otlp-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"67da0bc1-7480-4c70-9365-e9cd407cdf3b\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:03:06.923544 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:03:06.923434    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2jt55\" (UniqueName: \"kubernetes.io/projected/67da0bc1-7480-4c70-9365-e9cd407cdf3b-kube-api-access-2jt55\") pod \"data-science-collector-collector-0\" (UID: \"67da0bc1-7480-4c70-9365-e9cd407cdf3b\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:03:06.924253 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:03:06.924203    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/67da0bc1-7480-4c70-9365-e9cd407cdf3b-otc-internal\") pod \"data-science-collector-collector-0\" (UID: \"67da0bc1-7480-4c70-9365-e9cd407cdf3b\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:03:06.926113 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:03:06.926089    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/67da0bc1-7480-4c70-9365-e9cd407cdf3b-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-0\" (UID: \"67da0bc1-7480-4c70-9365-e9cd407cdf3b\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:03:06.926195 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:03:06.926171    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/67da0bc1-7480-4c70-9365-e9cd407cdf3b-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"67da0bc1-7480-4c70-9365-e9cd407cdf3b\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:03:06.926393 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:03:06.926371    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/67da0bc1-7480-4c70-9365-e9cd407cdf3b-otlp-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"67da0bc1-7480-4c70-9365-e9cd407cdf3b\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:03:06.926429 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:03:06.926395    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/67da0bc1-7480-4c70-9365-e9cd407cdf3b-monitoring-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"67da0bc1-7480-4c70-9365-e9cd407cdf3b\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:03:06.984202 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:03:06.984169    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2jt55\" (UniqueName: \"kubernetes.io/projected/67da0bc1-7480-4c70-9365-e9cd407cdf3b-kube-api-access-2jt55\") pod \"data-science-collector-collector-0\" (UID: \"67da0bc1-7480-4c70-9365-e9cd407cdf3b\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:03:07.077367 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:03:07.077286    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:03:07.427146 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:03:07.427071    4060 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="43ad29dd-e4ec-405f-8e7a-d566efa136b6" path="/var/lib/kubelet/pods/43ad29dd-e4ec-405f-8e7a-d566efa136b6/volumes"
Oct 30 21:03:07.450203 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:03:07.450180    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:03:07.452557 ip-10-0-142-4 kubenswrapper[4060]: W1030 21:03:07.452530    4060 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67da0bc1_7480_4c70_9365_e9cd407cdf3b.slice/crio-8cc43f6cdfc057eebd401c8ab2e1a051d77586b347f730a1c2d7553bdb9835ad WatchSource:0}: Error finding container 8cc43f6cdfc057eebd401c8ab2e1a051d77586b347f730a1c2d7553bdb9835ad: Status 404 returned error can't find the container with id 8cc43f6cdfc057eebd401c8ab2e1a051d77586b347f730a1c2d7553bdb9835ad
Oct 30 21:03:07.454449 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:03:07.454415    4060 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 21:03:07.454575 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:03:07.454505    4060 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 21:03:07.521997 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:03:07.521954    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"67da0bc1-7480-4c70-9365-e9cd407cdf3b","Type":"ContainerStarted","Data":"062e3120fe7535b1448559812002a1767fbb61f56946b62c2326b3902545aad4"}
Oct 30 21:03:07.522123 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:03:07.522019    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"67da0bc1-7480-4c70-9365-e9cd407cdf3b","Type":"ContainerStarted","Data":"8cc43f6cdfc057eebd401c8ab2e1a051d77586b347f730a1c2d7553bdb9835ad"}
Oct 30 21:03:07.641594 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:03:07.641545    4060 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-collector-0" podStartSLOduration=1.64152919 podStartE2EDuration="1.64152919s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:03:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:03:07.640368204 +0000 UTC m=+1606.397366503" watchObservedRunningTime="2026-10-30 21:03:07.64152919 +0000 UTC m=+1606.398527489"
Oct 30 21:03:12.150764 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:03:12.150719    4060 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v2f4x" containerName="extractor"
Oct 30 21:03:42.152975 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:03:42.152931    4060 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v2f4x" containerName="extractor"
Oct 30 21:03:46.558782 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:03:46.558750    4060 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["tests-monitoring-tenant-metrics/tenant-metrics-exporter-5cf544fb97-nzdkg"]
Oct 30 21:03:46.562626 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:03:46.562607    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="tests-monitoring-tenant-metrics/tenant-metrics-exporter-5cf544fb97-nzdkg"
Oct 30 21:03:46.608484 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:03:46.608447    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:03:46.608771 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:03:46.608723    4060 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-collector-0" podUID="67da0bc1-7480-4c70-9365-e9cd407cdf3b" containerName="otc-container" containerID="cri-o://062e3120fe7535b1448559812002a1767fbb61f56946b62c2326b3902545aad4" gracePeriod=30
Oct 30 21:03:46.627247 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:03:46.627207    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"tests-monitoring-tenant-metrics\"/\"openshift-service-ca.crt\""
Oct 30 21:03:46.627423 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:03:46.627297    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"tests-monitoring-tenant-metrics\"/\"kube-root-ca.crt\""
Oct 30 21:03:46.627753 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:03:46.627708    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["tests-monitoring-tenant-metrics/tenant-metrics-exporter-5cf544fb97-nzdkg"]
Oct 30 21:03:46.628868 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:03:46.628817    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"tests-monitoring-tenant-metrics\"/\"default-dockercfg-2kw4l\""
Oct 30 21:03:46.670923 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:03:46.670866    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bhdld\" (UniqueName: \"kubernetes.io/projected/b5927224-52e5-41f1-8f07-d3494f44751a-kube-api-access-bhdld\") pod \"tenant-metrics-exporter-5cf544fb97-nzdkg\" (UID: \"b5927224-52e5-41f1-8f07-d3494f44751a\") " pod="tests-monitoring-tenant-metrics/tenant-metrics-exporter-5cf544fb97-nzdkg"
Oct 30 21:03:46.671105 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:03:46.670999    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/b5927224-52e5-41f1-8f07-d3494f44751a-data\") pod \"tenant-metrics-exporter-5cf544fb97-nzdkg\" (UID: \"b5927224-52e5-41f1-8f07-d3494f44751a\") " pod="tests-monitoring-tenant-metrics/tenant-metrics-exporter-5cf544fb97-nzdkg"
Oct 30 21:03:46.771694 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:03:46.771659    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bhdld\" (UniqueName: \"kubernetes.io/projected/b5927224-52e5-41f1-8f07-d3494f44751a-kube-api-access-bhdld\") pod \"tenant-metrics-exporter-5cf544fb97-nzdkg\" (UID: \"b5927224-52e5-41f1-8f07-d3494f44751a\") " pod="tests-monitoring-tenant-metrics/tenant-metrics-exporter-5cf544fb97-nzdkg"
Oct 30 21:03:46.771874 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:03:46.771715    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/b5927224-52e5-41f1-8f07-d3494f44751a-data\") pod \"tenant-metrics-exporter-5cf544fb97-nzdkg\" (UID: \"b5927224-52e5-41f1-8f07-d3494f44751a\") " pod="tests-monitoring-tenant-metrics/tenant-metrics-exporter-5cf544fb97-nzdkg"
Oct 30 21:03:46.772071 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:03:46.772055    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/b5927224-52e5-41f1-8f07-d3494f44751a-data\") pod \"tenant-metrics-exporter-5cf544fb97-nzdkg\" (UID: \"b5927224-52e5-41f1-8f07-d3494f44751a\") " pod="tests-monitoring-tenant-metrics/tenant-metrics-exporter-5cf544fb97-nzdkg"
Oct 30 21:03:46.832946 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:03:46.832870    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bhdld\" (UniqueName: \"kubernetes.io/projected/b5927224-52e5-41f1-8f07-d3494f44751a-kube-api-access-bhdld\") pod \"tenant-metrics-exporter-5cf544fb97-nzdkg\" (UID: \"b5927224-52e5-41f1-8f07-d3494f44751a\") " pod="tests-monitoring-tenant-metrics/tenant-metrics-exporter-5cf544fb97-nzdkg"
Oct 30 21:03:46.875366 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:03:46.875336    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="tests-monitoring-tenant-metrics/tenant-metrics-exporter-5cf544fb97-nzdkg"
Oct 30 21:03:47.247536 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:03:47.247510    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["tests-monitoring-tenant-metrics/tenant-metrics-exporter-5cf544fb97-nzdkg"]
Oct 30 21:03:47.249504 ip-10-0-142-4 kubenswrapper[4060]: W1030 21:03:47.249459    4060 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5927224_52e5_41f1_8f07_d3494f44751a.slice/crio-dd8abc1dae9d7647d7671d1332772e4528ab1da0367d8bdd2c98b26282e6f99c WatchSource:0}: Error finding container dd8abc1dae9d7647d7671d1332772e4528ab1da0367d8bdd2c98b26282e6f99c: Status 404 returned error can't find the container with id dd8abc1dae9d7647d7671d1332772e4528ab1da0367d8bdd2c98b26282e6f99c
Oct 30 21:03:47.715978 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:03:47.715947    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="tests-monitoring-tenant-metrics/tenant-metrics-exporter-5cf544fb97-nzdkg" event={"ID":"b5927224-52e5-41f1-8f07-d3494f44751a","Type":"ContainerStarted","Data":"dd8abc1dae9d7647d7671d1332772e4528ab1da0367d8bdd2c98b26282e6f99c"}
Oct 30 21:03:49.001463 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:03:49.001433    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:03:49.192912 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:03:49.192822    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/67da0bc1-7480-4c70-9365-e9cd407cdf3b-otc-internal\" (UniqueName: \"kubernetes.io/configmap/67da0bc1-7480-4c70-9365-e9cd407cdf3b-otc-internal\") pod \"67da0bc1-7480-4c70-9365-e9cd407cdf3b\" (UID: \"67da0bc1-7480-4c70-9365-e9cd407cdf3b\") "
Oct 30 21:03:49.192912 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:03:49.192903    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/67da0bc1-7480-4c70-9365-e9cd407cdf3b-tls-certs\" (UniqueName: \"kubernetes.io/secret/67da0bc1-7480-4c70-9365-e9cd407cdf3b-tls-certs\") pod \"67da0bc1-7480-4c70-9365-e9cd407cdf3b\" (UID: \"67da0bc1-7480-4c70-9365-e9cd407cdf3b\") "
Oct 30 21:03:49.193150 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:03:49.192949    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/67da0bc1-7480-4c70-9365-e9cd407cdf3b-monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/67da0bc1-7480-4c70-9365-e9cd407cdf3b-monitoring-tls-certs\") pod \"67da0bc1-7480-4c70-9365-e9cd407cdf3b\" (UID: \"67da0bc1-7480-4c70-9365-e9cd407cdf3b\") "
Oct 30 21:03:49.193150 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:03:49.192982    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/67da0bc1-7480-4c70-9365-e9cd407cdf3b-kube-api-access-2jt55\" (UniqueName: \"kubernetes.io/projected/67da0bc1-7480-4c70-9365-e9cd407cdf3b-kube-api-access-2jt55\") pod \"67da0bc1-7480-4c70-9365-e9cd407cdf3b\" (UID: \"67da0bc1-7480-4c70-9365-e9cd407cdf3b\") "
Oct 30 21:03:49.193150 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:03:49.193028    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/67da0bc1-7480-4c70-9365-e9cd407cdf3b-otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/67da0bc1-7480-4c70-9365-e9cd407cdf3b-otlp-tls-certs\") pod \"67da0bc1-7480-4c70-9365-e9cd407cdf3b\" (UID: \"67da0bc1-7480-4c70-9365-e9cd407cdf3b\") "
Oct 30 21:03:49.193150 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:03:49.193061    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/67da0bc1-7480-4c70-9365-e9cd407cdf3b-data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/67da0bc1-7480-4c70-9365-e9cd407cdf3b-data-science-collector-ta-client-cert\") pod \"67da0bc1-7480-4c70-9365-e9cd407cdf3b\" (UID: \"67da0bc1-7480-4c70-9365-e9cd407cdf3b\") "
Oct 30 21:03:49.194650 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:03:49.194596    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/67da0bc1-7480-4c70-9365-e9cd407cdf3b-otc-internal" pod "67da0bc1-7480-4c70-9365-e9cd407cdf3b" (UID: "67da0bc1-7480-4c70-9365-e9cd407cdf3b"). InnerVolumeSpecName "otc-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:03:49.196359 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:03:49.196329    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/67da0bc1-7480-4c70-9365-e9cd407cdf3b-otlp-tls-certs" pod "67da0bc1-7480-4c70-9365-e9cd407cdf3b" (UID: "67da0bc1-7480-4c70-9365-e9cd407cdf3b"). InnerVolumeSpecName "otlp-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:03:49.196645 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:03:49.196625    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/67da0bc1-7480-4c70-9365-e9cd407cdf3b-monitoring-tls-certs" pod "67da0bc1-7480-4c70-9365-e9cd407cdf3b" (UID: "67da0bc1-7480-4c70-9365-e9cd407cdf3b"). InnerVolumeSpecName "monitoring-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:03:49.196881 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:03:49.196857    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/67da0bc1-7480-4c70-9365-e9cd407cdf3b-data-science-collector-ta-client-cert" pod "67da0bc1-7480-4c70-9365-e9cd407cdf3b" (UID: "67da0bc1-7480-4c70-9365-e9cd407cdf3b"). InnerVolumeSpecName "data-science-collector-ta-client-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:03:49.200877 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:03:49.200841    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/67da0bc1-7480-4c70-9365-e9cd407cdf3b-tls-certs" pod "67da0bc1-7480-4c70-9365-e9cd407cdf3b" (UID: "67da0bc1-7480-4c70-9365-e9cd407cdf3b"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:03:49.203632 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:03:49.203596    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/67da0bc1-7480-4c70-9365-e9cd407cdf3b-kube-api-access-2jt55" pod "67da0bc1-7480-4c70-9365-e9cd407cdf3b" (UID: "67da0bc1-7480-4c70-9365-e9cd407cdf3b"). InnerVolumeSpecName "kube-api-access-2jt55". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:03:49.294548 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:03:49.294507    4060 reconciler_common.go:299] "Volume detached for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/67da0bc1-7480-4c70-9365-e9cd407cdf3b-monitoring-tls-certs\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:03:49.294548 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:03:49.294546    4060 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2jt55\" (UniqueName: \"kubernetes.io/projected/67da0bc1-7480-4c70-9365-e9cd407cdf3b-kube-api-access-2jt55\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:03:49.294791 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:03:49.294561    4060 reconciler_common.go:299] "Volume detached for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/67da0bc1-7480-4c70-9365-e9cd407cdf3b-otlp-tls-certs\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:03:49.294791 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:03:49.294575    4060 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/67da0bc1-7480-4c70-9365-e9cd407cdf3b-data-science-collector-ta-client-cert\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:03:49.294791 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:03:49.294585    4060 reconciler_common.go:299] "Volume detached for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/67da0bc1-7480-4c70-9365-e9cd407cdf3b-otc-internal\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:03:49.294791 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:03:49.294594    4060 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/67da0bc1-7480-4c70-9365-e9cd407cdf3b-tls-certs\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:03:49.728927 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:03:49.728888    4060 generic.go:356] "Generic (PLEG): container finished" podID="67da0bc1-7480-4c70-9365-e9cd407cdf3b" containerID="062e3120fe7535b1448559812002a1767fbb61f56946b62c2326b3902545aad4" exitCode=0
Oct 30 21:03:49.729127 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:03:49.728948    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:03:49.729127 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:03:49.728970    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"67da0bc1-7480-4c70-9365-e9cd407cdf3b","Type":"ContainerDied","Data":"062e3120fe7535b1448559812002a1767fbb61f56946b62c2326b3902545aad4"}
Oct 30 21:03:49.729127 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:03:49.729024    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"67da0bc1-7480-4c70-9365-e9cd407cdf3b","Type":"ContainerDied","Data":"8cc43f6cdfc057eebd401c8ab2e1a051d77586b347f730a1c2d7553bdb9835ad"}
Oct 30 21:03:49.729127 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:03:49.729053    4060 scope.go:122] "RemoveContainer" containerID="062e3120fe7535b1448559812002a1767fbb61f56946b62c2326b3902545aad4"
Oct 30 21:03:49.748459 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:03:49.748270    4060 scope.go:122] "RemoveContainer" containerID="062e3120fe7535b1448559812002a1767fbb61f56946b62c2326b3902545aad4"
Oct 30 21:03:49.749150 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:03:49.749116    4060 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"062e3120fe7535b1448559812002a1767fbb61f56946b62c2326b3902545aad4\": container with ID starting with 062e3120fe7535b1448559812002a1767fbb61f56946b62c2326b3902545aad4 not found: ID does not exist" containerID="062e3120fe7535b1448559812002a1767fbb61f56946b62c2326b3902545aad4"
Oct 30 21:03:49.749282 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:03:49.749158    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"062e3120fe7535b1448559812002a1767fbb61f56946b62c2326b3902545aad4"} err="failed to get container status \"062e3120fe7535b1448559812002a1767fbb61f56946b62c2326b3902545aad4\": rpc error: code = NotFound desc = could not find container \"062e3120fe7535b1448559812002a1767fbb61f56946b62c2326b3902545aad4\": container with ID starting with 062e3120fe7535b1448559812002a1767fbb61f56946b62c2326b3902545aad4 not found: ID does not exist"
Oct 30 21:03:49.895379 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:03:49.895345    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:03:49.945845 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:03:49.945141    4060 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:03:49.977046 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:03:49.977014    4060 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:03:49.977544 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:03:49.977522    4060 cpu_manager.go:414] "containerMap: removing container" podUID="67da0bc1-7480-4c70-9365-e9cd407cdf3b" containerName="otc-container"
Oct 30 21:03:49.977544 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:03:49.977542    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="67da0bc1-7480-4c70-9365-e9cd407cdf3b" containerName="otc-container"
Oct 30 21:03:49.977731 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:03:49.977637    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="67da0bc1-7480-4c70-9365-e9cd407cdf3b" containerName="otc-container"
Oct 30 21:03:49.981037 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:03:49.980974    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:03:50.033976 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:03:50.033943    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-headless-tls\""
Oct 30 21:03:50.034462 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:03:50.034080    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-monitoring-tls\""
Oct 30 21:03:50.034462 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:03:50.034190    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-a0f9182a\""
Oct 30 21:03:50.034462 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:03:50.034214    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-dockercfg-jqj7h\""
Oct 30 21:03:50.034462 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:03:50.034235    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-ta-client-cert\""
Oct 30 21:03:50.034462 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:03:50.034254    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-tls\""
Oct 30 21:03:50.041120 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:03:50.041091    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:03:50.103295 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:03:50.103261    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jtfl8\" (UniqueName: \"kubernetes.io/projected/678208c4-7636-43e4-9fd8-135b176c9a67-kube-api-access-jtfl8\") pod \"data-science-collector-collector-0\" (UID: \"678208c4-7636-43e4-9fd8-135b176c9a67\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:03:50.103295 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:03:50.103299    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/678208c4-7636-43e4-9fd8-135b176c9a67-monitoring-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"678208c4-7636-43e4-9fd8-135b176c9a67\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:03:50.103572 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:03:50.103316    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/678208c4-7636-43e4-9fd8-135b176c9a67-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"678208c4-7636-43e4-9fd8-135b176c9a67\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:03:50.103572 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:03:50.103460    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/678208c4-7636-43e4-9fd8-135b176c9a67-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-0\" (UID: \"678208c4-7636-43e4-9fd8-135b176c9a67\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:03:50.103572 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:03:50.103543    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/678208c4-7636-43e4-9fd8-135b176c9a67-otlp-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"678208c4-7636-43e4-9fd8-135b176c9a67\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:03:50.103741 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:03:50.103629    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/678208c4-7636-43e4-9fd8-135b176c9a67-otc-internal\") pod \"data-science-collector-collector-0\" (UID: \"678208c4-7636-43e4-9fd8-135b176c9a67\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:03:50.204039 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:03:50.204002    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/678208c4-7636-43e4-9fd8-135b176c9a67-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-0\" (UID: \"678208c4-7636-43e4-9fd8-135b176c9a67\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:03:50.204205 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:03:50.204060    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/678208c4-7636-43e4-9fd8-135b176c9a67-otlp-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"678208c4-7636-43e4-9fd8-135b176c9a67\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:03:50.204205 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:03:50.204111    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/678208c4-7636-43e4-9fd8-135b176c9a67-otc-internal\") pod \"data-science-collector-collector-0\" (UID: \"678208c4-7636-43e4-9fd8-135b176c9a67\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:03:50.204205 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:03:50.204140    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jtfl8\" (UniqueName: \"kubernetes.io/projected/678208c4-7636-43e4-9fd8-135b176c9a67-kube-api-access-jtfl8\") pod \"data-science-collector-collector-0\" (UID: \"678208c4-7636-43e4-9fd8-135b176c9a67\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:03:50.204205 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:03:50.204168    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/678208c4-7636-43e4-9fd8-135b176c9a67-monitoring-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"678208c4-7636-43e4-9fd8-135b176c9a67\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:03:50.204205 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:03:50.204187    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/678208c4-7636-43e4-9fd8-135b176c9a67-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"678208c4-7636-43e4-9fd8-135b176c9a67\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:03:50.205020 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:03:50.204968    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/678208c4-7636-43e4-9fd8-135b176c9a67-otc-internal\") pod \"data-science-collector-collector-0\" (UID: \"678208c4-7636-43e4-9fd8-135b176c9a67\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:03:50.207292 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:03:50.207266    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/678208c4-7636-43e4-9fd8-135b176c9a67-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"678208c4-7636-43e4-9fd8-135b176c9a67\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:03:50.207417 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:03:50.207267    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/678208c4-7636-43e4-9fd8-135b176c9a67-monitoring-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"678208c4-7636-43e4-9fd8-135b176c9a67\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:03:50.207486 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:03:50.207424    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/678208c4-7636-43e4-9fd8-135b176c9a67-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-0\" (UID: \"678208c4-7636-43e4-9fd8-135b176c9a67\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:03:50.212150 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:03:50.212129    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/678208c4-7636-43e4-9fd8-135b176c9a67-otlp-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"678208c4-7636-43e4-9fd8-135b176c9a67\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:03:50.265616 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:03:50.265549    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jtfl8\" (UniqueName: \"kubernetes.io/projected/678208c4-7636-43e4-9fd8-135b176c9a67-kube-api-access-jtfl8\") pod \"data-science-collector-collector-0\" (UID: \"678208c4-7636-43e4-9fd8-135b176c9a67\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:03:50.296252 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:03:50.296212    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:03:50.675131 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:03:50.675102    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:03:50.677270 ip-10-0-142-4 kubenswrapper[4060]: W1030 21:03:50.677243    4060 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod678208c4_7636_43e4_9fd8_135b176c9a67.slice/crio-12df0690e47fb06b95c05659c42484d3c1b7db993affb961decbac895e55d951 WatchSource:0}: Error finding container 12df0690e47fb06b95c05659c42484d3c1b7db993affb961decbac895e55d951: Status 404 returned error can't find the container with id 12df0690e47fb06b95c05659c42484d3c1b7db993affb961decbac895e55d951
Oct 30 21:03:50.680255 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:03:50.680214    4060 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 21:03:50.680362 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:03:50.680296    4060 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 21:03:50.736748 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:03:50.736715    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"678208c4-7636-43e4-9fd8-135b176c9a67","Type":"ContainerStarted","Data":"12df0690e47fb06b95c05659c42484d3c1b7db993affb961decbac895e55d951"}
Oct 30 21:03:51.427560 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:03:51.427527    4060 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="67da0bc1-7480-4c70-9365-e9cd407cdf3b" path="/var/lib/kubelet/pods/67da0bc1-7480-4c70-9365-e9cd407cdf3b/volumes"
Oct 30 21:03:51.745326 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:03:51.745285    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="tests-monitoring-tenant-metrics/tenant-metrics-exporter-5cf544fb97-nzdkg" event={"ID":"b5927224-52e5-41f1-8f07-d3494f44751a","Type":"ContainerStarted","Data":"f673e7a374487cdd25f329672d39c71d799f55be902b0c8e7425ae6078b266c1"}
Oct 30 21:03:51.746932 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:03:51.746907    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"678208c4-7636-43e4-9fd8-135b176c9a67","Type":"ContainerStarted","Data":"6aeb5b7e396a00f1f6cad447cdcb440de95c9d735791b9431b17c4ad6c0fb81b"}
Oct 30 21:03:51.862376 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:03:51.862321    4060 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="tests-monitoring-tenant-metrics/tenant-metrics-exporter-5cf544fb97-nzdkg" podStartSLOduration=1.6206811650000001 podStartE2EDuration="5.862306707s" totalImagesPullingTime="4.241625542s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:03:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:03:51.859830129 +0000 UTC m=+1650.616828432" watchObservedRunningTime="2026-10-30 21:03:51.862306707 +0000 UTC m=+1650.619305005"
Oct 30 21:03:51.977519 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:03:51.977451    4060 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-collector-0" podStartSLOduration=2.977435339 podStartE2EDuration="2.977435339s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:03:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:03:51.976381234 +0000 UTC m=+1650.733379532" watchObservedRunningTime="2026-10-30 21:03:51.977435339 +0000 UTC m=+1650.734433640"
Oct 30 21:04:12.150554 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:04:12.150464    4060 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v2f4x" containerName="extractor"
Oct 30 21:04:42.151816 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:04:42.151784    4060 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v2f4x" containerName="extractor"
Oct 30 21:04:54.873796 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:04:54.873755    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["tests-monitoring-tenant-metrics/tenant-metrics-exporter-5cf544fb97-nzdkg"]
Oct 30 21:04:54.874352 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:04:54.873977    4060 kuberuntime_container.go:898] "Killing container with a grace period" pod="tests-monitoring-tenant-metrics/tenant-metrics-exporter-5cf544fb97-nzdkg" podUID="b5927224-52e5-41f1-8f07-d3494f44751a" containerName="tenant-metrics-exporter" containerID="cri-o://f673e7a374487cdd25f329672d39c71d799f55be902b0c8e7425ae6078b266c1" gracePeriod=30
Oct 30 21:04:55.052441 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:04:55.052412    4060 generic.go:356] "Generic (PLEG): container finished" podID="b5927224-52e5-41f1-8f07-d3494f44751a" containerID="f673e7a374487cdd25f329672d39c71d799f55be902b0c8e7425ae6078b266c1" exitCode=0
Oct 30 21:04:55.052613 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:04:55.052550    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="tests-monitoring-tenant-metrics/tenant-metrics-exporter-5cf544fb97-nzdkg" event={"ID":"b5927224-52e5-41f1-8f07-d3494f44751a","Type":"ContainerDied","Data":"f673e7a374487cdd25f329672d39c71d799f55be902b0c8e7425ae6078b266c1"}
Oct 30 21:04:55.118562 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:04:55.118538    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="tests-monitoring-tenant-metrics/tenant-metrics-exporter-5cf544fb97-nzdkg"
Oct 30 21:04:55.159809 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:04:55.159732    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b5927224-52e5-41f1-8f07-d3494f44751a-data\" (UniqueName: \"kubernetes.io/empty-dir/b5927224-52e5-41f1-8f07-d3494f44751a-data\") pod \"b5927224-52e5-41f1-8f07-d3494f44751a\" (UID: \"b5927224-52e5-41f1-8f07-d3494f44751a\") "
Oct 30 21:04:55.159809 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:04:55.159806    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b5927224-52e5-41f1-8f07-d3494f44751a-kube-api-access-bhdld\" (UniqueName: \"kubernetes.io/projected/b5927224-52e5-41f1-8f07-d3494f44751a-kube-api-access-bhdld\") pod \"b5927224-52e5-41f1-8f07-d3494f44751a\" (UID: \"b5927224-52e5-41f1-8f07-d3494f44751a\") "
Oct 30 21:04:55.160095 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:04:55.160072    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b5927224-52e5-41f1-8f07-d3494f44751a-data" pod "b5927224-52e5-41f1-8f07-d3494f44751a" (UID: "b5927224-52e5-41f1-8f07-d3494f44751a"). InnerVolumeSpecName "data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:04:55.162062 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:04:55.162042    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b5927224-52e5-41f1-8f07-d3494f44751a-kube-api-access-bhdld" pod "b5927224-52e5-41f1-8f07-d3494f44751a" (UID: "b5927224-52e5-41f1-8f07-d3494f44751a"). InnerVolumeSpecName "kube-api-access-bhdld". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:04:55.260907 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:04:55.260876    4060 reconciler_common.go:299] "Volume detached for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/b5927224-52e5-41f1-8f07-d3494f44751a-data\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:04:55.260907 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:04:55.260904    4060 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bhdld\" (UniqueName: \"kubernetes.io/projected/b5927224-52e5-41f1-8f07-d3494f44751a-kube-api-access-bhdld\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:04:56.058575 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:04:56.058547    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="tests-monitoring-tenant-metrics/tenant-metrics-exporter-5cf544fb97-nzdkg"
Oct 30 21:04:56.058575 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:04:56.058570    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="tests-monitoring-tenant-metrics/tenant-metrics-exporter-5cf544fb97-nzdkg" event={"ID":"b5927224-52e5-41f1-8f07-d3494f44751a","Type":"ContainerDied","Data":"dd8abc1dae9d7647d7671d1332772e4528ab1da0367d8bdd2c98b26282e6f99c"}
Oct 30 21:04:56.059095 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:04:56.058642    4060 scope.go:122] "RemoveContainer" containerID="f673e7a374487cdd25f329672d39c71d799f55be902b0c8e7425ae6078b266c1"
Oct 30 21:04:56.222679 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:04:56.222648    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["tests-monitoring-tenant-metrics/tenant-metrics-exporter-5cf544fb97-nzdkg"]
Oct 30 21:04:56.271978 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:04:56.271942    4060 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["tests-monitoring-tenant-metrics/tenant-metrics-exporter-5cf544fb97-nzdkg"]
Oct 30 21:04:57.426571 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:04:57.426536    4060 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b5927224-52e5-41f1-8f07-d3494f44751a" path="/var/lib/kubelet/pods/b5927224-52e5-41f1-8f07-d3494f44751a/volumes"
Oct 30 21:05:09.452774 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:05:09.452741    4060 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["tests-monitoring-dcgm-https-18e36a9f59ba6e1c/dcgm-https-exporter"]
Oct 30 21:05:09.453245 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:05:09.453201    4060 cpu_manager.go:414] "containerMap: removing container" podUID="b5927224-52e5-41f1-8f07-d3494f44751a" containerName="tenant-metrics-exporter"
Oct 30 21:05:09.453245 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:05:09.453219    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b5927224-52e5-41f1-8f07-d3494f44751a" containerName="tenant-metrics-exporter"
Oct 30 21:05:09.453597 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:05:09.453327    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="b5927224-52e5-41f1-8f07-d3494f44751a" containerName="tenant-metrics-exporter"
Oct 30 21:05:09.455765 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:05:09.455743    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="tests-monitoring-dcgm-https-18e36a9f59ba6e1c/dcgm-https-exporter"
Oct 30 21:05:09.508342 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:05:09.508313    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"tests-monitoring-dcgm-https-18e36a9f59ba6e1c\"/\"dcgm-https-exporter\""
Oct 30 21:05:09.514650 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:05:09.514622    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["tests-monitoring-dcgm-https-18e36a9f59ba6e1c/dcgm-https-exporter"]
Oct 30 21:05:09.557626 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:05:09.557598    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"tests-monitoring-dcgm-https-18e36a9f59ba6e1c\"/\"dcgm-https-tls\""
Oct 30 21:05:09.557796 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:05:09.557765    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"tests-monitoring-dcgm-https-18e36a9f59ba6e1c\"/\"default-dockercfg-czwrw\""
Oct 30 21:05:09.584972 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:05:09.584945    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/1d3ba6ad-9f43-401c-b1e6-f92746f584b9-data\") pod \"dcgm-https-exporter\" (UID: \"1d3ba6ad-9f43-401c-b1e6-f92746f584b9\") " pod="tests-monitoring-dcgm-https-18e36a9f59ba6e1c/dcgm-https-exporter"
Oct 30 21:05:09.585138 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:05:09.585005    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/1d3ba6ad-9f43-401c-b1e6-f92746f584b9-tls\") pod \"dcgm-https-exporter\" (UID: \"1d3ba6ad-9f43-401c-b1e6-f92746f584b9\") " pod="tests-monitoring-dcgm-https-18e36a9f59ba6e1c/dcgm-https-exporter"
Oct 30 21:05:09.585201 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:05:09.585136    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/configmap/1d3ba6ad-9f43-401c-b1e6-f92746f584b9-web-config\") pod \"dcgm-https-exporter\" (UID: \"1d3ba6ad-9f43-401c-b1e6-f92746f584b9\") " pod="tests-monitoring-dcgm-https-18e36a9f59ba6e1c/dcgm-https-exporter"
Oct 30 21:05:09.686092 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:05:09.686060    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/1d3ba6ad-9f43-401c-b1e6-f92746f584b9-data\") pod \"dcgm-https-exporter\" (UID: \"1d3ba6ad-9f43-401c-b1e6-f92746f584b9\") " pod="tests-monitoring-dcgm-https-18e36a9f59ba6e1c/dcgm-https-exporter"
Oct 30 21:05:09.686275 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:05:09.686119    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/1d3ba6ad-9f43-401c-b1e6-f92746f584b9-tls\") pod \"dcgm-https-exporter\" (UID: \"1d3ba6ad-9f43-401c-b1e6-f92746f584b9\") " pod="tests-monitoring-dcgm-https-18e36a9f59ba6e1c/dcgm-https-exporter"
Oct 30 21:05:09.686275 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:05:09.686158    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/configmap/1d3ba6ad-9f43-401c-b1e6-f92746f584b9-web-config\") pod \"dcgm-https-exporter\" (UID: \"1d3ba6ad-9f43-401c-b1e6-f92746f584b9\") " pod="tests-monitoring-dcgm-https-18e36a9f59ba6e1c/dcgm-https-exporter"
Oct 30 21:05:09.686536 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:05:09.686515    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/1d3ba6ad-9f43-401c-b1e6-f92746f584b9-data\") pod \"dcgm-https-exporter\" (UID: \"1d3ba6ad-9f43-401c-b1e6-f92746f584b9\") " pod="tests-monitoring-dcgm-https-18e36a9f59ba6e1c/dcgm-https-exporter"
Oct 30 21:05:09.686816 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:05:09.686794    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/configmap/1d3ba6ad-9f43-401c-b1e6-f92746f584b9-web-config\") pod \"dcgm-https-exporter\" (UID: \"1d3ba6ad-9f43-401c-b1e6-f92746f584b9\") " pod="tests-monitoring-dcgm-https-18e36a9f59ba6e1c/dcgm-https-exporter"
Oct 30 21:05:09.688667 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:05:09.688640    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls\" (UniqueName: \"kubernetes.io/secret/1d3ba6ad-9f43-401c-b1e6-f92746f584b9-tls\") pod \"dcgm-https-exporter\" (UID: \"1d3ba6ad-9f43-401c-b1e6-f92746f584b9\") " pod="tests-monitoring-dcgm-https-18e36a9f59ba6e1c/dcgm-https-exporter"
Oct 30 21:05:09.767728 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:05:09.767652    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="tests-monitoring-dcgm-https-18e36a9f59ba6e1c/dcgm-https-exporter"
Oct 30 21:05:10.157159 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:05:10.157137    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["tests-monitoring-dcgm-https-18e36a9f59ba6e1c/dcgm-https-exporter"]
Oct 30 21:05:10.159293 ip-10-0-142-4 kubenswrapper[4060]: W1030 21:05:10.159264    4060 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d3ba6ad_9f43_401c_b1e6_f92746f584b9.slice/crio-d197629715e8dc5bf91c171137aac5328d0d0aaaa0fcc048d58f8bde6ef4a7f2 WatchSource:0}: Error finding container d197629715e8dc5bf91c171137aac5328d0d0aaaa0fcc048d58f8bde6ef4a7f2: Status 404 returned error can't find the container with id d197629715e8dc5bf91c171137aac5328d0d0aaaa0fcc048d58f8bde6ef4a7f2
Oct 30 21:05:11.137094 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:05:11.137055    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="tests-monitoring-dcgm-https-18e36a9f59ba6e1c/dcgm-https-exporter" event={"ID":"1d3ba6ad-9f43-401c-b1e6-f92746f584b9","Type":"ContainerStarted","Data":"1bb489e9c149bebc5fce36173978806bb927b7734954aa41f8efa56d511ffd05"}
Oct 30 21:05:11.137537 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:05:11.137132    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="tests-monitoring-dcgm-https-18e36a9f59ba6e1c/dcgm-https-exporter" event={"ID":"1d3ba6ad-9f43-401c-b1e6-f92746f584b9","Type":"ContainerStarted","Data":"d197629715e8dc5bf91c171137aac5328d0d0aaaa0fcc048d58f8bde6ef4a7f2"}
Oct 30 21:05:11.137537 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:05:11.137158    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="tests-monitoring-dcgm-https-18e36a9f59ba6e1c/dcgm-https-exporter"
Oct 30 21:05:11.253425 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:05:11.253365    4060 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="tests-monitoring-dcgm-https-18e36a9f59ba6e1c/dcgm-https-exporter" podStartSLOduration=2.253351056 podStartE2EDuration="2.253351056s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:05:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:05:11.251978853 +0000 UTC m=+1730.008977185" watchObservedRunningTime="2026-10-30 21:05:11.253351056 +0000 UTC m=+1730.010349378"
Oct 30 21:05:12.150346 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:05:12.150314    4060 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v2f4x" containerName="extractor"
Oct 30 21:05:17.145001 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:05:17.144968    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="tests-monitoring-dcgm-https-18e36a9f59ba6e1c/dcgm-https-exporter"
Oct 30 21:05:38.147879 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:05:38.147792    4060 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-77cb4489f4-49kjk"]
Oct 30 21:05:38.151252 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:05:38.151234    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-77cb4489f4-49kjk"
Oct 30 21:05:38.205623 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:05:38.205589    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-targetallocator\""
Oct 30 21:05:38.222076 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:05:38.222041    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/59a22995-ac2c-4f92-b6b8-8d61bfd0a0cd-ta-internal\") pod \"data-science-collector-targetallocator-77cb4489f4-49kjk\" (UID: \"59a22995-ac2c-4f92-b6b8-8d61bfd0a0cd\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-77cb4489f4-49kjk"
Oct 30 21:05:38.222236 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:05:38.222084    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/59a22995-ac2c-4f92-b6b8-8d61bfd0a0cd-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-77cb4489f4-49kjk\" (UID: \"59a22995-ac2c-4f92-b6b8-8d61bfd0a0cd\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-77cb4489f4-49kjk"
Oct 30 21:05:38.222236 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:05:38.222215    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sqldd\" (UniqueName: \"kubernetes.io/projected/59a22995-ac2c-4f92-b6b8-8d61bfd0a0cd-kube-api-access-sqldd\") pod \"data-science-collector-targetallocator-77cb4489f4-49kjk\" (UID: \"59a22995-ac2c-4f92-b6b8-8d61bfd0a0cd\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-77cb4489f4-49kjk"
Oct 30 21:05:38.255374 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:05:38.255341    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-targetallocator-dockercfg-ltdzb\""
Oct 30 21:05:38.255625 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:05:38.255604    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-ta-server-cert\""
Oct 30 21:05:38.257277 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:05:38.257260    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-77cb4489f4-49kjk"]
Oct 30 21:05:38.323627 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:05:38.323598    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sqldd\" (UniqueName: \"kubernetes.io/projected/59a22995-ac2c-4f92-b6b8-8d61bfd0a0cd-kube-api-access-sqldd\") pod \"data-science-collector-targetallocator-77cb4489f4-49kjk\" (UID: \"59a22995-ac2c-4f92-b6b8-8d61bfd0a0cd\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-77cb4489f4-49kjk"
Oct 30 21:05:38.323794 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:05:38.323661    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/59a22995-ac2c-4f92-b6b8-8d61bfd0a0cd-ta-internal\") pod \"data-science-collector-targetallocator-77cb4489f4-49kjk\" (UID: \"59a22995-ac2c-4f92-b6b8-8d61bfd0a0cd\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-77cb4489f4-49kjk"
Oct 30 21:05:38.323794 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:05:38.323684    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/59a22995-ac2c-4f92-b6b8-8d61bfd0a0cd-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-77cb4489f4-49kjk\" (UID: \"59a22995-ac2c-4f92-b6b8-8d61bfd0a0cd\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-77cb4489f4-49kjk"
Oct 30 21:05:38.324367 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:05:38.324342    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/59a22995-ac2c-4f92-b6b8-8d61bfd0a0cd-ta-internal\") pod \"data-science-collector-targetallocator-77cb4489f4-49kjk\" (UID: \"59a22995-ac2c-4f92-b6b8-8d61bfd0a0cd\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-77cb4489f4-49kjk"
Oct 30 21:05:38.326010 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:05:38.325987    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/59a22995-ac2c-4f92-b6b8-8d61bfd0a0cd-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-77cb4489f4-49kjk\" (UID: \"59a22995-ac2c-4f92-b6b8-8d61bfd0a0cd\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-77cb4489f4-49kjk"
Oct 30 21:05:38.384985 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:05:38.384945    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sqldd\" (UniqueName: \"kubernetes.io/projected/59a22995-ac2c-4f92-b6b8-8d61bfd0a0cd-kube-api-access-sqldd\") pod \"data-science-collector-targetallocator-77cb4489f4-49kjk\" (UID: \"59a22995-ac2c-4f92-b6b8-8d61bfd0a0cd\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-77cb4489f4-49kjk"
Oct 30 21:05:38.462469 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:05:38.462435    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-77cb4489f4-49kjk"
Oct 30 21:05:38.837181 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:05:38.837152    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-77cb4489f4-49kjk"]
Oct 30 21:05:38.839043 ip-10-0-142-4 kubenswrapper[4060]: W1030 21:05:38.839012    4060 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod59a22995_ac2c_4f92_b6b8_8d61bfd0a0cd.slice/crio-91ab4218bc39102712b96d309550eeff363a7a378a7f93e536eec208efbdfabd WatchSource:0}: Error finding container 91ab4218bc39102712b96d309550eeff363a7a378a7f93e536eec208efbdfabd: Status 404 returned error can't find the container with id 91ab4218bc39102712b96d309550eeff363a7a378a7f93e536eec208efbdfabd
Oct 30 21:05:38.841041 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:05:38.841025    4060 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 21:05:39.270874 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:05:39.270842    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-77cb4489f4-49kjk" event={"ID":"59a22995-ac2c-4f92-b6b8-8d61bfd0a0cd","Type":"ContainerStarted","Data":"91ab4218bc39102712b96d309550eeff363a7a378a7f93e536eec208efbdfabd"}
Oct 30 21:05:42.113683 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:05:42.113653    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:05:42.114096 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:05:42.113869    4060 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-collector-0" podUID="678208c4-7636-43e4-9fd8-135b176c9a67" containerName="otc-container" containerID="cri-o://6aeb5b7e396a00f1f6cad447cdcb440de95c9d735791b9431b17c4ad6c0fb81b" gracePeriod=30
Oct 30 21:05:42.152122 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:05:42.152085    4060 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v2f4x" containerName="extractor"
Oct 30 21:05:43.722646 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:05:43.722358    4060 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 21:05:43.722646 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:05:43.722442    4060 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 21:05:44.301885 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:05:44.301853    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-77cb4489f4-49kjk" event={"ID":"59a22995-ac2c-4f92-b6b8-8d61bfd0a0cd","Type":"ContainerStarted","Data":"e30435754e6dbcfcc57b869742d603465321b1813eac36e5948c81e230086615"}
Oct 30 21:05:44.302072 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:05:44.302040    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-77cb4489f4-49kjk"
Oct 30 21:05:44.303381 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:05:44.303353    4060 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-collector-targetallocator-77cb4489f4-49kjk" podUID="59a22995-ac2c-4f92-b6b8-8d61bfd0a0cd" containerName="ta-container" probeResult="failure" output="Get \"http://10.133.0.78:8080/readyz\": dial tcp 10.133.0.78:8080: connect: connection refused"
Oct 30 21:05:44.454554 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:05:44.454521    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:05:44.576458 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:05:44.576355    4060 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-targetallocator-77cb4489f4-49kjk" podStartSLOduration=1.696167851 podStartE2EDuration="6.576341063s" totalImagesPullingTime="4.880173212s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:05:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:05:44.417993957 +0000 UTC m=+1763.174992255" watchObservedRunningTime="2026-10-30 21:05:44.576341063 +0000 UTC m=+1763.333339360"
Oct 30 21:05:44.580421 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:05:44.580390    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/678208c4-7636-43e4-9fd8-135b176c9a67-otc-internal\" (UniqueName: \"kubernetes.io/configmap/678208c4-7636-43e4-9fd8-135b176c9a67-otc-internal\") pod \"678208c4-7636-43e4-9fd8-135b176c9a67\" (UID: \"678208c4-7636-43e4-9fd8-135b176c9a67\") "
Oct 30 21:05:44.580605 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:05:44.580456    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/678208c4-7636-43e4-9fd8-135b176c9a67-kube-api-access-jtfl8\" (UniqueName: \"kubernetes.io/projected/678208c4-7636-43e4-9fd8-135b176c9a67-kube-api-access-jtfl8\") pod \"678208c4-7636-43e4-9fd8-135b176c9a67\" (UID: \"678208c4-7636-43e4-9fd8-135b176c9a67\") "
Oct 30 21:05:44.580605 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:05:44.580568    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/678208c4-7636-43e4-9fd8-135b176c9a67-monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/678208c4-7636-43e4-9fd8-135b176c9a67-monitoring-tls-certs\") pod \"678208c4-7636-43e4-9fd8-135b176c9a67\" (UID: \"678208c4-7636-43e4-9fd8-135b176c9a67\") "
Oct 30 21:05:44.580722 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:05:44.580617    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/678208c4-7636-43e4-9fd8-135b176c9a67-tls-certs\" (UniqueName: \"kubernetes.io/secret/678208c4-7636-43e4-9fd8-135b176c9a67-tls-certs\") pod \"678208c4-7636-43e4-9fd8-135b176c9a67\" (UID: \"678208c4-7636-43e4-9fd8-135b176c9a67\") "
Oct 30 21:05:44.580722 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:05:44.580646    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/678208c4-7636-43e4-9fd8-135b176c9a67-otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/678208c4-7636-43e4-9fd8-135b176c9a67-otlp-tls-certs\") pod \"678208c4-7636-43e4-9fd8-135b176c9a67\" (UID: \"678208c4-7636-43e4-9fd8-135b176c9a67\") "
Oct 30 21:05:44.580840 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:05:44.580736    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/678208c4-7636-43e4-9fd8-135b176c9a67-data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/678208c4-7636-43e4-9fd8-135b176c9a67-data-science-collector-ta-client-cert\") pod \"678208c4-7636-43e4-9fd8-135b176c9a67\" (UID: \"678208c4-7636-43e4-9fd8-135b176c9a67\") "
Oct 30 21:05:44.580895 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:05:44.580865    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/678208c4-7636-43e4-9fd8-135b176c9a67-otc-internal" pod "678208c4-7636-43e4-9fd8-135b176c9a67" (UID: "678208c4-7636-43e4-9fd8-135b176c9a67"). InnerVolumeSpecName "otc-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:05:44.582777 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:05:44.581012    4060 reconciler_common.go:299] "Volume detached for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/678208c4-7636-43e4-9fd8-135b176c9a67-otc-internal\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:05:44.583125 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:05:44.583096    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/678208c4-7636-43e4-9fd8-135b176c9a67-kube-api-access-jtfl8" pod "678208c4-7636-43e4-9fd8-135b176c9a67" (UID: "678208c4-7636-43e4-9fd8-135b176c9a67"). InnerVolumeSpecName "kube-api-access-jtfl8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:05:44.583395 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:05:44.583363    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/678208c4-7636-43e4-9fd8-135b176c9a67-data-science-collector-ta-client-cert" pod "678208c4-7636-43e4-9fd8-135b176c9a67" (UID: "678208c4-7636-43e4-9fd8-135b176c9a67"). InnerVolumeSpecName "data-science-collector-ta-client-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:05:44.584067 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:05:44.584039    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/678208c4-7636-43e4-9fd8-135b176c9a67-monitoring-tls-certs" pod "678208c4-7636-43e4-9fd8-135b176c9a67" (UID: "678208c4-7636-43e4-9fd8-135b176c9a67"). InnerVolumeSpecName "monitoring-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:05:44.584308 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:05:44.584285    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/678208c4-7636-43e4-9fd8-135b176c9a67-tls-certs" pod "678208c4-7636-43e4-9fd8-135b176c9a67" (UID: "678208c4-7636-43e4-9fd8-135b176c9a67"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:05:44.585217 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:05:44.585188    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/678208c4-7636-43e4-9fd8-135b176c9a67-otlp-tls-certs" pod "678208c4-7636-43e4-9fd8-135b176c9a67" (UID: "678208c4-7636-43e4-9fd8-135b176c9a67"). InnerVolumeSpecName "otlp-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:05:44.682391 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:05:44.682357    4060 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jtfl8\" (UniqueName: \"kubernetes.io/projected/678208c4-7636-43e4-9fd8-135b176c9a67-kube-api-access-jtfl8\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:05:44.682391 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:05:44.682384    4060 reconciler_common.go:299] "Volume detached for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/678208c4-7636-43e4-9fd8-135b176c9a67-monitoring-tls-certs\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:05:44.682391 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:05:44.682397    4060 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/678208c4-7636-43e4-9fd8-135b176c9a67-tls-certs\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:05:44.682657 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:05:44.682405    4060 reconciler_common.go:299] "Volume detached for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/678208c4-7636-43e4-9fd8-135b176c9a67-otlp-tls-certs\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:05:44.682657 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:05:44.682416    4060 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/678208c4-7636-43e4-9fd8-135b176c9a67-data-science-collector-ta-client-cert\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:05:45.308472 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:05:45.308438    4060 generic.go:356] "Generic (PLEG): container finished" podID="678208c4-7636-43e4-9fd8-135b176c9a67" containerID="6aeb5b7e396a00f1f6cad447cdcb440de95c9d735791b9431b17c4ad6c0fb81b" exitCode=0
Oct 30 21:05:45.311079 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:05:45.308485    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:05:45.311079 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:05:45.308525    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"678208c4-7636-43e4-9fd8-135b176c9a67","Type":"ContainerDied","Data":"6aeb5b7e396a00f1f6cad447cdcb440de95c9d735791b9431b17c4ad6c0fb81b"}
Oct 30 21:05:45.311079 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:05:45.308574    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"678208c4-7636-43e4-9fd8-135b176c9a67","Type":"ContainerDied","Data":"12df0690e47fb06b95c05659c42484d3c1b7db993affb961decbac895e55d951"}
Oct 30 21:05:45.311079 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:05:45.308595    4060 scope.go:122] "RemoveContainer" containerID="6aeb5b7e396a00f1f6cad447cdcb440de95c9d735791b9431b17c4ad6c0fb81b"
Oct 30 21:05:45.311079 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:05:45.309964    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-77cb4489f4-49kjk"
Oct 30 21:05:45.317985 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:05:45.317970    4060 scope.go:122] "RemoveContainer" containerID="6aeb5b7e396a00f1f6cad447cdcb440de95c9d735791b9431b17c4ad6c0fb81b"
Oct 30 21:05:45.318323 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:05:45.318304    4060 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6aeb5b7e396a00f1f6cad447cdcb440de95c9d735791b9431b17c4ad6c0fb81b\": container with ID starting with 6aeb5b7e396a00f1f6cad447cdcb440de95c9d735791b9431b17c4ad6c0fb81b not found: ID does not exist" containerID="6aeb5b7e396a00f1f6cad447cdcb440de95c9d735791b9431b17c4ad6c0fb81b"
Oct 30 21:05:45.318371 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:05:45.318332    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6aeb5b7e396a00f1f6cad447cdcb440de95c9d735791b9431b17c4ad6c0fb81b"} err="failed to get container status \"6aeb5b7e396a00f1f6cad447cdcb440de95c9d735791b9431b17c4ad6c0fb81b\": rpc error: code = NotFound desc = could not find container \"6aeb5b7e396a00f1f6cad447cdcb440de95c9d735791b9431b17c4ad6c0fb81b\": container with ID starting with 6aeb5b7e396a00f1f6cad447cdcb440de95c9d735791b9431b17c4ad6c0fb81b not found: ID does not exist"
Oct 30 21:05:45.475073 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:05:45.475037    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:05:45.524922 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:05:45.524881    4060 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:05:45.553565 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:05:45.553529    4060 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:05:45.553902 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:05:45.553889    4060 cpu_manager.go:414] "containerMap: removing container" podUID="678208c4-7636-43e4-9fd8-135b176c9a67" containerName="otc-container"
Oct 30 21:05:45.553950 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:05:45.553903    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="678208c4-7636-43e4-9fd8-135b176c9a67" containerName="otc-container"
Oct 30 21:05:45.553994 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:05:45.553984    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="678208c4-7636-43e4-9fd8-135b176c9a67" containerName="otc-container"
Oct 30 21:05:45.558263 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:05:45.558234    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:05:45.610930 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:05:45.610874    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-monitoring-tls\""
Oct 30 21:05:45.610930 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:05:45.610897    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-ta-client-cert\""
Oct 30 21:05:45.610930 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:05:45.610899    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-dockercfg-jqj7h\""
Oct 30 21:05:45.610930 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:05:45.610875    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-headless-tls\""
Oct 30 21:05:45.611256 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:05:45.610996    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-tls\""
Oct 30 21:05:45.611256 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:05:45.611114    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-db539ca7\""
Oct 30 21:05:45.646385 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:05:45.646354    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:05:45.692789 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:05:45.692757    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/93d31976-56dc-432e-9c70-00a66b36a367-monitoring-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"93d31976-56dc-432e-9c70-00a66b36a367\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:05:45.692992 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:05:45.692819    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/93d31976-56dc-432e-9c70-00a66b36a367-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"93d31976-56dc-432e-9c70-00a66b36a367\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:05:45.692992 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:05:45.692971    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/93d31976-56dc-432e-9c70-00a66b36a367-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-0\" (UID: \"93d31976-56dc-432e-9c70-00a66b36a367\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:05:45.693106 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:05:45.693017    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/93d31976-56dc-432e-9c70-00a66b36a367-otc-internal\") pod \"data-science-collector-collector-0\" (UID: \"93d31976-56dc-432e-9c70-00a66b36a367\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:05:45.693106 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:05:45.693037    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dlcms\" (UniqueName: \"kubernetes.io/projected/93d31976-56dc-432e-9c70-00a66b36a367-kube-api-access-dlcms\") pod \"data-science-collector-collector-0\" (UID: \"93d31976-56dc-432e-9c70-00a66b36a367\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:05:45.693225 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:05:45.693133    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/93d31976-56dc-432e-9c70-00a66b36a367-otlp-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"93d31976-56dc-432e-9c70-00a66b36a367\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:05:45.794027 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:05:45.793978    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/93d31976-56dc-432e-9c70-00a66b36a367-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-0\" (UID: \"93d31976-56dc-432e-9c70-00a66b36a367\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:05:45.794240 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:05:45.794043    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/93d31976-56dc-432e-9c70-00a66b36a367-otc-internal\") pod \"data-science-collector-collector-0\" (UID: \"93d31976-56dc-432e-9c70-00a66b36a367\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:05:45.794240 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:05:45.794066    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dlcms\" (UniqueName: \"kubernetes.io/projected/93d31976-56dc-432e-9c70-00a66b36a367-kube-api-access-dlcms\") pod \"data-science-collector-collector-0\" (UID: \"93d31976-56dc-432e-9c70-00a66b36a367\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:05:45.794240 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:05:45.794094    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/93d31976-56dc-432e-9c70-00a66b36a367-otlp-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"93d31976-56dc-432e-9c70-00a66b36a367\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:05:45.794240 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:05:45.794124    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/93d31976-56dc-432e-9c70-00a66b36a367-monitoring-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"93d31976-56dc-432e-9c70-00a66b36a367\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:05:45.794240 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:05:45.794176    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/93d31976-56dc-432e-9c70-00a66b36a367-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"93d31976-56dc-432e-9c70-00a66b36a367\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:05:45.794949 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:05:45.794913    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/93d31976-56dc-432e-9c70-00a66b36a367-otc-internal\") pod \"data-science-collector-collector-0\" (UID: \"93d31976-56dc-432e-9c70-00a66b36a367\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:05:45.796749 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:05:45.796721    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/93d31976-56dc-432e-9c70-00a66b36a367-otlp-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"93d31976-56dc-432e-9c70-00a66b36a367\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:05:45.796870 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:05:45.796759    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/93d31976-56dc-432e-9c70-00a66b36a367-monitoring-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"93d31976-56dc-432e-9c70-00a66b36a367\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:05:45.796870 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:05:45.796817    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/93d31976-56dc-432e-9c70-00a66b36a367-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"93d31976-56dc-432e-9c70-00a66b36a367\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:05:45.796988 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:05:45.796966    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/93d31976-56dc-432e-9c70-00a66b36a367-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-0\" (UID: \"93d31976-56dc-432e-9c70-00a66b36a367\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:05:45.855354 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:05:45.855273    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dlcms\" (UniqueName: \"kubernetes.io/projected/93d31976-56dc-432e-9c70-00a66b36a367-kube-api-access-dlcms\") pod \"data-science-collector-collector-0\" (UID: \"93d31976-56dc-432e-9c70-00a66b36a367\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:05:45.871031 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:05:45.870995    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:05:46.247952 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:05:46.247924    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:05:46.249799 ip-10-0-142-4 kubenswrapper[4060]: W1030 21:05:46.249772    4060 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93d31976_56dc_432e_9c70_00a66b36a367.slice/crio-a880373cad62e81fd512d1d15f4b2ef863f434f38f9953471c2393fb0bf4c057 WatchSource:0}: Error finding container a880373cad62e81fd512d1d15f4b2ef863f434f38f9953471c2393fb0bf4c057: Status 404 returned error can't find the container with id a880373cad62e81fd512d1d15f4b2ef863f434f38f9953471c2393fb0bf4c057
Oct 30 21:05:46.252181 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:05:46.252140    4060 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 21:05:46.252276 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:05:46.252210    4060 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 21:05:46.322725 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:05:46.322683    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"93d31976-56dc-432e-9c70-00a66b36a367","Type":"ContainerStarted","Data":"7f74ae2be5ff56db28ee9e789af77990eed339120889306d6312732dc6147723"}
Oct 30 21:05:46.323194 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:05:46.322774    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"93d31976-56dc-432e-9c70-00a66b36a367","Type":"ContainerStarted","Data":"a880373cad62e81fd512d1d15f4b2ef863f434f38f9953471c2393fb0bf4c057"}
Oct 30 21:05:46.443458 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:05:46.443404    4060 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-collector-0" podStartSLOduration=1.443389026 podStartE2EDuration="1.443389026s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:05:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:05:46.442011247 +0000 UTC m=+1765.199009545" watchObservedRunningTime="2026-10-30 21:05:46.443389026 +0000 UTC m=+1765.200387448"
Oct 30 21:05:47.428333 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:05:47.428294    4060 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="678208c4-7636-43e4-9fd8-135b176c9a67" path="/var/lib/kubelet/pods/678208c4-7636-43e4-9fd8-135b176c9a67/volumes"
Oct 30 21:06:12.150167 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:06:12.150131    4060 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v2f4x" containerName="extractor"
Oct 30 21:06:42.150775 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:06:42.150734    4060 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v2f4x" containerName="extractor"
Oct 30 21:07:12.150221 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:07:12.150144    4060 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v2f4x" containerName="extractor"
Oct 30 21:07:42.150166 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:07:42.150132    4060 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v2f4x" containerName="extractor"
Oct 30 21:07:46.294051 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:07:46.294010    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-77cb4489f4-49kjk"]
Oct 30 21:07:46.294791 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:07:46.294744    4060 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-targetallocator-77cb4489f4-49kjk" podUID="59a22995-ac2c-4f92-b6b8-8d61bfd0a0cd" containerName="ta-container" containerID="cri-o://e30435754e6dbcfcc57b869742d603465321b1813eac36e5948c81e230086615" gracePeriod=30
Oct 30 21:07:46.556353 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:07:46.556294    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-77cb4489f4-49kjk"
Oct 30 21:07:46.631100 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:07:46.631073    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/59a22995-ac2c-4f92-b6b8-8d61bfd0a0cd-data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/59a22995-ac2c-4f92-b6b8-8d61bfd0a0cd-data-science-collector-ta-server-cert\") pod \"59a22995-ac2c-4f92-b6b8-8d61bfd0a0cd\" (UID: \"59a22995-ac2c-4f92-b6b8-8d61bfd0a0cd\") "
Oct 30 21:07:46.631320 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:07:46.631110    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/59a22995-ac2c-4f92-b6b8-8d61bfd0a0cd-kube-api-access-sqldd\" (UniqueName: \"kubernetes.io/projected/59a22995-ac2c-4f92-b6b8-8d61bfd0a0cd-kube-api-access-sqldd\") pod \"59a22995-ac2c-4f92-b6b8-8d61bfd0a0cd\" (UID: \"59a22995-ac2c-4f92-b6b8-8d61bfd0a0cd\") "
Oct 30 21:07:46.631320 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:07:46.631140    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/59a22995-ac2c-4f92-b6b8-8d61bfd0a0cd-ta-internal\" (UniqueName: \"kubernetes.io/configmap/59a22995-ac2c-4f92-b6b8-8d61bfd0a0cd-ta-internal\") pod \"59a22995-ac2c-4f92-b6b8-8d61bfd0a0cd\" (UID: \"59a22995-ac2c-4f92-b6b8-8d61bfd0a0cd\") "
Oct 30 21:07:46.631582 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:07:46.631560    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/59a22995-ac2c-4f92-b6b8-8d61bfd0a0cd-ta-internal" pod "59a22995-ac2c-4f92-b6b8-8d61bfd0a0cd" (UID: "59a22995-ac2c-4f92-b6b8-8d61bfd0a0cd"). InnerVolumeSpecName "ta-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:07:46.633294 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:07:46.633268    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/59a22995-ac2c-4f92-b6b8-8d61bfd0a0cd-kube-api-access-sqldd" pod "59a22995-ac2c-4f92-b6b8-8d61bfd0a0cd" (UID: "59a22995-ac2c-4f92-b6b8-8d61bfd0a0cd"). InnerVolumeSpecName "kube-api-access-sqldd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:07:46.633392 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:07:46.633311    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/59a22995-ac2c-4f92-b6b8-8d61bfd0a0cd-data-science-collector-ta-server-cert" pod "59a22995-ac2c-4f92-b6b8-8d61bfd0a0cd" (UID: "59a22995-ac2c-4f92-b6b8-8d61bfd0a0cd"). InnerVolumeSpecName "data-science-collector-ta-server-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:07:46.731805 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:07:46.731774    4060 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/59a22995-ac2c-4f92-b6b8-8d61bfd0a0cd-data-science-collector-ta-server-cert\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:07:46.731805 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:07:46.731803    4060 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sqldd\" (UniqueName: \"kubernetes.io/projected/59a22995-ac2c-4f92-b6b8-8d61bfd0a0cd-kube-api-access-sqldd\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:07:46.732030 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:07:46.731814    4060 reconciler_common.go:299] "Volume detached for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/59a22995-ac2c-4f92-b6b8-8d61bfd0a0cd-ta-internal\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:07:46.901815 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:07:46.901727    4060 generic.go:356] "Generic (PLEG): container finished" podID="59a22995-ac2c-4f92-b6b8-8d61bfd0a0cd" containerID="e30435754e6dbcfcc57b869742d603465321b1813eac36e5948c81e230086615" exitCode=0
Oct 30 21:07:46.901815 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:07:46.901764    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-77cb4489f4-49kjk"
Oct 30 21:07:46.901815 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:07:46.901803    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-77cb4489f4-49kjk" event={"ID":"59a22995-ac2c-4f92-b6b8-8d61bfd0a0cd","Type":"ContainerDied","Data":"e30435754e6dbcfcc57b869742d603465321b1813eac36e5948c81e230086615"}
Oct 30 21:07:46.902094 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:07:46.901845    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-77cb4489f4-49kjk" event={"ID":"59a22995-ac2c-4f92-b6b8-8d61bfd0a0cd","Type":"ContainerDied","Data":"91ab4218bc39102712b96d309550eeff363a7a378a7f93e536eec208efbdfabd"}
Oct 30 21:07:46.902094 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:07:46.901865    4060 scope.go:122] "RemoveContainer" containerID="e30435754e6dbcfcc57b869742d603465321b1813eac36e5948c81e230086615"
Oct 30 21:07:46.913613 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:07:46.913582    4060 scope.go:122] "RemoveContainer" containerID="e30435754e6dbcfcc57b869742d603465321b1813eac36e5948c81e230086615"
Oct 30 21:07:46.914031 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:07:46.913979    4060 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e30435754e6dbcfcc57b869742d603465321b1813eac36e5948c81e230086615\": container with ID starting with e30435754e6dbcfcc57b869742d603465321b1813eac36e5948c81e230086615 not found: ID does not exist" containerID="e30435754e6dbcfcc57b869742d603465321b1813eac36e5948c81e230086615"
Oct 30 21:07:46.914143 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:07:46.914024    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e30435754e6dbcfcc57b869742d603465321b1813eac36e5948c81e230086615"} err="failed to get container status \"e30435754e6dbcfcc57b869742d603465321b1813eac36e5948c81e230086615\": rpc error: code = NotFound desc = could not find container \"e30435754e6dbcfcc57b869742d603465321b1813eac36e5948c81e230086615\": container with ID starting with e30435754e6dbcfcc57b869742d603465321b1813eac36e5948c81e230086615 not found: ID does not exist"
Oct 30 21:07:47.065293 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:07:47.065260    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-77cb4489f4-49kjk"]
Oct 30 21:07:47.071522 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:07:47.071486    4060 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-77cb4489f4-49kjk"]
Oct 30 21:07:47.426530 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:07:47.426480    4060 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="59a22995-ac2c-4f92-b6b8-8d61bfd0a0cd" path="/var/lib/kubelet/pods/59a22995-ac2c-4f92-b6b8-8d61bfd0a0cd/volumes"
Oct 30 21:07:47.714958 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:07:47.714927    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:07:47.715141 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:07:47.715122    4060 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-collector-0" podUID="93d31976-56dc-432e-9c70-00a66b36a367" containerName="otc-container" containerID="cri-o://7f74ae2be5ff56db28ee9e789af77990eed339120889306d6312732dc6147723" gracePeriod=30
Oct 30 21:07:47.908827 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:07:47.908797    4060 generic.go:356] "Generic (PLEG): container finished" podID="cc6aeef9-afb1-4052-91eb-76d3d3a3427a" containerID="53d48b7a825de1df676d12cc8b8840e22d6ac7974c9768034b751fcb8c68ffef" exitCode=137
Oct 30 21:07:47.908999 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:07:47.908868    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-observability-system/odh-observability-6f5479fd64-7gfbz" event={"ID":"cc6aeef9-afb1-4052-91eb-76d3d3a3427a","Type":"ContainerDied","Data":"53d48b7a825de1df676d12cc8b8840e22d6ac7974c9768034b751fcb8c68ffef"}
Oct 30 21:07:47.908999 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:07:47.908917    4060 scope.go:122] "RemoveContainer" containerID="4bb24a3af92c97102b47314019e0a5683c03e153ecf04972d55c9910b9db0cf4"
Oct 30 21:07:47.909254 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:07:47.909234    4060 scope.go:122] "RemoveContainer" containerID="53d48b7a825de1df676d12cc8b8840e22d6ac7974c9768034b751fcb8c68ffef"
Oct 30 21:07:47.909480 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:07:47.909460    4060 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 20s restarting failed container=manager pod=odh-observability-6f5479fd64-7gfbz_odh-observability-system(cc6aeef9-afb1-4052-91eb-76d3d3a3427a)\"" pod="odh-observability-system/odh-observability-6f5479fd64-7gfbz" podUID="cc6aeef9-afb1-4052-91eb-76d3d3a3427a"
Oct 30 21:07:48.245845 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:07:48.245803    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-observability-system/odh-observability-6f5479fd64-7gfbz"
Oct 30 21:07:48.915481 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:07:48.915436    4060 scope.go:122] "RemoveContainer" containerID="53d48b7a825de1df676d12cc8b8840e22d6ac7974c9768034b751fcb8c68ffef"
Oct 30 21:07:48.915961 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:07:48.915715    4060 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 20s restarting failed container=manager pod=odh-observability-6f5479fd64-7gfbz_odh-observability-system(cc6aeef9-afb1-4052-91eb-76d3d3a3427a)\"" pod="odh-observability-system/odh-observability-6f5479fd64-7gfbz" podUID="cc6aeef9-afb1-4052-91eb-76d3d3a3427a"
Oct 30 21:07:50.056562 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:07:50.056536    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:07:50.162885 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:07:50.162799    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/93d31976-56dc-432e-9c70-00a66b36a367-kube-api-access-dlcms\" (UniqueName: \"kubernetes.io/projected/93d31976-56dc-432e-9c70-00a66b36a367-kube-api-access-dlcms\") pod \"93d31976-56dc-432e-9c70-00a66b36a367\" (UID: \"93d31976-56dc-432e-9c70-00a66b36a367\") "
Oct 30 21:07:50.162885 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:07:50.162852    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/93d31976-56dc-432e-9c70-00a66b36a367-data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/93d31976-56dc-432e-9c70-00a66b36a367-data-science-collector-ta-client-cert\") pod \"93d31976-56dc-432e-9c70-00a66b36a367\" (UID: \"93d31976-56dc-432e-9c70-00a66b36a367\") "
Oct 30 21:07:50.163107 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:07:50.162899    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/93d31976-56dc-432e-9c70-00a66b36a367-otc-internal\" (UniqueName: \"kubernetes.io/configmap/93d31976-56dc-432e-9c70-00a66b36a367-otc-internal\") pod \"93d31976-56dc-432e-9c70-00a66b36a367\" (UID: \"93d31976-56dc-432e-9c70-00a66b36a367\") "
Oct 30 21:07:50.163107 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:07:50.162924    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/93d31976-56dc-432e-9c70-00a66b36a367-otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/93d31976-56dc-432e-9c70-00a66b36a367-otlp-tls-certs\") pod \"93d31976-56dc-432e-9c70-00a66b36a367\" (UID: \"93d31976-56dc-432e-9c70-00a66b36a367\") "
Oct 30 21:07:50.163107 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:07:50.163003    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/93d31976-56dc-432e-9c70-00a66b36a367-tls-certs\" (UniqueName: \"kubernetes.io/secret/93d31976-56dc-432e-9c70-00a66b36a367-tls-certs\") pod \"93d31976-56dc-432e-9c70-00a66b36a367\" (UID: \"93d31976-56dc-432e-9c70-00a66b36a367\") "
Oct 30 21:07:50.163107 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:07:50.163040    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/93d31976-56dc-432e-9c70-00a66b36a367-monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/93d31976-56dc-432e-9c70-00a66b36a367-monitoring-tls-certs\") pod \"93d31976-56dc-432e-9c70-00a66b36a367\" (UID: \"93d31976-56dc-432e-9c70-00a66b36a367\") "
Oct 30 21:07:50.163329 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:07:50.163298    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/93d31976-56dc-432e-9c70-00a66b36a367-otc-internal" pod "93d31976-56dc-432e-9c70-00a66b36a367" (UID: "93d31976-56dc-432e-9c70-00a66b36a367"). InnerVolumeSpecName "otc-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:07:50.165040 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:07:50.165009    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/93d31976-56dc-432e-9c70-00a66b36a367-otlp-tls-certs" pod "93d31976-56dc-432e-9c70-00a66b36a367" (UID: "93d31976-56dc-432e-9c70-00a66b36a367"). InnerVolumeSpecName "otlp-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:07:50.165184 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:07:50.165159    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/93d31976-56dc-432e-9c70-00a66b36a367-data-science-collector-ta-client-cert" pod "93d31976-56dc-432e-9c70-00a66b36a367" (UID: "93d31976-56dc-432e-9c70-00a66b36a367"). InnerVolumeSpecName "data-science-collector-ta-client-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:07:50.165250 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:07:50.165177    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/93d31976-56dc-432e-9c70-00a66b36a367-monitoring-tls-certs" pod "93d31976-56dc-432e-9c70-00a66b36a367" (UID: "93d31976-56dc-432e-9c70-00a66b36a367"). InnerVolumeSpecName "monitoring-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:07:50.165356 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:07:50.165336    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/93d31976-56dc-432e-9c70-00a66b36a367-tls-certs" pod "93d31976-56dc-432e-9c70-00a66b36a367" (UID: "93d31976-56dc-432e-9c70-00a66b36a367"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:07:50.165438 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:07:50.165421    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/93d31976-56dc-432e-9c70-00a66b36a367-kube-api-access-dlcms" pod "93d31976-56dc-432e-9c70-00a66b36a367" (UID: "93d31976-56dc-432e-9c70-00a66b36a367"). InnerVolumeSpecName "kube-api-access-dlcms". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:07:50.263640 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:07:50.263608    4060 reconciler_common.go:299] "Volume detached for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/93d31976-56dc-432e-9c70-00a66b36a367-otc-internal\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:07:50.263640 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:07:50.263634    4060 reconciler_common.go:299] "Volume detached for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/93d31976-56dc-432e-9c70-00a66b36a367-otlp-tls-certs\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:07:50.263640 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:07:50.263644    4060 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/93d31976-56dc-432e-9c70-00a66b36a367-tls-certs\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:07:50.263881 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:07:50.263653    4060 reconciler_common.go:299] "Volume detached for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/93d31976-56dc-432e-9c70-00a66b36a367-monitoring-tls-certs\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:07:50.263881 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:07:50.263663    4060 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dlcms\" (UniqueName: \"kubernetes.io/projected/93d31976-56dc-432e-9c70-00a66b36a367-kube-api-access-dlcms\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:07:50.263881 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:07:50.263675    4060 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/93d31976-56dc-432e-9c70-00a66b36a367-data-science-collector-ta-client-cert\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:07:50.925622 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:07:50.925584    4060 generic.go:356] "Generic (PLEG): container finished" podID="93d31976-56dc-432e-9c70-00a66b36a367" containerID="7f74ae2be5ff56db28ee9e789af77990eed339120889306d6312732dc6147723" exitCode=0
Oct 30 21:07:50.925793 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:07:50.925633    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:07:50.925793 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:07:50.925667    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"93d31976-56dc-432e-9c70-00a66b36a367","Type":"ContainerDied","Data":"7f74ae2be5ff56db28ee9e789af77990eed339120889306d6312732dc6147723"}
Oct 30 21:07:50.925793 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:07:50.925718    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"93d31976-56dc-432e-9c70-00a66b36a367","Type":"ContainerDied","Data":"a880373cad62e81fd512d1d15f4b2ef863f434f38f9953471c2393fb0bf4c057"}
Oct 30 21:07:50.925793 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:07:50.925742    4060 scope.go:122] "RemoveContainer" containerID="7f74ae2be5ff56db28ee9e789af77990eed339120889306d6312732dc6147723"
Oct 30 21:07:50.935389 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:07:50.935244    4060 scope.go:122] "RemoveContainer" containerID="7f74ae2be5ff56db28ee9e789af77990eed339120889306d6312732dc6147723"
Oct 30 21:07:50.935528 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:07:50.935507    4060 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7f74ae2be5ff56db28ee9e789af77990eed339120889306d6312732dc6147723\": container with ID starting with 7f74ae2be5ff56db28ee9e789af77990eed339120889306d6312732dc6147723 not found: ID does not exist" containerID="7f74ae2be5ff56db28ee9e789af77990eed339120889306d6312732dc6147723"
Oct 30 21:07:50.935578 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:07:50.935541    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f74ae2be5ff56db28ee9e789af77990eed339120889306d6312732dc6147723"} err="failed to get container status \"7f74ae2be5ff56db28ee9e789af77990eed339120889306d6312732dc6147723\": rpc error: code = NotFound desc = could not find container \"7f74ae2be5ff56db28ee9e789af77990eed339120889306d6312732dc6147723\": container with ID starting with 7f74ae2be5ff56db28ee9e789af77990eed339120889306d6312732dc6147723 not found: ID does not exist"
Oct 30 21:07:50.941933 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:07:50.941912    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["tests-monitoring-dcgm-https-18e36a9f59ba6e1c/dcgm-https-exporter"]
Oct 30 21:07:50.942109 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:07:50.942090    4060 kuberuntime_container.go:898] "Killing container with a grace period" pod="tests-monitoring-dcgm-https-18e36a9f59ba6e1c/dcgm-https-exporter" podUID="1d3ba6ad-9f43-401c-b1e6-f92746f584b9" containerName="dcgm-https-exporter" containerID="cri-o://1bb489e9c149bebc5fce36173978806bb927b7734954aa41f8efa56d511ffd05" gracePeriod=30
Oct 30 21:07:51.225153 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:07:51.225122    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:07:51.229851 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:07:51.229829    4060 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:07:51.285861 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:07:51.285838    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="tests-monitoring-dcgm-https-18e36a9f59ba6e1c/dcgm-https-exporter"
Oct 30 21:07:51.306792 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:07:51.306766    4060 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:07:51.307101 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:07:51.307089    4060 cpu_manager.go:414] "containerMap: removing container" podUID="1d3ba6ad-9f43-401c-b1e6-f92746f584b9" containerName="dcgm-https-exporter"
Oct 30 21:07:51.307142 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:07:51.307103    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1d3ba6ad-9f43-401c-b1e6-f92746f584b9" containerName="dcgm-https-exporter"
Oct 30 21:07:51.307142 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:07:51.307125    4060 cpu_manager.go:414] "containerMap: removing container" podUID="93d31976-56dc-432e-9c70-00a66b36a367" containerName="otc-container"
Oct 30 21:07:51.307142 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:07:51.307130    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="93d31976-56dc-432e-9c70-00a66b36a367" containerName="otc-container"
Oct 30 21:07:51.307242 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:07:51.307145    4060 cpu_manager.go:414] "containerMap: removing container" podUID="59a22995-ac2c-4f92-b6b8-8d61bfd0a0cd" containerName="ta-container"
Oct 30 21:07:51.307242 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:07:51.307152    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="59a22995-ac2c-4f92-b6b8-8d61bfd0a0cd" containerName="ta-container"
Oct 30 21:07:51.307242 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:07:51.307199    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="59a22995-ac2c-4f92-b6b8-8d61bfd0a0cd" containerName="ta-container"
Oct 30 21:07:51.307242 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:07:51.307208    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="1d3ba6ad-9f43-401c-b1e6-f92746f584b9" containerName="dcgm-https-exporter"
Oct 30 21:07:51.307242 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:07:51.307216    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="93d31976-56dc-432e-9c70-00a66b36a367" containerName="otc-container"
Oct 30 21:07:51.310083 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:07:51.310067    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:07:51.362569 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:07:51.362540    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-headless-tls\""
Oct 30 21:07:51.362781 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:07:51.362766    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-tls\""
Oct 30 21:07:51.362781 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:07:51.362772    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-monitoring-tls\""
Oct 30 21:07:51.362878 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:07:51.362864    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-ta-client-cert\""
Oct 30 21:07:51.362924 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:07:51.362878    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-dockercfg-jqj7h\""
Oct 30 21:07:51.362958 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:07:51.362922    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-a0f9182a\""
Oct 30 21:07:51.370946 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:07:51.370916    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:07:51.371193 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:07:51.371175    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/1d3ba6ad-9f43-401c-b1e6-f92746f584b9-web-config\" (UniqueName: \"kubernetes.io/configmap/1d3ba6ad-9f43-401c-b1e6-f92746f584b9-web-config\") pod \"1d3ba6ad-9f43-401c-b1e6-f92746f584b9\" (UID: \"1d3ba6ad-9f43-401c-b1e6-f92746f584b9\") "
Oct 30 21:07:51.371291 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:07:51.371232    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/1d3ba6ad-9f43-401c-b1e6-f92746f584b9-tls\" (UniqueName: \"kubernetes.io/secret/1d3ba6ad-9f43-401c-b1e6-f92746f584b9-tls\") pod \"1d3ba6ad-9f43-401c-b1e6-f92746f584b9\" (UID: \"1d3ba6ad-9f43-401c-b1e6-f92746f584b9\") "
Oct 30 21:07:51.371291 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:07:51.371267    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1d3ba6ad-9f43-401c-b1e6-f92746f584b9-data\" (UniqueName: \"kubernetes.io/empty-dir/1d3ba6ad-9f43-401c-b1e6-f92746f584b9-data\") pod \"1d3ba6ad-9f43-401c-b1e6-f92746f584b9\" (UID: \"1d3ba6ad-9f43-401c-b1e6-f92746f584b9\") "
Oct 30 21:07:51.371378 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:07:51.371360    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g7lwg\" (UniqueName: \"kubernetes.io/projected/2de60e47-4751-4e47-aad8-3d3fba742fb3-kube-api-access-g7lwg\") pod \"data-science-collector-collector-0\" (UID: \"2de60e47-4751-4e47-aad8-3d3fba742fb3\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:07:51.371417 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:07:51.371395    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/2de60e47-4751-4e47-aad8-3d3fba742fb3-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-0\" (UID: \"2de60e47-4751-4e47-aad8-3d3fba742fb3\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:07:51.371514 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:07:51.371461    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/2de60e47-4751-4e47-aad8-3d3fba742fb3-otlp-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"2de60e47-4751-4e47-aad8-3d3fba742fb3\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:07:51.371604 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:07:51.371531    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2de60e47-4751-4e47-aad8-3d3fba742fb3-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"2de60e47-4751-4e47-aad8-3d3fba742fb3\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:07:51.371714 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:07:51.371689    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/2de60e47-4751-4e47-aad8-3d3fba742fb3-monitoring-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"2de60e47-4751-4e47-aad8-3d3fba742fb3\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:07:51.372107 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:07:51.371755    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/2de60e47-4751-4e47-aad8-3d3fba742fb3-otc-internal\") pod \"data-science-collector-collector-0\" (UID: \"2de60e47-4751-4e47-aad8-3d3fba742fb3\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:07:51.372107 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:07:51.371992    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d3ba6ad-9f43-401c-b1e6-f92746f584b9-data" pod "1d3ba6ad-9f43-401c-b1e6-f92746f584b9" (UID: "1d3ba6ad-9f43-401c-b1e6-f92746f584b9"). InnerVolumeSpecName "data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:07:51.374066 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:07:51.374041    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1d3ba6ad-9f43-401c-b1e6-f92746f584b9-tls" pod "1d3ba6ad-9f43-401c-b1e6-f92746f584b9" (UID: "1d3ba6ad-9f43-401c-b1e6-f92746f584b9"). InnerVolumeSpecName "tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:07:51.377011 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:07:51.376988    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1d3ba6ad-9f43-401c-b1e6-f92746f584b9-web-config" pod "1d3ba6ad-9f43-401c-b1e6-f92746f584b9" (UID: "1d3ba6ad-9f43-401c-b1e6-f92746f584b9"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:07:51.432851 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:07:51.432819    4060 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="93d31976-56dc-432e-9c70-00a66b36a367" path="/var/lib/kubelet/pods/93d31976-56dc-432e-9c70-00a66b36a367/volumes"
Oct 30 21:07:51.472787 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:07:51.472711    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/2de60e47-4751-4e47-aad8-3d3fba742fb3-otc-internal\") pod \"data-science-collector-collector-0\" (UID: \"2de60e47-4751-4e47-aad8-3d3fba742fb3\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:07:51.472787 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:07:51.472757    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7lwg\" (UniqueName: \"kubernetes.io/projected/2de60e47-4751-4e47-aad8-3d3fba742fb3-kube-api-access-g7lwg\") pod \"data-science-collector-collector-0\" (UID: \"2de60e47-4751-4e47-aad8-3d3fba742fb3\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:07:51.472971 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:07:51.472790    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/2de60e47-4751-4e47-aad8-3d3fba742fb3-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-0\" (UID: \"2de60e47-4751-4e47-aad8-3d3fba742fb3\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:07:51.472971 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:07:51.472848    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/2de60e47-4751-4e47-aad8-3d3fba742fb3-otlp-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"2de60e47-4751-4e47-aad8-3d3fba742fb3\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:07:51.472971 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:07:51.472896    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2de60e47-4751-4e47-aad8-3d3fba742fb3-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"2de60e47-4751-4e47-aad8-3d3fba742fb3\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:07:51.472971 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:07:51.472920    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/2de60e47-4751-4e47-aad8-3d3fba742fb3-monitoring-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"2de60e47-4751-4e47-aad8-3d3fba742fb3\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:07:51.472971 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:07:51.472957    4060 reconciler_common.go:299] "Volume detached for volume \"tls\" (UniqueName: \"kubernetes.io/secret/1d3ba6ad-9f43-401c-b1e6-f92746f584b9-tls\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:07:51.473213 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:07:51.472973    4060 reconciler_common.go:299] "Volume detached for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/1d3ba6ad-9f43-401c-b1e6-f92746f584b9-data\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:07:51.473213 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:07:51.472989    4060 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/configmap/1d3ba6ad-9f43-401c-b1e6-f92746f584b9-web-config\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:07:51.473512 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:07:51.473475    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/2de60e47-4751-4e47-aad8-3d3fba742fb3-otc-internal\") pod \"data-science-collector-collector-0\" (UID: \"2de60e47-4751-4e47-aad8-3d3fba742fb3\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:07:51.475345 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:07:51.475322    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2de60e47-4751-4e47-aad8-3d3fba742fb3-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"2de60e47-4751-4e47-aad8-3d3fba742fb3\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:07:51.475464 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:07:51.475440    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/2de60e47-4751-4e47-aad8-3d3fba742fb3-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-0\" (UID: \"2de60e47-4751-4e47-aad8-3d3fba742fb3\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:07:51.475636 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:07:51.475618    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/2de60e47-4751-4e47-aad8-3d3fba742fb3-otlp-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"2de60e47-4751-4e47-aad8-3d3fba742fb3\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:07:51.475682 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:07:51.475651    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/2de60e47-4751-4e47-aad8-3d3fba742fb3-monitoring-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"2de60e47-4751-4e47-aad8-3d3fba742fb3\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:07:51.534097 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:07:51.534071    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g7lwg\" (UniqueName: \"kubernetes.io/projected/2de60e47-4751-4e47-aad8-3d3fba742fb3-kube-api-access-g7lwg\") pod \"data-science-collector-collector-0\" (UID: \"2de60e47-4751-4e47-aad8-3d3fba742fb3\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:07:51.621924 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:07:51.621892    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:07:51.932022 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:07:51.931929    4060 generic.go:356] "Generic (PLEG): container finished" podID="1d3ba6ad-9f43-401c-b1e6-f92746f584b9" containerID="1bb489e9c149bebc5fce36173978806bb927b7734954aa41f8efa56d511ffd05" exitCode=0
Oct 30 21:07:51.932022 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:07:51.931995    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="tests-monitoring-dcgm-https-18e36a9f59ba6e1c/dcgm-https-exporter"
Oct 30 21:07:51.932255 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:07:51.932017    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="tests-monitoring-dcgm-https-18e36a9f59ba6e1c/dcgm-https-exporter" event={"ID":"1d3ba6ad-9f43-401c-b1e6-f92746f584b9","Type":"ContainerDied","Data":"1bb489e9c149bebc5fce36173978806bb927b7734954aa41f8efa56d511ffd05"}
Oct 30 21:07:51.932255 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:07:51.932074    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="tests-monitoring-dcgm-https-18e36a9f59ba6e1c/dcgm-https-exporter" event={"ID":"1d3ba6ad-9f43-401c-b1e6-f92746f584b9","Type":"ContainerDied","Data":"d197629715e8dc5bf91c171137aac5328d0d0aaaa0fcc048d58f8bde6ef4a7f2"}
Oct 30 21:07:51.932255 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:07:51.932094    4060 scope.go:122] "RemoveContainer" containerID="1bb489e9c149bebc5fce36173978806bb927b7734954aa41f8efa56d511ffd05"
Oct 30 21:07:51.941118 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:07:51.940869    4060 scope.go:122] "RemoveContainer" containerID="1bb489e9c149bebc5fce36173978806bb927b7734954aa41f8efa56d511ffd05"
Oct 30 21:07:51.941118 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:07:51.941103    4060 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1bb489e9c149bebc5fce36173978806bb927b7734954aa41f8efa56d511ffd05\": container with ID starting with 1bb489e9c149bebc5fce36173978806bb927b7734954aa41f8efa56d511ffd05 not found: ID does not exist" containerID="1bb489e9c149bebc5fce36173978806bb927b7734954aa41f8efa56d511ffd05"
Oct 30 21:07:51.941229 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:07:51.941127    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1bb489e9c149bebc5fce36173978806bb927b7734954aa41f8efa56d511ffd05"} err="failed to get container status \"1bb489e9c149bebc5fce36173978806bb927b7734954aa41f8efa56d511ffd05\": rpc error: code = NotFound desc = could not find container \"1bb489e9c149bebc5fce36173978806bb927b7734954aa41f8efa56d511ffd05\": container with ID starting with 1bb489e9c149bebc5fce36173978806bb927b7734954aa41f8efa56d511ffd05 not found: ID does not exist"
Oct 30 21:07:51.997751 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:07:51.997663    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:07:52.000473 ip-10-0-142-4 kubenswrapper[4060]: W1030 21:07:52.000441    4060 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2de60e47_4751_4e47_aad8_3d3fba742fb3.slice/crio-734e178d60ca74ae79ee029f2cd33edbdb0ccc17fb689b771901d2fdc5a245d0 WatchSource:0}: Error finding container 734e178d60ca74ae79ee029f2cd33edbdb0ccc17fb689b771901d2fdc5a245d0: Status 404 returned error can't find the container with id 734e178d60ca74ae79ee029f2cd33edbdb0ccc17fb689b771901d2fdc5a245d0
Oct 30 21:07:52.002516 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:07:52.002463    4060 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 21:07:52.002587 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:07:52.002546    4060 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 21:07:52.095573 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:07:52.095541    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["tests-monitoring-dcgm-https-18e36a9f59ba6e1c/dcgm-https-exporter"]
Oct 30 21:07:52.101611 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:07:52.101589    4060 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["tests-monitoring-dcgm-https-18e36a9f59ba6e1c/dcgm-https-exporter"]
Oct 30 21:07:52.940274 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:07:52.940235    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"2de60e47-4751-4e47-aad8-3d3fba742fb3","Type":"ContainerStarted","Data":"598b1d9e91ff30dbbb11eaa477755fb0cd19d8dd3a36442889a69702b75f06dd"}
Oct 30 21:07:52.940794 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:07:52.940295    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"2de60e47-4751-4e47-aad8-3d3fba742fb3","Type":"ContainerStarted","Data":"734e178d60ca74ae79ee029f2cd33edbdb0ccc17fb689b771901d2fdc5a245d0"}
Oct 30 21:07:53.058614 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:07:53.058563    4060 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-collector-0" podStartSLOduration=2.058547104 podStartE2EDuration="2.058547104s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:07:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:07:53.057780379 +0000 UTC m=+1891.814778679" watchObservedRunningTime="2026-10-30 21:07:53.058547104 +0000 UTC m=+1891.815545475"
Oct 30 21:07:53.428733 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:07:53.428691    4060 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="1d3ba6ad-9f43-401c-b1e6-f92746f584b9" path="/var/lib/kubelet/pods/1d3ba6ad-9f43-401c-b1e6-f92746f584b9/volumes"
Oct 30 21:07:53.689943 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:07:53.689869    4060 kubelet.go:2727] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-observability-system/odh-observability-6f5479fd64-7gfbz"
Oct 30 21:07:53.690223 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:07:53.690210    4060 scope.go:122] "RemoveContainer" containerID="53d48b7a825de1df676d12cc8b8840e22d6ac7974c9768034b751fcb8c68ffef"
Oct 30 21:07:53.690426 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:07:53.690407    4060 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 20s restarting failed container=manager pod=odh-observability-6f5479fd64-7gfbz_odh-observability-system(cc6aeef9-afb1-4052-91eb-76d3d3a3427a)\"" pod="odh-observability-system/odh-observability-6f5479fd64-7gfbz" podUID="cc6aeef9-afb1-4052-91eb-76d3d3a3427a"
Oct 30 21:08:10.421932 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:08:10.421897    4060 scope.go:122] "RemoveContainer" containerID="53d48b7a825de1df676d12cc8b8840e22d6ac7974c9768034b751fcb8c68ffef"
Oct 30 21:08:12.030224 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:08:12.030187    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-observability-system/odh-observability-6f5479fd64-7gfbz" event={"ID":"cc6aeef9-afb1-4052-91eb-76d3d3a3427a","Type":"ContainerStarted","Data":"5ad71449f1119df4f79d19ba21f90c580fa97b289cde0645175fc43f351f0fc7"}
Oct 30 21:08:12.030784 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:08:12.030412    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-observability-system/odh-observability-6f5479fd64-7gfbz"
Oct 30 21:08:12.151473 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:08:12.151438    4060 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v2f4x" containerName="extractor"
Oct 30 21:08:23.036544 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:08:23.036511    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-observability-system/odh-observability-6f5479fd64-7gfbz"
Oct 30 21:08:33.427017 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:08:33.426946    4060 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["tests-monitoring-tenant-metrics/tenant-metrics-exporter-5cf544fb97-cv5zn"]
Oct 30 21:08:33.431372 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:08:33.431353    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="tests-monitoring-tenant-metrics/tenant-metrics-exporter-5cf544fb97-cv5zn"
Oct 30 21:08:33.484250 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:08:33.484220    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"tests-monitoring-tenant-metrics\"/\"kube-root-ca.crt\""
Oct 30 21:08:33.522610 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:08:33.522576    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p5ljx\" (UniqueName: \"kubernetes.io/projected/380e6dd1-060b-4ab8-b1f7-686d2273db0d-kube-api-access-p5ljx\") pod \"tenant-metrics-exporter-5cf544fb97-cv5zn\" (UID: \"380e6dd1-060b-4ab8-b1f7-686d2273db0d\") " pod="tests-monitoring-tenant-metrics/tenant-metrics-exporter-5cf544fb97-cv5zn"
Oct 30 21:08:33.522610 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:08:33.522611    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/380e6dd1-060b-4ab8-b1f7-686d2273db0d-data\") pod \"tenant-metrics-exporter-5cf544fb97-cv5zn\" (UID: \"380e6dd1-060b-4ab8-b1f7-686d2273db0d\") " pod="tests-monitoring-tenant-metrics/tenant-metrics-exporter-5cf544fb97-cv5zn"
Oct 30 21:08:33.533941 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:08:33.533922    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"tests-monitoring-tenant-metrics\"/\"openshift-service-ca.crt\""
Oct 30 21:08:33.534048 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:08:33.533991    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"tests-monitoring-tenant-metrics\"/\"default-dockercfg-nq2ds\""
Oct 30 21:08:33.537987 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:08:33.537961    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["tests-monitoring-tenant-metrics/tenant-metrics-exporter-5cf544fb97-cv5zn"]
Oct 30 21:08:33.623973 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:08:33.623940    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p5ljx\" (UniqueName: \"kubernetes.io/projected/380e6dd1-060b-4ab8-b1f7-686d2273db0d-kube-api-access-p5ljx\") pod \"tenant-metrics-exporter-5cf544fb97-cv5zn\" (UID: \"380e6dd1-060b-4ab8-b1f7-686d2273db0d\") " pod="tests-monitoring-tenant-metrics/tenant-metrics-exporter-5cf544fb97-cv5zn"
Oct 30 21:08:33.623973 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:08:33.623974    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/380e6dd1-060b-4ab8-b1f7-686d2273db0d-data\") pod \"tenant-metrics-exporter-5cf544fb97-cv5zn\" (UID: \"380e6dd1-060b-4ab8-b1f7-686d2273db0d\") " pod="tests-monitoring-tenant-metrics/tenant-metrics-exporter-5cf544fb97-cv5zn"
Oct 30 21:08:33.624350 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:08:33.624330    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/380e6dd1-060b-4ab8-b1f7-686d2273db0d-data\") pod \"tenant-metrics-exporter-5cf544fb97-cv5zn\" (UID: \"380e6dd1-060b-4ab8-b1f7-686d2273db0d\") " pod="tests-monitoring-tenant-metrics/tenant-metrics-exporter-5cf544fb97-cv5zn"
Oct 30 21:08:33.684838 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:08:33.684772    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p5ljx\" (UniqueName: \"kubernetes.io/projected/380e6dd1-060b-4ab8-b1f7-686d2273db0d-kube-api-access-p5ljx\") pod \"tenant-metrics-exporter-5cf544fb97-cv5zn\" (UID: \"380e6dd1-060b-4ab8-b1f7-686d2273db0d\") " pod="tests-monitoring-tenant-metrics/tenant-metrics-exporter-5cf544fb97-cv5zn"
Oct 30 21:08:33.743614 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:08:33.743587    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="tests-monitoring-tenant-metrics/tenant-metrics-exporter-5cf544fb97-cv5zn"
Oct 30 21:08:33.951025 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:08:33.950996    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:08:33.951248 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:08:33.951201    4060 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-collector-0" podUID="2de60e47-4751-4e47-aad8-3d3fba742fb3" containerName="otc-container" containerID="cri-o://598b1d9e91ff30dbbb11eaa477755fb0cd19d8dd3a36442889a69702b75f06dd" gracePeriod=30
Oct 30 21:08:34.117265 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:08:34.117241    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["tests-monitoring-tenant-metrics/tenant-metrics-exporter-5cf544fb97-cv5zn"]
Oct 30 21:08:34.119685 ip-10-0-142-4 kubenswrapper[4060]: W1030 21:08:34.119652    4060 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod380e6dd1_060b_4ab8_b1f7_686d2273db0d.slice/crio-f9f6b59955524cd4a03141e21242b99b6ea40d77cd1fe7b5a296a99201efc745 WatchSource:0}: Error finding container f9f6b59955524cd4a03141e21242b99b6ea40d77cd1fe7b5a296a99201efc745: Status 404 returned error can't find the container with id f9f6b59955524cd4a03141e21242b99b6ea40d77cd1fe7b5a296a99201efc745
Oct 30 21:08:34.137566 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:08:34.137536    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="tests-monitoring-tenant-metrics/tenant-metrics-exporter-5cf544fb97-cv5zn" event={"ID":"380e6dd1-060b-4ab8-b1f7-686d2273db0d","Type":"ContainerStarted","Data":"f9f6b59955524cd4a03141e21242b99b6ea40d77cd1fe7b5a296a99201efc745"}
Oct 30 21:08:35.143734 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:08:35.143698    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="tests-monitoring-tenant-metrics/tenant-metrics-exporter-5cf544fb97-cv5zn" event={"ID":"380e6dd1-060b-4ab8-b1f7-686d2273db0d","Type":"ContainerStarted","Data":"5c99e0209bbdef365c7a2cf74a839e119c8e312e8eb91203496577d97eff11ee"}
Oct 30 21:08:35.260098 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:08:35.260037    4060 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="tests-monitoring-tenant-metrics/tenant-metrics-exporter-5cf544fb97-cv5zn" podStartSLOduration=2.260017323 podStartE2EDuration="2.260017323s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:08:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:08:35.258553084 +0000 UTC m=+1934.015551384" watchObservedRunningTime="2026-10-30 21:08:35.260017323 +0000 UTC m=+1934.017015622"
Oct 30 21:08:36.287933 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:08:36.287912    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:08:36.445334 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:08:36.445259    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/2de60e47-4751-4e47-aad8-3d3fba742fb3-otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/2de60e47-4751-4e47-aad8-3d3fba742fb3-otlp-tls-certs\") pod \"2de60e47-4751-4e47-aad8-3d3fba742fb3\" (UID: \"2de60e47-4751-4e47-aad8-3d3fba742fb3\") "
Oct 30 21:08:36.445334 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:08:36.445325    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/2de60e47-4751-4e47-aad8-3d3fba742fb3-monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/2de60e47-4751-4e47-aad8-3d3fba742fb3-monitoring-tls-certs\") pod \"2de60e47-4751-4e47-aad8-3d3fba742fb3\" (UID: \"2de60e47-4751-4e47-aad8-3d3fba742fb3\") "
Oct 30 21:08:36.445586 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:08:36.445348    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/2de60e47-4751-4e47-aad8-3d3fba742fb3-tls-certs\" (UniqueName: \"kubernetes.io/secret/2de60e47-4751-4e47-aad8-3d3fba742fb3-tls-certs\") pod \"2de60e47-4751-4e47-aad8-3d3fba742fb3\" (UID: \"2de60e47-4751-4e47-aad8-3d3fba742fb3\") "
Oct 30 21:08:36.445586 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:08:36.445455    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2de60e47-4751-4e47-aad8-3d3fba742fb3-otc-internal\" (UniqueName: \"kubernetes.io/configmap/2de60e47-4751-4e47-aad8-3d3fba742fb3-otc-internal\") pod \"2de60e47-4751-4e47-aad8-3d3fba742fb3\" (UID: \"2de60e47-4751-4e47-aad8-3d3fba742fb3\") "
Oct 30 21:08:36.445586 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:08:36.445535    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2de60e47-4751-4e47-aad8-3d3fba742fb3-kube-api-access-g7lwg\" (UniqueName: \"kubernetes.io/projected/2de60e47-4751-4e47-aad8-3d3fba742fb3-kube-api-access-g7lwg\") pod \"2de60e47-4751-4e47-aad8-3d3fba742fb3\" (UID: \"2de60e47-4751-4e47-aad8-3d3fba742fb3\") "
Oct 30 21:08:36.445586 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:08:36.445575    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/2de60e47-4751-4e47-aad8-3d3fba742fb3-data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/2de60e47-4751-4e47-aad8-3d3fba742fb3-data-science-collector-ta-client-cert\") pod \"2de60e47-4751-4e47-aad8-3d3fba742fb3\" (UID: \"2de60e47-4751-4e47-aad8-3d3fba742fb3\") "
Oct 30 21:08:36.445894 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:08:36.445851    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2de60e47-4751-4e47-aad8-3d3fba742fb3-otc-internal" pod "2de60e47-4751-4e47-aad8-3d3fba742fb3" (UID: "2de60e47-4751-4e47-aad8-3d3fba742fb3"). InnerVolumeSpecName "otc-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:08:36.447619 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:08:36.447534    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2de60e47-4751-4e47-aad8-3d3fba742fb3-monitoring-tls-certs" pod "2de60e47-4751-4e47-aad8-3d3fba742fb3" (UID: "2de60e47-4751-4e47-aad8-3d3fba742fb3"). InnerVolumeSpecName "monitoring-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:08:36.447619 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:08:36.447551    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2de60e47-4751-4e47-aad8-3d3fba742fb3-otlp-tls-certs" pod "2de60e47-4751-4e47-aad8-3d3fba742fb3" (UID: "2de60e47-4751-4e47-aad8-3d3fba742fb3"). InnerVolumeSpecName "otlp-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:08:36.447755 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:08:36.447688    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2de60e47-4751-4e47-aad8-3d3fba742fb3-data-science-collector-ta-client-cert" pod "2de60e47-4751-4e47-aad8-3d3fba742fb3" (UID: "2de60e47-4751-4e47-aad8-3d3fba742fb3"). InnerVolumeSpecName "data-science-collector-ta-client-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:08:36.447821 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:08:36.447806    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2de60e47-4751-4e47-aad8-3d3fba742fb3-tls-certs" pod "2de60e47-4751-4e47-aad8-3d3fba742fb3" (UID: "2de60e47-4751-4e47-aad8-3d3fba742fb3"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:08:36.447959 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:08:36.447942    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2de60e47-4751-4e47-aad8-3d3fba742fb3-kube-api-access-g7lwg" pod "2de60e47-4751-4e47-aad8-3d3fba742fb3" (UID: "2de60e47-4751-4e47-aad8-3d3fba742fb3"). InnerVolumeSpecName "kube-api-access-g7lwg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:08:36.546569 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:08:36.546537    4060 reconciler_common.go:299] "Volume detached for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/2de60e47-4751-4e47-aad8-3d3fba742fb3-otlp-tls-certs\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:08:36.546569 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:08:36.546562    4060 reconciler_common.go:299] "Volume detached for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/2de60e47-4751-4e47-aad8-3d3fba742fb3-monitoring-tls-certs\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:08:36.546569 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:08:36.546573    4060 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2de60e47-4751-4e47-aad8-3d3fba742fb3-tls-certs\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:08:36.546798 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:08:36.546582    4060 reconciler_common.go:299] "Volume detached for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/2de60e47-4751-4e47-aad8-3d3fba742fb3-otc-internal\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:08:36.546798 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:08:36.546592    4060 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g7lwg\" (UniqueName: \"kubernetes.io/projected/2de60e47-4751-4e47-aad8-3d3fba742fb3-kube-api-access-g7lwg\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:08:36.546798 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:08:36.546601    4060 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/2de60e47-4751-4e47-aad8-3d3fba742fb3-data-science-collector-ta-client-cert\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:08:37.154193 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:08:37.154154    4060 generic.go:356] "Generic (PLEG): container finished" podID="2de60e47-4751-4e47-aad8-3d3fba742fb3" containerID="598b1d9e91ff30dbbb11eaa477755fb0cd19d8dd3a36442889a69702b75f06dd" exitCode=0
Oct 30 21:08:37.154389 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:08:37.154232    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:08:37.154389 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:08:37.154240    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"2de60e47-4751-4e47-aad8-3d3fba742fb3","Type":"ContainerDied","Data":"598b1d9e91ff30dbbb11eaa477755fb0cd19d8dd3a36442889a69702b75f06dd"}
Oct 30 21:08:37.154389 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:08:37.154330    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"2de60e47-4751-4e47-aad8-3d3fba742fb3","Type":"ContainerDied","Data":"734e178d60ca74ae79ee029f2cd33edbdb0ccc17fb689b771901d2fdc5a245d0"}
Oct 30 21:08:37.154389 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:08:37.154364    4060 scope.go:122] "RemoveContainer" containerID="598b1d9e91ff30dbbb11eaa477755fb0cd19d8dd3a36442889a69702b75f06dd"
Oct 30 21:08:37.163184 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:08:37.163167    4060 scope.go:122] "RemoveContainer" containerID="598b1d9e91ff30dbbb11eaa477755fb0cd19d8dd3a36442889a69702b75f06dd"
Oct 30 21:08:37.163434 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:08:37.163416    4060 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"598b1d9e91ff30dbbb11eaa477755fb0cd19d8dd3a36442889a69702b75f06dd\": container with ID starting with 598b1d9e91ff30dbbb11eaa477755fb0cd19d8dd3a36442889a69702b75f06dd not found: ID does not exist" containerID="598b1d9e91ff30dbbb11eaa477755fb0cd19d8dd3a36442889a69702b75f06dd"
Oct 30 21:08:37.163479 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:08:37.163442    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"598b1d9e91ff30dbbb11eaa477755fb0cd19d8dd3a36442889a69702b75f06dd"} err="failed to get container status \"598b1d9e91ff30dbbb11eaa477755fb0cd19d8dd3a36442889a69702b75f06dd\": rpc error: code = NotFound desc = could not find container \"598b1d9e91ff30dbbb11eaa477755fb0cd19d8dd3a36442889a69702b75f06dd\": container with ID starting with 598b1d9e91ff30dbbb11eaa477755fb0cd19d8dd3a36442889a69702b75f06dd not found: ID does not exist"
Oct 30 21:08:37.320766 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:08:37.320730    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:08:37.370049 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:08:37.370020    4060 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:08:37.403475 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:08:37.403446    4060 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:08:37.403811 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:08:37.403799    4060 cpu_manager.go:414] "containerMap: removing container" podUID="2de60e47-4751-4e47-aad8-3d3fba742fb3" containerName="otc-container"
Oct 30 21:08:37.403853 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:08:37.403812    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2de60e47-4751-4e47-aad8-3d3fba742fb3" containerName="otc-container"
Oct 30 21:08:37.403888 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:08:37.403873    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="2de60e47-4751-4e47-aad8-3d3fba742fb3" containerName="otc-container"
Oct 30 21:08:37.409817 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:08:37.408405    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:08:37.426866 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:08:37.426842    4060 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2de60e47-4751-4e47-aad8-3d3fba742fb3" path="/var/lib/kubelet/pods/2de60e47-4751-4e47-aad8-3d3fba742fb3/volumes"
Oct 30 21:08:37.461359 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:08:37.461326    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-ta-client-cert\""
Oct 30 21:08:37.461359 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:08:37.461336    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-tls\""
Oct 30 21:08:37.461359 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:08:37.461358    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-monitoring-tls\""
Oct 30 21:08:37.461641 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:08:37.461479    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-headless-tls\""
Oct 30 21:08:37.461641 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:08:37.461561    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-a0f9182a\""
Oct 30 21:08:37.461719 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:08:37.461653    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-dockercfg-jqj7h\""
Oct 30 21:08:37.511962 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:08:37.511933    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:08:37.554413 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:08:37.554385    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2ed905d2-83c6-4671-99c8-9e83373a6c01-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"2ed905d2-83c6-4671-99c8-9e83373a6c01\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:08:37.554582 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:08:37.554420    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-grnlh\" (UniqueName: \"kubernetes.io/projected/2ed905d2-83c6-4671-99c8-9e83373a6c01-kube-api-access-grnlh\") pod \"data-science-collector-collector-0\" (UID: \"2ed905d2-83c6-4671-99c8-9e83373a6c01\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:08:37.554582 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:08:37.554521    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/2ed905d2-83c6-4671-99c8-9e83373a6c01-monitoring-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"2ed905d2-83c6-4671-99c8-9e83373a6c01\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:08:37.554582 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:08:37.554544    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/2ed905d2-83c6-4671-99c8-9e83373a6c01-otlp-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"2ed905d2-83c6-4671-99c8-9e83373a6c01\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:08:37.554689 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:08:37.554605    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/2ed905d2-83c6-4671-99c8-9e83373a6c01-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-0\" (UID: \"2ed905d2-83c6-4671-99c8-9e83373a6c01\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:08:37.554689 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:08:37.554626    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/2ed905d2-83c6-4671-99c8-9e83373a6c01-otc-internal\") pod \"data-science-collector-collector-0\" (UID: \"2ed905d2-83c6-4671-99c8-9e83373a6c01\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:08:37.655287 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:08:37.655249    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/2ed905d2-83c6-4671-99c8-9e83373a6c01-otc-internal\") pod \"data-science-collector-collector-0\" (UID: \"2ed905d2-83c6-4671-99c8-9e83373a6c01\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:08:37.655462 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:08:37.655314    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2ed905d2-83c6-4671-99c8-9e83373a6c01-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"2ed905d2-83c6-4671-99c8-9e83373a6c01\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:08:37.655462 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:08:37.655348    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-grnlh\" (UniqueName: \"kubernetes.io/projected/2ed905d2-83c6-4671-99c8-9e83373a6c01-kube-api-access-grnlh\") pod \"data-science-collector-collector-0\" (UID: \"2ed905d2-83c6-4671-99c8-9e83373a6c01\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:08:37.655462 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:08:37.655390    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/2ed905d2-83c6-4671-99c8-9e83373a6c01-monitoring-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"2ed905d2-83c6-4671-99c8-9e83373a6c01\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:08:37.655647 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:08:37.655560    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/2ed905d2-83c6-4671-99c8-9e83373a6c01-otlp-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"2ed905d2-83c6-4671-99c8-9e83373a6c01\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:08:37.655647 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:08:37.655634    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/2ed905d2-83c6-4671-99c8-9e83373a6c01-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-0\" (UID: \"2ed905d2-83c6-4671-99c8-9e83373a6c01\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:08:37.656151 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:08:37.656124    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/2ed905d2-83c6-4671-99c8-9e83373a6c01-otc-internal\") pod \"data-science-collector-collector-0\" (UID: \"2ed905d2-83c6-4671-99c8-9e83373a6c01\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:08:37.658042 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:08:37.658018    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2ed905d2-83c6-4671-99c8-9e83373a6c01-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"2ed905d2-83c6-4671-99c8-9e83373a6c01\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:08:37.658145 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:08:37.658019    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/2ed905d2-83c6-4671-99c8-9e83373a6c01-otlp-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"2ed905d2-83c6-4671-99c8-9e83373a6c01\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:08:37.658145 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:08:37.658073    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/2ed905d2-83c6-4671-99c8-9e83373a6c01-monitoring-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"2ed905d2-83c6-4671-99c8-9e83373a6c01\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:08:37.658145 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:08:37.658074    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/2ed905d2-83c6-4671-99c8-9e83373a6c01-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-0\" (UID: \"2ed905d2-83c6-4671-99c8-9e83373a6c01\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:08:37.716349 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:08:37.716328    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-grnlh\" (UniqueName: \"kubernetes.io/projected/2ed905d2-83c6-4671-99c8-9e83373a6c01-kube-api-access-grnlh\") pod \"data-science-collector-collector-0\" (UID: \"2ed905d2-83c6-4671-99c8-9e83373a6c01\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:08:37.724137 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:08:37.724107    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:08:38.102188 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:08:38.102158    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:08:38.103635 ip-10-0-142-4 kubenswrapper[4060]: W1030 21:08:38.103610    4060 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ed905d2_83c6_4671_99c8_9e83373a6c01.slice/crio-a4dde83089a9989bc77d3b5f7b9978d8edd13d87448d74cd7c27fa1576481de6 WatchSource:0}: Error finding container a4dde83089a9989bc77d3b5f7b9978d8edd13d87448d74cd7c27fa1576481de6: Status 404 returned error can't find the container with id a4dde83089a9989bc77d3b5f7b9978d8edd13d87448d74cd7c27fa1576481de6
Oct 30 21:08:38.105893 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:08:38.105860    4060 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 21:08:38.105966 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:08:38.105919    4060 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 21:08:38.160979 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:08:38.160951    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"2ed905d2-83c6-4671-99c8-9e83373a6c01","Type":"ContainerStarted","Data":"e97538d3a72874a90842b12627ce80aba7229b41ca023212911705e4bef8041f"}
Oct 30 21:08:38.161078 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:08:38.161006    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"2ed905d2-83c6-4671-99c8-9e83373a6c01","Type":"ContainerStarted","Data":"a4dde83089a9989bc77d3b5f7b9978d8edd13d87448d74cd7c27fa1576481de6"}
Oct 30 21:08:38.279925 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:08:38.279864    4060 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-collector-0" podStartSLOduration=1.279845289 podStartE2EDuration="1.279845289s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:08:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:08:38.278755889 +0000 UTC m=+1937.035754186" watchObservedRunningTime="2026-10-30 21:08:38.279845289 +0000 UTC m=+1937.036843588"
Oct 30 21:08:42.150138 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:08:42.150107    4060 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v2f4x" containerName="extractor"
Oct 30 21:09:12.151008 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:09:12.150972    4060 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v2f4x" containerName="extractor"
Oct 30 21:09:42.149366 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:09:42.149330    4060 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v2f4x" containerName="extractor"
Oct 30 21:10:12.150408 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:10:12.150325    4060 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v2f4x" containerName="extractor"
Oct 30 21:10:42.149615 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:10:42.149581    4060 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v2f4x" containerName="extractor"
Oct 30 21:11:12.151519 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:11:12.151467    4060 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v2f4x" containerName="extractor"
Oct 30 21:11:42.150094 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:11:42.150014    4060 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v2f4x" containerName="extractor"
Oct 30 21:12:12.150218 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:12:12.150184    4060 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v2f4x" containerName="extractor"
Oct 30 21:12:14.167932 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:12:14.167899    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["tests-monitoring-tenant-metrics/tenant-metrics-exporter-5cf544fb97-cv5zn"]
Oct 30 21:12:14.168354 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:12:14.168117    4060 kuberuntime_container.go:898] "Killing container with a grace period" pod="tests-monitoring-tenant-metrics/tenant-metrics-exporter-5cf544fb97-cv5zn" podUID="380e6dd1-060b-4ab8-b1f7-686d2273db0d" containerName="tenant-metrics-exporter" containerID="cri-o://5c99e0209bbdef365c7a2cf74a839e119c8e312e8eb91203496577d97eff11ee" gracePeriod=30
Oct 30 21:12:14.413299 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:12:14.413272    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="tests-monitoring-tenant-metrics/tenant-metrics-exporter-5cf544fb97-cv5zn"
Oct 30 21:12:14.518932 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:12:14.518899    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/380e6dd1-060b-4ab8-b1f7-686d2273db0d-kube-api-access-p5ljx\" (UniqueName: \"kubernetes.io/projected/380e6dd1-060b-4ab8-b1f7-686d2273db0d-kube-api-access-p5ljx\") pod \"380e6dd1-060b-4ab8-b1f7-686d2273db0d\" (UID: \"380e6dd1-060b-4ab8-b1f7-686d2273db0d\") "
Oct 30 21:12:14.519096 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:12:14.518943    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/380e6dd1-060b-4ab8-b1f7-686d2273db0d-data\" (UniqueName: \"kubernetes.io/empty-dir/380e6dd1-060b-4ab8-b1f7-686d2273db0d-data\") pod \"380e6dd1-060b-4ab8-b1f7-686d2273db0d\" (UID: \"380e6dd1-060b-4ab8-b1f7-686d2273db0d\") "
Oct 30 21:12:14.519423 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:12:14.519393    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/380e6dd1-060b-4ab8-b1f7-686d2273db0d-data" pod "380e6dd1-060b-4ab8-b1f7-686d2273db0d" (UID: "380e6dd1-060b-4ab8-b1f7-686d2273db0d"). InnerVolumeSpecName "data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:12:14.519614 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:12:14.519593    4060 reconciler_common.go:299] "Volume detached for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/380e6dd1-060b-4ab8-b1f7-686d2273db0d-data\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:12:14.521155 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:12:14.521132    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/380e6dd1-060b-4ab8-b1f7-686d2273db0d-kube-api-access-p5ljx" pod "380e6dd1-060b-4ab8-b1f7-686d2273db0d" (UID: "380e6dd1-060b-4ab8-b1f7-686d2273db0d"). InnerVolumeSpecName "kube-api-access-p5ljx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:12:14.620162 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:12:14.620132    4060 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p5ljx\" (UniqueName: \"kubernetes.io/projected/380e6dd1-060b-4ab8-b1f7-686d2273db0d-kube-api-access-p5ljx\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:12:15.176289 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:12:15.176258    4060 generic.go:356] "Generic (PLEG): container finished" podID="380e6dd1-060b-4ab8-b1f7-686d2273db0d" containerID="5c99e0209bbdef365c7a2cf74a839e119c8e312e8eb91203496577d97eff11ee" exitCode=0
Oct 30 21:12:15.176831 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:12:15.176306    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="tests-monitoring-tenant-metrics/tenant-metrics-exporter-5cf544fb97-cv5zn"
Oct 30 21:12:15.176831 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:12:15.176353    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="tests-monitoring-tenant-metrics/tenant-metrics-exporter-5cf544fb97-cv5zn" event={"ID":"380e6dd1-060b-4ab8-b1f7-686d2273db0d","Type":"ContainerDied","Data":"5c99e0209bbdef365c7a2cf74a839e119c8e312e8eb91203496577d97eff11ee"}
Oct 30 21:12:15.176831 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:12:15.176405    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="tests-monitoring-tenant-metrics/tenant-metrics-exporter-5cf544fb97-cv5zn" event={"ID":"380e6dd1-060b-4ab8-b1f7-686d2273db0d","Type":"ContainerDied","Data":"f9f6b59955524cd4a03141e21242b99b6ea40d77cd1fe7b5a296a99201efc745"}
Oct 30 21:12:15.176831 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:12:15.176426    4060 scope.go:122] "RemoveContainer" containerID="5c99e0209bbdef365c7a2cf74a839e119c8e312e8eb91203496577d97eff11ee"
Oct 30 21:12:15.184905 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:12:15.184888    4060 scope.go:122] "RemoveContainer" containerID="5c99e0209bbdef365c7a2cf74a839e119c8e312e8eb91203496577d97eff11ee"
Oct 30 21:12:15.185167 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:12:15.185151    4060 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5c99e0209bbdef365c7a2cf74a839e119c8e312e8eb91203496577d97eff11ee\": container with ID starting with 5c99e0209bbdef365c7a2cf74a839e119c8e312e8eb91203496577d97eff11ee not found: ID does not exist" containerID="5c99e0209bbdef365c7a2cf74a839e119c8e312e8eb91203496577d97eff11ee"
Oct 30 21:12:15.185210 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:12:15.185176    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c99e0209bbdef365c7a2cf74a839e119c8e312e8eb91203496577d97eff11ee"} err="failed to get container status \"5c99e0209bbdef365c7a2cf74a839e119c8e312e8eb91203496577d97eff11ee\": rpc error: code = NotFound desc = could not find container \"5c99e0209bbdef365c7a2cf74a839e119c8e312e8eb91203496577d97eff11ee\": container with ID starting with 5c99e0209bbdef365c7a2cf74a839e119c8e312e8eb91203496577d97eff11ee not found: ID does not exist"
Oct 30 21:12:15.338769 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:12:15.338739    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["tests-monitoring-tenant-metrics/tenant-metrics-exporter-5cf544fb97-cv5zn"]
Oct 30 21:12:15.343056 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:12:15.343032    4060 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["tests-monitoring-tenant-metrics/tenant-metrics-exporter-5cf544fb97-cv5zn"]
Oct 30 21:12:15.426425 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:12:15.426358    4060 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="380e6dd1-060b-4ab8-b1f7-686d2273db0d" path="/var/lib/kubelet/pods/380e6dd1-060b-4ab8-b1f7-686d2273db0d/volumes"
Oct 30 21:12:33.498102 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:12:33.498064    4060 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-6c6c7b9779-gm485"]
Oct 30 21:12:33.498594 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:12:33.498430    4060 cpu_manager.go:414] "containerMap: removing container" podUID="380e6dd1-060b-4ab8-b1f7-686d2273db0d" containerName="tenant-metrics-exporter"
Oct 30 21:12:33.498594 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:12:33.498448    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="380e6dd1-060b-4ab8-b1f7-686d2273db0d" containerName="tenant-metrics-exporter"
Oct 30 21:12:33.498594 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:12:33.498548    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="380e6dd1-060b-4ab8-b1f7-686d2273db0d" containerName="tenant-metrics-exporter"
Oct 30 21:12:33.502647 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:12:33.502631    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6c6c7b9779-gm485"
Oct 30 21:12:33.582022 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:12:33.581989    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/0b93950d-3376-4005-8439-7133aa732906-ta-internal\") pod \"data-science-collector-targetallocator-6c6c7b9779-gm485\" (UID: \"0b93950d-3376-4005-8439-7133aa732906\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6c6c7b9779-gm485"
Oct 30 21:12:33.582176 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:12:33.582035    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/0b93950d-3376-4005-8439-7133aa732906-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-6c6c7b9779-gm485\" (UID: \"0b93950d-3376-4005-8439-7133aa732906\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6c6c7b9779-gm485"
Oct 30 21:12:33.582176 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:12:33.582152    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hgszd\" (UniqueName: \"kubernetes.io/projected/0b93950d-3376-4005-8439-7133aa732906-kube-api-access-hgszd\") pod \"data-science-collector-targetallocator-6c6c7b9779-gm485\" (UID: \"0b93950d-3376-4005-8439-7133aa732906\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6c6c7b9779-gm485"
Oct 30 21:12:33.604354 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:12:33.604326    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-targetallocator-dockercfg-ltdzb\""
Oct 30 21:12:33.604354 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:12:33.604326    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-ta-server-cert\""
Oct 30 21:12:33.606166 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:12:33.606148    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-6c6c7b9779-gm485"]
Oct 30 21:12:33.611395 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:12:33.611379    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-targetallocator\""
Oct 30 21:12:33.682809 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:12:33.682777    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hgszd\" (UniqueName: \"kubernetes.io/projected/0b93950d-3376-4005-8439-7133aa732906-kube-api-access-hgszd\") pod \"data-science-collector-targetallocator-6c6c7b9779-gm485\" (UID: \"0b93950d-3376-4005-8439-7133aa732906\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6c6c7b9779-gm485"
Oct 30 21:12:33.682941 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:12:33.682818    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/0b93950d-3376-4005-8439-7133aa732906-ta-internal\") pod \"data-science-collector-targetallocator-6c6c7b9779-gm485\" (UID: \"0b93950d-3376-4005-8439-7133aa732906\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6c6c7b9779-gm485"
Oct 30 21:12:33.682941 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:12:33.682849    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/0b93950d-3376-4005-8439-7133aa732906-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-6c6c7b9779-gm485\" (UID: \"0b93950d-3376-4005-8439-7133aa732906\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6c6c7b9779-gm485"
Oct 30 21:12:33.683470 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:12:33.683452    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/0b93950d-3376-4005-8439-7133aa732906-ta-internal\") pod \"data-science-collector-targetallocator-6c6c7b9779-gm485\" (UID: \"0b93950d-3376-4005-8439-7133aa732906\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6c6c7b9779-gm485"
Oct 30 21:12:33.685276 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:12:33.685248    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/0b93950d-3376-4005-8439-7133aa732906-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-6c6c7b9779-gm485\" (UID: \"0b93950d-3376-4005-8439-7133aa732906\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6c6c7b9779-gm485"
Oct 30 21:12:33.743564 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:12:33.743532    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hgszd\" (UniqueName: \"kubernetes.io/projected/0b93950d-3376-4005-8439-7133aa732906-kube-api-access-hgszd\") pod \"data-science-collector-targetallocator-6c6c7b9779-gm485\" (UID: \"0b93950d-3376-4005-8439-7133aa732906\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6c6c7b9779-gm485"
Oct 30 21:12:33.813688 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:12:33.813614    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6c6c7b9779-gm485"
Oct 30 21:12:34.186303 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:12:34.186273    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-6c6c7b9779-gm485"]
Oct 30 21:12:34.188443 ip-10-0-142-4 kubenswrapper[4060]: W1030 21:12:34.188415    4060 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0b93950d_3376_4005_8439_7133aa732906.slice/crio-2ae7cd25a4a6c6ce79ebded418239462aed7b5b082f7cf82e363638e44b7ed87 WatchSource:0}: Error finding container 2ae7cd25a4a6c6ce79ebded418239462aed7b5b082f7cf82e363638e44b7ed87: Status 404 returned error can't find the container with id 2ae7cd25a4a6c6ce79ebded418239462aed7b5b082f7cf82e363638e44b7ed87
Oct 30 21:12:34.191124 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:12:34.191090    4060 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 21:12:34.191223 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:12:34.191159    4060 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 21:12:34.268752 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:12:34.268718    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6c6c7b9779-gm485" event={"ID":"0b93950d-3376-4005-8439-7133aa732906","Type":"ContainerStarted","Data":"f11f3ee3e5f642bac9ca73141ca223538d4a64aa2c0db61bdc6d40a4ffef4b75"}
Oct 30 21:12:34.268909 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:12:34.268763    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6c6c7b9779-gm485" event={"ID":"0b93950d-3376-4005-8439-7133aa732906","Type":"ContainerStarted","Data":"2ae7cd25a4a6c6ce79ebded418239462aed7b5b082f7cf82e363638e44b7ed87"}
Oct 30 21:12:34.268909 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:12:34.268883    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6c6c7b9779-gm485"
Oct 30 21:12:34.270733 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:12:34.270701    4060 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6c6c7b9779-gm485" podUID="0b93950d-3376-4005-8439-7133aa732906" containerName="ta-container" probeResult="failure" output="Get \"http://10.133.0.83:8080/readyz\": dial tcp 10.133.0.83:8080: connect: connection refused"
Oct 30 21:12:34.385691 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:12:34.385638    4060 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6c6c7b9779-gm485" podStartSLOduration=1.385623902 podStartE2EDuration="1.385623902s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:12:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:12:34.384353881 +0000 UTC m=+2173.141352205" watchObservedRunningTime="2026-10-30 21:12:34.385623902 +0000 UTC m=+2173.142622200"
Oct 30 21:12:35.273467 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:12:35.273425    4060 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6c6c7b9779-gm485" podUID="0b93950d-3376-4005-8439-7133aa732906" containerName="ta-container" probeResult="failure" output="Get \"http://10.133.0.83:8080/readyz\": dial tcp 10.133.0.83:8080: connect: connection refused"
Oct 30 21:12:42.151170 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:12:42.151135    4060 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v2f4x" containerName="extractor"
Oct 30 21:12:45.274275 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:12:45.274245    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6c6c7b9779-gm485"
Oct 30 21:12:53.678964 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:12:53.678922    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-6c6c7b9779-gm485"]
Oct 30 21:12:53.679727 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:12:53.679112    4060 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6c6c7b9779-gm485" podUID="0b93950d-3376-4005-8439-7133aa732906" containerName="ta-container" containerID="cri-o://f11f3ee3e5f642bac9ca73141ca223538d4a64aa2c0db61bdc6d40a4ffef4b75" gracePeriod=30
Oct 30 21:12:53.928550 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:12:53.928524    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6c6c7b9779-gm485"
Oct 30 21:12:54.043010 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:12:54.042978    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/0b93950d-3376-4005-8439-7133aa732906-ta-internal\" (UniqueName: \"kubernetes.io/configmap/0b93950d-3376-4005-8439-7133aa732906-ta-internal\") pod \"0b93950d-3376-4005-8439-7133aa732906\" (UID: \"0b93950d-3376-4005-8439-7133aa732906\") "
Oct 30 21:12:54.043217 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:12:54.043038    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/0b93950d-3376-4005-8439-7133aa732906-data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/0b93950d-3376-4005-8439-7133aa732906-data-science-collector-ta-server-cert\") pod \"0b93950d-3376-4005-8439-7133aa732906\" (UID: \"0b93950d-3376-4005-8439-7133aa732906\") "
Oct 30 21:12:54.043217 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:12:54.043117    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0b93950d-3376-4005-8439-7133aa732906-kube-api-access-hgszd\" (UniqueName: \"kubernetes.io/projected/0b93950d-3376-4005-8439-7133aa732906-kube-api-access-hgszd\") pod \"0b93950d-3376-4005-8439-7133aa732906\" (UID: \"0b93950d-3376-4005-8439-7133aa732906\") "
Oct 30 21:12:54.043843 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:12:54.043807    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0b93950d-3376-4005-8439-7133aa732906-ta-internal" pod "0b93950d-3376-4005-8439-7133aa732906" (UID: "0b93950d-3376-4005-8439-7133aa732906"). InnerVolumeSpecName "ta-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:12:54.046486 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:12:54.046455    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0b93950d-3376-4005-8439-7133aa732906-kube-api-access-hgszd" pod "0b93950d-3376-4005-8439-7133aa732906" (UID: "0b93950d-3376-4005-8439-7133aa732906"). InnerVolumeSpecName "kube-api-access-hgszd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:12:54.046753 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:12:54.046519    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0b93950d-3376-4005-8439-7133aa732906-data-science-collector-ta-server-cert" pod "0b93950d-3376-4005-8439-7133aa732906" (UID: "0b93950d-3376-4005-8439-7133aa732906"). InnerVolumeSpecName "data-science-collector-ta-server-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:12:54.054784 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:12:54.054742    4060 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hgszd\" (UniqueName: \"kubernetes.io/projected/0b93950d-3376-4005-8439-7133aa732906-kube-api-access-hgszd\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:12:54.054784 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:12:54.054770    4060 reconciler_common.go:299] "Volume detached for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/0b93950d-3376-4005-8439-7133aa732906-ta-internal\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:12:54.055065 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:12:54.054788    4060 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/0b93950d-3376-4005-8439-7133aa732906-data-science-collector-ta-server-cert\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:12:54.363102 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:12:54.363011    4060 generic.go:356] "Generic (PLEG): container finished" podID="0b93950d-3376-4005-8439-7133aa732906" containerID="f11f3ee3e5f642bac9ca73141ca223538d4a64aa2c0db61bdc6d40a4ffef4b75" exitCode=0
Oct 30 21:12:54.363102 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:12:54.363059    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6c6c7b9779-gm485"
Oct 30 21:12:54.363102 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:12:54.363086    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6c6c7b9779-gm485" event={"ID":"0b93950d-3376-4005-8439-7133aa732906","Type":"ContainerDied","Data":"f11f3ee3e5f642bac9ca73141ca223538d4a64aa2c0db61bdc6d40a4ffef4b75"}
Oct 30 21:12:54.363327 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:12:54.363131    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6c6c7b9779-gm485" event={"ID":"0b93950d-3376-4005-8439-7133aa732906","Type":"ContainerDied","Data":"2ae7cd25a4a6c6ce79ebded418239462aed7b5b082f7cf82e363638e44b7ed87"}
Oct 30 21:12:54.363327 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:12:54.363153    4060 scope.go:122] "RemoveContainer" containerID="f11f3ee3e5f642bac9ca73141ca223538d4a64aa2c0db61bdc6d40a4ffef4b75"
Oct 30 21:12:54.372479 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:12:54.372461    4060 scope.go:122] "RemoveContainer" containerID="f11f3ee3e5f642bac9ca73141ca223538d4a64aa2c0db61bdc6d40a4ffef4b75"
Oct 30 21:12:54.372773 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:12:54.372750    4060 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f11f3ee3e5f642bac9ca73141ca223538d4a64aa2c0db61bdc6d40a4ffef4b75\": container with ID starting with f11f3ee3e5f642bac9ca73141ca223538d4a64aa2c0db61bdc6d40a4ffef4b75 not found: ID does not exist" containerID="f11f3ee3e5f642bac9ca73141ca223538d4a64aa2c0db61bdc6d40a4ffef4b75"
Oct 30 21:12:54.372899 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:12:54.372784    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f11f3ee3e5f642bac9ca73141ca223538d4a64aa2c0db61bdc6d40a4ffef4b75"} err="failed to get container status \"f11f3ee3e5f642bac9ca73141ca223538d4a64aa2c0db61bdc6d40a4ffef4b75\": rpc error: code = NotFound desc = could not find container \"f11f3ee3e5f642bac9ca73141ca223538d4a64aa2c0db61bdc6d40a4ffef4b75\": container with ID starting with f11f3ee3e5f642bac9ca73141ca223538d4a64aa2c0db61bdc6d40a4ffef4b75 not found: ID does not exist"
Oct 30 21:12:54.527769 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:12:54.527732    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-6c6c7b9779-gm485"]
Oct 30 21:12:54.531876 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:12:54.531854    4060 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-6c6c7b9779-gm485"]
Oct 30 21:12:55.230184 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:12:55.230149    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:12:55.230651 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:12:55.230375    4060 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-collector-0" podUID="2ed905d2-83c6-4671-99c8-9e83373a6c01" containerName="otc-container" containerID="cri-o://e97538d3a72874a90842b12627ce80aba7229b41ca023212911705e4bef8041f" gracePeriod=30
Oct 30 21:12:55.426848 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:12:55.426818    4060 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="0b93950d-3376-4005-8439-7133aa732906" path="/var/lib/kubelet/pods/0b93950d-3376-4005-8439-7133aa732906/volumes"
Oct 30 21:12:56.341889 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:12:56.341857    4060 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/operator-metrics-auth-probe"]
Oct 30 21:12:56.342294 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:12:56.342187    4060 cpu_manager.go:414] "containerMap: removing container" podUID="0b93950d-3376-4005-8439-7133aa732906" containerName="ta-container"
Oct 30 21:12:56.342294 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:12:56.342198    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0b93950d-3376-4005-8439-7133aa732906" containerName="ta-container"
Oct 30 21:12:56.342294 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:12:56.342256    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="0b93950d-3376-4005-8439-7133aa732906" containerName="ta-container"
Oct 30 21:12:56.346560 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:12:56.346543    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/operator-metrics-auth-probe"
Oct 30 21:12:56.401554 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:12:56.401515    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"odh-observability-metrics-ca\""
Oct 30 21:12:56.401729 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:12:56.401683    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"default-dockercfg-48j4p\""
Oct 30 21:12:56.452772 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:12:56.452744    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/operator-metrics-auth-probe"]
Oct 30 21:12:56.478098 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:12:56.478067    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-ca\" (UniqueName: \"kubernetes.io/configmap/9b805f40-7999-4636-8d9d-79897d349df2-metrics-ca\") pod \"operator-metrics-auth-probe\" (UID: \"9b805f40-7999-4636-8d9d-79897d349df2\") " pod="redhat-ods-monitoring/operator-metrics-auth-probe"
Oct 30 21:12:56.478269 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:12:56.478225    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4pj2n\" (UniqueName: \"kubernetes.io/projected/9b805f40-7999-4636-8d9d-79897d349df2-kube-api-access-4pj2n\") pod \"operator-metrics-auth-probe\" (UID: \"9b805f40-7999-4636-8d9d-79897d349df2\") " pod="redhat-ods-monitoring/operator-metrics-auth-probe"
Oct 30 21:12:56.579207 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:12:56.579166    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4pj2n\" (UniqueName: \"kubernetes.io/projected/9b805f40-7999-4636-8d9d-79897d349df2-kube-api-access-4pj2n\") pod \"operator-metrics-auth-probe\" (UID: \"9b805f40-7999-4636-8d9d-79897d349df2\") " pod="redhat-ods-monitoring/operator-metrics-auth-probe"
Oct 30 21:12:56.579405 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:12:56.579229    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-ca\" (UniqueName: \"kubernetes.io/configmap/9b805f40-7999-4636-8d9d-79897d349df2-metrics-ca\") pod \"operator-metrics-auth-probe\" (UID: \"9b805f40-7999-4636-8d9d-79897d349df2\") " pod="redhat-ods-monitoring/operator-metrics-auth-probe"
Oct 30 21:12:56.579935 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:12:56.579909    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-ca\" (UniqueName: \"kubernetes.io/configmap/9b805f40-7999-4636-8d9d-79897d349df2-metrics-ca\") pod \"operator-metrics-auth-probe\" (UID: \"9b805f40-7999-4636-8d9d-79897d349df2\") " pod="redhat-ods-monitoring/operator-metrics-auth-probe"
Oct 30 21:12:56.640786 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:12:56.640711    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4pj2n\" (UniqueName: \"kubernetes.io/projected/9b805f40-7999-4636-8d9d-79897d349df2-kube-api-access-4pj2n\") pod \"operator-metrics-auth-probe\" (UID: \"9b805f40-7999-4636-8d9d-79897d349df2\") " pod="redhat-ods-monitoring/operator-metrics-auth-probe"
Oct 30 21:12:56.658164 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:12:56.658133    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/operator-metrics-auth-probe"
Oct 30 21:12:57.027634 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:12:57.027608    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/operator-metrics-auth-probe"]
Oct 30 21:12:57.029308 ip-10-0-142-4 kubenswrapper[4060]: W1030 21:12:57.029280    4060 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9b805f40_7999_4636_8d9d_79897d349df2.slice/crio-cbcf88a75557f3ddf8c77340d47a1ae7f47099e832fcae197058cc1a0006a154 WatchSource:0}: Error finding container cbcf88a75557f3ddf8c77340d47a1ae7f47099e832fcae197058cc1a0006a154: Status 404 returned error can't find the container with id cbcf88a75557f3ddf8c77340d47a1ae7f47099e832fcae197058cc1a0006a154
Oct 30 21:12:57.031396 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:12:57.031380    4060 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 21:12:57.381259 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:12:57.381178    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/operator-metrics-auth-probe" event={"ID":"9b805f40-7999-4636-8d9d-79897d349df2","Type":"ContainerStarted","Data":"cbcf88a75557f3ddf8c77340d47a1ae7f47099e832fcae197058cc1a0006a154"}
Oct 30 21:12:57.560402 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:12:57.560379    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:12:57.688556 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:12:57.688521    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2ed905d2-83c6-4671-99c8-9e83373a6c01-kube-api-access-grnlh\" (UniqueName: \"kubernetes.io/projected/2ed905d2-83c6-4671-99c8-9e83373a6c01-kube-api-access-grnlh\") pod \"2ed905d2-83c6-4671-99c8-9e83373a6c01\" (UID: \"2ed905d2-83c6-4671-99c8-9e83373a6c01\") "
Oct 30 21:12:57.688754 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:12:57.688577    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/2ed905d2-83c6-4671-99c8-9e83373a6c01-otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/2ed905d2-83c6-4671-99c8-9e83373a6c01-otlp-tls-certs\") pod \"2ed905d2-83c6-4671-99c8-9e83373a6c01\" (UID: \"2ed905d2-83c6-4671-99c8-9e83373a6c01\") "
Oct 30 21:12:57.688754 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:12:57.688624    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/2ed905d2-83c6-4671-99c8-9e83373a6c01-tls-certs\" (UniqueName: \"kubernetes.io/secret/2ed905d2-83c6-4671-99c8-9e83373a6c01-tls-certs\") pod \"2ed905d2-83c6-4671-99c8-9e83373a6c01\" (UID: \"2ed905d2-83c6-4671-99c8-9e83373a6c01\") "
Oct 30 21:12:57.688754 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:12:57.688704    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/2ed905d2-83c6-4671-99c8-9e83373a6c01-data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/2ed905d2-83c6-4671-99c8-9e83373a6c01-data-science-collector-ta-client-cert\") pod \"2ed905d2-83c6-4671-99c8-9e83373a6c01\" (UID: \"2ed905d2-83c6-4671-99c8-9e83373a6c01\") "
Oct 30 21:12:57.688754 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:12:57.688726    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2ed905d2-83c6-4671-99c8-9e83373a6c01-otc-internal\" (UniqueName: \"kubernetes.io/configmap/2ed905d2-83c6-4671-99c8-9e83373a6c01-otc-internal\") pod \"2ed905d2-83c6-4671-99c8-9e83373a6c01\" (UID: \"2ed905d2-83c6-4671-99c8-9e83373a6c01\") "
Oct 30 21:12:57.688754 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:12:57.688754    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/2ed905d2-83c6-4671-99c8-9e83373a6c01-monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/2ed905d2-83c6-4671-99c8-9e83373a6c01-monitoring-tls-certs\") pod \"2ed905d2-83c6-4671-99c8-9e83373a6c01\" (UID: \"2ed905d2-83c6-4671-99c8-9e83373a6c01\") "
Oct 30 21:12:57.689696 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:12:57.689647    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2ed905d2-83c6-4671-99c8-9e83373a6c01-otc-internal" pod "2ed905d2-83c6-4671-99c8-9e83373a6c01" (UID: "2ed905d2-83c6-4671-99c8-9e83373a6c01"). InnerVolumeSpecName "otc-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:12:57.691571 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:12:57.691476    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2ed905d2-83c6-4671-99c8-9e83373a6c01-monitoring-tls-certs" pod "2ed905d2-83c6-4671-99c8-9e83373a6c01" (UID: "2ed905d2-83c6-4671-99c8-9e83373a6c01"). InnerVolumeSpecName "monitoring-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:12:57.691897 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:12:57.691866    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2ed905d2-83c6-4671-99c8-9e83373a6c01-otlp-tls-certs" pod "2ed905d2-83c6-4671-99c8-9e83373a6c01" (UID: "2ed905d2-83c6-4671-99c8-9e83373a6c01"). InnerVolumeSpecName "otlp-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:12:57.692061 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:12:57.692039    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2ed905d2-83c6-4671-99c8-9e83373a6c01-data-science-collector-ta-client-cert" pod "2ed905d2-83c6-4671-99c8-9e83373a6c01" (UID: "2ed905d2-83c6-4671-99c8-9e83373a6c01"). InnerVolumeSpecName "data-science-collector-ta-client-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:12:57.692061 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:12:57.692047    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2ed905d2-83c6-4671-99c8-9e83373a6c01-kube-api-access-grnlh" pod "2ed905d2-83c6-4671-99c8-9e83373a6c01" (UID: "2ed905d2-83c6-4671-99c8-9e83373a6c01"). InnerVolumeSpecName "kube-api-access-grnlh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:12:57.692842 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:12:57.692825    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2ed905d2-83c6-4671-99c8-9e83373a6c01-tls-certs" pod "2ed905d2-83c6-4671-99c8-9e83373a6c01" (UID: "2ed905d2-83c6-4671-99c8-9e83373a6c01"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:12:57.790388 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:12:57.790351    4060 reconciler_common.go:299] "Volume detached for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/2ed905d2-83c6-4671-99c8-9e83373a6c01-monitoring-tls-certs\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:12:57.790388 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:12:57.790390    4060 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-grnlh\" (UniqueName: \"kubernetes.io/projected/2ed905d2-83c6-4671-99c8-9e83373a6c01-kube-api-access-grnlh\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:12:57.790623 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:12:57.790407    4060 reconciler_common.go:299] "Volume detached for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/2ed905d2-83c6-4671-99c8-9e83373a6c01-otlp-tls-certs\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:12:57.790623 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:12:57.790422    4060 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2ed905d2-83c6-4671-99c8-9e83373a6c01-tls-certs\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:12:57.790623 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:12:57.790438    4060 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/2ed905d2-83c6-4671-99c8-9e83373a6c01-data-science-collector-ta-client-cert\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:12:57.790623 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:12:57.790453    4060 reconciler_common.go:299] "Volume detached for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/2ed905d2-83c6-4671-99c8-9e83373a6c01-otc-internal\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:12:58.387487 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:12:58.387452    4060 generic.go:356] "Generic (PLEG): container finished" podID="2ed905d2-83c6-4671-99c8-9e83373a6c01" containerID="e97538d3a72874a90842b12627ce80aba7229b41ca023212911705e4bef8041f" exitCode=0
Oct 30 21:12:58.387922 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:12:58.387512    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:12:58.387922 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:12:58.387533    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"2ed905d2-83c6-4671-99c8-9e83373a6c01","Type":"ContainerDied","Data":"e97538d3a72874a90842b12627ce80aba7229b41ca023212911705e4bef8041f"}
Oct 30 21:12:58.387922 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:12:58.387585    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"2ed905d2-83c6-4671-99c8-9e83373a6c01","Type":"ContainerDied","Data":"a4dde83089a9989bc77d3b5f7b9978d8edd13d87448d74cd7c27fa1576481de6"}
Oct 30 21:12:58.387922 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:12:58.387607    4060 scope.go:122] "RemoveContainer" containerID="e97538d3a72874a90842b12627ce80aba7229b41ca023212911705e4bef8041f"
Oct 30 21:12:58.396713 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:12:58.396691    4060 scope.go:122] "RemoveContainer" containerID="e97538d3a72874a90842b12627ce80aba7229b41ca023212911705e4bef8041f"
Oct 30 21:12:58.396995 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:12:58.396977    4060 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e97538d3a72874a90842b12627ce80aba7229b41ca023212911705e4bef8041f\": container with ID starting with e97538d3a72874a90842b12627ce80aba7229b41ca023212911705e4bef8041f not found: ID does not exist" containerID="e97538d3a72874a90842b12627ce80aba7229b41ca023212911705e4bef8041f"
Oct 30 21:12:58.397068 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:12:58.397007    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e97538d3a72874a90842b12627ce80aba7229b41ca023212911705e4bef8041f"} err="failed to get container status \"e97538d3a72874a90842b12627ce80aba7229b41ca023212911705e4bef8041f\": rpc error: code = NotFound desc = could not find container \"e97538d3a72874a90842b12627ce80aba7229b41ca023212911705e4bef8041f\": container with ID starting with e97538d3a72874a90842b12627ce80aba7229b41ca023212911705e4bef8041f not found: ID does not exist"
Oct 30 21:12:58.579252 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:12:58.579216    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:12:58.632906 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:12:58.632866    4060 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:12:58.667883 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:12:58.667803    4060 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:12:58.668268 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:12:58.668252    4060 cpu_manager.go:414] "containerMap: removing container" podUID="2ed905d2-83c6-4671-99c8-9e83373a6c01" containerName="otc-container"
Oct 30 21:12:58.668319 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:12:58.668271    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2ed905d2-83c6-4671-99c8-9e83373a6c01" containerName="otc-container"
Oct 30 21:12:58.668377 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:12:58.668367    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="2ed905d2-83c6-4671-99c8-9e83373a6c01" containerName="otc-container"
Oct 30 21:12:58.671524 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:12:58.671481    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:12:58.698616 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:12:58.698583    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/9c1866ce-acd4-4c40-aa47-4ec96b029d07-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-0\" (UID: \"9c1866ce-acd4-4c40-aa47-4ec96b029d07\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:12:58.698769 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:12:58.698627    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/9c1866ce-acd4-4c40-aa47-4ec96b029d07-monitoring-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"9c1866ce-acd4-4c40-aa47-4ec96b029d07\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:12:58.698769 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:12:58.698697    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/9c1866ce-acd4-4c40-aa47-4ec96b029d07-otc-internal\") pod \"data-science-collector-collector-0\" (UID: \"9c1866ce-acd4-4c40-aa47-4ec96b029d07\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:12:58.698769 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:12:58.698725    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9c1866ce-acd4-4c40-aa47-4ec96b029d07-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"9c1866ce-acd4-4c40-aa47-4ec96b029d07\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:12:58.698886 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:12:58.698774    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/9c1866ce-acd4-4c40-aa47-4ec96b029d07-otlp-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"9c1866ce-acd4-4c40-aa47-4ec96b029d07\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:12:58.698886 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:12:58.698802    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lhn4d\" (UniqueName: \"kubernetes.io/projected/9c1866ce-acd4-4c40-aa47-4ec96b029d07-kube-api-access-lhn4d\") pod \"data-science-collector-collector-0\" (UID: \"9c1866ce-acd4-4c40-aa47-4ec96b029d07\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:12:58.724416 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:12:58.724387    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-monitoring-tls\""
Oct 30 21:12:58.724587 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:12:58.724427    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-tls\""
Oct 30 21:12:58.724587 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:12:58.724459    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-headless-tls\""
Oct 30 21:12:58.724587 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:12:58.724471    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-dockercfg-jqj7h\""
Oct 30 21:12:58.724587 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:12:58.724430    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-a0f9182a\""
Oct 30 21:12:58.724587 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:12:58.724562    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-ta-client-cert\""
Oct 30 21:12:58.732249 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:12:58.732224    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:12:58.799307 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:12:58.799273    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/9c1866ce-acd4-4c40-aa47-4ec96b029d07-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-0\" (UID: \"9c1866ce-acd4-4c40-aa47-4ec96b029d07\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:12:58.799482 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:12:58.799327    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/9c1866ce-acd4-4c40-aa47-4ec96b029d07-monitoring-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"9c1866ce-acd4-4c40-aa47-4ec96b029d07\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:12:58.799482 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:12:58.799394    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/9c1866ce-acd4-4c40-aa47-4ec96b029d07-otc-internal\") pod \"data-science-collector-collector-0\" (UID: \"9c1866ce-acd4-4c40-aa47-4ec96b029d07\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:12:58.799482 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:12:58.799425    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9c1866ce-acd4-4c40-aa47-4ec96b029d07-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"9c1866ce-acd4-4c40-aa47-4ec96b029d07\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:12:58.799482 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:12:58.799475    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/9c1866ce-acd4-4c40-aa47-4ec96b029d07-otlp-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"9c1866ce-acd4-4c40-aa47-4ec96b029d07\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:12:58.799737 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:12:58.799517    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lhn4d\" (UniqueName: \"kubernetes.io/projected/9c1866ce-acd4-4c40-aa47-4ec96b029d07-kube-api-access-lhn4d\") pod \"data-science-collector-collector-0\" (UID: \"9c1866ce-acd4-4c40-aa47-4ec96b029d07\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:12:58.800174 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:12:58.800147    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/9c1866ce-acd4-4c40-aa47-4ec96b029d07-otc-internal\") pod \"data-science-collector-collector-0\" (UID: \"9c1866ce-acd4-4c40-aa47-4ec96b029d07\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:12:58.802392 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:12:58.802368    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9c1866ce-acd4-4c40-aa47-4ec96b029d07-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"9c1866ce-acd4-4c40-aa47-4ec96b029d07\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:12:58.802508 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:12:58.802385    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/9c1866ce-acd4-4c40-aa47-4ec96b029d07-otlp-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"9c1866ce-acd4-4c40-aa47-4ec96b029d07\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:12:58.802647 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:12:58.802625    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/9c1866ce-acd4-4c40-aa47-4ec96b029d07-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-0\" (UID: \"9c1866ce-acd4-4c40-aa47-4ec96b029d07\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:12:58.802946 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:12:58.802925    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/9c1866ce-acd4-4c40-aa47-4ec96b029d07-monitoring-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"9c1866ce-acd4-4c40-aa47-4ec96b029d07\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:12:58.861188 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:12:58.861145    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lhn4d\" (UniqueName: \"kubernetes.io/projected/9c1866ce-acd4-4c40-aa47-4ec96b029d07-kube-api-access-lhn4d\") pod \"data-science-collector-collector-0\" (UID: \"9c1866ce-acd4-4c40-aa47-4ec96b029d07\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:12:58.986241 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:12:58.986207    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:12:59.364866 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:12:59.364842    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:12:59.366701 ip-10-0-142-4 kubenswrapper[4060]: W1030 21:12:59.366672    4060 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c1866ce_acd4_4c40_aa47_4ec96b029d07.slice/crio-195ec2a7d46e936d19b5ba03c71919e0137b293156bec654588b42dee1cfe85d WatchSource:0}: Error finding container 195ec2a7d46e936d19b5ba03c71919e0137b293156bec654588b42dee1cfe85d: Status 404 returned error can't find the container with id 195ec2a7d46e936d19b5ba03c71919e0137b293156bec654588b42dee1cfe85d
Oct 30 21:12:59.368898 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:12:59.368868    4060 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 21:12:59.368966 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:12:59.368948    4060 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 21:12:59.392899 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:12:59.392778    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"9c1866ce-acd4-4c40-aa47-4ec96b029d07","Type":"ContainerStarted","Data":"195ec2a7d46e936d19b5ba03c71919e0137b293156bec654588b42dee1cfe85d"}
Oct 30 21:12:59.395466 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:12:59.395442    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/operator-metrics-auth-probe" event={"ID":"9b805f40-7999-4636-8d9d-79897d349df2","Type":"ContainerStarted","Data":"48eb7308d2234db1d19be35976ef27bdb6d78dca3ed4254fe46c033374e77439"}
Oct 30 21:12:59.427032 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:12:59.427002    4060 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2ed905d2-83c6-4671-99c8-9e83373a6c01" path="/var/lib/kubelet/pods/2ed905d2-83c6-4671-99c8-9e83373a6c01/volumes"
Oct 30 21:12:59.509972 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:12:59.509917    4060 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/operator-metrics-auth-probe" podStartSLOduration=1.54792926 podStartE2EDuration="3.509902897s" totalImagesPullingTime="1.961973637s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:12:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:12:59.508729079 +0000 UTC m=+2198.265727403" watchObservedRunningTime="2026-10-30 21:12:59.509902897 +0000 UTC m=+2198.266901195"
Oct 30 21:13:00.402071 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:13:00.402030    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"9c1866ce-acd4-4c40-aa47-4ec96b029d07","Type":"ContainerStarted","Data":"5a3ac09300438902890fff45a31b8b62a1faf2b21ba7e3382e2c5049acab720f"}
Oct 30 21:13:00.521142 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:13:00.521084    4060 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-collector-0" podStartSLOduration=2.5210679049999998 podStartE2EDuration="2.521067905s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:12:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:13:00.520286483 +0000 UTC m=+2199.277284776" watchObservedRunningTime="2026-10-30 21:13:00.521067905 +0000 UTC m=+2199.278066204"
Oct 30 21:13:03.180136 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:13:03.180057    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/operator-metrics-auth-probe"]
Oct 30 21:13:03.180590 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:13:03.180211    4060 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/operator-metrics-auth-probe" podUID="9b805f40-7999-4636-8d9d-79897d349df2" containerName="curl" containerID="cri-o://48eb7308d2234db1d19be35976ef27bdb6d78dca3ed4254fe46c033374e77439" gracePeriod=30
Oct 30 21:13:12.151279 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:13:12.151235    4060 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v2f4x" containerName="extractor"
Oct 30 21:13:33.211325 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:13:33.211293    4060 cadvisor_stats_provider.go:569] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9b805f40_7999_4636_8d9d_79897d349df2.slice/crio-conmon-48eb7308d2234db1d19be35976ef27bdb6d78dca3ed4254fe46c033374e77439.scope\": RecentStats: unable to find data in memory cache]"
Oct 30 21:13:33.211799 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:13:33.211334    4060 cadvisor_stats_provider.go:569] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9b805f40_7999_4636_8d9d_79897d349df2.slice/crio-48eb7308d2234db1d19be35976ef27bdb6d78dca3ed4254fe46c033374e77439.scope\": RecentStats: unable to find data in memory cache]"
Oct 30 21:13:33.333182 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:13:33.333157    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/operator-metrics-auth-probe"
Oct 30 21:13:33.397615 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:13:33.397585    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9b805f40-7999-4636-8d9d-79897d349df2-metrics-ca\" (UniqueName: \"kubernetes.io/configmap/9b805f40-7999-4636-8d9d-79897d349df2-metrics-ca\") pod \"9b805f40-7999-4636-8d9d-79897d349df2\" (UID: \"9b805f40-7999-4636-8d9d-79897d349df2\") "
Oct 30 21:13:33.397776 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:13:33.397659    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9b805f40-7999-4636-8d9d-79897d349df2-kube-api-access-4pj2n\" (UniqueName: \"kubernetes.io/projected/9b805f40-7999-4636-8d9d-79897d349df2-kube-api-access-4pj2n\") pod \"9b805f40-7999-4636-8d9d-79897d349df2\" (UID: \"9b805f40-7999-4636-8d9d-79897d349df2\") "
Oct 30 21:13:33.397979 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:13:33.397955    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9b805f40-7999-4636-8d9d-79897d349df2-metrics-ca" pod "9b805f40-7999-4636-8d9d-79897d349df2" (UID: "9b805f40-7999-4636-8d9d-79897d349df2"). InnerVolumeSpecName "metrics-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:13:33.399832 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:13:33.399809    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b805f40-7999-4636-8d9d-79897d349df2-kube-api-access-4pj2n" pod "9b805f40-7999-4636-8d9d-79897d349df2" (UID: "9b805f40-7999-4636-8d9d-79897d349df2"). InnerVolumeSpecName "kube-api-access-4pj2n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:13:33.499303 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:13:33.499263    4060 reconciler_common.go:299] "Volume detached for volume \"metrics-ca\" (UniqueName: \"kubernetes.io/configmap/9b805f40-7999-4636-8d9d-79897d349df2-metrics-ca\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:13:33.499546 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:13:33.499333    4060 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4pj2n\" (UniqueName: \"kubernetes.io/projected/9b805f40-7999-4636-8d9d-79897d349df2-kube-api-access-4pj2n\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:13:33.559543 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:13:33.559476    4060 generic.go:356] "Generic (PLEG): container finished" podID="9b805f40-7999-4636-8d9d-79897d349df2" containerID="48eb7308d2234db1d19be35976ef27bdb6d78dca3ed4254fe46c033374e77439" exitCode=137
Oct 30 21:13:33.559543 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:13:33.559535    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/operator-metrics-auth-probe"
Oct 30 21:13:33.559765 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:13:33.559575    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/operator-metrics-auth-probe" event={"ID":"9b805f40-7999-4636-8d9d-79897d349df2","Type":"ContainerDied","Data":"48eb7308d2234db1d19be35976ef27bdb6d78dca3ed4254fe46c033374e77439"}
Oct 30 21:13:33.559765 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:13:33.559617    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/operator-metrics-auth-probe" event={"ID":"9b805f40-7999-4636-8d9d-79897d349df2","Type":"ContainerDied","Data":"cbcf88a75557f3ddf8c77340d47a1ae7f47099e832fcae197058cc1a0006a154"}
Oct 30 21:13:33.559765 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:13:33.559633    4060 scope.go:122] "RemoveContainer" containerID="48eb7308d2234db1d19be35976ef27bdb6d78dca3ed4254fe46c033374e77439"
Oct 30 21:13:33.568036 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:13:33.568018    4060 scope.go:122] "RemoveContainer" containerID="48eb7308d2234db1d19be35976ef27bdb6d78dca3ed4254fe46c033374e77439"
Oct 30 21:13:33.568302 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:13:33.568283    4060 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"48eb7308d2234db1d19be35976ef27bdb6d78dca3ed4254fe46c033374e77439\": container with ID starting with 48eb7308d2234db1d19be35976ef27bdb6d78dca3ed4254fe46c033374e77439 not found: ID does not exist" containerID="48eb7308d2234db1d19be35976ef27bdb6d78dca3ed4254fe46c033374e77439"
Oct 30 21:13:33.568374 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:13:33.568317    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"48eb7308d2234db1d19be35976ef27bdb6d78dca3ed4254fe46c033374e77439"} err="failed to get container status \"48eb7308d2234db1d19be35976ef27bdb6d78dca3ed4254fe46c033374e77439\": rpc error: code = NotFound desc = could not find container \"48eb7308d2234db1d19be35976ef27bdb6d78dca3ed4254fe46c033374e77439\": container with ID starting with 48eb7308d2234db1d19be35976ef27bdb6d78dca3ed4254fe46c033374e77439 not found: ID does not exist"
Oct 30 21:13:33.722698 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:13:33.722663    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/operator-metrics-auth-probe"]
Oct 30 21:13:33.729479 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:13:33.729447    4060 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/operator-metrics-auth-probe"]
Oct 30 21:13:35.427060 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:13:35.427027    4060 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9b805f40-7999-4636-8d9d-79897d349df2" path="/var/lib/kubelet/pods/9b805f40-7999-4636-8d9d-79897d349df2/volumes"
Oct 30 21:13:40.048683 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:13:40.048651    4060 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/collector-prometheus-allowed-18e36b163e841787"]
Oct 30 21:13:40.049152 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:13:40.048985    4060 cpu_manager.go:414] "containerMap: removing container" podUID="9b805f40-7999-4636-8d9d-79897d349df2" containerName="curl"
Oct 30 21:13:40.049152 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:13:40.048996    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9b805f40-7999-4636-8d9d-79897d349df2" containerName="curl"
Oct 30 21:13:40.049152 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:13:40.049048    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="9b805f40-7999-4636-8d9d-79897d349df2" containerName="curl"
Oct 30 21:13:40.053253 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:13:40.053236    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/collector-prometheus-allowed-18e36b163e841787"
Oct 30 21:13:40.109925 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:13:40.109884    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/collector-prometheus-allowed-18e36b163e841787"]
Oct 30 21:13:40.157233 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:13:40.157202    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"default-dockercfg-48j4p\""
Oct 30 21:13:40.164302 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:13:40.164279    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/collector-prometheus-allowed-18e36b163e841787"
Oct 30 21:13:40.535818 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:13:40.535788    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/collector-prometheus-allowed-18e36b163e841787"]
Oct 30 21:13:40.538784 ip-10-0-142-4 kubenswrapper[4060]: W1030 21:13:40.538756    4060 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1b4f1066_241c_44f3_8923_138ca8ca78ea.slice/crio-2eb7248517703e8969f3c176ee77230e02c7ad4a0c2505c2823f5a531c258c18 WatchSource:0}: Error finding container 2eb7248517703e8969f3c176ee77230e02c7ad4a0c2505c2823f5a531c258c18: Status 404 returned error can't find the container with id 2eb7248517703e8969f3c176ee77230e02c7ad4a0c2505c2823f5a531c258c18
Oct 30 21:13:40.595435 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:13:40.595403    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/collector-prometheus-allowed-18e36b163e841787" event={"ID":"1b4f1066-241c-44f3-8923-138ca8ca78ea","Type":"ContainerStarted","Data":"2eb7248517703e8969f3c176ee77230e02c7ad4a0c2505c2823f5a531c258c18"}
Oct 30 21:13:42.152973 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:13:42.152939    4060 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v2f4x" containerName="extractor"
Oct 30 21:13:45.626014 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:13:45.625982    4060 generic.go:356] "Generic (PLEG): container finished" podID="1b4f1066-241c-44f3-8923-138ca8ca78ea" containerID="0f62eec7a0c00c16a7cf37fb741a01561f6075af2965d7b693dcfcace2a2cf4e" exitCode=0
Oct 30 21:13:45.626419 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:13:45.626082    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/collector-prometheus-allowed-18e36b163e841787" event={"ID":"1b4f1066-241c-44f3-8923-138ca8ca78ea","Type":"ContainerDied","Data":"0f62eec7a0c00c16a7cf37fb741a01561f6075af2965d7b693dcfcace2a2cf4e"}
Oct 30 21:13:46.753943 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:13:46.753917    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/collector-prometheus-allowed-18e36b163e841787"
Oct 30 21:13:47.636708 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:13:47.636675    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/collector-prometheus-allowed-18e36b163e841787" event={"ID":"1b4f1066-241c-44f3-8923-138ca8ca78ea","Type":"ContainerDied","Data":"2eb7248517703e8969f3c176ee77230e02c7ad4a0c2505c2823f5a531c258c18"}
Oct 30 21:13:47.636708 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:13:47.636706    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/collector-prometheus-allowed-18e36b163e841787"
Oct 30 21:13:47.636911 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:13:47.636712    4060 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2eb7248517703e8969f3c176ee77230e02c7ad4a0c2505c2823f5a531c258c18"
Oct 30 21:14:12.150224 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:14:12.150189    4060 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v2f4x" containerName="extractor"
Oct 30 21:14:12.309400 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:14:12.309364    4060 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-5db796d88d-tths7"]
Oct 30 21:14:12.309731 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:14:12.309717    4060 cpu_manager.go:414] "containerMap: removing container" podUID="1b4f1066-241c-44f3-8923-138ca8ca78ea" containerName="curl"
Oct 30 21:14:12.309775 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:14:12.309731    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1b4f1066-241c-44f3-8923-138ca8ca78ea" containerName="curl"
Oct 30 21:14:12.309809 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:14:12.309804    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="1b4f1066-241c-44f3-8923-138ca8ca78ea" containerName="curl"
Oct 30 21:14:12.312908 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:14:12.312891    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5db796d88d-tths7"
Oct 30 21:14:12.414667 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:14:12.414582    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-targetallocator\""
Oct 30 21:14:12.414667 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:14:12.414583    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-ta-server-cert\""
Oct 30 21:14:12.414895 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:14:12.414707    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-targetallocator-dockercfg-ltdzb\""
Oct 30 21:14:12.416640 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:14:12.416619    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-5db796d88d-tths7"]
Oct 30 21:14:12.427945 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:14:12.427918    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vcrwx\" (UniqueName: \"kubernetes.io/projected/db376607-a32c-4fce-9df3-404c6f653d5e-kube-api-access-vcrwx\") pod \"data-science-collector-targetallocator-5db796d88d-tths7\" (UID: \"db376607-a32c-4fce-9df3-404c6f653d5e\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5db796d88d-tths7"
Oct 30 21:14:12.428231 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:14:12.427961    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/db376607-a32c-4fce-9df3-404c6f653d5e-ta-internal\") pod \"data-science-collector-targetallocator-5db796d88d-tths7\" (UID: \"db376607-a32c-4fce-9df3-404c6f653d5e\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5db796d88d-tths7"
Oct 30 21:14:12.428231 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:14:12.428099    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/db376607-a32c-4fce-9df3-404c6f653d5e-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-5db796d88d-tths7\" (UID: \"db376607-a32c-4fce-9df3-404c6f653d5e\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5db796d88d-tths7"
Oct 30 21:14:12.528733 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:14:12.528691    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vcrwx\" (UniqueName: \"kubernetes.io/projected/db376607-a32c-4fce-9df3-404c6f653d5e-kube-api-access-vcrwx\") pod \"data-science-collector-targetallocator-5db796d88d-tths7\" (UID: \"db376607-a32c-4fce-9df3-404c6f653d5e\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5db796d88d-tths7"
Oct 30 21:14:12.528733 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:14:12.528738    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/db376607-a32c-4fce-9df3-404c6f653d5e-ta-internal\") pod \"data-science-collector-targetallocator-5db796d88d-tths7\" (UID: \"db376607-a32c-4fce-9df3-404c6f653d5e\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5db796d88d-tths7"
Oct 30 21:14:12.528993 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:14:12.528801    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/db376607-a32c-4fce-9df3-404c6f653d5e-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-5db796d88d-tths7\" (UID: \"db376607-a32c-4fce-9df3-404c6f653d5e\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5db796d88d-tths7"
Oct 30 21:14:12.529532 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:14:12.529513    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/db376607-a32c-4fce-9df3-404c6f653d5e-ta-internal\") pod \"data-science-collector-targetallocator-5db796d88d-tths7\" (UID: \"db376607-a32c-4fce-9df3-404c6f653d5e\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5db796d88d-tths7"
Oct 30 21:14:12.531274 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:14:12.531255    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/db376607-a32c-4fce-9df3-404c6f653d5e-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-5db796d88d-tths7\" (UID: \"db376607-a32c-4fce-9df3-404c6f653d5e\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5db796d88d-tths7"
Oct 30 21:14:12.589420 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:14:12.589392    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vcrwx\" (UniqueName: \"kubernetes.io/projected/db376607-a32c-4fce-9df3-404c6f653d5e-kube-api-access-vcrwx\") pod \"data-science-collector-targetallocator-5db796d88d-tths7\" (UID: \"db376607-a32c-4fce-9df3-404c6f653d5e\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5db796d88d-tths7"
Oct 30 21:14:12.624059 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:14:12.624033    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5db796d88d-tths7"
Oct 30 21:14:12.994802 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:14:12.994778    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-5db796d88d-tths7"]
Oct 30 21:14:12.997342 ip-10-0-142-4 kubenswrapper[4060]: W1030 21:14:12.997311    4060 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddb376607_a32c_4fce_9df3_404c6f653d5e.slice/crio-9bd5f5ebdd262875b7b1a28b349c570c5734b79b42981db1fbc58bec473b6c6f WatchSource:0}: Error finding container 9bd5f5ebdd262875b7b1a28b349c570c5734b79b42981db1fbc58bec473b6c6f: Status 404 returned error can't find the container with id 9bd5f5ebdd262875b7b1a28b349c570c5734b79b42981db1fbc58bec473b6c6f
Oct 30 21:14:12.999679 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:14:12.999629    4060 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 21:14:12.999772 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:14:12.999712    4060 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 21:14:13.757431 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:14:13.757396    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5db796d88d-tths7" event={"ID":"db376607-a32c-4fce-9df3-404c6f653d5e","Type":"ContainerStarted","Data":"087934ff30866245be53ab21599851e273b2ae446a814047a01e48fcb6a219de"}
Oct 30 21:14:13.757431 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:14:13.757437    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5db796d88d-tths7" event={"ID":"db376607-a32c-4fce-9df3-404c6f653d5e","Type":"ContainerStarted","Data":"9bd5f5ebdd262875b7b1a28b349c570c5734b79b42981db1fbc58bec473b6c6f"}
Oct 30 21:14:13.757928 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:14:13.757517    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5db796d88d-tths7"
Oct 30 21:14:13.758748 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:14:13.758723    4060 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5db796d88d-tths7" podUID="db376607-a32c-4fce-9df3-404c6f653d5e" containerName="ta-container" probeResult="failure" output="Get \"http://10.133.0.87:8080/readyz\": dial tcp 10.133.0.87:8080: connect: connection refused"
Oct 30 21:14:13.876108 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:14:13.876057    4060 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5db796d88d-tths7" podStartSLOduration=1.876042518 podStartE2EDuration="1.876042518s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:14:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:14:13.874003244 +0000 UTC m=+2272.631001544" watchObservedRunningTime="2026-10-30 21:14:13.876042518 +0000 UTC m=+2272.633040815"
Oct 30 21:14:14.764183 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:14:14.764151    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5db796d88d-tths7"
Oct 30 21:14:42.149819 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:14:42.149732    4060 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v2f4x" containerName="extractor"
Oct 30 21:15:12.150140 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:15:12.150100    4060 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v2f4x" containerName="extractor"
Oct 30 21:15:42.150968 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:15:42.150930    4060 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v2f4x" containerName="extractor"
Oct 30 21:16:12.149545 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:16:12.149509    4060 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v2f4x" containerName="extractor"
Oct 30 21:16:42.148847 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:16:42.148811    4060 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v2f4x" containerName="extractor"
Oct 30 21:17:12.150516 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:17:12.150448    4060 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v2f4x" containerName="extractor"
Oct 30 21:17:42.150717 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:17:42.150640    4060 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v2f4x" containerName="extractor"
Oct 30 21:17:45.310719 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:17:45.310683    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/collector-prometheus-allowed-18e36b163e841787"]
Oct 30 21:17:45.314962 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:17:45.314937    4060 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/collector-prometheus-allowed-18e36b163e841787"]
Oct 30 21:17:45.426662 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:17:45.426631    4060 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="1b4f1066-241c-44f3-8923-138ca8ca78ea" path="/var/lib/kubelet/pods/1b4f1066-241c-44f3-8923-138ca8ca78ea/volumes"
Oct 30 21:18:00.279572 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:00.279533    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-5db796d88d-tths7"]
Oct 30 21:18:00.280093 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:00.279741    4060 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5db796d88d-tths7" podUID="db376607-a32c-4fce-9df3-404c6f653d5e" containerName="ta-container" containerID="cri-o://087934ff30866245be53ab21599851e273b2ae446a814047a01e48fcb6a219de" gracePeriod=30
Oct 30 21:18:00.535933 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:00.535868    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5db796d88d-tths7"
Oct 30 21:18:00.634789 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:00.634752    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/db376607-a32c-4fce-9df3-404c6f653d5e-kube-api-access-vcrwx\" (UniqueName: \"kubernetes.io/projected/db376607-a32c-4fce-9df3-404c6f653d5e-kube-api-access-vcrwx\") pod \"db376607-a32c-4fce-9df3-404c6f653d5e\" (UID: \"db376607-a32c-4fce-9df3-404c6f653d5e\") "
Oct 30 21:18:00.634978 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:00.634856    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/db376607-a32c-4fce-9df3-404c6f653d5e-data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/db376607-a32c-4fce-9df3-404c6f653d5e-data-science-collector-ta-server-cert\") pod \"db376607-a32c-4fce-9df3-404c6f653d5e\" (UID: \"db376607-a32c-4fce-9df3-404c6f653d5e\") "
Oct 30 21:18:00.634978 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:00.634897    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/db376607-a32c-4fce-9df3-404c6f653d5e-ta-internal\" (UniqueName: \"kubernetes.io/configmap/db376607-a32c-4fce-9df3-404c6f653d5e-ta-internal\") pod \"db376607-a32c-4fce-9df3-404c6f653d5e\" (UID: \"db376607-a32c-4fce-9df3-404c6f653d5e\") "
Oct 30 21:18:00.635329 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:00.635305    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/db376607-a32c-4fce-9df3-404c6f653d5e-ta-internal" pod "db376607-a32c-4fce-9df3-404c6f653d5e" (UID: "db376607-a32c-4fce-9df3-404c6f653d5e"). InnerVolumeSpecName "ta-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:18:00.637043 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:00.637020    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/db376607-a32c-4fce-9df3-404c6f653d5e-kube-api-access-vcrwx" pod "db376607-a32c-4fce-9df3-404c6f653d5e" (UID: "db376607-a32c-4fce-9df3-404c6f653d5e"). InnerVolumeSpecName "kube-api-access-vcrwx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:18:00.637043 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:00.637032    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/db376607-a32c-4fce-9df3-404c6f653d5e-data-science-collector-ta-server-cert" pod "db376607-a32c-4fce-9df3-404c6f653d5e" (UID: "db376607-a32c-4fce-9df3-404c6f653d5e"). InnerVolumeSpecName "data-science-collector-ta-server-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:18:00.735623 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:00.735585    4060 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vcrwx\" (UniqueName: \"kubernetes.io/projected/db376607-a32c-4fce-9df3-404c6f653d5e-kube-api-access-vcrwx\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:18:00.735623 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:00.735616    4060 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/db376607-a32c-4fce-9df3-404c6f653d5e-data-science-collector-ta-server-cert\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:18:00.735623 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:00.735628    4060 reconciler_common.go:299] "Volume detached for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/db376607-a32c-4fce-9df3-404c6f653d5e-ta-internal\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:18:00.838376 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:00.838286    4060 generic.go:356] "Generic (PLEG): container finished" podID="db376607-a32c-4fce-9df3-404c6f653d5e" containerID="087934ff30866245be53ab21599851e273b2ae446a814047a01e48fcb6a219de" exitCode=0
Oct 30 21:18:00.838376 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:00.838330    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5db796d88d-tths7"
Oct 30 21:18:00.838671 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:00.838385    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5db796d88d-tths7" event={"ID":"db376607-a32c-4fce-9df3-404c6f653d5e","Type":"ContainerDied","Data":"087934ff30866245be53ab21599851e273b2ae446a814047a01e48fcb6a219de"}
Oct 30 21:18:00.838671 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:00.838438    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5db796d88d-tths7" event={"ID":"db376607-a32c-4fce-9df3-404c6f653d5e","Type":"ContainerDied","Data":"9bd5f5ebdd262875b7b1a28b349c570c5734b79b42981db1fbc58bec473b6c6f"}
Oct 30 21:18:00.838671 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:00.838460    4060 scope.go:122] "RemoveContainer" containerID="087934ff30866245be53ab21599851e273b2ae446a814047a01e48fcb6a219de"
Oct 30 21:18:00.847568 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:00.847549    4060 scope.go:122] "RemoveContainer" containerID="087934ff30866245be53ab21599851e273b2ae446a814047a01e48fcb6a219de"
Oct 30 21:18:00.847867 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:18:00.847848    4060 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"087934ff30866245be53ab21599851e273b2ae446a814047a01e48fcb6a219de\": container with ID starting with 087934ff30866245be53ab21599851e273b2ae446a814047a01e48fcb6a219de not found: ID does not exist" containerID="087934ff30866245be53ab21599851e273b2ae446a814047a01e48fcb6a219de"
Oct 30 21:18:00.847916 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:00.847878    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"087934ff30866245be53ab21599851e273b2ae446a814047a01e48fcb6a219de"} err="failed to get container status \"087934ff30866245be53ab21599851e273b2ae446a814047a01e48fcb6a219de\": rpc error: code = NotFound desc = could not find container \"087934ff30866245be53ab21599851e273b2ae446a814047a01e48fcb6a219de\": container with ID starting with 087934ff30866245be53ab21599851e273b2ae446a814047a01e48fcb6a219de not found: ID does not exist"
Oct 30 21:18:01.002441 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:01.002399    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-5db796d88d-tths7"]
Oct 30 21:18:01.004480 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:01.004454    4060 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-5db796d88d-tths7"]
Oct 30 21:18:01.383860 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:01.383814    4060 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["collector-namespace-auth-18e36b4f60efd942/revoked-inference-denied-18e36b531750e1cf"]
Oct 30 21:18:01.384368 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:01.384330    4060 cpu_manager.go:414] "containerMap: removing container" podUID="db376607-a32c-4fce-9df3-404c6f653d5e" containerName="ta-container"
Oct 30 21:18:01.384368 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:01.384351    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="db376607-a32c-4fce-9df3-404c6f653d5e" containerName="ta-container"
Oct 30 21:18:01.384480 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:01.384446    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="db376607-a32c-4fce-9df3-404c6f653d5e" containerName="ta-container"
Oct 30 21:18:01.388607 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:01.388585    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="collector-namespace-auth-18e36b4f60efd942/revoked-inference-denied-18e36b531750e1cf"
Oct 30 21:18:01.427195 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:01.427167    4060 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="db376607-a32c-4fce-9df3-404c6f653d5e" path="/var/lib/kubelet/pods/db376607-a32c-4fce-9df3-404c6f653d5e/volumes"
Oct 30 21:18:01.442776 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:01.442747    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"collector-namespace-auth-18e36b4f60efd942\"/\"default-dockercfg-8djrv\""
Oct 30 21:18:01.444664 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:01.444642    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["collector-namespace-auth-18e36b4f60efd942/revoked-inference-denied-18e36b531750e1cf"]
Oct 30 21:18:01.449851 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:01.449829    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="collector-namespace-auth-18e36b4f60efd942/revoked-inference-denied-18e36b531750e1cf"
Oct 30 21:18:01.826258 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:01.826235    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["collector-namespace-auth-18e36b4f60efd942/revoked-inference-denied-18e36b531750e1cf"]
Oct 30 21:18:01.828456 ip-10-0-142-4 kubenswrapper[4060]: W1030 21:18:01.828430    4060 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod64ead62d_5a92_4824_8389_dd242e54e2a2.slice/crio-28603b632d6bde8692319b8bf70bb619faa9529f77c269ba52f20af6b954cad7 WatchSource:0}: Error finding container 28603b632d6bde8692319b8bf70bb619faa9529f77c269ba52f20af6b954cad7: Status 404 returned error can't find the container with id 28603b632d6bde8692319b8bf70bb619faa9529f77c269ba52f20af6b954cad7
Oct 30 21:18:01.847236 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:01.847205    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="collector-namespace-auth-18e36b4f60efd942/revoked-inference-denied-18e36b531750e1cf" event={"ID":"64ead62d-5a92-4824-8389-dd242e54e2a2","Type":"ContainerStarted","Data":"28603b632d6bde8692319b8bf70bb619faa9529f77c269ba52f20af6b954cad7"}
Oct 30 21:18:02.853197 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:02.853162    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="collector-namespace-auth-18e36b4f60efd942/revoked-inference-denied-18e36b531750e1cf" event={"ID":"64ead62d-5a92-4824-8389-dd242e54e2a2","Type":"ContainerStarted","Data":"737cfb22d648edbfbfbcdaf3371da75c79070481c8e93aee36c9e0b75970fdc3"}
Oct 30 21:18:02.970777 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:02.970713    4060 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="collector-namespace-auth-18e36b4f60efd942/revoked-inference-denied-18e36b531750e1cf" podStartSLOduration=1.97069552 podStartE2EDuration="1.97069552s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:18:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:18:02.970567248 +0000 UTC m=+2501.727565549" watchObservedRunningTime="2026-10-30 21:18:02.97069552 +0000 UTC m=+2501.727693819"
Oct 30 21:18:09.886014 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:09.885979    4060 generic.go:356] "Generic (PLEG): container finished" podID="64ead62d-5a92-4824-8389-dd242e54e2a2" containerID="737cfb22d648edbfbfbcdaf3371da75c79070481c8e93aee36c9e0b75970fdc3" exitCode=0
Oct 30 21:18:09.886403 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:09.886053    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="collector-namespace-auth-18e36b4f60efd942/revoked-inference-denied-18e36b531750e1cf" event={"ID":"64ead62d-5a92-4824-8389-dd242e54e2a2","Type":"ContainerDied","Data":"737cfb22d648edbfbfbcdaf3371da75c79070481c8e93aee36c9e0b75970fdc3"}
Oct 30 21:18:11.021666 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:11.021642    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="collector-namespace-auth-18e36b4f60efd942/revoked-inference-denied-18e36b531750e1cf"
Oct 30 21:18:11.499393 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:11.499355    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["collector-namespace-auth-18e36b4f60efd942/revoked-inference-denied-18e36b531750e1cf"]
Oct 30 21:18:11.503433 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:11.503394    4060 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["collector-namespace-auth-18e36b4f60efd942/revoked-inference-denied-18e36b531750e1cf"]
Oct 30 21:18:11.896856 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:11.896834    4060 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="28603b632d6bde8692319b8bf70bb619faa9529f77c269ba52f20af6b954cad7"
Oct 30 21:18:11.896856 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:11.896854    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="collector-namespace-auth-18e36b4f60efd942/revoked-inference-denied-18e36b531750e1cf"
Oct 30 21:18:11.949710 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:18:11.949665    4060 status_manager.go:1045] "Failed to get status for pod" err="pods \"revoked-inference-denied-18e36b531750e1cf\" is forbidden: User \"system:node:ip-10-0-142-4.us-west-1.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"collector-namespace-auth-18e36b4f60efd942\": no relationship found between node 'ip-10-0-142-4.us-west-1.compute.internal' and this object" podUID="64ead62d-5a92-4824-8389-dd242e54e2a2" pod="collector-namespace-auth-18e36b4f60efd942/revoked-inference-denied-18e36b531750e1cf"
Oct 30 21:18:12.149846 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:18:12.149766    4060 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v2f4x" containerName="extractor"
Oct 30 21:18:13.427482 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:13.427452    4060 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="64ead62d-5a92-4824-8389-dd242e54e2a2" path="/var/lib/kubelet/pods/64ead62d-5a92-4824-8389-dd242e54e2a2/volumes"
Oct 30 21:18:14.377733 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:14.377698    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-tctk6"]
Oct 30 21:18:14.377984 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:14.377959    4060 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-tctk6" podUID="9ed8e0b4-0888-43d8-bae7-a7a201130785" containerName="kube-rbac-proxy" containerID="cri-o://044be665bc939cff522946754f9299fc67d9c9615f32e87f4d881b73065595bc" gracePeriod=30
Oct 30 21:18:14.534268 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:14.534238    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/korrel8r-5cbcc89b8f-mg9mm"]
Oct 30 21:18:14.534657 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:14.534422    4060 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-mg9mm" podUID="dc2a888c-b107-4cc7-823f-51bda67f9992" containerName="korrel8r" containerID="cri-o://e237c8c08b29fa4dc0e6b99e71a606cf7bd5fa2dfc19359ef5fdeea316a6f723" gracePeriod=30
Oct 30 21:18:14.657206 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:14.657183    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-tctk6"
Oct 30 21:18:14.755608 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:14.755576    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9ed8e0b4-0888-43d8-bae7-a7a201130785-kube-api-access-prrjr\" (UniqueName: \"kubernetes.io/projected/9ed8e0b4-0888-43d8-bae7-a7a201130785-kube-api-access-prrjr\") pod \"9ed8e0b4-0888-43d8-bae7-a7a201130785\" (UID: \"9ed8e0b4-0888-43d8-bae7-a7a201130785\") "
Oct 30 21:18:14.755768 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:14.755654    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/9ed8e0b4-0888-43d8-bae7-a7a201130785-prometheus-client-cert\" (UniqueName: \"kubernetes.io/secret/9ed8e0b4-0888-43d8-bae7-a7a201130785-prometheus-client-cert\") pod \"9ed8e0b4-0888-43d8-bae7-a7a201130785\" (UID: \"9ed8e0b4-0888-43d8-bae7-a7a201130785\") "
Oct 30 21:18:14.755841 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:14.755817    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9ed8e0b4-0888-43d8-bae7-a7a201130785-prometheus-ca\" (UniqueName: \"kubernetes.io/configmap/9ed8e0b4-0888-43d8-bae7-a7a201130785-prometheus-ca\") pod \"9ed8e0b4-0888-43d8-bae7-a7a201130785\" (UID: \"9ed8e0b4-0888-43d8-bae7-a7a201130785\") "
Oct 30 21:18:14.755950 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:14.755933    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/9ed8e0b4-0888-43d8-bae7-a7a201130785-tls\" (UniqueName: \"kubernetes.io/secret/9ed8e0b4-0888-43d8-bae7-a7a201130785-tls\") pod \"9ed8e0b4-0888-43d8-bae7-a7a201130785\" (UID: \"9ed8e0b4-0888-43d8-bae7-a7a201130785\") "
Oct 30 21:18:14.756016 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:14.755979    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/9ed8e0b4-0888-43d8-bae7-a7a201130785-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9ed8e0b4-0888-43d8-bae7-a7a201130785-kube-rbac-proxy-config\") pod \"9ed8e0b4-0888-43d8-bae7-a7a201130785\" (UID: \"9ed8e0b4-0888-43d8-bae7-a7a201130785\") "
Oct 30 21:18:14.756181 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:14.756155    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9ed8e0b4-0888-43d8-bae7-a7a201130785-prometheus-ca" pod "9ed8e0b4-0888-43d8-bae7-a7a201130785" (UID: "9ed8e0b4-0888-43d8-bae7-a7a201130785"). InnerVolumeSpecName "prometheus-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:18:14.757838 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:14.757807    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9ed8e0b4-0888-43d8-bae7-a7a201130785-prometheus-client-cert" pod "9ed8e0b4-0888-43d8-bae7-a7a201130785" (UID: "9ed8e0b4-0888-43d8-bae7-a7a201130785"). InnerVolumeSpecName "prometheus-client-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:18:14.757964 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:14.757908    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ed8e0b4-0888-43d8-bae7-a7a201130785-kube-api-access-prrjr" pod "9ed8e0b4-0888-43d8-bae7-a7a201130785" (UID: "9ed8e0b4-0888-43d8-bae7-a7a201130785"). InnerVolumeSpecName "kube-api-access-prrjr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:18:14.758024 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:14.758011    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9ed8e0b4-0888-43d8-bae7-a7a201130785-tls" pod "9ed8e0b4-0888-43d8-bae7-a7a201130785" (UID: "9ed8e0b4-0888-43d8-bae7-a7a201130785"). InnerVolumeSpecName "tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:18:14.758108 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:14.758092    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9ed8e0b4-0888-43d8-bae7-a7a201130785-kube-rbac-proxy-config" pod "9ed8e0b4-0888-43d8-bae7-a7a201130785" (UID: "9ed8e0b4-0888-43d8-bae7-a7a201130785"). InnerVolumeSpecName "kube-rbac-proxy-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:18:14.767147 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:14.767127    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-mg9mm"
Oct 30 21:18:14.857183 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:14.857145    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/dc2a888c-b107-4cc7-823f-51bda67f9992-tls\" (UniqueName: \"kubernetes.io/secret/dc2a888c-b107-4cc7-823f-51bda67f9992-tls\") pod \"dc2a888c-b107-4cc7-823f-51bda67f9992\" (UID: \"dc2a888c-b107-4cc7-823f-51bda67f9992\") "
Oct 30 21:18:14.857389 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:14.857207    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/dc2a888c-b107-4cc7-823f-51bda67f9992-config\" (UniqueName: \"kubernetes.io/configmap/dc2a888c-b107-4cc7-823f-51bda67f9992-config\") pod \"dc2a888c-b107-4cc7-823f-51bda67f9992\" (UID: \"dc2a888c-b107-4cc7-823f-51bda67f9992\") "
Oct 30 21:18:14.857389 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:14.857291    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/dc2a888c-b107-4cc7-823f-51bda67f9992-kube-api-access-hl7sv\" (UniqueName: \"kubernetes.io/projected/dc2a888c-b107-4cc7-823f-51bda67f9992-kube-api-access-hl7sv\") pod \"dc2a888c-b107-4cc7-823f-51bda67f9992\" (UID: \"dc2a888c-b107-4cc7-823f-51bda67f9992\") "
Oct 30 21:18:14.857583 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:14.857563    4060 reconciler_common.go:299] "Volume detached for volume \"prometheus-client-cert\" (UniqueName: \"kubernetes.io/secret/9ed8e0b4-0888-43d8-bae7-a7a201130785-prometheus-client-cert\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:18:14.857660 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:14.857589    4060 reconciler_common.go:299] "Volume detached for volume \"prometheus-ca\" (UniqueName: \"kubernetes.io/configmap/9ed8e0b4-0888-43d8-bae7-a7a201130785-prometheus-ca\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:18:14.857660 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:14.857603    4060 reconciler_common.go:299] "Volume detached for volume \"tls\" (UniqueName: \"kubernetes.io/secret/9ed8e0b4-0888-43d8-bae7-a7a201130785-tls\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:18:14.857660 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:14.857617    4060 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9ed8e0b4-0888-43d8-bae7-a7a201130785-kube-rbac-proxy-config\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:18:14.857660 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:14.857631    4060 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-prrjr\" (UniqueName: \"kubernetes.io/projected/9ed8e0b4-0888-43d8-bae7-a7a201130785-kube-api-access-prrjr\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:18:14.857899 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:14.857871    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dc2a888c-b107-4cc7-823f-51bda67f9992-config" pod "dc2a888c-b107-4cc7-823f-51bda67f9992" (UID: "dc2a888c-b107-4cc7-823f-51bda67f9992"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:18:14.860061 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:14.860034    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dc2a888c-b107-4cc7-823f-51bda67f9992-kube-api-access-hl7sv" pod "dc2a888c-b107-4cc7-823f-51bda67f9992" (UID: "dc2a888c-b107-4cc7-823f-51bda67f9992"). InnerVolumeSpecName "kube-api-access-hl7sv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:18:14.860178 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:14.860136    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dc2a888c-b107-4cc7-823f-51bda67f9992-tls" pod "dc2a888c-b107-4cc7-823f-51bda67f9992" (UID: "dc2a888c-b107-4cc7-823f-51bda67f9992"). InnerVolumeSpecName "tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:18:14.914566 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:14.914451    4060 generic.go:356] "Generic (PLEG): container finished" podID="9ed8e0b4-0888-43d8-bae7-a7a201130785" containerID="044be665bc939cff522946754f9299fc67d9c9615f32e87f4d881b73065595bc" exitCode=0
Oct 30 21:18:14.914738 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:14.914587    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-tctk6"
Oct 30 21:18:14.914738 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:14.914597    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-tctk6" event={"ID":"9ed8e0b4-0888-43d8-bae7-a7a201130785","Type":"ContainerDied","Data":"044be665bc939cff522946754f9299fc67d9c9615f32e87f4d881b73065595bc"}
Oct 30 21:18:14.914738 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:14.914655    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-tctk6" event={"ID":"9ed8e0b4-0888-43d8-bae7-a7a201130785","Type":"ContainerDied","Data":"bd1df7d89731ecef0d11aedcaea0e39a5a150242cb177ab033e75ada5e1fb5e5"}
Oct 30 21:18:14.914738 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:14.914687    4060 scope.go:122] "RemoveContainer" containerID="044be665bc939cff522946754f9299fc67d9c9615f32e87f4d881b73065595bc"
Oct 30 21:18:14.916085 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:14.916007    4060 generic.go:356] "Generic (PLEG): container finished" podID="dc2a888c-b107-4cc7-823f-51bda67f9992" containerID="e237c8c08b29fa4dc0e6b99e71a606cf7bd5fa2dfc19359ef5fdeea316a6f723" exitCode=0
Oct 30 21:18:14.916085 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:14.916062    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-mg9mm" event={"ID":"dc2a888c-b107-4cc7-823f-51bda67f9992","Type":"ContainerDied","Data":"e237c8c08b29fa4dc0e6b99e71a606cf7bd5fa2dfc19359ef5fdeea316a6f723"}
Oct 30 21:18:14.916224 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:14.916095    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-mg9mm" event={"ID":"dc2a888c-b107-4cc7-823f-51bda67f9992","Type":"ContainerDied","Data":"4347e00adbc0e8eb9394060a84b52bd0e8836abe82545be21b38ce4200487b53"}
Oct 30 21:18:14.916224 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:14.916147    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-mg9mm"
Oct 30 21:18:14.925516 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:14.925467    4060 scope.go:122] "RemoveContainer" containerID="044be665bc939cff522946754f9299fc67d9c9615f32e87f4d881b73065595bc"
Oct 30 21:18:14.925850 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:18:14.925824    4060 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"044be665bc939cff522946754f9299fc67d9c9615f32e87f4d881b73065595bc\": container with ID starting with 044be665bc939cff522946754f9299fc67d9c9615f32e87f4d881b73065595bc not found: ID does not exist" containerID="044be665bc939cff522946754f9299fc67d9c9615f32e87f4d881b73065595bc"
Oct 30 21:18:14.925955 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:14.925857    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"044be665bc939cff522946754f9299fc67d9c9615f32e87f4d881b73065595bc"} err="failed to get container status \"044be665bc939cff522946754f9299fc67d9c9615f32e87f4d881b73065595bc\": rpc error: code = NotFound desc = could not find container \"044be665bc939cff522946754f9299fc67d9c9615f32e87f4d881b73065595bc\": container with ID starting with 044be665bc939cff522946754f9299fc67d9c9615f32e87f4d881b73065595bc not found: ID does not exist"
Oct 30 21:18:14.925955 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:14.925873    4060 scope.go:122] "RemoveContainer" containerID="e237c8c08b29fa4dc0e6b99e71a606cf7bd5fa2dfc19359ef5fdeea316a6f723"
Oct 30 21:18:14.933629 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:14.933610    4060 scope.go:122] "RemoveContainer" containerID="e237c8c08b29fa4dc0e6b99e71a606cf7bd5fa2dfc19359ef5fdeea316a6f723"
Oct 30 21:18:14.933926 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:18:14.933909    4060 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e237c8c08b29fa4dc0e6b99e71a606cf7bd5fa2dfc19359ef5fdeea316a6f723\": container with ID starting with e237c8c08b29fa4dc0e6b99e71a606cf7bd5fa2dfc19359ef5fdeea316a6f723 not found: ID does not exist" containerID="e237c8c08b29fa4dc0e6b99e71a606cf7bd5fa2dfc19359ef5fdeea316a6f723"
Oct 30 21:18:14.933974 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:14.933936    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e237c8c08b29fa4dc0e6b99e71a606cf7bd5fa2dfc19359ef5fdeea316a6f723"} err="failed to get container status \"e237c8c08b29fa4dc0e6b99e71a606cf7bd5fa2dfc19359ef5fdeea316a6f723\": rpc error: code = NotFound desc = could not find container \"e237c8c08b29fa4dc0e6b99e71a606cf7bd5fa2dfc19359ef5fdeea316a6f723\": container with ID starting with e237c8c08b29fa4dc0e6b99e71a606cf7bd5fa2dfc19359ef5fdeea316a6f723 not found: ID does not exist"
Oct 30 21:18:14.959020 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:14.958994    4060 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hl7sv\" (UniqueName: \"kubernetes.io/projected/dc2a888c-b107-4cc7-823f-51bda67f9992-kube-api-access-hl7sv\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:18:14.959020 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:14.959017    4060 reconciler_common.go:299] "Volume detached for volume \"tls\" (UniqueName: \"kubernetes.io/secret/dc2a888c-b107-4cc7-823f-51bda67f9992-tls\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:18:14.959190 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:14.959027    4060 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/dc2a888c-b107-4cc7-823f-51bda67f9992-config\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:18:15.083369 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:15.083339    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/korrel8r-5cbcc89b8f-mg9mm"]
Oct 30 21:18:15.088074 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:15.088048    4060 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/korrel8r-5cbcc89b8f-mg9mm"]
Oct 30 21:18:15.198822 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:15.198793    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-tctk6"]
Oct 30 21:18:15.204131 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:15.204107    4060 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-tctk6"]
Oct 30 21:18:15.427582 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:15.427551    4060 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9ed8e0b4-0888-43d8-bae7-a7a201130785" path="/var/lib/kubelet/pods/9ed8e0b4-0888-43d8-bae7-a7a201130785/volumes"
Oct 30 21:18:15.427938 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:15.427926    4060 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="dc2a888c-b107-4cc7-823f-51bda67f9992" path="/var/lib/kubelet/pods/dc2a888c-b107-4cc7-823f-51bda67f9992/volumes"
Oct 30 21:18:15.750471 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:15.750434    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"]
Oct 30 21:18:15.750860 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:15.750696    4060 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0" podUID="b2c848d9-2add-4fde-8575-85ee3a22a1ae" containerName="alertmanager" containerID="cri-o://43bff33733df7bfc6815aac83720e28e2f35192df77a3aa4b37139fe9496f9f9" gracePeriod=120
Oct 30 21:18:15.750860 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:15.750715    4060 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0" podUID="b2c848d9-2add-4fde-8575-85ee3a22a1ae" containerName="config-reloader" containerID="cri-o://1e63113e2e7320e307ed2b1e4c9c25aefabf40cb29f551014df24c7fb19c0a5c" gracePeriod=120
Oct 30 21:18:15.924463 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:15.924434    4060 generic.go:356] "Generic (PLEG): container finished" podID="b2c848d9-2add-4fde-8575-85ee3a22a1ae" containerID="1e63113e2e7320e307ed2b1e4c9c25aefabf40cb29f551014df24c7fb19c0a5c" exitCode=0
Oct 30 21:18:15.924615 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:15.924528    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0" event={"ID":"b2c848d9-2add-4fde-8575-85ee3a22a1ae","Type":"ContainerDied","Data":"1e63113e2e7320e307ed2b1e4c9c25aefabf40cb29f551014df24c7fb19c0a5c"}
Oct 30 21:18:16.602148 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:16.602124    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:18:16.776449 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:16.776418    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b2c848d9-2add-4fde-8575-85ee3a22a1ae-alertmanager-data-science-monitoringstack-db\" (UniqueName: \"kubernetes.io/empty-dir/b2c848d9-2add-4fde-8575-85ee3a22a1ae-alertmanager-data-science-monitoringstack-db\") pod \"b2c848d9-2add-4fde-8575-85ee3a22a1ae\" (UID: \"b2c848d9-2add-4fde-8575-85ee3a22a1ae\") "
Oct 30 21:18:16.776973 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:16.776462    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b2c848d9-2add-4fde-8575-85ee3a22a1ae-config-out\" (UniqueName: \"kubernetes.io/empty-dir/b2c848d9-2add-4fde-8575-85ee3a22a1ae-config-out\") pod \"b2c848d9-2add-4fde-8575-85ee3a22a1ae\" (UID: \"b2c848d9-2add-4fde-8575-85ee3a22a1ae\") "
Oct 30 21:18:16.776973 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:16.776515    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b2c848d9-2add-4fde-8575-85ee3a22a1ae-cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b2c848d9-2add-4fde-8575-85ee3a22a1ae-cluster-tls-config\") pod \"b2c848d9-2add-4fde-8575-85ee3a22a1ae\" (UID: \"b2c848d9-2add-4fde-8575-85ee3a22a1ae\") "
Oct 30 21:18:16.776973 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:16.776536    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b2c848d9-2add-4fde-8575-85ee3a22a1ae-web-config\" (UniqueName: \"kubernetes.io/secret/b2c848d9-2add-4fde-8575-85ee3a22a1ae-web-config\") pod \"b2c848d9-2add-4fde-8575-85ee3a22a1ae\" (UID: \"b2c848d9-2add-4fde-8575-85ee3a22a1ae\") "
Oct 30 21:18:16.776973 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:16.776567    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b2c848d9-2add-4fde-8575-85ee3a22a1ae-tls-assets\" (UniqueName: \"kubernetes.io/projected/b2c848d9-2add-4fde-8575-85ee3a22a1ae-tls-assets\") pod \"b2c848d9-2add-4fde-8575-85ee3a22a1ae\" (UID: \"b2c848d9-2add-4fde-8575-85ee3a22a1ae\") "
Oct 30 21:18:16.776973 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:16.776597    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b2c848d9-2add-4fde-8575-85ee3a22a1ae-kube-api-access-qnqjk\" (UniqueName: \"kubernetes.io/projected/b2c848d9-2add-4fde-8575-85ee3a22a1ae-kube-api-access-qnqjk\") pod \"b2c848d9-2add-4fde-8575-85ee3a22a1ae\" (UID: \"b2c848d9-2add-4fde-8575-85ee3a22a1ae\") "
Oct 30 21:18:16.776973 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:16.776739    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b2c848d9-2add-4fde-8575-85ee3a22a1ae-config-volume\" (UniqueName: \"kubernetes.io/secret/b2c848d9-2add-4fde-8575-85ee3a22a1ae-config-volume\") pod \"b2c848d9-2add-4fde-8575-85ee3a22a1ae\" (UID: \"b2c848d9-2add-4fde-8575-85ee3a22a1ae\") "
Oct 30 21:18:16.776973 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:16.776834    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2c848d9-2add-4fde-8575-85ee3a22a1ae-alertmanager-data-science-monitoringstack-db" pod "b2c848d9-2add-4fde-8575-85ee3a22a1ae" (UID: "b2c848d9-2add-4fde-8575-85ee3a22a1ae"). InnerVolumeSpecName "alertmanager-data-science-monitoringstack-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:18:16.777359 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:16.777032    4060 reconciler_common.go:299] "Volume detached for volume \"alertmanager-data-science-monitoringstack-db\" (UniqueName: \"kubernetes.io/empty-dir/b2c848d9-2add-4fde-8575-85ee3a22a1ae-alertmanager-data-science-monitoringstack-db\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:18:16.778810 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:16.778786    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2c848d9-2add-4fde-8575-85ee3a22a1ae-config-out" pod "b2c848d9-2add-4fde-8575-85ee3a22a1ae" (UID: "b2c848d9-2add-4fde-8575-85ee3a22a1ae"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:18:16.779285 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:16.779256    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b2c848d9-2add-4fde-8575-85ee3a22a1ae-kube-api-access-qnqjk" pod "b2c848d9-2add-4fde-8575-85ee3a22a1ae" (UID: "b2c848d9-2add-4fde-8575-85ee3a22a1ae"). InnerVolumeSpecName "kube-api-access-qnqjk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:18:16.779423 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:16.779298    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b2c848d9-2add-4fde-8575-85ee3a22a1ae-tls-assets" pod "b2c848d9-2add-4fde-8575-85ee3a22a1ae" (UID: "b2c848d9-2add-4fde-8575-85ee3a22a1ae"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:18:16.779423 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:16.779306    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b2c848d9-2add-4fde-8575-85ee3a22a1ae-config-volume" pod "b2c848d9-2add-4fde-8575-85ee3a22a1ae" (UID: "b2c848d9-2add-4fde-8575-85ee3a22a1ae"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:18:16.782737 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:16.782713    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b2c848d9-2add-4fde-8575-85ee3a22a1ae-cluster-tls-config" pod "b2c848d9-2add-4fde-8575-85ee3a22a1ae" (UID: "b2c848d9-2add-4fde-8575-85ee3a22a1ae"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:18:16.789121 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:16.789101    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b2c848d9-2add-4fde-8575-85ee3a22a1ae-web-config" pod "b2c848d9-2add-4fde-8575-85ee3a22a1ae" (UID: "b2c848d9-2add-4fde-8575-85ee3a22a1ae"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:18:16.877713 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:16.877685    4060 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b2c848d9-2add-4fde-8575-85ee3a22a1ae-config-out\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:18:16.877713 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:16.877710    4060 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b2c848d9-2add-4fde-8575-85ee3a22a1ae-cluster-tls-config\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:18:16.877908 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:16.877721    4060 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b2c848d9-2add-4fde-8575-85ee3a22a1ae-web-config\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:18:16.877908 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:16.877730    4060 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b2c848d9-2add-4fde-8575-85ee3a22a1ae-tls-assets\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:18:16.877908 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:16.877739    4060 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qnqjk\" (UniqueName: \"kubernetes.io/projected/b2c848d9-2add-4fde-8575-85ee3a22a1ae-kube-api-access-qnqjk\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:18:16.877908 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:16.877749    4060 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b2c848d9-2add-4fde-8575-85ee3a22a1ae-config-volume\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:18:16.932263 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:16.932235    4060 generic.go:356] "Generic (PLEG): container finished" podID="b2c848d9-2add-4fde-8575-85ee3a22a1ae" containerID="43bff33733df7bfc6815aac83720e28e2f35192df77a3aa4b37139fe9496f9f9" exitCode=0
Oct 30 21:18:16.932390 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:16.932274    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0" event={"ID":"b2c848d9-2add-4fde-8575-85ee3a22a1ae","Type":"ContainerDied","Data":"43bff33733df7bfc6815aac83720e28e2f35192df77a3aa4b37139fe9496f9f9"}
Oct 30 21:18:16.932390 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:16.932294    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:18:16.932390 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:16.932324    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0" event={"ID":"b2c848d9-2add-4fde-8575-85ee3a22a1ae","Type":"ContainerDied","Data":"da0af607e990ea31b5cc6c2bfa12e2b8235d8f0c95e2ce4affb7243381edc672"}
Oct 30 21:18:16.932390 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:16.932349    4060 scope.go:122] "RemoveContainer" containerID="1e63113e2e7320e307ed2b1e4c9c25aefabf40cb29f551014df24c7fb19c0a5c"
Oct 30 21:18:16.940632 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:16.940615    4060 scope.go:122] "RemoveContainer" containerID="43bff33733df7bfc6815aac83720e28e2f35192df77a3aa4b37139fe9496f9f9"
Oct 30 21:18:16.950869 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:16.950847    4060 scope.go:122] "RemoveContainer" containerID="7cb7950855de335aeb14f1342b34b21a84e791c5bea04a8d31e48e1bd3be9b8f"
Oct 30 21:18:16.959036 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:16.959010    4060 scope.go:122] "RemoveContainer" containerID="1e63113e2e7320e307ed2b1e4c9c25aefabf40cb29f551014df24c7fb19c0a5c"
Oct 30 21:18:16.959298 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:18:16.959282    4060 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1e63113e2e7320e307ed2b1e4c9c25aefabf40cb29f551014df24c7fb19c0a5c\": container with ID starting with 1e63113e2e7320e307ed2b1e4c9c25aefabf40cb29f551014df24c7fb19c0a5c not found: ID does not exist" containerID="1e63113e2e7320e307ed2b1e4c9c25aefabf40cb29f551014df24c7fb19c0a5c"
Oct 30 21:18:16.959341 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:16.959311    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1e63113e2e7320e307ed2b1e4c9c25aefabf40cb29f551014df24c7fb19c0a5c"} err="failed to get container status \"1e63113e2e7320e307ed2b1e4c9c25aefabf40cb29f551014df24c7fb19c0a5c\": rpc error: code = NotFound desc = could not find container \"1e63113e2e7320e307ed2b1e4c9c25aefabf40cb29f551014df24c7fb19c0a5c\": container with ID starting with 1e63113e2e7320e307ed2b1e4c9c25aefabf40cb29f551014df24c7fb19c0a5c not found: ID does not exist"
Oct 30 21:18:16.959341 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:16.959328    4060 scope.go:122] "RemoveContainer" containerID="43bff33733df7bfc6815aac83720e28e2f35192df77a3aa4b37139fe9496f9f9"
Oct 30 21:18:16.959570 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:18:16.959552    4060 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"43bff33733df7bfc6815aac83720e28e2f35192df77a3aa4b37139fe9496f9f9\": container with ID starting with 43bff33733df7bfc6815aac83720e28e2f35192df77a3aa4b37139fe9496f9f9 not found: ID does not exist" containerID="43bff33733df7bfc6815aac83720e28e2f35192df77a3aa4b37139fe9496f9f9"
Oct 30 21:18:16.959666 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:16.959571    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"43bff33733df7bfc6815aac83720e28e2f35192df77a3aa4b37139fe9496f9f9"} err="failed to get container status \"43bff33733df7bfc6815aac83720e28e2f35192df77a3aa4b37139fe9496f9f9\": rpc error: code = NotFound desc = could not find container \"43bff33733df7bfc6815aac83720e28e2f35192df77a3aa4b37139fe9496f9f9\": container with ID starting with 43bff33733df7bfc6815aac83720e28e2f35192df77a3aa4b37139fe9496f9f9 not found: ID does not exist"
Oct 30 21:18:16.959666 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:16.959591    4060 scope.go:122] "RemoveContainer" containerID="7cb7950855de335aeb14f1342b34b21a84e791c5bea04a8d31e48e1bd3be9b8f"
Oct 30 21:18:16.959835 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:18:16.959820    4060 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7cb7950855de335aeb14f1342b34b21a84e791c5bea04a8d31e48e1bd3be9b8f\": container with ID starting with 7cb7950855de335aeb14f1342b34b21a84e791c5bea04a8d31e48e1bd3be9b8f not found: ID does not exist" containerID="7cb7950855de335aeb14f1342b34b21a84e791c5bea04a8d31e48e1bd3be9b8f"
Oct 30 21:18:16.959872 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:16.959846    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7cb7950855de335aeb14f1342b34b21a84e791c5bea04a8d31e48e1bd3be9b8f"} err="failed to get container status \"7cb7950855de335aeb14f1342b34b21a84e791c5bea04a8d31e48e1bd3be9b8f\": rpc error: code = NotFound desc = could not find container \"7cb7950855de335aeb14f1342b34b21a84e791c5bea04a8d31e48e1bd3be9b8f\": container with ID starting with 7cb7950855de335aeb14f1342b34b21a84e791c5bea04a8d31e48e1bd3be9b8f not found: ID does not exist"
Oct 30 21:18:17.096662 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:17.096583    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"]
Oct 30 21:18:17.100896 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:17.100870    4060 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"]
Oct 30 21:18:17.426658 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:17.426628    4060 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b2c848d9-2add-4fde-8575-85ee3a22a1ae" path="/var/lib/kubelet/pods/b2c848d9-2add-4fde-8575-85ee3a22a1ae/volumes"
Oct 30 21:18:18.108618 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:18.108580    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:18:18.109149 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:18.108882    4060 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-collector-0" podUID="9c1866ce-acd4-4c40-aa47-4ec96b029d07" containerName="otc-container" containerID="cri-o://5a3ac09300438902890fff45a31b8b62a1faf2b21ba7e3382e2c5049acab720f" gracePeriod=30
Oct 30 21:18:18.365013 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:18.364950    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:18:18.493913 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:18.493880    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9c1866ce-acd4-4c40-aa47-4ec96b029d07-kube-api-access-lhn4d\" (UniqueName: \"kubernetes.io/projected/9c1866ce-acd4-4c40-aa47-4ec96b029d07-kube-api-access-lhn4d\") pod \"9c1866ce-acd4-4c40-aa47-4ec96b029d07\" (UID: \"9c1866ce-acd4-4c40-aa47-4ec96b029d07\") "
Oct 30 21:18:18.494178 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:18.494149    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/9c1866ce-acd4-4c40-aa47-4ec96b029d07-tls-certs\" (UniqueName: \"kubernetes.io/secret/9c1866ce-acd4-4c40-aa47-4ec96b029d07-tls-certs\") pod \"9c1866ce-acd4-4c40-aa47-4ec96b029d07\" (UID: \"9c1866ce-acd4-4c40-aa47-4ec96b029d07\") "
Oct 30 21:18:18.494281 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:18.494192    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/9c1866ce-acd4-4c40-aa47-4ec96b029d07-monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/9c1866ce-acd4-4c40-aa47-4ec96b029d07-monitoring-tls-certs\") pod \"9c1866ce-acd4-4c40-aa47-4ec96b029d07\" (UID: \"9c1866ce-acd4-4c40-aa47-4ec96b029d07\") "
Oct 30 21:18:18.494281 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:18.494239    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9c1866ce-acd4-4c40-aa47-4ec96b029d07-otc-internal\" (UniqueName: \"kubernetes.io/configmap/9c1866ce-acd4-4c40-aa47-4ec96b029d07-otc-internal\") pod \"9c1866ce-acd4-4c40-aa47-4ec96b029d07\" (UID: \"9c1866ce-acd4-4c40-aa47-4ec96b029d07\") "
Oct 30 21:18:18.494281 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:18.494270    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/9c1866ce-acd4-4c40-aa47-4ec96b029d07-otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/9c1866ce-acd4-4c40-aa47-4ec96b029d07-otlp-tls-certs\") pod \"9c1866ce-acd4-4c40-aa47-4ec96b029d07\" (UID: \"9c1866ce-acd4-4c40-aa47-4ec96b029d07\") "
Oct 30 21:18:18.494465 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:18.494343    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/9c1866ce-acd4-4c40-aa47-4ec96b029d07-data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/9c1866ce-acd4-4c40-aa47-4ec96b029d07-data-science-collector-ta-client-cert\") pod \"9c1866ce-acd4-4c40-aa47-4ec96b029d07\" (UID: \"9c1866ce-acd4-4c40-aa47-4ec96b029d07\") "
Oct 30 21:18:18.495015 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:18.494971    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9c1866ce-acd4-4c40-aa47-4ec96b029d07-otc-internal" pod "9c1866ce-acd4-4c40-aa47-4ec96b029d07" (UID: "9c1866ce-acd4-4c40-aa47-4ec96b029d07"). InnerVolumeSpecName "otc-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:18:18.496741 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:18.496700    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9c1866ce-acd4-4c40-aa47-4ec96b029d07-kube-api-access-lhn4d" pod "9c1866ce-acd4-4c40-aa47-4ec96b029d07" (UID: "9c1866ce-acd4-4c40-aa47-4ec96b029d07"). InnerVolumeSpecName "kube-api-access-lhn4d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:18:18.497889 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:18.497844    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9c1866ce-acd4-4c40-aa47-4ec96b029d07-tls-certs" pod "9c1866ce-acd4-4c40-aa47-4ec96b029d07" (UID: "9c1866ce-acd4-4c40-aa47-4ec96b029d07"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:18:18.498114 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:18.498080    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9c1866ce-acd4-4c40-aa47-4ec96b029d07-data-science-collector-ta-client-cert" pod "9c1866ce-acd4-4c40-aa47-4ec96b029d07" (UID: "9c1866ce-acd4-4c40-aa47-4ec96b029d07"). InnerVolumeSpecName "data-science-collector-ta-client-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:18:18.498337 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:18.498309    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9c1866ce-acd4-4c40-aa47-4ec96b029d07-otlp-tls-certs" pod "9c1866ce-acd4-4c40-aa47-4ec96b029d07" (UID: "9c1866ce-acd4-4c40-aa47-4ec96b029d07"). InnerVolumeSpecName "otlp-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:18:18.498950 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:18.498930    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9c1866ce-acd4-4c40-aa47-4ec96b029d07-monitoring-tls-certs" pod "9c1866ce-acd4-4c40-aa47-4ec96b029d07" (UID: "9c1866ce-acd4-4c40-aa47-4ec96b029d07"). InnerVolumeSpecName "monitoring-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:18:18.595425 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:18.595395    4060 reconciler_common.go:299] "Volume detached for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/9c1866ce-acd4-4c40-aa47-4ec96b029d07-otc-internal\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:18:18.595425 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:18.595424    4060 reconciler_common.go:299] "Volume detached for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/9c1866ce-acd4-4c40-aa47-4ec96b029d07-otlp-tls-certs\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:18:18.595689 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:18.595435    4060 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/9c1866ce-acd4-4c40-aa47-4ec96b029d07-data-science-collector-ta-client-cert\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:18:18.595689 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:18.595445    4060 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lhn4d\" (UniqueName: \"kubernetes.io/projected/9c1866ce-acd4-4c40-aa47-4ec96b029d07-kube-api-access-lhn4d\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:18:18.595689 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:18.595455    4060 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9c1866ce-acd4-4c40-aa47-4ec96b029d07-tls-certs\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:18:18.595689 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:18.595464    4060 reconciler_common.go:299] "Volume detached for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/9c1866ce-acd4-4c40-aa47-4ec96b029d07-monitoring-tls-certs\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:18:18.944671 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:18.944633    4060 generic.go:356] "Generic (PLEG): container finished" podID="9c1866ce-acd4-4c40-aa47-4ec96b029d07" containerID="5a3ac09300438902890fff45a31b8b62a1faf2b21ba7e3382e2c5049acab720f" exitCode=0
Oct 30 21:18:18.944859 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:18.944687    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:18:18.944859 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:18.944718    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"9c1866ce-acd4-4c40-aa47-4ec96b029d07","Type":"ContainerDied","Data":"5a3ac09300438902890fff45a31b8b62a1faf2b21ba7e3382e2c5049acab720f"}
Oct 30 21:18:18.944859 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:18.944776    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"9c1866ce-acd4-4c40-aa47-4ec96b029d07","Type":"ContainerDied","Data":"195ec2a7d46e936d19b5ba03c71919e0137b293156bec654588b42dee1cfe85d"}
Oct 30 21:18:18.944859 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:18.944800    4060 scope.go:122] "RemoveContainer" containerID="5a3ac09300438902890fff45a31b8b62a1faf2b21ba7e3382e2c5049acab720f"
Oct 30 21:18:18.953715 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:18.953699    4060 scope.go:122] "RemoveContainer" containerID="5a3ac09300438902890fff45a31b8b62a1faf2b21ba7e3382e2c5049acab720f"
Oct 30 21:18:18.953991 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:18:18.953974    4060 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5a3ac09300438902890fff45a31b8b62a1faf2b21ba7e3382e2c5049acab720f\": container with ID starting with 5a3ac09300438902890fff45a31b8b62a1faf2b21ba7e3382e2c5049acab720f not found: ID does not exist" containerID="5a3ac09300438902890fff45a31b8b62a1faf2b21ba7e3382e2c5049acab720f"
Oct 30 21:18:18.954045 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:18.954002    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5a3ac09300438902890fff45a31b8b62a1faf2b21ba7e3382e2c5049acab720f"} err="failed to get container status \"5a3ac09300438902890fff45a31b8b62a1faf2b21ba7e3382e2c5049acab720f\": rpc error: code = NotFound desc = could not find container \"5a3ac09300438902890fff45a31b8b62a1faf2b21ba7e3382e2c5049acab720f\": container with ID starting with 5a3ac09300438902890fff45a31b8b62a1faf2b21ba7e3382e2c5049acab720f not found: ID does not exist"
Oct 30 21:18:19.108615 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:19.108575    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:18:19.112565 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:19.112536    4060 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:18:19.426961 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:19.426928    4060 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9c1866ce-acd4-4c40-aa47-4ec96b029d07" path="/var/lib/kubelet/pods/9c1866ce-acd4-4c40-aa47-4ec96b029d07/volumes"
Oct 30 21:18:26.391352 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:26.391315    4060 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/korrel8r-6644769df5-v8pwt"]
Oct 30 21:18:26.391754 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:26.391603    4060 cpu_manager.go:414] "containerMap: removing container" podUID="b2c848d9-2add-4fde-8575-85ee3a22a1ae" containerName="alertmanager"
Oct 30 21:18:26.391754 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:26.391613    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b2c848d9-2add-4fde-8575-85ee3a22a1ae" containerName="alertmanager"
Oct 30 21:18:26.391754 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:26.391625    4060 cpu_manager.go:414] "containerMap: removing container" podUID="9c1866ce-acd4-4c40-aa47-4ec96b029d07" containerName="otc-container"
Oct 30 21:18:26.391754 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:26.391630    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9c1866ce-acd4-4c40-aa47-4ec96b029d07" containerName="otc-container"
Oct 30 21:18:26.391754 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:26.391640    4060 cpu_manager.go:414] "containerMap: removing container" podUID="dc2a888c-b107-4cc7-823f-51bda67f9992" containerName="korrel8r"
Oct 30 21:18:26.391754 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:26.391644    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="dc2a888c-b107-4cc7-823f-51bda67f9992" containerName="korrel8r"
Oct 30 21:18:26.391754 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:26.391661    4060 cpu_manager.go:414] "containerMap: removing container" podUID="b2c848d9-2add-4fde-8575-85ee3a22a1ae" containerName="config-reloader"
Oct 30 21:18:26.391754 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:26.391665    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b2c848d9-2add-4fde-8575-85ee3a22a1ae" containerName="config-reloader"
Oct 30 21:18:26.391754 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:26.391673    4060 cpu_manager.go:414] "containerMap: removing container" podUID="9ed8e0b4-0888-43d8-bae7-a7a201130785" containerName="kube-rbac-proxy"
Oct 30 21:18:26.391754 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:26.391677    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9ed8e0b4-0888-43d8-bae7-a7a201130785" containerName="kube-rbac-proxy"
Oct 30 21:18:26.391754 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:26.391682    4060 cpu_manager.go:414] "containerMap: removing container" podUID="64ead62d-5a92-4824-8389-dd242e54e2a2" containerName="curl"
Oct 30 21:18:26.391754 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:26.391686    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="64ead62d-5a92-4824-8389-dd242e54e2a2" containerName="curl"
Oct 30 21:18:26.391754 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:26.391694    4060 cpu_manager.go:414] "containerMap: removing container" podUID="b2c848d9-2add-4fde-8575-85ee3a22a1ae" containerName="init-config-reloader"
Oct 30 21:18:26.391754 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:26.391701    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b2c848d9-2add-4fde-8575-85ee3a22a1ae" containerName="init-config-reloader"
Oct 30 21:18:26.391754 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:26.391750    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="b2c848d9-2add-4fde-8575-85ee3a22a1ae" containerName="config-reloader"
Oct 30 21:18:26.391754 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:26.391758    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="9ed8e0b4-0888-43d8-bae7-a7a201130785" containerName="kube-rbac-proxy"
Oct 30 21:18:26.392231 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:26.391764    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="64ead62d-5a92-4824-8389-dd242e54e2a2" containerName="curl"
Oct 30 21:18:26.392231 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:26.391772    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="b2c848d9-2add-4fde-8575-85ee3a22a1ae" containerName="alertmanager"
Oct 30 21:18:26.392231 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:26.391778    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="9c1866ce-acd4-4c40-aa47-4ec96b029d07" containerName="otc-container"
Oct 30 21:18:26.392231 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:26.391784    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="dc2a888c-b107-4cc7-823f-51bda67f9992" containerName="korrel8r"
Oct 30 21:18:26.396073 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:26.396056    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/korrel8r-6644769df5-v8pwt"
Oct 30 21:18:26.458099 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:26.458066    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/55f06620-a374-4e36-86c5-9d56804dc002-config\") pod \"korrel8r-6644769df5-v8pwt\" (UID: \"55f06620-a374-4e36-86c5-9d56804dc002\") " pod="redhat-ods-monitoring/korrel8r-6644769df5-v8pwt"
Oct 30 21:18:26.458266 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:26.458126    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/55f06620-a374-4e36-86c5-9d56804dc002-tls\") pod \"korrel8r-6644769df5-v8pwt\" (UID: \"55f06620-a374-4e36-86c5-9d56804dc002\") " pod="redhat-ods-monitoring/korrel8r-6644769df5-v8pwt"
Oct 30 21:18:26.458266 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:26.458222    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7lq62\" (UniqueName: \"kubernetes.io/projected/55f06620-a374-4e36-86c5-9d56804dc002-kube-api-access-7lq62\") pod \"korrel8r-6644769df5-v8pwt\" (UID: \"55f06620-a374-4e36-86c5-9d56804dc002\") " pod="redhat-ods-monitoring/korrel8r-6644769df5-v8pwt"
Oct 30 21:18:26.475051 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:26.475020    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"kube-root-ca.crt\""
Oct 30 21:18:26.475051 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:26.475034    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"openshift-service-ca.crt\""
Oct 30 21:18:26.475211 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:26.475020    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"korrel8r-config\""
Oct 30 21:18:26.497789 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:26.497769    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"korrel8r-dockercfg-hkq5z\""
Oct 30 21:18:26.497906 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:26.497890    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"korrel8r-tls\""
Oct 30 21:18:26.499775 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:26.499754    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/korrel8r-6644769df5-v8pwt"]
Oct 30 21:18:26.558836 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:26.558797    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/55f06620-a374-4e36-86c5-9d56804dc002-tls\") pod \"korrel8r-6644769df5-v8pwt\" (UID: \"55f06620-a374-4e36-86c5-9d56804dc002\") " pod="redhat-ods-monitoring/korrel8r-6644769df5-v8pwt"
Oct 30 21:18:26.559016 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:26.558840    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7lq62\" (UniqueName: \"kubernetes.io/projected/55f06620-a374-4e36-86c5-9d56804dc002-kube-api-access-7lq62\") pod \"korrel8r-6644769df5-v8pwt\" (UID: \"55f06620-a374-4e36-86c5-9d56804dc002\") " pod="redhat-ods-monitoring/korrel8r-6644769df5-v8pwt"
Oct 30 21:18:26.559016 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:26.558919    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/55f06620-a374-4e36-86c5-9d56804dc002-config\") pod \"korrel8r-6644769df5-v8pwt\" (UID: \"55f06620-a374-4e36-86c5-9d56804dc002\") " pod="redhat-ods-monitoring/korrel8r-6644769df5-v8pwt"
Oct 30 21:18:26.559677 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:26.559653    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/55f06620-a374-4e36-86c5-9d56804dc002-config\") pod \"korrel8r-6644769df5-v8pwt\" (UID: \"55f06620-a374-4e36-86c5-9d56804dc002\") " pod="redhat-ods-monitoring/korrel8r-6644769df5-v8pwt"
Oct 30 21:18:26.561252 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:26.561232    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls\" (UniqueName: \"kubernetes.io/secret/55f06620-a374-4e36-86c5-9d56804dc002-tls\") pod \"korrel8r-6644769df5-v8pwt\" (UID: \"55f06620-a374-4e36-86c5-9d56804dc002\") " pod="redhat-ods-monitoring/korrel8r-6644769df5-v8pwt"
Oct 30 21:18:26.620387 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:26.620351    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7lq62\" (UniqueName: \"kubernetes.io/projected/55f06620-a374-4e36-86c5-9d56804dc002-kube-api-access-7lq62\") pod \"korrel8r-6644769df5-v8pwt\" (UID: \"55f06620-a374-4e36-86c5-9d56804dc002\") " pod="redhat-ods-monitoring/korrel8r-6644769df5-v8pwt"
Oct 30 21:18:26.707795 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:26.707764    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/korrel8r-6644769df5-v8pwt"
Oct 30 21:18:27.077386 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:27.077363    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/korrel8r-6644769df5-v8pwt"]
Oct 30 21:18:27.079973 ip-10-0-142-4 kubenswrapper[4060]: W1030 21:18:27.079949    4060 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55f06620_a374_4e36_86c5_9d56804dc002.slice/crio-d495d1810627cb4e51bafa7e5a7acab78c28abc0174bda784f2e991579032cff WatchSource:0}: Error finding container d495d1810627cb4e51bafa7e5a7acab78c28abc0174bda784f2e991579032cff: Status 404 returned error can't find the container with id d495d1810627cb4e51bafa7e5a7acab78c28abc0174bda784f2e991579032cff
Oct 30 21:18:27.987500 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:27.987455    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/korrel8r-6644769df5-v8pwt" event={"ID":"55f06620-a374-4e36-86c5-9d56804dc002","Type":"ContainerStarted","Data":"5713d7c6ad58020c9cc40f3ab76e52805338747b6cd28927c4f7de51fd6e7e21"}
Oct 30 21:18:27.987949 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:27.987514    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/korrel8r-6644769df5-v8pwt" event={"ID":"55f06620-a374-4e36-86c5-9d56804dc002","Type":"ContainerStarted","Data":"d495d1810627cb4e51bafa7e5a7acab78c28abc0174bda784f2e991579032cff"}
Oct 30 21:18:27.987949 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:27.987543    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/korrel8r-6644769df5-v8pwt"
Oct 30 21:18:28.105108 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:28.105055    4060 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/korrel8r-6644769df5-v8pwt" podStartSLOduration=2.105040046 podStartE2EDuration="2.105040046s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:18:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:18:28.103527911 +0000 UTC m=+2526.860526212" watchObservedRunningTime="2026-10-30 21:18:28.105040046 +0000 UTC m=+2526.862038381"
Oct 30 21:18:28.695353 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:28.695319    4060 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:18:28.698782 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:28.698764    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:18:28.754961 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:28.754931    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-headless-tls\""
Oct 30 21:18:28.755141 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:28.754969    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-dockercfg-x5mw4\""
Oct 30 21:18:28.772089 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:28.772056    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/478ff1aa-9427-4598-a6fe-25a103bdec28-monitoring-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"478ff1aa-9427-4598-a6fe-25a103bdec28\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:18:28.772253 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:28.772098    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/478ff1aa-9427-4598-a6fe-25a103bdec28-otc-internal\") pod \"data-science-collector-collector-0\" (UID: \"478ff1aa-9427-4598-a6fe-25a103bdec28\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:18:28.772253 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:28.772114    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/478ff1aa-9427-4598-a6fe-25a103bdec28-otlp-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"478ff1aa-9427-4598-a6fe-25a103bdec28\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:18:28.772253 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:28.772189    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-96vxc\" (UniqueName: \"kubernetes.io/projected/478ff1aa-9427-4598-a6fe-25a103bdec28-kube-api-access-96vxc\") pod \"data-science-collector-collector-0\" (UID: \"478ff1aa-9427-4598-a6fe-25a103bdec28\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:18:28.804667 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:28.804626    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-monitoring-tls\""
Oct 30 21:18:28.804844 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:28.804736    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-af329f19\""
Oct 30 21:18:28.806530 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:28.806508    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:18:28.873151 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:28.873117    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/478ff1aa-9427-4598-a6fe-25a103bdec28-monitoring-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"478ff1aa-9427-4598-a6fe-25a103bdec28\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:18:28.873334 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:28.873158    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/478ff1aa-9427-4598-a6fe-25a103bdec28-otc-internal\") pod \"data-science-collector-collector-0\" (UID: \"478ff1aa-9427-4598-a6fe-25a103bdec28\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:18:28.873334 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:28.873176    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/478ff1aa-9427-4598-a6fe-25a103bdec28-otlp-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"478ff1aa-9427-4598-a6fe-25a103bdec28\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:18:28.873334 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:28.873194    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-96vxc\" (UniqueName: \"kubernetes.io/projected/478ff1aa-9427-4598-a6fe-25a103bdec28-kube-api-access-96vxc\") pod \"data-science-collector-collector-0\" (UID: \"478ff1aa-9427-4598-a6fe-25a103bdec28\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:18:28.873938 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:28.873913    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/478ff1aa-9427-4598-a6fe-25a103bdec28-otc-internal\") pod \"data-science-collector-collector-0\" (UID: \"478ff1aa-9427-4598-a6fe-25a103bdec28\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:18:28.875660 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:28.875640    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/478ff1aa-9427-4598-a6fe-25a103bdec28-otlp-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"478ff1aa-9427-4598-a6fe-25a103bdec28\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:18:28.875758 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:28.875703    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/478ff1aa-9427-4598-a6fe-25a103bdec28-monitoring-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"478ff1aa-9427-4598-a6fe-25a103bdec28\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:18:28.937591 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:28.937554    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-96vxc\" (UniqueName: \"kubernetes.io/projected/478ff1aa-9427-4598-a6fe-25a103bdec28-kube-api-access-96vxc\") pod \"data-science-collector-collector-0\" (UID: \"478ff1aa-9427-4598-a6fe-25a103bdec28\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:18:29.011406 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:29.011368    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:18:29.387178 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:29.387094    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:18:29.418720 ip-10-0-142-4 kubenswrapper[4060]: W1030 21:18:29.418692    4060 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod478ff1aa_9427_4598_a6fe_25a103bdec28.slice/crio-ac31867fb5d8362ccd51030ad452c5445fb887c46fc745e4b43daaab74a550e0 WatchSource:0}: Error finding container ac31867fb5d8362ccd51030ad452c5445fb887c46fc745e4b43daaab74a550e0: Status 404 returned error can't find the container with id ac31867fb5d8362ccd51030ad452c5445fb887c46fc745e4b43daaab74a550e0
Oct 30 21:18:29.420982 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:29.420949    4060 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 21:18:29.421081 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:29.421011    4060 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 21:18:30.009211 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:30.009167    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"478ff1aa-9427-4598-a6fe-25a103bdec28","Type":"ContainerStarted","Data":"090d470320ebff83e4136ddffaa68e0d1cd5c2b51f8328bdf93bbad861266ab0"}
Oct 30 21:18:30.009391 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:30.009238    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"478ff1aa-9427-4598-a6fe-25a103bdec28","Type":"ContainerStarted","Data":"ac31867fb5d8362ccd51030ad452c5445fb887c46fc745e4b43daaab74a550e0"}
Oct 30 21:18:30.127670 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:30.127602    4060 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-collector-0" podStartSLOduration=2.127585226 podStartE2EDuration="2.127585226s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:18:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:18:30.126581979 +0000 UTC m=+2528.883580276" watchObservedRunningTime="2026-10-30 21:18:30.127585226 +0000 UTC m=+2528.884583523"
Oct 30 21:18:39.002690 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:18:39.002659    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/korrel8r-6644769df5-v8pwt"
Oct 30 21:18:42.150399 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:18:42.150362    4060 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v2f4x" containerName="extractor"
Oct 30 21:19:12.150160 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:19:12.150084    4060 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v2f4x" containerName="extractor"
Oct 30 21:19:20.827844 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:19:20.827806    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/korrel8r-6644769df5-v8pwt"]
Oct 30 21:19:20.828332 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:19:20.828035    4060 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/korrel8r-6644769df5-v8pwt" podUID="55f06620-a374-4e36-86c5-9d56804dc002" containerName="korrel8r" containerID="cri-o://5713d7c6ad58020c9cc40f3ab76e52805338747b6cd28927c4f7de51fd6e7e21" gracePeriod=30
Oct 30 21:19:21.067995 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:19:21.067971    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/korrel8r-6644769df5-v8pwt"
Oct 30 21:19:21.107161 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:19:21.107093    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/55f06620-a374-4e36-86c5-9d56804dc002-tls\" (UniqueName: \"kubernetes.io/secret/55f06620-a374-4e36-86c5-9d56804dc002-tls\") pod \"55f06620-a374-4e36-86c5-9d56804dc002\" (UID: \"55f06620-a374-4e36-86c5-9d56804dc002\") "
Oct 30 21:19:21.107161 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:19:21.107137    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/55f06620-a374-4e36-86c5-9d56804dc002-kube-api-access-7lq62\" (UniqueName: \"kubernetes.io/projected/55f06620-a374-4e36-86c5-9d56804dc002-kube-api-access-7lq62\") pod \"55f06620-a374-4e36-86c5-9d56804dc002\" (UID: \"55f06620-a374-4e36-86c5-9d56804dc002\") "
Oct 30 21:19:21.107359 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:19:21.107316    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/55f06620-a374-4e36-86c5-9d56804dc002-config\" (UniqueName: \"kubernetes.io/configmap/55f06620-a374-4e36-86c5-9d56804dc002-config\") pod \"55f06620-a374-4e36-86c5-9d56804dc002\" (UID: \"55f06620-a374-4e36-86c5-9d56804dc002\") "
Oct 30 21:19:21.107710 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:19:21.107676    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/55f06620-a374-4e36-86c5-9d56804dc002-config" pod "55f06620-a374-4e36-86c5-9d56804dc002" (UID: "55f06620-a374-4e36-86c5-9d56804dc002"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:19:21.109118 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:19:21.109095    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/55f06620-a374-4e36-86c5-9d56804dc002-kube-api-access-7lq62" pod "55f06620-a374-4e36-86c5-9d56804dc002" (UID: "55f06620-a374-4e36-86c5-9d56804dc002"). InnerVolumeSpecName "kube-api-access-7lq62". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:19:21.109118 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:19:21.109112    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/55f06620-a374-4e36-86c5-9d56804dc002-tls" pod "55f06620-a374-4e36-86c5-9d56804dc002" (UID: "55f06620-a374-4e36-86c5-9d56804dc002"). InnerVolumeSpecName "tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:19:21.207997 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:19:21.207959    4060 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/55f06620-a374-4e36-86c5-9d56804dc002-config\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:19:21.207997 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:19:21.207990    4060 reconciler_common.go:299] "Volume detached for volume \"tls\" (UniqueName: \"kubernetes.io/secret/55f06620-a374-4e36-86c5-9d56804dc002-tls\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:19:21.208192 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:19:21.208004    4060 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7lq62\" (UniqueName: \"kubernetes.io/projected/55f06620-a374-4e36-86c5-9d56804dc002-kube-api-access-7lq62\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:19:21.240408 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:19:21.240377    4060 generic.go:356] "Generic (PLEG): container finished" podID="55f06620-a374-4e36-86c5-9d56804dc002" containerID="5713d7c6ad58020c9cc40f3ab76e52805338747b6cd28927c4f7de51fd6e7e21" exitCode=0
Oct 30 21:19:21.240571 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:19:21.240431    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/korrel8r-6644769df5-v8pwt"
Oct 30 21:19:21.240571 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:19:21.240461    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/korrel8r-6644769df5-v8pwt" event={"ID":"55f06620-a374-4e36-86c5-9d56804dc002","Type":"ContainerDied","Data":"5713d7c6ad58020c9cc40f3ab76e52805338747b6cd28927c4f7de51fd6e7e21"}
Oct 30 21:19:21.240571 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:19:21.240543    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/korrel8r-6644769df5-v8pwt" event={"ID":"55f06620-a374-4e36-86c5-9d56804dc002","Type":"ContainerDied","Data":"d495d1810627cb4e51bafa7e5a7acab78c28abc0174bda784f2e991579032cff"}
Oct 30 21:19:21.240683 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:19:21.240580    4060 scope.go:122] "RemoveContainer" containerID="5713d7c6ad58020c9cc40f3ab76e52805338747b6cd28927c4f7de51fd6e7e21"
Oct 30 21:19:21.249128 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:19:21.249109    4060 scope.go:122] "RemoveContainer" containerID="5713d7c6ad58020c9cc40f3ab76e52805338747b6cd28927c4f7de51fd6e7e21"
Oct 30 21:19:21.249383 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:19:21.249367    4060 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5713d7c6ad58020c9cc40f3ab76e52805338747b6cd28927c4f7de51fd6e7e21\": container with ID starting with 5713d7c6ad58020c9cc40f3ab76e52805338747b6cd28927c4f7de51fd6e7e21 not found: ID does not exist" containerID="5713d7c6ad58020c9cc40f3ab76e52805338747b6cd28927c4f7de51fd6e7e21"
Oct 30 21:19:21.249443 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:19:21.249392    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5713d7c6ad58020c9cc40f3ab76e52805338747b6cd28927c4f7de51fd6e7e21"} err="failed to get container status \"5713d7c6ad58020c9cc40f3ab76e52805338747b6cd28927c4f7de51fd6e7e21\": rpc error: code = NotFound desc = could not find container \"5713d7c6ad58020c9cc40f3ab76e52805338747b6cd28927c4f7de51fd6e7e21\": container with ID starting with 5713d7c6ad58020c9cc40f3ab76e52805338747b6cd28927c4f7de51fd6e7e21 not found: ID does not exist"
Oct 30 21:19:21.404253 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:19:21.404179    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/korrel8r-6644769df5-v8pwt"]
Oct 30 21:19:21.408800 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:19:21.408774    4060 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/korrel8r-6644769df5-v8pwt"]
Oct 30 21:19:21.426622 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:19:21.426595    4060 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="55f06620-a374-4e36-86c5-9d56804dc002" path="/var/lib/kubelet/pods/55f06620-a374-4e36-86c5-9d56804dc002/volumes"
Oct 30 21:19:22.194728 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:19:22.194638    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:19:22.195528 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:19:22.195466    4060 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-collector-0" podUID="478ff1aa-9427-4598-a6fe-25a103bdec28" containerName="otc-container" containerID="cri-o://090d470320ebff83e4136ddffaa68e0d1cd5c2b51f8328bdf93bbad861266ab0" gracePeriod=30
Oct 30 21:19:22.443503 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:19:22.443474    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:19:22.617711 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:19:22.617684    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/478ff1aa-9427-4598-a6fe-25a103bdec28-otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/478ff1aa-9427-4598-a6fe-25a103bdec28-otlp-tls-certs\") pod \"478ff1aa-9427-4598-a6fe-25a103bdec28\" (UID: \"478ff1aa-9427-4598-a6fe-25a103bdec28\") "
Oct 30 21:19:22.617905 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:19:22.617726    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/478ff1aa-9427-4598-a6fe-25a103bdec28-monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/478ff1aa-9427-4598-a6fe-25a103bdec28-monitoring-tls-certs\") pod \"478ff1aa-9427-4598-a6fe-25a103bdec28\" (UID: \"478ff1aa-9427-4598-a6fe-25a103bdec28\") "
Oct 30 21:19:22.617905 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:19:22.617776    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/478ff1aa-9427-4598-a6fe-25a103bdec28-otc-internal\" (UniqueName: \"kubernetes.io/configmap/478ff1aa-9427-4598-a6fe-25a103bdec28-otc-internal\") pod \"478ff1aa-9427-4598-a6fe-25a103bdec28\" (UID: \"478ff1aa-9427-4598-a6fe-25a103bdec28\") "
Oct 30 21:19:22.617905 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:19:22.617831    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/478ff1aa-9427-4598-a6fe-25a103bdec28-kube-api-access-96vxc\" (UniqueName: \"kubernetes.io/projected/478ff1aa-9427-4598-a6fe-25a103bdec28-kube-api-access-96vxc\") pod \"478ff1aa-9427-4598-a6fe-25a103bdec28\" (UID: \"478ff1aa-9427-4598-a6fe-25a103bdec28\") "
Oct 30 21:19:22.618093 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:19:22.618028    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/478ff1aa-9427-4598-a6fe-25a103bdec28-otc-internal" pod "478ff1aa-9427-4598-a6fe-25a103bdec28" (UID: "478ff1aa-9427-4598-a6fe-25a103bdec28"). InnerVolumeSpecName "otc-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:19:22.619697 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:19:22.619672    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/478ff1aa-9427-4598-a6fe-25a103bdec28-otlp-tls-certs" pod "478ff1aa-9427-4598-a6fe-25a103bdec28" (UID: "478ff1aa-9427-4598-a6fe-25a103bdec28"). InnerVolumeSpecName "otlp-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:19:22.619818 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:19:22.619734    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/478ff1aa-9427-4598-a6fe-25a103bdec28-kube-api-access-96vxc" pod "478ff1aa-9427-4598-a6fe-25a103bdec28" (UID: "478ff1aa-9427-4598-a6fe-25a103bdec28"). InnerVolumeSpecName "kube-api-access-96vxc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:19:22.619818 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:19:22.619774    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/478ff1aa-9427-4598-a6fe-25a103bdec28-monitoring-tls-certs" pod "478ff1aa-9427-4598-a6fe-25a103bdec28" (UID: "478ff1aa-9427-4598-a6fe-25a103bdec28"). InnerVolumeSpecName "monitoring-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:19:22.718816 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:19:22.718771    4060 reconciler_common.go:299] "Volume detached for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/478ff1aa-9427-4598-a6fe-25a103bdec28-otlp-tls-certs\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:19:22.718816 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:19:22.718811    4060 reconciler_common.go:299] "Volume detached for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/478ff1aa-9427-4598-a6fe-25a103bdec28-monitoring-tls-certs\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:19:22.718816 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:19:22.718824    4060 reconciler_common.go:299] "Volume detached for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/478ff1aa-9427-4598-a6fe-25a103bdec28-otc-internal\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:19:22.719037 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:19:22.718837    4060 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-96vxc\" (UniqueName: \"kubernetes.io/projected/478ff1aa-9427-4598-a6fe-25a103bdec28-kube-api-access-96vxc\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:19:23.250314 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:19:23.250276    4060 generic.go:356] "Generic (PLEG): container finished" podID="478ff1aa-9427-4598-a6fe-25a103bdec28" containerID="090d470320ebff83e4136ddffaa68e0d1cd5c2b51f8328bdf93bbad861266ab0" exitCode=0
Oct 30 21:19:23.250772 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:19:23.250336    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:19:23.250772 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:19:23.250364    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"478ff1aa-9427-4598-a6fe-25a103bdec28","Type":"ContainerDied","Data":"090d470320ebff83e4136ddffaa68e0d1cd5c2b51f8328bdf93bbad861266ab0"}
Oct 30 21:19:23.250772 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:19:23.250442    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"478ff1aa-9427-4598-a6fe-25a103bdec28","Type":"ContainerDied","Data":"ac31867fb5d8362ccd51030ad452c5445fb887c46fc745e4b43daaab74a550e0"}
Oct 30 21:19:23.250772 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:19:23.250466    4060 scope.go:122] "RemoveContainer" containerID="090d470320ebff83e4136ddffaa68e0d1cd5c2b51f8328bdf93bbad861266ab0"
Oct 30 21:19:23.259535 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:19:23.259520    4060 scope.go:122] "RemoveContainer" containerID="090d470320ebff83e4136ddffaa68e0d1cd5c2b51f8328bdf93bbad861266ab0"
Oct 30 21:19:23.259798 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:19:23.259780    4060 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"090d470320ebff83e4136ddffaa68e0d1cd5c2b51f8328bdf93bbad861266ab0\": container with ID starting with 090d470320ebff83e4136ddffaa68e0d1cd5c2b51f8328bdf93bbad861266ab0 not found: ID does not exist" containerID="090d470320ebff83e4136ddffaa68e0d1cd5c2b51f8328bdf93bbad861266ab0"
Oct 30 21:19:23.259849 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:19:23.259808    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"090d470320ebff83e4136ddffaa68e0d1cd5c2b51f8328bdf93bbad861266ab0"} err="failed to get container status \"090d470320ebff83e4136ddffaa68e0d1cd5c2b51f8328bdf93bbad861266ab0\": rpc error: code = NotFound desc = could not find container \"090d470320ebff83e4136ddffaa68e0d1cd5c2b51f8328bdf93bbad861266ab0\": container with ID starting with 090d470320ebff83e4136ddffaa68e0d1cd5c2b51f8328bdf93bbad861266ab0 not found: ID does not exist"
Oct 30 21:19:23.414170 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:19:23.414136    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:19:23.417981 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:19:23.417956    4060 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:19:23.426855 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:19:23.426827    4060 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="478ff1aa-9427-4598-a6fe-25a103bdec28" path="/var/lib/kubelet/pods/478ff1aa-9427-4598-a6fe-25a103bdec28/volumes"
Oct 30 21:19:28.725452 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:19:28.725417    4060 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/korrel8r-6644769df5-lcvvq"]
Oct 30 21:19:28.726081 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:19:28.725741    4060 cpu_manager.go:414] "containerMap: removing container" podUID="478ff1aa-9427-4598-a6fe-25a103bdec28" containerName="otc-container"
Oct 30 21:19:28.726081 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:19:28.725752    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="478ff1aa-9427-4598-a6fe-25a103bdec28" containerName="otc-container"
Oct 30 21:19:28.726081 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:19:28.725779    4060 cpu_manager.go:414] "containerMap: removing container" podUID="55f06620-a374-4e36-86c5-9d56804dc002" containerName="korrel8r"
Oct 30 21:19:28.726081 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:19:28.725784    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="55f06620-a374-4e36-86c5-9d56804dc002" containerName="korrel8r"
Oct 30 21:19:28.726081 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:19:28.725833    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="478ff1aa-9427-4598-a6fe-25a103bdec28" containerName="otc-container"
Oct 30 21:19:28.726081 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:19:28.725844    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="55f06620-a374-4e36-86c5-9d56804dc002" containerName="korrel8r"
Oct 30 21:19:28.729972 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:19:28.729953    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/korrel8r-6644769df5-lcvvq"
Oct 30 21:19:28.759254 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:19:28.759228    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bc44870c-74df-426c-9fab-eccfd4d78653-config\") pod \"korrel8r-6644769df5-lcvvq\" (UID: \"bc44870c-74df-426c-9fab-eccfd4d78653\") " pod="redhat-ods-monitoring/korrel8r-6644769df5-lcvvq"
Oct 30 21:19:28.759364 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:19:28.759271    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/bc44870c-74df-426c-9fab-eccfd4d78653-tls\") pod \"korrel8r-6644769df5-lcvvq\" (UID: \"bc44870c-74df-426c-9fab-eccfd4d78653\") " pod="redhat-ods-monitoring/korrel8r-6644769df5-lcvvq"
Oct 30 21:19:28.759364 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:19:28.759287    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q2cn8\" (UniqueName: \"kubernetes.io/projected/bc44870c-74df-426c-9fab-eccfd4d78653-kube-api-access-q2cn8\") pod \"korrel8r-6644769df5-lcvvq\" (UID: \"bc44870c-74df-426c-9fab-eccfd4d78653\") " pod="redhat-ods-monitoring/korrel8r-6644769df5-lcvvq"
Oct 30 21:19:28.832967 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:19:28.832939    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"korrel8r-tls\""
Oct 30 21:19:28.832967 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:19:28.832969    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"openshift-service-ca.crt\""
Oct 30 21:19:28.832967 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:19:28.832968    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"kube-root-ca.crt\""
Oct 30 21:19:28.833204 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:19:28.832986    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"korrel8r-dockercfg-4gw2k\""
Oct 30 21:19:28.835613 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:19:28.835588    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"korrel8r-config\""
Oct 30 21:19:28.837302 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:19:28.837284    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/korrel8r-6644769df5-lcvvq"]
Oct 30 21:19:28.860131 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:19:28.860108    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bc44870c-74df-426c-9fab-eccfd4d78653-config\") pod \"korrel8r-6644769df5-lcvvq\" (UID: \"bc44870c-74df-426c-9fab-eccfd4d78653\") " pod="redhat-ods-monitoring/korrel8r-6644769df5-lcvvq"
Oct 30 21:19:28.860244 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:19:28.860156    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/bc44870c-74df-426c-9fab-eccfd4d78653-tls\") pod \"korrel8r-6644769df5-lcvvq\" (UID: \"bc44870c-74df-426c-9fab-eccfd4d78653\") " pod="redhat-ods-monitoring/korrel8r-6644769df5-lcvvq"
Oct 30 21:19:28.860244 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:19:28.860174    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q2cn8\" (UniqueName: \"kubernetes.io/projected/bc44870c-74df-426c-9fab-eccfd4d78653-kube-api-access-q2cn8\") pod \"korrel8r-6644769df5-lcvvq\" (UID: \"bc44870c-74df-426c-9fab-eccfd4d78653\") " pod="redhat-ods-monitoring/korrel8r-6644769df5-lcvvq"
Oct 30 21:19:28.860945 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:19:28.860923    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bc44870c-74df-426c-9fab-eccfd4d78653-config\") pod \"korrel8r-6644769df5-lcvvq\" (UID: \"bc44870c-74df-426c-9fab-eccfd4d78653\") " pod="redhat-ods-monitoring/korrel8r-6644769df5-lcvvq"
Oct 30 21:19:28.862626 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:19:28.862604    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls\" (UniqueName: \"kubernetes.io/secret/bc44870c-74df-426c-9fab-eccfd4d78653-tls\") pod \"korrel8r-6644769df5-lcvvq\" (UID: \"bc44870c-74df-426c-9fab-eccfd4d78653\") " pod="redhat-ods-monitoring/korrel8r-6644769df5-lcvvq"
Oct 30 21:19:28.921107 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:19:28.921078    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q2cn8\" (UniqueName: \"kubernetes.io/projected/bc44870c-74df-426c-9fab-eccfd4d78653-kube-api-access-q2cn8\") pod \"korrel8r-6644769df5-lcvvq\" (UID: \"bc44870c-74df-426c-9fab-eccfd4d78653\") " pod="redhat-ods-monitoring/korrel8r-6644769df5-lcvvq"
Oct 30 21:19:29.041751 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:19:29.041678    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/korrel8r-6644769df5-lcvvq"
Oct 30 21:19:29.418742 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:19:29.418714    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/korrel8r-6644769df5-lcvvq"]
Oct 30 21:19:29.420198 ip-10-0-142-4 kubenswrapper[4060]: W1030 21:19:29.420164    4060 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc44870c_74df_426c_9fab_eccfd4d78653.slice/crio-d8ad62e655f43e4e16c154adae6dce90eeaf387a56c0bba2dbf6e4e960ff2ed8 WatchSource:0}: Error finding container d8ad62e655f43e4e16c154adae6dce90eeaf387a56c0bba2dbf6e4e960ff2ed8: Status 404 returned error can't find the container with id d8ad62e655f43e4e16c154adae6dce90eeaf387a56c0bba2dbf6e4e960ff2ed8
Oct 30 21:19:30.284230 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:19:30.284196    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/korrel8r-6644769df5-lcvvq" event={"ID":"bc44870c-74df-426c-9fab-eccfd4d78653","Type":"ContainerStarted","Data":"412ae823b60cfd7d5d7a789c45377bb51f9631a6d226406997784828d9d07020"}
Oct 30 21:19:30.284663 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:19:30.284249    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/korrel8r-6644769df5-lcvvq" event={"ID":"bc44870c-74df-426c-9fab-eccfd4d78653","Type":"ContainerStarted","Data":"d8ad62e655f43e4e16c154adae6dce90eeaf387a56c0bba2dbf6e4e960ff2ed8"}
Oct 30 21:19:30.284663 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:19:30.284289    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/korrel8r-6644769df5-lcvvq"
Oct 30 21:19:30.400382 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:19:30.400326    4060 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/korrel8r-6644769df5-lcvvq" podStartSLOduration=2.40031234 podStartE2EDuration="2.40031234s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:19:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:19:30.399115605 +0000 UTC m=+2589.156113902" watchObservedRunningTime="2026-10-30 21:19:30.40031234 +0000 UTC m=+2589.157310638"
Oct 30 21:19:30.555272 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:19:30.555188    4060 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:19:30.559058 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:19:30.559032    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:19:30.572928 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:19:30.572900    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/81379e55-7a4e-4e52-8729-b4735b82355e-monitoring-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"81379e55-7a4e-4e52-8729-b4735b82355e\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:19:30.573049 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:19:30.572956    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/81379e55-7a4e-4e52-8729-b4735b82355e-otc-internal\") pod \"data-science-collector-collector-0\" (UID: \"81379e55-7a4e-4e52-8729-b4735b82355e\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:19:30.573049 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:19:30.573022    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/81379e55-7a4e-4e52-8729-b4735b82355e-otlp-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"81379e55-7a4e-4e52-8729-b4735b82355e\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:19:30.573175 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:19:30.573104    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n765h\" (UniqueName: \"kubernetes.io/projected/81379e55-7a4e-4e52-8729-b4735b82355e-kube-api-access-n765h\") pod \"data-science-collector-collector-0\" (UID: \"81379e55-7a4e-4e52-8729-b4735b82355e\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:19:30.613359 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:19:30.613325    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-headless-tls\""
Oct 30 21:19:30.613359 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:19:30.613343    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-monitoring-tls\""
Oct 30 21:19:30.613359 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:19:30.613348    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-af329f19\""
Oct 30 21:19:30.651600 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:19:30.651571    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:19:30.673925 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:19:30.673888    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/81379e55-7a4e-4e52-8729-b4735b82355e-otc-internal\") pod \"data-science-collector-collector-0\" (UID: \"81379e55-7a4e-4e52-8729-b4735b82355e\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:19:30.674081 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:19:30.674025    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/81379e55-7a4e-4e52-8729-b4735b82355e-otlp-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"81379e55-7a4e-4e52-8729-b4735b82355e\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:19:30.674081 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:19:30.674072    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n765h\" (UniqueName: \"kubernetes.io/projected/81379e55-7a4e-4e52-8729-b4735b82355e-kube-api-access-n765h\") pod \"data-science-collector-collector-0\" (UID: \"81379e55-7a4e-4e52-8729-b4735b82355e\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:19:30.674209 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:19:30.674151    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/81379e55-7a4e-4e52-8729-b4735b82355e-monitoring-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"81379e55-7a4e-4e52-8729-b4735b82355e\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:19:30.674209 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:19:30.674163    4060 secret.go:189] Couldn't get secret redhat-ods-monitoring/data-science-collector-collector-headless-tls: secret "data-science-collector-collector-headless-tls" not found
Oct 30 21:19:30.674328 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:19:30.674232    4060 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/81379e55-7a4e-4e52-8729-b4735b82355e-otlp-tls-certs podName:81379e55-7a4e-4e52-8729-b4735b82355e nodeName:}" failed. No retries permitted until 2026-10-30 21:19:31.174209888 +0000 UTC m=+2589.931208178 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "otlp-tls-certs" (UniqueName: "kubernetes.io/secret/81379e55-7a4e-4e52-8729-b4735b82355e-otlp-tls-certs") pod "data-science-collector-collector-0" (UID: "81379e55-7a4e-4e52-8729-b4735b82355e") : secret "data-science-collector-collector-headless-tls" not found
Oct 30 21:19:30.674743 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:19:30.674717    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/81379e55-7a4e-4e52-8729-b4735b82355e-otc-internal\") pod \"data-science-collector-collector-0\" (UID: \"81379e55-7a4e-4e52-8729-b4735b82355e\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:19:30.676906 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:19:30.676884    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/81379e55-7a4e-4e52-8729-b4735b82355e-monitoring-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"81379e55-7a4e-4e52-8729-b4735b82355e\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:19:30.739617 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:19:30.739590    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n765h\" (UniqueName: \"kubernetes.io/projected/81379e55-7a4e-4e52-8729-b4735b82355e-kube-api-access-n765h\") pod \"data-science-collector-collector-0\" (UID: \"81379e55-7a4e-4e52-8729-b4735b82355e\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:19:31.177352 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:19:31.177316    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/81379e55-7a4e-4e52-8729-b4735b82355e-otlp-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"81379e55-7a4e-4e52-8729-b4735b82355e\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:19:31.179783 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:19:31.179758    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/81379e55-7a4e-4e52-8729-b4735b82355e-otlp-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"81379e55-7a4e-4e52-8729-b4735b82355e\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:19:31.471631 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:19:31.471601    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:19:31.846241 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:19:31.846152    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:19:31.848894 ip-10-0-142-4 kubenswrapper[4060]: W1030 21:19:31.848866    4060 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81379e55_7a4e_4e52_8729_b4735b82355e.slice/crio-b35afb931bd978e6c26ffc136421d65c54e71126a7c05b7b3d9b56a936140513 WatchSource:0}: Error finding container b35afb931bd978e6c26ffc136421d65c54e71126a7c05b7b3d9b56a936140513: Status 404 returned error can't find the container with id b35afb931bd978e6c26ffc136421d65c54e71126a7c05b7b3d9b56a936140513
Oct 30 21:19:31.851051 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:19:31.851019    4060 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 21:19:31.851128 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:19:31.851076    4060 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 21:19:32.294682 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:19:32.294647    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"81379e55-7a4e-4e52-8729-b4735b82355e","Type":"ContainerStarted","Data":"2e81e55df2b0a7b0acba6f329d063a63bc8134c578ed5e2982e52230fa297a83"}
Oct 30 21:19:32.294856 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:19:32.294699    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"81379e55-7a4e-4e52-8729-b4735b82355e","Type":"ContainerStarted","Data":"b35afb931bd978e6c26ffc136421d65c54e71126a7c05b7b3d9b56a936140513"}
Oct 30 21:19:32.412848 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:19:32.412788    4060 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-collector-0" podStartSLOduration=2.412771412 podStartE2EDuration="2.412771412s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:19:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:19:32.41173089 +0000 UTC m=+2591.168729201" watchObservedRunningTime="2026-10-30 21:19:32.412771412 +0000 UTC m=+2591.169769711"
Oct 30 21:19:41.291043 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:19:41.291015    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/korrel8r-6644769df5-lcvvq"
Oct 30 21:19:42.151388 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:19:42.151359    4060 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v2f4x" containerName="extractor"
Oct 30 21:19:51.456173 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:19:51.456137    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/korrel8r-6644769df5-lcvvq"]
Oct 30 21:19:51.456587 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:19:51.456326    4060 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/korrel8r-6644769df5-lcvvq" podUID="bc44870c-74df-426c-9fab-eccfd4d78653" containerName="korrel8r" containerID="cri-o://412ae823b60cfd7d5d7a789c45377bb51f9631a6d226406997784828d9d07020" gracePeriod=30
Oct 30 21:19:51.694913 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:19:51.694880    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/korrel8r-6644769df5-lcvvq"
Oct 30 21:19:51.724811 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:19:51.724764    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/bc44870c-74df-426c-9fab-eccfd4d78653-config\" (UniqueName: \"kubernetes.io/configmap/bc44870c-74df-426c-9fab-eccfd4d78653-config\") pod \"bc44870c-74df-426c-9fab-eccfd4d78653\" (UID: \"bc44870c-74df-426c-9fab-eccfd4d78653\") "
Oct 30 21:19:51.724811 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:19:51.724794    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/bc44870c-74df-426c-9fab-eccfd4d78653-tls\" (UniqueName: \"kubernetes.io/secret/bc44870c-74df-426c-9fab-eccfd4d78653-tls\") pod \"bc44870c-74df-426c-9fab-eccfd4d78653\" (UID: \"bc44870c-74df-426c-9fab-eccfd4d78653\") "
Oct 30 21:19:51.724945 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:19:51.724838    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/bc44870c-74df-426c-9fab-eccfd4d78653-kube-api-access-q2cn8\" (UniqueName: \"kubernetes.io/projected/bc44870c-74df-426c-9fab-eccfd4d78653-kube-api-access-q2cn8\") pod \"bc44870c-74df-426c-9fab-eccfd4d78653\" (UID: \"bc44870c-74df-426c-9fab-eccfd4d78653\") "
Oct 30 21:19:51.725171 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:19:51.725150    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bc44870c-74df-426c-9fab-eccfd4d78653-config" pod "bc44870c-74df-426c-9fab-eccfd4d78653" (UID: "bc44870c-74df-426c-9fab-eccfd4d78653"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:19:51.726931 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:19:51.726908    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bc44870c-74df-426c-9fab-eccfd4d78653-tls" pod "bc44870c-74df-426c-9fab-eccfd4d78653" (UID: "bc44870c-74df-426c-9fab-eccfd4d78653"). InnerVolumeSpecName "tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:19:51.727014 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:19:51.726908    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bc44870c-74df-426c-9fab-eccfd4d78653-kube-api-access-q2cn8" pod "bc44870c-74df-426c-9fab-eccfd4d78653" (UID: "bc44870c-74df-426c-9fab-eccfd4d78653"). InnerVolumeSpecName "kube-api-access-q2cn8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:19:51.826019 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:19:51.825992    4060 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bc44870c-74df-426c-9fab-eccfd4d78653-config\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:19:51.826019 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:19:51.826017    4060 reconciler_common.go:299] "Volume detached for volume \"tls\" (UniqueName: \"kubernetes.io/secret/bc44870c-74df-426c-9fab-eccfd4d78653-tls\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:19:51.826198 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:19:51.826027    4060 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q2cn8\" (UniqueName: \"kubernetes.io/projected/bc44870c-74df-426c-9fab-eccfd4d78653-kube-api-access-q2cn8\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:19:52.390465 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:19:52.390435    4060 generic.go:356] "Generic (PLEG): container finished" podID="bc44870c-74df-426c-9fab-eccfd4d78653" containerID="412ae823b60cfd7d5d7a789c45377bb51f9631a6d226406997784828d9d07020" exitCode=0
Oct 30 21:19:52.390652 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:19:52.390474    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/korrel8r-6644769df5-lcvvq"
Oct 30 21:19:52.390652 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:19:52.390514    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/korrel8r-6644769df5-lcvvq" event={"ID":"bc44870c-74df-426c-9fab-eccfd4d78653","Type":"ContainerDied","Data":"412ae823b60cfd7d5d7a789c45377bb51f9631a6d226406997784828d9d07020"}
Oct 30 21:19:52.390652 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:19:52.390567    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/korrel8r-6644769df5-lcvvq" event={"ID":"bc44870c-74df-426c-9fab-eccfd4d78653","Type":"ContainerDied","Data":"d8ad62e655f43e4e16c154adae6dce90eeaf387a56c0bba2dbf6e4e960ff2ed8"}
Oct 30 21:19:52.390652 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:19:52.390589    4060 scope.go:122] "RemoveContainer" containerID="412ae823b60cfd7d5d7a789c45377bb51f9631a6d226406997784828d9d07020"
Oct 30 21:19:52.399638 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:19:52.399622    4060 scope.go:122] "RemoveContainer" containerID="412ae823b60cfd7d5d7a789c45377bb51f9631a6d226406997784828d9d07020"
Oct 30 21:19:52.399879 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:19:52.399861    4060 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"412ae823b60cfd7d5d7a789c45377bb51f9631a6d226406997784828d9d07020\": container with ID starting with 412ae823b60cfd7d5d7a789c45377bb51f9631a6d226406997784828d9d07020 not found: ID does not exist" containerID="412ae823b60cfd7d5d7a789c45377bb51f9631a6d226406997784828d9d07020"
Oct 30 21:19:52.399936 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:19:52.399887    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"412ae823b60cfd7d5d7a789c45377bb51f9631a6d226406997784828d9d07020"} err="failed to get container status \"412ae823b60cfd7d5d7a789c45377bb51f9631a6d226406997784828d9d07020\": rpc error: code = NotFound desc = could not find container \"412ae823b60cfd7d5d7a789c45377bb51f9631a6d226406997784828d9d07020\": container with ID starting with 412ae823b60cfd7d5d7a789c45377bb51f9631a6d226406997784828d9d07020 not found: ID does not exist"
Oct 30 21:19:52.554861 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:19:52.554828    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/korrel8r-6644769df5-lcvvq"]
Oct 30 21:19:52.605575 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:19:52.605548    4060 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/korrel8r-6644769df5-lcvvq"]
Oct 30 21:19:52.799517 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:19:52.799474    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:19:52.799734 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:19:52.799685    4060 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-collector-0" podUID="81379e55-7a4e-4e52-8729-b4735b82355e" containerName="otc-container" containerID="cri-o://2e81e55df2b0a7b0acba6f329d063a63bc8134c578ed5e2982e52230fa297a83" gracePeriod=30
Oct 30 21:19:53.079398 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:19:53.079357    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:19:53.134973 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:19:53.134943    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/81379e55-7a4e-4e52-8729-b4735b82355e-otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/81379e55-7a4e-4e52-8729-b4735b82355e-otlp-tls-certs\") pod \"81379e55-7a4e-4e52-8729-b4735b82355e\" (UID: \"81379e55-7a4e-4e52-8729-b4735b82355e\") "
Oct 30 21:19:53.135123 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:19:53.135007    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/81379e55-7a4e-4e52-8729-b4735b82355e-monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/81379e55-7a4e-4e52-8729-b4735b82355e-monitoring-tls-certs\") pod \"81379e55-7a4e-4e52-8729-b4735b82355e\" (UID: \"81379e55-7a4e-4e52-8729-b4735b82355e\") "
Oct 30 21:19:53.135164 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:19:53.135125    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/81379e55-7a4e-4e52-8729-b4735b82355e-kube-api-access-n765h\" (UniqueName: \"kubernetes.io/projected/81379e55-7a4e-4e52-8729-b4735b82355e-kube-api-access-n765h\") pod \"81379e55-7a4e-4e52-8729-b4735b82355e\" (UID: \"81379e55-7a4e-4e52-8729-b4735b82355e\") "
Oct 30 21:19:53.135218 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:19:53.135199    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/81379e55-7a4e-4e52-8729-b4735b82355e-otc-internal\" (UniqueName: \"kubernetes.io/configmap/81379e55-7a4e-4e52-8729-b4735b82355e-otc-internal\") pod \"81379e55-7a4e-4e52-8729-b4735b82355e\" (UID: \"81379e55-7a4e-4e52-8729-b4735b82355e\") "
Oct 30 21:19:53.135596 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:19:53.135564    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/81379e55-7a4e-4e52-8729-b4735b82355e-otc-internal" pod "81379e55-7a4e-4e52-8729-b4735b82355e" (UID: "81379e55-7a4e-4e52-8729-b4735b82355e"). InnerVolumeSpecName "otc-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:19:53.136968 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:19:53.136936    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/81379e55-7a4e-4e52-8729-b4735b82355e-monitoring-tls-certs" pod "81379e55-7a4e-4e52-8729-b4735b82355e" (UID: "81379e55-7a4e-4e52-8729-b4735b82355e"). InnerVolumeSpecName "monitoring-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:19:53.137070 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:19:53.136980    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/81379e55-7a4e-4e52-8729-b4735b82355e-otlp-tls-certs" pod "81379e55-7a4e-4e52-8729-b4735b82355e" (UID: "81379e55-7a4e-4e52-8729-b4735b82355e"). InnerVolumeSpecName "otlp-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:19:53.137070 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:19:53.137040    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/81379e55-7a4e-4e52-8729-b4735b82355e-kube-api-access-n765h" pod "81379e55-7a4e-4e52-8729-b4735b82355e" (UID: "81379e55-7a4e-4e52-8729-b4735b82355e"). InnerVolumeSpecName "kube-api-access-n765h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:19:53.236047 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:19:53.236016    4060 reconciler_common.go:299] "Volume detached for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/81379e55-7a4e-4e52-8729-b4735b82355e-otc-internal\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:19:53.236047 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:19:53.236043    4060 reconciler_common.go:299] "Volume detached for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/81379e55-7a4e-4e52-8729-b4735b82355e-otlp-tls-certs\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:19:53.236047 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:19:53.236054    4060 reconciler_common.go:299] "Volume detached for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/81379e55-7a4e-4e52-8729-b4735b82355e-monitoring-tls-certs\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:19:53.236265 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:19:53.236063    4060 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n765h\" (UniqueName: \"kubernetes.io/projected/81379e55-7a4e-4e52-8729-b4735b82355e-kube-api-access-n765h\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:19:53.396486 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:19:53.396401    4060 generic.go:356] "Generic (PLEG): container finished" podID="81379e55-7a4e-4e52-8729-b4735b82355e" containerID="2e81e55df2b0a7b0acba6f329d063a63bc8134c578ed5e2982e52230fa297a83" exitCode=0
Oct 30 21:19:53.396486 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:19:53.396457    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:19:53.396738 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:19:53.396486    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"81379e55-7a4e-4e52-8729-b4735b82355e","Type":"ContainerDied","Data":"2e81e55df2b0a7b0acba6f329d063a63bc8134c578ed5e2982e52230fa297a83"}
Oct 30 21:19:53.396738 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:19:53.396556    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"81379e55-7a4e-4e52-8729-b4735b82355e","Type":"ContainerDied","Data":"b35afb931bd978e6c26ffc136421d65c54e71126a7c05b7b3d9b56a936140513"}
Oct 30 21:19:53.396738 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:19:53.396581    4060 scope.go:122] "RemoveContainer" containerID="2e81e55df2b0a7b0acba6f329d063a63bc8134c578ed5e2982e52230fa297a83"
Oct 30 21:19:53.410823 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:19:53.410807    4060 scope.go:122] "RemoveContainer" containerID="2e81e55df2b0a7b0acba6f329d063a63bc8134c578ed5e2982e52230fa297a83"
Oct 30 21:19:53.411086 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:19:53.411069    4060 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2e81e55df2b0a7b0acba6f329d063a63bc8134c578ed5e2982e52230fa297a83\": container with ID starting with 2e81e55df2b0a7b0acba6f329d063a63bc8134c578ed5e2982e52230fa297a83 not found: ID does not exist" containerID="2e81e55df2b0a7b0acba6f329d063a63bc8134c578ed5e2982e52230fa297a83"
Oct 30 21:19:53.411144 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:19:53.411093    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2e81e55df2b0a7b0acba6f329d063a63bc8134c578ed5e2982e52230fa297a83"} err="failed to get container status \"2e81e55df2b0a7b0acba6f329d063a63bc8134c578ed5e2982e52230fa297a83\": rpc error: code = NotFound desc = could not find container \"2e81e55df2b0a7b0acba6f329d063a63bc8134c578ed5e2982e52230fa297a83\": container with ID starting with 2e81e55df2b0a7b0acba6f329d063a63bc8134c578ed5e2982e52230fa297a83 not found: ID does not exist"
Oct 30 21:19:53.426048 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:19:53.426021    4060 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="bc44870c-74df-426c-9fab-eccfd4d78653" path="/var/lib/kubelet/pods/bc44870c-74df-426c-9fab-eccfd4d78653/volumes"
Oct 30 21:19:53.563142 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:19:53.563110    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:19:53.569525 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:19:53.569478    4060 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:19:55.426155 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:19:55.426127    4060 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="81379e55-7a4e-4e52-8729-b4735b82355e" path="/var/lib/kubelet/pods/81379e55-7a4e-4e52-8729-b4735b82355e/volumes"
Oct 30 21:19:59.351401 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:19:59.351363    4060 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/korrel8r-6644769df5-l292b"]
Oct 30 21:19:59.351811 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:19:59.351795    4060 cpu_manager.go:414] "containerMap: removing container" podUID="81379e55-7a4e-4e52-8729-b4735b82355e" containerName="otc-container"
Oct 30 21:19:59.351857 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:19:59.351812    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="81379e55-7a4e-4e52-8729-b4735b82355e" containerName="otc-container"
Oct 30 21:19:59.351857 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:19:59.351832    4060 cpu_manager.go:414] "containerMap: removing container" podUID="bc44870c-74df-426c-9fab-eccfd4d78653" containerName="korrel8r"
Oct 30 21:19:59.351857 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:19:59.351838    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="bc44870c-74df-426c-9fab-eccfd4d78653" containerName="korrel8r"
Oct 30 21:19:59.351949 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:19:59.351895    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="81379e55-7a4e-4e52-8729-b4735b82355e" containerName="otc-container"
Oct 30 21:19:59.351949 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:19:59.351904    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="bc44870c-74df-426c-9fab-eccfd4d78653" containerName="korrel8r"
Oct 30 21:19:59.355987 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:19:59.355967    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/korrel8r-6644769df5-l292b"
Oct 30 21:19:59.385820 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:19:59.385788    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0e1c3f3b-4855-4e02-8953-2caefa83de2c-config\") pod \"korrel8r-6644769df5-l292b\" (UID: \"0e1c3f3b-4855-4e02-8953-2caefa83de2c\") " pod="redhat-ods-monitoring/korrel8r-6644769df5-l292b"
Oct 30 21:19:59.385971 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:19:59.385835    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/0e1c3f3b-4855-4e02-8953-2caefa83de2c-tls\") pod \"korrel8r-6644769df5-l292b\" (UID: \"0e1c3f3b-4855-4e02-8953-2caefa83de2c\") " pod="redhat-ods-monitoring/korrel8r-6644769df5-l292b"
Oct 30 21:19:59.385971 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:19:59.385914    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mtxdh\" (UniqueName: \"kubernetes.io/projected/0e1c3f3b-4855-4e02-8953-2caefa83de2c-kube-api-access-mtxdh\") pod \"korrel8r-6644769df5-l292b\" (UID: \"0e1c3f3b-4855-4e02-8953-2caefa83de2c\") " pod="redhat-ods-monitoring/korrel8r-6644769df5-l292b"
Oct 30 21:19:59.409486 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:19:59.409460    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"kube-root-ca.crt\""
Oct 30 21:19:59.413699 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:19:59.413677    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"openshift-service-ca.crt\""
Oct 30 21:19:59.458557 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:19:59.458527    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"korrel8r-dockercfg-gg5hx\""
Oct 30 21:19:59.458747 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:19:59.458706    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"korrel8r-config\""
Oct 30 21:19:59.458747 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:19:59.458705    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"korrel8r-tls\""
Oct 30 21:19:59.460350 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:19:59.460330    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/korrel8r-6644769df5-l292b"]
Oct 30 21:19:59.486781 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:19:59.486754    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mtxdh\" (UniqueName: \"kubernetes.io/projected/0e1c3f3b-4855-4e02-8953-2caefa83de2c-kube-api-access-mtxdh\") pod \"korrel8r-6644769df5-l292b\" (UID: \"0e1c3f3b-4855-4e02-8953-2caefa83de2c\") " pod="redhat-ods-monitoring/korrel8r-6644769df5-l292b"
Oct 30 21:19:59.486917 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:19:59.486801    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0e1c3f3b-4855-4e02-8953-2caefa83de2c-config\") pod \"korrel8r-6644769df5-l292b\" (UID: \"0e1c3f3b-4855-4e02-8953-2caefa83de2c\") " pod="redhat-ods-monitoring/korrel8r-6644769df5-l292b"
Oct 30 21:19:59.486917 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:19:59.486859    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/0e1c3f3b-4855-4e02-8953-2caefa83de2c-tls\") pod \"korrel8r-6644769df5-l292b\" (UID: \"0e1c3f3b-4855-4e02-8953-2caefa83de2c\") " pod="redhat-ods-monitoring/korrel8r-6644769df5-l292b"
Oct 30 21:19:59.487447 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:19:59.487424    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0e1c3f3b-4855-4e02-8953-2caefa83de2c-config\") pod \"korrel8r-6644769df5-l292b\" (UID: \"0e1c3f3b-4855-4e02-8953-2caefa83de2c\") " pod="redhat-ods-monitoring/korrel8r-6644769df5-l292b"
Oct 30 21:19:59.489209 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:19:59.489189    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls\" (UniqueName: \"kubernetes.io/secret/0e1c3f3b-4855-4e02-8953-2caefa83de2c-tls\") pod \"korrel8r-6644769df5-l292b\" (UID: \"0e1c3f3b-4855-4e02-8953-2caefa83de2c\") " pod="redhat-ods-monitoring/korrel8r-6644769df5-l292b"
Oct 30 21:19:59.548332 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:19:59.548306    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mtxdh\" (UniqueName: \"kubernetes.io/projected/0e1c3f3b-4855-4e02-8953-2caefa83de2c-kube-api-access-mtxdh\") pod \"korrel8r-6644769df5-l292b\" (UID: \"0e1c3f3b-4855-4e02-8953-2caefa83de2c\") " pod="redhat-ods-monitoring/korrel8r-6644769df5-l292b"
Oct 30 21:19:59.667968 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:19:59.667898    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/korrel8r-6644769df5-l292b"
Oct 30 21:20:00.036851 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:20:00.036827    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/korrel8r-6644769df5-l292b"]
Oct 30 21:20:00.039322 ip-10-0-142-4 kubenswrapper[4060]: W1030 21:20:00.039297    4060 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e1c3f3b_4855_4e02_8953_2caefa83de2c.slice/crio-c8f7311331e7ddba937b3255eaf049bb606634e1980c93ad4f1c1eb3757d499e WatchSource:0}: Error finding container c8f7311331e7ddba937b3255eaf049bb606634e1980c93ad4f1c1eb3757d499e: Status 404 returned error can't find the container with id c8f7311331e7ddba937b3255eaf049bb606634e1980c93ad4f1c1eb3757d499e
Oct 30 21:20:00.440326 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:20:00.440235    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/korrel8r-6644769df5-l292b" event={"ID":"0e1c3f3b-4855-4e02-8953-2caefa83de2c","Type":"ContainerStarted","Data":"c0994f0125c1242c1810182aab4d4d2ad0256acfe96a889565429558cd67b850"}
Oct 30 21:20:00.440326 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:20:00.440286    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/korrel8r-6644769df5-l292b" event={"ID":"0e1c3f3b-4855-4e02-8953-2caefa83de2c","Type":"ContainerStarted","Data":"c8f7311331e7ddba937b3255eaf049bb606634e1980c93ad4f1c1eb3757d499e"}
Oct 30 21:20:00.440820 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:20:00.440336    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/korrel8r-6644769df5-l292b"
Oct 30 21:20:00.557817 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:20:00.557768    4060 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/korrel8r-6644769df5-l292b" podStartSLOduration=1.557752945 podStartE2EDuration="1.557752945s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:19:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:20:00.556416892 +0000 UTC m=+2619.313415190" watchObservedRunningTime="2026-10-30 21:20:00.557752945 +0000 UTC m=+2619.314751242"
Oct 30 21:20:01.198046 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:20:01.198007    4060 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:20:01.201320 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:20:01.201297    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:20:01.254212 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:20:01.254184    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-monitoring-tls\""
Oct 30 21:20:01.302698 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:20:01.302665    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/95756a7e-6c08-4a25-ae19-66e0498b5b22-otc-internal\") pod \"data-science-collector-collector-0\" (UID: \"95756a7e-6c08-4a25-ae19-66e0498b5b22\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:20:01.302898 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:20:01.302719    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x6tg2\" (UniqueName: \"kubernetes.io/projected/95756a7e-6c08-4a25-ae19-66e0498b5b22-kube-api-access-x6tg2\") pod \"data-science-collector-collector-0\" (UID: \"95756a7e-6c08-4a25-ae19-66e0498b5b22\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:20:01.302898 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:20:01.302865    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/95756a7e-6c08-4a25-ae19-66e0498b5b22-otlp-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"95756a7e-6c08-4a25-ae19-66e0498b5b22\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:20:01.302985 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:20:01.302917    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/95756a7e-6c08-4a25-ae19-66e0498b5b22-monitoring-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"95756a7e-6c08-4a25-ae19-66e0498b5b22\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:20:01.303735 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:20:01.303717    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-dockercfg-fbjqp\""
Oct 30 21:20:01.303806 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:20:01.303717    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-af329f19\""
Oct 30 21:20:01.303806 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:20:01.303717    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-headless-tls\""
Oct 30 21:20:01.305679 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:20:01.305659    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:20:01.404217 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:20:01.404186    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/95756a7e-6c08-4a25-ae19-66e0498b5b22-monitoring-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"95756a7e-6c08-4a25-ae19-66e0498b5b22\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:20:01.404413 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:20:01.404228    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/95756a7e-6c08-4a25-ae19-66e0498b5b22-otc-internal\") pod \"data-science-collector-collector-0\" (UID: \"95756a7e-6c08-4a25-ae19-66e0498b5b22\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:20:01.404413 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:20:01.404258    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x6tg2\" (UniqueName: \"kubernetes.io/projected/95756a7e-6c08-4a25-ae19-66e0498b5b22-kube-api-access-x6tg2\") pod \"data-science-collector-collector-0\" (UID: \"95756a7e-6c08-4a25-ae19-66e0498b5b22\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:20:01.404413 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:20:01.404296    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/95756a7e-6c08-4a25-ae19-66e0498b5b22-otlp-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"95756a7e-6c08-4a25-ae19-66e0498b5b22\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:20:01.404888 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:20:01.404864    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/95756a7e-6c08-4a25-ae19-66e0498b5b22-otc-internal\") pod \"data-science-collector-collector-0\" (UID: \"95756a7e-6c08-4a25-ae19-66e0498b5b22\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:20:01.406799 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:20:01.406775    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/95756a7e-6c08-4a25-ae19-66e0498b5b22-otlp-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"95756a7e-6c08-4a25-ae19-66e0498b5b22\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:20:01.406893 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:20:01.406775    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/95756a7e-6c08-4a25-ae19-66e0498b5b22-monitoring-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"95756a7e-6c08-4a25-ae19-66e0498b5b22\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:20:01.467176 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:20:01.467140    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x6tg2\" (UniqueName: \"kubernetes.io/projected/95756a7e-6c08-4a25-ae19-66e0498b5b22-kube-api-access-x6tg2\") pod \"data-science-collector-collector-0\" (UID: \"95756a7e-6c08-4a25-ae19-66e0498b5b22\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:20:01.514592 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:20:01.514569    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:20:01.889635 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:20:01.889608    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:20:01.891255 ip-10-0-142-4 kubenswrapper[4060]: W1030 21:20:01.891228    4060 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95756a7e_6c08_4a25_ae19_66e0498b5b22.slice/crio-e422d7fbb8dcb2b891c07616ed4bea5c87dc40c82627dc7339d7ada0cea0a2d9 WatchSource:0}: Error finding container e422d7fbb8dcb2b891c07616ed4bea5c87dc40c82627dc7339d7ada0cea0a2d9: Status 404 returned error can't find the container with id e422d7fbb8dcb2b891c07616ed4bea5c87dc40c82627dc7339d7ada0cea0a2d9
Oct 30 21:20:01.893445 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:20:01.893412    4060 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 21:20:01.893554 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:20:01.893474    4060 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 21:20:02.450695 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:20:02.450663    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"95756a7e-6c08-4a25-ae19-66e0498b5b22","Type":"ContainerStarted","Data":"67703c78ec7dd7c1a7847900dfea0f151700eb9d5900f219b78fd4cf90c9c2a6"}
Oct 30 21:20:02.450863 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:20:02.450711    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"95756a7e-6c08-4a25-ae19-66e0498b5b22","Type":"ContainerStarted","Data":"e422d7fbb8dcb2b891c07616ed4bea5c87dc40c82627dc7339d7ada0cea0a2d9"}
Oct 30 21:20:02.568919 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:20:02.568857    4060 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-collector-0" podStartSLOduration=1.5688386269999999 podStartE2EDuration="1.568838627s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:20:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:20:02.567356326 +0000 UTC m=+2621.324354624" watchObservedRunningTime="2026-10-30 21:20:02.568838627 +0000 UTC m=+2621.325836922"
Oct 30 21:20:11.446475 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:20:11.446448    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/korrel8r-6644769df5-l292b"
Oct 30 21:20:12.152118 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:20:12.152085    4060 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v2f4x" containerName="extractor"
Oct 30 21:20:21.912074 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:20:21.912042    4060 scope.go:122] "RemoveContainer" containerID="0f62eec7a0c00c16a7cf37fb741a01561f6075af2965d7b693dcfcace2a2cf4e"
Oct 30 21:20:42.152032 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:20:42.151953    4060 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v2f4x" containerName="extractor"
Oct 30 21:20:51.316957 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:20:51.316918    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/korrel8r-6644769df5-l292b"]
Oct 30 21:20:51.317540 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:20:51.317123    4060 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/korrel8r-6644769df5-l292b" podUID="0e1c3f3b-4855-4e02-8953-2caefa83de2c" containerName="korrel8r" containerID="cri-o://c0994f0125c1242c1810182aab4d4d2ad0256acfe96a889565429558cd67b850" gracePeriod=30
Oct 30 21:20:51.444564 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:20:51.444529    4060 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/korrel8r-6644769df5-l292b" podUID="0e1c3f3b-4855-4e02-8953-2caefa83de2c" containerName="korrel8r" probeResult="failure" output="dial tcp 10.133.0.93:8443: connect: connection refused"
Oct 30 21:20:51.555003 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:20:51.554978    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/korrel8r-6644769df5-l292b"
Oct 30 21:20:51.675534 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:20:51.675415    4060 generic.go:356] "Generic (PLEG): container finished" podID="0e1c3f3b-4855-4e02-8953-2caefa83de2c" containerID="c0994f0125c1242c1810182aab4d4d2ad0256acfe96a889565429558cd67b850" exitCode=0
Oct 30 21:20:51.675534 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:20:51.675465    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/korrel8r-6644769df5-l292b"
Oct 30 21:20:51.675534 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:20:51.675504    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/korrel8r-6644769df5-l292b" event={"ID":"0e1c3f3b-4855-4e02-8953-2caefa83de2c","Type":"ContainerDied","Data":"c0994f0125c1242c1810182aab4d4d2ad0256acfe96a889565429558cd67b850"}
Oct 30 21:20:51.675833 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:20:51.675557    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/korrel8r-6644769df5-l292b" event={"ID":"0e1c3f3b-4855-4e02-8953-2caefa83de2c","Type":"ContainerDied","Data":"c8f7311331e7ddba937b3255eaf049bb606634e1980c93ad4f1c1eb3757d499e"}
Oct 30 21:20:51.675833 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:20:51.675585    4060 scope.go:122] "RemoveContainer" containerID="c0994f0125c1242c1810182aab4d4d2ad0256acfe96a889565429558cd67b850"
Oct 30 21:20:51.684648 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:20:51.684599    4060 scope.go:122] "RemoveContainer" containerID="c0994f0125c1242c1810182aab4d4d2ad0256acfe96a889565429558cd67b850"
Oct 30 21:20:51.684954 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:20:51.684928    4060 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c0994f0125c1242c1810182aab4d4d2ad0256acfe96a889565429558cd67b850\": container with ID starting with c0994f0125c1242c1810182aab4d4d2ad0256acfe96a889565429558cd67b850 not found: ID does not exist" containerID="c0994f0125c1242c1810182aab4d4d2ad0256acfe96a889565429558cd67b850"
Oct 30 21:20:51.685056 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:20:51.684966    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c0994f0125c1242c1810182aab4d4d2ad0256acfe96a889565429558cd67b850"} err="failed to get container status \"c0994f0125c1242c1810182aab4d4d2ad0256acfe96a889565429558cd67b850\": rpc error: code = NotFound desc = could not find container \"c0994f0125c1242c1810182aab4d4d2ad0256acfe96a889565429558cd67b850\": container with ID starting with c0994f0125c1242c1810182aab4d4d2ad0256acfe96a889565429558cd67b850 not found: ID does not exist"
Oct 30 21:20:51.701206 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:20:51.701179    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/0e1c3f3b-4855-4e02-8953-2caefa83de2c-config\" (UniqueName: \"kubernetes.io/configmap/0e1c3f3b-4855-4e02-8953-2caefa83de2c-config\") pod \"0e1c3f3b-4855-4e02-8953-2caefa83de2c\" (UID: \"0e1c3f3b-4855-4e02-8953-2caefa83de2c\") "
Oct 30 21:20:51.701329 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:20:51.701228    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0e1c3f3b-4855-4e02-8953-2caefa83de2c-kube-api-access-mtxdh\" (UniqueName: \"kubernetes.io/projected/0e1c3f3b-4855-4e02-8953-2caefa83de2c-kube-api-access-mtxdh\") pod \"0e1c3f3b-4855-4e02-8953-2caefa83de2c\" (UID: \"0e1c3f3b-4855-4e02-8953-2caefa83de2c\") "
Oct 30 21:20:51.701329 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:20:51.701257    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/0e1c3f3b-4855-4e02-8953-2caefa83de2c-tls\" (UniqueName: \"kubernetes.io/secret/0e1c3f3b-4855-4e02-8953-2caefa83de2c-tls\") pod \"0e1c3f3b-4855-4e02-8953-2caefa83de2c\" (UID: \"0e1c3f3b-4855-4e02-8953-2caefa83de2c\") "
Oct 30 21:20:51.701665 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:20:51.701637    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0e1c3f3b-4855-4e02-8953-2caefa83de2c-config" pod "0e1c3f3b-4855-4e02-8953-2caefa83de2c" (UID: "0e1c3f3b-4855-4e02-8953-2caefa83de2c"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:20:51.703326 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:20:51.703302    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0e1c3f3b-4855-4e02-8953-2caefa83de2c-kube-api-access-mtxdh" pod "0e1c3f3b-4855-4e02-8953-2caefa83de2c" (UID: "0e1c3f3b-4855-4e02-8953-2caefa83de2c"). InnerVolumeSpecName "kube-api-access-mtxdh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:20:51.703419 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:20:51.703371    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0e1c3f3b-4855-4e02-8953-2caefa83de2c-tls" pod "0e1c3f3b-4855-4e02-8953-2caefa83de2c" (UID: "0e1c3f3b-4855-4e02-8953-2caefa83de2c"). InnerVolumeSpecName "tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:20:51.802164 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:20:51.802130    4060 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0e1c3f3b-4855-4e02-8953-2caefa83de2c-config\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:20:51.802164 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:20:51.802159    4060 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mtxdh\" (UniqueName: \"kubernetes.io/projected/0e1c3f3b-4855-4e02-8953-2caefa83de2c-kube-api-access-mtxdh\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:20:51.802164 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:20:51.802171    4060 reconciler_common.go:299] "Volume detached for volume \"tls\" (UniqueName: \"kubernetes.io/secret/0e1c3f3b-4855-4e02-8953-2caefa83de2c-tls\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:20:52.096445 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:20:52.096413    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/korrel8r-6644769df5-l292b"]
Oct 30 21:20:52.146176 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:20:52.146145    4060 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/korrel8r-6644769df5-l292b"]
Oct 30 21:20:52.698285 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:20:52.698245    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:20:52.698782 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:20:52.698528    4060 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-collector-0" podUID="95756a7e-6c08-4a25-ae19-66e0498b5b22" containerName="otc-container" containerID="cri-o://67703c78ec7dd7c1a7847900dfea0f151700eb9d5900f219b78fd4cf90c9c2a6" gracePeriod=30
Oct 30 21:20:52.944079 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:20:52.944053    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:20:53.011720 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:20:53.011689    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/95756a7e-6c08-4a25-ae19-66e0498b5b22-monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/95756a7e-6c08-4a25-ae19-66e0498b5b22-monitoring-tls-certs\") pod \"95756a7e-6c08-4a25-ae19-66e0498b5b22\" (UID: \"95756a7e-6c08-4a25-ae19-66e0498b5b22\") "
Oct 30 21:20:53.011875 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:20:53.011731    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/95756a7e-6c08-4a25-ae19-66e0498b5b22-kube-api-access-x6tg2\" (UniqueName: \"kubernetes.io/projected/95756a7e-6c08-4a25-ae19-66e0498b5b22-kube-api-access-x6tg2\") pod \"95756a7e-6c08-4a25-ae19-66e0498b5b22\" (UID: \"95756a7e-6c08-4a25-ae19-66e0498b5b22\") "
Oct 30 21:20:53.011875 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:20:53.011762    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/95756a7e-6c08-4a25-ae19-66e0498b5b22-otc-internal\" (UniqueName: \"kubernetes.io/configmap/95756a7e-6c08-4a25-ae19-66e0498b5b22-otc-internal\") pod \"95756a7e-6c08-4a25-ae19-66e0498b5b22\" (UID: \"95756a7e-6c08-4a25-ae19-66e0498b5b22\") "
Oct 30 21:20:53.012181 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:20:53.012157    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/95756a7e-6c08-4a25-ae19-66e0498b5b22-otc-internal" pod "95756a7e-6c08-4a25-ae19-66e0498b5b22" (UID: "95756a7e-6c08-4a25-ae19-66e0498b5b22"). InnerVolumeSpecName "otc-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:20:53.013754 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:20:53.013729    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/95756a7e-6c08-4a25-ae19-66e0498b5b22-monitoring-tls-certs" pod "95756a7e-6c08-4a25-ae19-66e0498b5b22" (UID: "95756a7e-6c08-4a25-ae19-66e0498b5b22"). InnerVolumeSpecName "monitoring-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:20:53.013878 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:20:53.013857    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/95756a7e-6c08-4a25-ae19-66e0498b5b22-kube-api-access-x6tg2" pod "95756a7e-6c08-4a25-ae19-66e0498b5b22" (UID: "95756a7e-6c08-4a25-ae19-66e0498b5b22"). InnerVolumeSpecName "kube-api-access-x6tg2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:20:53.112594 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:20:53.112563    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/95756a7e-6c08-4a25-ae19-66e0498b5b22-otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/95756a7e-6c08-4a25-ae19-66e0498b5b22-otlp-tls-certs\") pod \"95756a7e-6c08-4a25-ae19-66e0498b5b22\" (UID: \"95756a7e-6c08-4a25-ae19-66e0498b5b22\") "
Oct 30 21:20:53.112818 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:20:53.112803    4060 reconciler_common.go:299] "Volume detached for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/95756a7e-6c08-4a25-ae19-66e0498b5b22-monitoring-tls-certs\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:20:53.112932 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:20:53.112824    4060 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x6tg2\" (UniqueName: \"kubernetes.io/projected/95756a7e-6c08-4a25-ae19-66e0498b5b22-kube-api-access-x6tg2\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:20:53.112932 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:20:53.112839    4060 reconciler_common.go:299] "Volume detached for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/95756a7e-6c08-4a25-ae19-66e0498b5b22-otc-internal\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:20:53.114527 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:20:53.114483    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/95756a7e-6c08-4a25-ae19-66e0498b5b22-otlp-tls-certs" pod "95756a7e-6c08-4a25-ae19-66e0498b5b22" (UID: "95756a7e-6c08-4a25-ae19-66e0498b5b22"). InnerVolumeSpecName "otlp-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:20:53.213279 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:20:53.213240    4060 reconciler_common.go:299] "Volume detached for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/95756a7e-6c08-4a25-ae19-66e0498b5b22-otlp-tls-certs\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:20:53.427737 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:20:53.427659    4060 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="0e1c3f3b-4855-4e02-8953-2caefa83de2c" path="/var/lib/kubelet/pods/0e1c3f3b-4855-4e02-8953-2caefa83de2c/volumes"
Oct 30 21:20:53.694245 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:20:53.694154    4060 generic.go:356] "Generic (PLEG): container finished" podID="95756a7e-6c08-4a25-ae19-66e0498b5b22" containerID="67703c78ec7dd7c1a7847900dfea0f151700eb9d5900f219b78fd4cf90c9c2a6" exitCode=0
Oct 30 21:20:53.694245 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:20:53.694196    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:20:53.694245 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:20:53.694229    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"95756a7e-6c08-4a25-ae19-66e0498b5b22","Type":"ContainerDied","Data":"67703c78ec7dd7c1a7847900dfea0f151700eb9d5900f219b78fd4cf90c9c2a6"}
Oct 30 21:20:53.694540 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:20:53.694281    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"95756a7e-6c08-4a25-ae19-66e0498b5b22","Type":"ContainerDied","Data":"e422d7fbb8dcb2b891c07616ed4bea5c87dc40c82627dc7339d7ada0cea0a2d9"}
Oct 30 21:20:53.694540 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:20:53.694309    4060 scope.go:122] "RemoveContainer" containerID="67703c78ec7dd7c1a7847900dfea0f151700eb9d5900f219b78fd4cf90c9c2a6"
Oct 30 21:20:53.704144 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:20:53.703960    4060 scope.go:122] "RemoveContainer" containerID="67703c78ec7dd7c1a7847900dfea0f151700eb9d5900f219b78fd4cf90c9c2a6"
Oct 30 21:20:53.704427 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:20:53.704314    4060 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"67703c78ec7dd7c1a7847900dfea0f151700eb9d5900f219b78fd4cf90c9c2a6\": container with ID starting with 67703c78ec7dd7c1a7847900dfea0f151700eb9d5900f219b78fd4cf90c9c2a6 not found: ID does not exist" containerID="67703c78ec7dd7c1a7847900dfea0f151700eb9d5900f219b78fd4cf90c9c2a6"
Oct 30 21:20:53.704427 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:20:53.704340    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"67703c78ec7dd7c1a7847900dfea0f151700eb9d5900f219b78fd4cf90c9c2a6"} err="failed to get container status \"67703c78ec7dd7c1a7847900dfea0f151700eb9d5900f219b78fd4cf90c9c2a6\": rpc error: code = NotFound desc = could not find container \"67703c78ec7dd7c1a7847900dfea0f151700eb9d5900f219b78fd4cf90c9c2a6\": container with ID starting with 67703c78ec7dd7c1a7847900dfea0f151700eb9d5900f219b78fd4cf90c9c2a6 not found: ID does not exist"
Oct 30 21:20:53.858225 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:20:53.858196    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:20:53.907553 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:20:53.907518    4060 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:20:55.426407 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:20:55.426375    4060 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="95756a7e-6c08-4a25-ae19-66e0498b5b22" path="/var/lib/kubelet/pods/95756a7e-6c08-4a25-ae19-66e0498b5b22/volumes"
Oct 30 21:21:12.149562 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:21:12.149527    4060 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v2f4x" containerName="extractor"
Oct 30 21:21:31.533846 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:21:31.533807    4060 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/korrel8r-5d45699dc4-22dth"]
Oct 30 21:21:31.534257 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:21:31.534086    4060 cpu_manager.go:414] "containerMap: removing container" podUID="95756a7e-6c08-4a25-ae19-66e0498b5b22" containerName="otc-container"
Oct 30 21:21:31.534257 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:21:31.534096    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="95756a7e-6c08-4a25-ae19-66e0498b5b22" containerName="otc-container"
Oct 30 21:21:31.534257 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:21:31.534116    4060 cpu_manager.go:414] "containerMap: removing container" podUID="0e1c3f3b-4855-4e02-8953-2caefa83de2c" containerName="korrel8r"
Oct 30 21:21:31.534257 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:21:31.534121    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0e1c3f3b-4855-4e02-8953-2caefa83de2c" containerName="korrel8r"
Oct 30 21:21:31.534257 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:21:31.534175    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="95756a7e-6c08-4a25-ae19-66e0498b5b22" containerName="otc-container"
Oct 30 21:21:31.534257 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:21:31.534186    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="0e1c3f3b-4855-4e02-8953-2caefa83de2c" containerName="korrel8r"
Oct 30 21:21:31.538109 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:21:31.538092    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/korrel8r-5d45699dc4-22dth"
Oct 30 21:21:31.574026 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:21:31.573999    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/df137507-d9aa-49a6-8ecf-ff2215870fb3-tls\") pod \"korrel8r-5d45699dc4-22dth\" (UID: \"df137507-d9aa-49a6-8ecf-ff2215870fb3\") " pod="redhat-ods-monitoring/korrel8r-5d45699dc4-22dth"
Oct 30 21:21:31.574177 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:21:31.574032    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/df137507-d9aa-49a6-8ecf-ff2215870fb3-config\") pod \"korrel8r-5d45699dc4-22dth\" (UID: \"df137507-d9aa-49a6-8ecf-ff2215870fb3\") " pod="redhat-ods-monitoring/korrel8r-5d45699dc4-22dth"
Oct 30 21:21:31.574177 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:21:31.574048    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8zr27\" (UniqueName: \"kubernetes.io/projected/df137507-d9aa-49a6-8ecf-ff2215870fb3-kube-api-access-8zr27\") pod \"korrel8r-5d45699dc4-22dth\" (UID: \"df137507-d9aa-49a6-8ecf-ff2215870fb3\") " pod="redhat-ods-monitoring/korrel8r-5d45699dc4-22dth"
Oct 30 21:21:31.614308 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:21:31.614287    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"kube-root-ca.crt\""
Oct 30 21:21:31.614308 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:21:31.614287    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"korrel8r-config\""
Oct 30 21:21:31.663710 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:21:31.663680    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"korrel8r-dockercfg-smdb9\""
Oct 30 21:21:31.663895 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:21:31.663729    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"korrel8r-tls\""
Oct 30 21:21:31.665466 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:21:31.665446    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/korrel8r-5d45699dc4-22dth"]
Oct 30 21:21:31.675065 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:21:31.675047    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/df137507-d9aa-49a6-8ecf-ff2215870fb3-tls\") pod \"korrel8r-5d45699dc4-22dth\" (UID: \"df137507-d9aa-49a6-8ecf-ff2215870fb3\") " pod="redhat-ods-monitoring/korrel8r-5d45699dc4-22dth"
Oct 30 21:21:31.675158 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:21:31.675072    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/df137507-d9aa-49a6-8ecf-ff2215870fb3-config\") pod \"korrel8r-5d45699dc4-22dth\" (UID: \"df137507-d9aa-49a6-8ecf-ff2215870fb3\") " pod="redhat-ods-monitoring/korrel8r-5d45699dc4-22dth"
Oct 30 21:21:31.675158 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:21:31.675099    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8zr27\" (UniqueName: \"kubernetes.io/projected/df137507-d9aa-49a6-8ecf-ff2215870fb3-kube-api-access-8zr27\") pod \"korrel8r-5d45699dc4-22dth\" (UID: \"df137507-d9aa-49a6-8ecf-ff2215870fb3\") " pod="redhat-ods-monitoring/korrel8r-5d45699dc4-22dth"
Oct 30 21:21:31.675807 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:21:31.675787    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/df137507-d9aa-49a6-8ecf-ff2215870fb3-config\") pod \"korrel8r-5d45699dc4-22dth\" (UID: \"df137507-d9aa-49a6-8ecf-ff2215870fb3\") " pod="redhat-ods-monitoring/korrel8r-5d45699dc4-22dth"
Oct 30 21:21:31.677552 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:21:31.677532    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls\" (UniqueName: \"kubernetes.io/secret/df137507-d9aa-49a6-8ecf-ff2215870fb3-tls\") pod \"korrel8r-5d45699dc4-22dth\" (UID: \"df137507-d9aa-49a6-8ecf-ff2215870fb3\") " pod="redhat-ods-monitoring/korrel8r-5d45699dc4-22dth"
Oct 30 21:21:31.707157 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:21:31.707131    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"openshift-service-ca.crt\""
Oct 30 21:21:31.737377 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:21:31.737347    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8zr27\" (UniqueName: \"kubernetes.io/projected/df137507-d9aa-49a6-8ecf-ff2215870fb3-kube-api-access-8zr27\") pod \"korrel8r-5d45699dc4-22dth\" (UID: \"df137507-d9aa-49a6-8ecf-ff2215870fb3\") " pod="redhat-ods-monitoring/korrel8r-5d45699dc4-22dth"
Oct 30 21:21:31.850363 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:21:31.850281    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/korrel8r-5d45699dc4-22dth"
Oct 30 21:21:32.222659 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:21:32.222634    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/korrel8r-5d45699dc4-22dth"]
Oct 30 21:21:32.225080 ip-10-0-142-4 kubenswrapper[4060]: W1030 21:21:32.225052    4060 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf137507_d9aa_49a6_8ecf_ff2215870fb3.slice/crio-afa77b0dfdcfaea63629b962d3cd4aaa5c8c62e66588e44e26fe92aab76ea3e4 WatchSource:0}: Error finding container afa77b0dfdcfaea63629b962d3cd4aaa5c8c62e66588e44e26fe92aab76ea3e4: Status 404 returned error can't find the container with id afa77b0dfdcfaea63629b962d3cd4aaa5c8c62e66588e44e26fe92aab76ea3e4
Oct 30 21:21:32.871433 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:21:32.871403    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/korrel8r-5d45699dc4-22dth" event={"ID":"df137507-d9aa-49a6-8ecf-ff2215870fb3","Type":"ContainerStarted","Data":"0eaa5823e6e566ccb65160a1fb4135828f130cf652080080a4d4a25d3c238c93"}
Oct 30 21:21:32.871905 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:21:32.871451    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/korrel8r-5d45699dc4-22dth" event={"ID":"df137507-d9aa-49a6-8ecf-ff2215870fb3","Type":"ContainerStarted","Data":"afa77b0dfdcfaea63629b962d3cd4aaa5c8c62e66588e44e26fe92aab76ea3e4"}
Oct 30 21:21:32.871905 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:21:32.871536    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/korrel8r-5d45699dc4-22dth"
Oct 30 21:21:32.991149 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:21:32.991100    4060 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/korrel8r-5d45699dc4-22dth" podStartSLOduration=1.991088483 podStartE2EDuration="1.991088483s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:21:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:21:32.990156306 +0000 UTC m=+2711.747154606" watchObservedRunningTime="2026-10-30 21:21:32.991088483 +0000 UTC m=+2711.748086781"
Oct 30 21:21:33.707929 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:21:33.707895    4060 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:21:33.712071 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:21:33.712048    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:21:33.764355 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:21:33.764328    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-dockercfg-phj8t\""
Oct 30 21:21:33.764539 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:21:33.764405    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-headless-tls\""
Oct 30 21:21:33.764539 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:21:33.764402    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-54f83bab\""
Oct 30 21:21:33.764539 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:21:33.764405    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-monitoring-tls\""
Oct 30 21:21:33.792910 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:21:33.792882    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8jgtj\" (UniqueName: \"kubernetes.io/projected/12dd915a-40b8-4607-ab2b-2bbe0532f87b-kube-api-access-8jgtj\") pod \"data-science-collector-collector-0\" (UID: \"12dd915a-40b8-4607-ab2b-2bbe0532f87b\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:21:33.793029 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:21:33.792924    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/12dd915a-40b8-4607-ab2b-2bbe0532f87b-otlp-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"12dd915a-40b8-4607-ab2b-2bbe0532f87b\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:21:33.793029 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:21:33.792944    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/12dd915a-40b8-4607-ab2b-2bbe0532f87b-monitoring-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"12dd915a-40b8-4607-ab2b-2bbe0532f87b\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:21:33.793102 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:21:33.793052    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/12dd915a-40b8-4607-ab2b-2bbe0532f87b-otc-internal\") pod \"data-science-collector-collector-0\" (UID: \"12dd915a-40b8-4607-ab2b-2bbe0532f87b\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:21:33.811381 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:21:33.811348    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:21:33.894026 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:21:33.893994    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/12dd915a-40b8-4607-ab2b-2bbe0532f87b-otc-internal\") pod \"data-science-collector-collector-0\" (UID: \"12dd915a-40b8-4607-ab2b-2bbe0532f87b\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:21:33.894449 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:21:33.894050    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8jgtj\" (UniqueName: \"kubernetes.io/projected/12dd915a-40b8-4607-ab2b-2bbe0532f87b-kube-api-access-8jgtj\") pod \"data-science-collector-collector-0\" (UID: \"12dd915a-40b8-4607-ab2b-2bbe0532f87b\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:21:33.894449 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:21:33.894075    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/12dd915a-40b8-4607-ab2b-2bbe0532f87b-otlp-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"12dd915a-40b8-4607-ab2b-2bbe0532f87b\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:21:33.894449 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:21:33.894094    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/12dd915a-40b8-4607-ab2b-2bbe0532f87b-monitoring-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"12dd915a-40b8-4607-ab2b-2bbe0532f87b\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:21:33.894867 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:21:33.894848    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/12dd915a-40b8-4607-ab2b-2bbe0532f87b-otc-internal\") pod \"data-science-collector-collector-0\" (UID: \"12dd915a-40b8-4607-ab2b-2bbe0532f87b\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:21:33.896467 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:21:33.896442    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/12dd915a-40b8-4607-ab2b-2bbe0532f87b-monitoring-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"12dd915a-40b8-4607-ab2b-2bbe0532f87b\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:21:33.896599 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:21:33.896516    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/12dd915a-40b8-4607-ab2b-2bbe0532f87b-otlp-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"12dd915a-40b8-4607-ab2b-2bbe0532f87b\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:21:33.954751 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:21:33.954724    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8jgtj\" (UniqueName: \"kubernetes.io/projected/12dd915a-40b8-4607-ab2b-2bbe0532f87b-kube-api-access-8jgtj\") pod \"data-science-collector-collector-0\" (UID: \"12dd915a-40b8-4607-ab2b-2bbe0532f87b\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:21:34.024991 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:21:34.024925    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:21:34.396884 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:21:34.396856    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:21:34.398750 ip-10-0-142-4 kubenswrapper[4060]: W1030 21:21:34.398713    4060 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12dd915a_40b8_4607_ab2b_2bbe0532f87b.slice/crio-efa3055d3e97a57975c5852f9ac747e8c6023b6be0046d3bb4c1ae6a4f656e10 WatchSource:0}: Error finding container efa3055d3e97a57975c5852f9ac747e8c6023b6be0046d3bb4c1ae6a4f656e10: Status 404 returned error can't find the container with id efa3055d3e97a57975c5852f9ac747e8c6023b6be0046d3bb4c1ae6a4f656e10
Oct 30 21:21:34.400975 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:21:34.400941    4060 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 21:21:34.401071 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:21:34.401004    4060 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 21:21:34.882432 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:21:34.882395    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"12dd915a-40b8-4607-ab2b-2bbe0532f87b","Type":"ContainerStarted","Data":"8faa714fc2ee4b7992c014a1fd916b9f872087ba88c76233cb4f2d84d7d8dd45"}
Oct 30 21:21:34.882604 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:21:34.882447    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"12dd915a-40b8-4607-ab2b-2bbe0532f87b","Type":"ContainerStarted","Data":"efa3055d3e97a57975c5852f9ac747e8c6023b6be0046d3bb4c1ae6a4f656e10"}
Oct 30 21:21:35.001171 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:21:35.001106    4060 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-collector-0" podStartSLOduration=2.001092779 podStartE2EDuration="2.001092779s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:21:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:21:34.999228482 +0000 UTC m=+2713.756226779" watchObservedRunningTime="2026-10-30 21:21:35.001092779 +0000 UTC m=+2713.758091077"
Oct 30 21:21:38.212264 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:21:38.212233    4060 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/tempo-data-science-tempostack-distributor-5d4b69f56-lk8q4"]
Oct 30 21:21:38.221922 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:21:38.221898    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/tempo-data-science-tempostack-distributor-5d4b69f56-lk8q4"
Oct 30 21:21:38.276511 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:21:38.276460    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"tempo-data-science-tempostack-ca-bundle\""
Oct 30 21:21:38.325910 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:21:38.325886    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"tempo-data-science-tempostack-dockercfg-dgbvr\""
Oct 30 21:21:38.326063 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:21:38.325953    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"tempo-data-science-tempostack\""
Oct 30 21:21:38.326063 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:21:38.326020    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"tempo-data-science-tempostack-distributor-mtls\""
Oct 30 21:21:38.328410 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:21:38.328382    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tempo-data-science-tempostack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79dff00b-7000-4e8d-872a-30822842afa0-tempo-data-science-tempostack-ca-bundle\") pod \"tempo-data-science-tempostack-distributor-5d4b69f56-lk8q4\" (UID: \"79dff00b-7000-4e8d-872a-30822842afa0\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-distributor-5d4b69f56-lk8q4"
Oct 30 21:21:38.328516 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:21:38.328447    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tempo-data-science-tempostack-distributor-mtls\" (UniqueName: \"kubernetes.io/secret/79dff00b-7000-4e8d-872a-30822842afa0-tempo-data-science-tempostack-distributor-mtls\") pod \"tempo-data-science-tempostack-distributor-5d4b69f56-lk8q4\" (UID: \"79dff00b-7000-4e8d-872a-30822842afa0\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-distributor-5d4b69f56-lk8q4"
Oct 30 21:21:38.328584 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:21:38.328547    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2xb6m\" (UniqueName: \"kubernetes.io/projected/79dff00b-7000-4e8d-872a-30822842afa0-kube-api-access-2xb6m\") pod \"tempo-data-science-tempostack-distributor-5d4b69f56-lk8q4\" (UID: \"79dff00b-7000-4e8d-872a-30822842afa0\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-distributor-5d4b69f56-lk8q4"
Oct 30 21:21:38.328635 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:21:38.328582    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tempo-tmp-storage\" (UniqueName: \"kubernetes.io/empty-dir/79dff00b-7000-4e8d-872a-30822842afa0-tempo-tmp-storage\") pod \"tempo-data-science-tempostack-distributor-5d4b69f56-lk8q4\" (UID: \"79dff00b-7000-4e8d-872a-30822842afa0\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-distributor-5d4b69f56-lk8q4"
Oct 30 21:21:38.328635 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:21:38.328602    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tempo-conf\" (UniqueName: \"kubernetes.io/configmap/79dff00b-7000-4e8d-872a-30822842afa0-tempo-conf\") pod \"tempo-data-science-tempostack-distributor-5d4b69f56-lk8q4\" (UID: \"79dff00b-7000-4e8d-872a-30822842afa0\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-distributor-5d4b69f56-lk8q4"
Oct 30 21:21:38.328800 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:21:38.328781    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/tempo-data-science-tempostack-distributor-5d4b69f56-lk8q4"]
Oct 30 21:21:38.429173 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:21:38.429139    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tempo-data-science-tempostack-distributor-mtls\" (UniqueName: \"kubernetes.io/secret/79dff00b-7000-4e8d-872a-30822842afa0-tempo-data-science-tempostack-distributor-mtls\") pod \"tempo-data-science-tempostack-distributor-5d4b69f56-lk8q4\" (UID: \"79dff00b-7000-4e8d-872a-30822842afa0\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-distributor-5d4b69f56-lk8q4"
Oct 30 21:21:38.429173 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:21:38.429176    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2xb6m\" (UniqueName: \"kubernetes.io/projected/79dff00b-7000-4e8d-872a-30822842afa0-kube-api-access-2xb6m\") pod \"tempo-data-science-tempostack-distributor-5d4b69f56-lk8q4\" (UID: \"79dff00b-7000-4e8d-872a-30822842afa0\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-distributor-5d4b69f56-lk8q4"
Oct 30 21:21:38.429432 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:21:38.429318    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tempo-tmp-storage\" (UniqueName: \"kubernetes.io/empty-dir/79dff00b-7000-4e8d-872a-30822842afa0-tempo-tmp-storage\") pod \"tempo-data-science-tempostack-distributor-5d4b69f56-lk8q4\" (UID: \"79dff00b-7000-4e8d-872a-30822842afa0\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-distributor-5d4b69f56-lk8q4"
Oct 30 21:21:38.429432 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:21:38.429350    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tempo-conf\" (UniqueName: \"kubernetes.io/configmap/79dff00b-7000-4e8d-872a-30822842afa0-tempo-conf\") pod \"tempo-data-science-tempostack-distributor-5d4b69f56-lk8q4\" (UID: \"79dff00b-7000-4e8d-872a-30822842afa0\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-distributor-5d4b69f56-lk8q4"
Oct 30 21:21:38.429432 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:21:38.429397    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tempo-data-science-tempostack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79dff00b-7000-4e8d-872a-30822842afa0-tempo-data-science-tempostack-ca-bundle\") pod \"tempo-data-science-tempostack-distributor-5d4b69f56-lk8q4\" (UID: \"79dff00b-7000-4e8d-872a-30822842afa0\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-distributor-5d4b69f56-lk8q4"
Oct 30 21:21:38.429780 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:21:38.429756    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tempo-tmp-storage\" (UniqueName: \"kubernetes.io/empty-dir/79dff00b-7000-4e8d-872a-30822842afa0-tempo-tmp-storage\") pod \"tempo-data-science-tempostack-distributor-5d4b69f56-lk8q4\" (UID: \"79dff00b-7000-4e8d-872a-30822842afa0\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-distributor-5d4b69f56-lk8q4"
Oct 30 21:21:38.430078 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:21:38.430061    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tempo-data-science-tempostack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79dff00b-7000-4e8d-872a-30822842afa0-tempo-data-science-tempostack-ca-bundle\") pod \"tempo-data-science-tempostack-distributor-5d4b69f56-lk8q4\" (UID: \"79dff00b-7000-4e8d-872a-30822842afa0\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-distributor-5d4b69f56-lk8q4"
Oct 30 21:21:38.430172 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:21:38.430156    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tempo-conf\" (UniqueName: \"kubernetes.io/configmap/79dff00b-7000-4e8d-872a-30822842afa0-tempo-conf\") pod \"tempo-data-science-tempostack-distributor-5d4b69f56-lk8q4\" (UID: \"79dff00b-7000-4e8d-872a-30822842afa0\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-distributor-5d4b69f56-lk8q4"
Oct 30 21:21:38.431597 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:21:38.431575    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tempo-data-science-tempostack-distributor-mtls\" (UniqueName: \"kubernetes.io/secret/79dff00b-7000-4e8d-872a-30822842afa0-tempo-data-science-tempostack-distributor-mtls\") pod \"tempo-data-science-tempostack-distributor-5d4b69f56-lk8q4\" (UID: \"79dff00b-7000-4e8d-872a-30822842afa0\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-distributor-5d4b69f56-lk8q4"
Oct 30 21:21:38.490190 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:21:38.490111    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2xb6m\" (UniqueName: \"kubernetes.io/projected/79dff00b-7000-4e8d-872a-30822842afa0-kube-api-access-2xb6m\") pod \"tempo-data-science-tempostack-distributor-5d4b69f56-lk8q4\" (UID: \"79dff00b-7000-4e8d-872a-30822842afa0\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-distributor-5d4b69f56-lk8q4"
Oct 30 21:21:38.534146 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:21:38.534114    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/tempo-data-science-tempostack-distributor-5d4b69f56-lk8q4"
Oct 30 21:21:38.859086 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:21:38.858992    4060 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/tempo-data-science-tempostack-querier-66cf97989c-bbdff"]
Oct 30 21:21:38.863288 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:21:38.863266    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/tempo-data-science-tempostack-querier-66cf97989c-bbdff"
Oct 30 21:21:38.915980 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:21:38.915948    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"s3-secret\""
Oct 30 21:21:38.916289 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:21:38.916270    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"tempo-data-science-tempostack-querier-mtls\""
Oct 30 21:21:38.923573 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:21:38.923538    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/tempo-data-science-tempostack-querier-66cf97989c-bbdff"]
Oct 30 21:21:38.934665 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:21:38.934641    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tempo-data-science-tempostack-querier-mtls\" (UniqueName: \"kubernetes.io/secret/89a032e2-2d7b-43d7-bdd3-8cf4408e9e8a-tempo-data-science-tempostack-querier-mtls\") pod \"tempo-data-science-tempostack-querier-66cf97989c-bbdff\" (UID: \"89a032e2-2d7b-43d7-bdd3-8cf4408e9e8a\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-querier-66cf97989c-bbdff"
Oct 30 21:21:38.934801 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:21:38.934683    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vfbfj\" (UniqueName: \"kubernetes.io/projected/89a032e2-2d7b-43d7-bdd3-8cf4408e9e8a-kube-api-access-vfbfj\") pod \"tempo-data-science-tempostack-querier-66cf97989c-bbdff\" (UID: \"89a032e2-2d7b-43d7-bdd3-8cf4408e9e8a\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-querier-66cf97989c-bbdff"
Oct 30 21:21:38.934801 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:21:38.934710    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tempo-tmp-storage\" (UniqueName: \"kubernetes.io/empty-dir/89a032e2-2d7b-43d7-bdd3-8cf4408e9e8a-tempo-tmp-storage\") pod \"tempo-data-science-tempostack-querier-66cf97989c-bbdff\" (UID: \"89a032e2-2d7b-43d7-bdd3-8cf4408e9e8a\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-querier-66cf97989c-bbdff"
Oct 30 21:21:38.934885 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:21:38.934829    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tempo-conf\" (UniqueName: \"kubernetes.io/configmap/89a032e2-2d7b-43d7-bdd3-8cf4408e9e8a-tempo-conf\") pod \"tempo-data-science-tempostack-querier-66cf97989c-bbdff\" (UID: \"89a032e2-2d7b-43d7-bdd3-8cf4408e9e8a\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-querier-66cf97989c-bbdff"
Oct 30 21:21:38.934885 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:21:38.934863    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tempo-data-science-tempostack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/89a032e2-2d7b-43d7-bdd3-8cf4408e9e8a-tempo-data-science-tempostack-ca-bundle\") pod \"tempo-data-science-tempostack-querier-66cf97989c-bbdff\" (UID: \"89a032e2-2d7b-43d7-bdd3-8cf4408e9e8a\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-querier-66cf97989c-bbdff"
Oct 30 21:21:38.966411 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:21:38.966384    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/tempo-data-science-tempostack-distributor-5d4b69f56-lk8q4"]
Oct 30 21:21:38.968450 ip-10-0-142-4 kubenswrapper[4060]: W1030 21:21:38.968422    4060 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79dff00b_7000_4e8d_872a_30822842afa0.slice/crio-8d22a385dd3fa76f7d107711d0fe7bc3cc225c71a37300b643cda8b581f19bdb WatchSource:0}: Error finding container 8d22a385dd3fa76f7d107711d0fe7bc3cc225c71a37300b643cda8b581f19bdb: Status 404 returned error can't find the container with id 8d22a385dd3fa76f7d107711d0fe7bc3cc225c71a37300b643cda8b581f19bdb
Oct 30 21:21:39.035263 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:21:39.035233    4060 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/tempo-data-science-tempostack-compactor-594786c479-qqgkv"]
Oct 30 21:21:39.035645 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:21:39.035616    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tempo-conf\" (UniqueName: \"kubernetes.io/configmap/89a032e2-2d7b-43d7-bdd3-8cf4408e9e8a-tempo-conf\") pod \"tempo-data-science-tempostack-querier-66cf97989c-bbdff\" (UID: \"89a032e2-2d7b-43d7-bdd3-8cf4408e9e8a\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-querier-66cf97989c-bbdff"
Oct 30 21:21:39.035748 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:21:39.035672    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tempo-data-science-tempostack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/89a032e2-2d7b-43d7-bdd3-8cf4408e9e8a-tempo-data-science-tempostack-ca-bundle\") pod \"tempo-data-science-tempostack-querier-66cf97989c-bbdff\" (UID: \"89a032e2-2d7b-43d7-bdd3-8cf4408e9e8a\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-querier-66cf97989c-bbdff"
Oct 30 21:21:39.035818 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:21:39.035760    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tempo-data-science-tempostack-querier-mtls\" (UniqueName: \"kubernetes.io/secret/89a032e2-2d7b-43d7-bdd3-8cf4408e9e8a-tempo-data-science-tempostack-querier-mtls\") pod \"tempo-data-science-tempostack-querier-66cf97989c-bbdff\" (UID: \"89a032e2-2d7b-43d7-bdd3-8cf4408e9e8a\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-querier-66cf97989c-bbdff"
Oct 30 21:21:39.035818 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:21:39.035813    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vfbfj\" (UniqueName: \"kubernetes.io/projected/89a032e2-2d7b-43d7-bdd3-8cf4408e9e8a-kube-api-access-vfbfj\") pod \"tempo-data-science-tempostack-querier-66cf97989c-bbdff\" (UID: \"89a032e2-2d7b-43d7-bdd3-8cf4408e9e8a\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-querier-66cf97989c-bbdff"
Oct 30 21:21:39.035930 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:21:39.035838    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tempo-tmp-storage\" (UniqueName: \"kubernetes.io/empty-dir/89a032e2-2d7b-43d7-bdd3-8cf4408e9e8a-tempo-tmp-storage\") pod \"tempo-data-science-tempostack-querier-66cf97989c-bbdff\" (UID: \"89a032e2-2d7b-43d7-bdd3-8cf4408e9e8a\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-querier-66cf97989c-bbdff"
Oct 30 21:21:39.036216 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:21:39.036189    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tempo-tmp-storage\" (UniqueName: \"kubernetes.io/empty-dir/89a032e2-2d7b-43d7-bdd3-8cf4408e9e8a-tempo-tmp-storage\") pod \"tempo-data-science-tempostack-querier-66cf97989c-bbdff\" (UID: \"89a032e2-2d7b-43d7-bdd3-8cf4408e9e8a\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-querier-66cf97989c-bbdff"
Oct 30 21:21:39.036449 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:21:39.036426    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tempo-data-science-tempostack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/89a032e2-2d7b-43d7-bdd3-8cf4408e9e8a-tempo-data-science-tempostack-ca-bundle\") pod \"tempo-data-science-tempostack-querier-66cf97989c-bbdff\" (UID: \"89a032e2-2d7b-43d7-bdd3-8cf4408e9e8a\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-querier-66cf97989c-bbdff"
Oct 30 21:21:39.036623 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:21:39.036605    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tempo-conf\" (UniqueName: \"kubernetes.io/configmap/89a032e2-2d7b-43d7-bdd3-8cf4408e9e8a-tempo-conf\") pod \"tempo-data-science-tempostack-querier-66cf97989c-bbdff\" (UID: \"89a032e2-2d7b-43d7-bdd3-8cf4408e9e8a\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-querier-66cf97989c-bbdff"
Oct 30 21:21:39.038154 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:21:39.038135    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tempo-data-science-tempostack-querier-mtls\" (UniqueName: \"kubernetes.io/secret/89a032e2-2d7b-43d7-bdd3-8cf4408e9e8a-tempo-data-science-tempostack-querier-mtls\") pod \"tempo-data-science-tempostack-querier-66cf97989c-bbdff\" (UID: \"89a032e2-2d7b-43d7-bdd3-8cf4408e9e8a\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-querier-66cf97989c-bbdff"
Oct 30 21:21:39.038976 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:21:39.038961    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/tempo-data-science-tempostack-compactor-594786c479-qqgkv"
Oct 30 21:21:39.092147 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:21:39.092117    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"tempo-data-science-tempostack-compactor-mtls\""
Oct 30 21:21:39.097015 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:21:39.096990    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vfbfj\" (UniqueName: \"kubernetes.io/projected/89a032e2-2d7b-43d7-bdd3-8cf4408e9e8a-kube-api-access-vfbfj\") pod \"tempo-data-science-tempostack-querier-66cf97989c-bbdff\" (UID: \"89a032e2-2d7b-43d7-bdd3-8cf4408e9e8a\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-querier-66cf97989c-bbdff"
Oct 30 21:21:39.100364 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:21:39.100339    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/tempo-data-science-tempostack-compactor-594786c479-qqgkv"]
Oct 30 21:21:39.136548 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:21:39.136468    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tempo-conf\" (UniqueName: \"kubernetes.io/configmap/c74a7a04-b7f9-4401-a97b-2ef76cc0cb42-tempo-conf\") pod \"tempo-data-science-tempostack-compactor-594786c479-qqgkv\" (UID: \"c74a7a04-b7f9-4401-a97b-2ef76cc0cb42\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-compactor-594786c479-qqgkv"
Oct 30 21:21:39.136686 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:21:39.136601    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tempo-data-science-tempostack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c74a7a04-b7f9-4401-a97b-2ef76cc0cb42-tempo-data-science-tempostack-ca-bundle\") pod \"tempo-data-science-tempostack-compactor-594786c479-qqgkv\" (UID: \"c74a7a04-b7f9-4401-a97b-2ef76cc0cb42\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-compactor-594786c479-qqgkv"
Oct 30 21:21:39.136756 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:21:39.136690    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tempo-data-science-tempostack-compactor-mtls\" (UniqueName: \"kubernetes.io/secret/c74a7a04-b7f9-4401-a97b-2ef76cc0cb42-tempo-data-science-tempostack-compactor-mtls\") pod \"tempo-data-science-tempostack-compactor-594786c479-qqgkv\" (UID: \"c74a7a04-b7f9-4401-a97b-2ef76cc0cb42\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-compactor-594786c479-qqgkv"
Oct 30 21:21:39.136756 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:21:39.136736    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tempo-tmp-storage\" (UniqueName: \"kubernetes.io/empty-dir/c74a7a04-b7f9-4401-a97b-2ef76cc0cb42-tempo-tmp-storage\") pod \"tempo-data-science-tempostack-compactor-594786c479-qqgkv\" (UID: \"c74a7a04-b7f9-4401-a97b-2ef76cc0cb42\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-compactor-594786c479-qqgkv"
Oct 30 21:21:39.136869 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:21:39.136857    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bhq2j\" (UniqueName: \"kubernetes.io/projected/c74a7a04-b7f9-4401-a97b-2ef76cc0cb42-kube-api-access-bhq2j\") pod \"tempo-data-science-tempostack-compactor-594786c479-qqgkv\" (UID: \"c74a7a04-b7f9-4401-a97b-2ef76cc0cb42\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-compactor-594786c479-qqgkv"
Oct 30 21:21:39.175651 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:21:39.175624    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/tempo-data-science-tempostack-querier-66cf97989c-bbdff"
Oct 30 21:21:39.238129 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:21:39.238089    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tempo-tmp-storage\" (UniqueName: \"kubernetes.io/empty-dir/c74a7a04-b7f9-4401-a97b-2ef76cc0cb42-tempo-tmp-storage\") pod \"tempo-data-science-tempostack-compactor-594786c479-qqgkv\" (UID: \"c74a7a04-b7f9-4401-a97b-2ef76cc0cb42\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-compactor-594786c479-qqgkv"
Oct 30 21:21:39.238580 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:21:39.238201    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bhq2j\" (UniqueName: \"kubernetes.io/projected/c74a7a04-b7f9-4401-a97b-2ef76cc0cb42-kube-api-access-bhq2j\") pod \"tempo-data-science-tempostack-compactor-594786c479-qqgkv\" (UID: \"c74a7a04-b7f9-4401-a97b-2ef76cc0cb42\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-compactor-594786c479-qqgkv"
Oct 30 21:21:39.238580 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:21:39.238262    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tempo-conf\" (UniqueName: \"kubernetes.io/configmap/c74a7a04-b7f9-4401-a97b-2ef76cc0cb42-tempo-conf\") pod \"tempo-data-science-tempostack-compactor-594786c479-qqgkv\" (UID: \"c74a7a04-b7f9-4401-a97b-2ef76cc0cb42\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-compactor-594786c479-qqgkv"
Oct 30 21:21:39.238580 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:21:39.238301    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tempo-data-science-tempostack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c74a7a04-b7f9-4401-a97b-2ef76cc0cb42-tempo-data-science-tempostack-ca-bundle\") pod \"tempo-data-science-tempostack-compactor-594786c479-qqgkv\" (UID: \"c74a7a04-b7f9-4401-a97b-2ef76cc0cb42\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-compactor-594786c479-qqgkv"
Oct 30 21:21:39.238580 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:21:39.238345    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tempo-data-science-tempostack-compactor-mtls\" (UniqueName: \"kubernetes.io/secret/c74a7a04-b7f9-4401-a97b-2ef76cc0cb42-tempo-data-science-tempostack-compactor-mtls\") pod \"tempo-data-science-tempostack-compactor-594786c479-qqgkv\" (UID: \"c74a7a04-b7f9-4401-a97b-2ef76cc0cb42\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-compactor-594786c479-qqgkv"
Oct 30 21:21:39.239281 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:21:39.239255    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tempo-tmp-storage\" (UniqueName: \"kubernetes.io/empty-dir/c74a7a04-b7f9-4401-a97b-2ef76cc0cb42-tempo-tmp-storage\") pod \"tempo-data-science-tempostack-compactor-594786c479-qqgkv\" (UID: \"c74a7a04-b7f9-4401-a97b-2ef76cc0cb42\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-compactor-594786c479-qqgkv"
Oct 30 21:21:39.239865 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:21:39.239839    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tempo-data-science-tempostack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c74a7a04-b7f9-4401-a97b-2ef76cc0cb42-tempo-data-science-tempostack-ca-bundle\") pod \"tempo-data-science-tempostack-compactor-594786c479-qqgkv\" (UID: \"c74a7a04-b7f9-4401-a97b-2ef76cc0cb42\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-compactor-594786c479-qqgkv"
Oct 30 21:21:39.240013 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:21:39.239899    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tempo-conf\" (UniqueName: \"kubernetes.io/configmap/c74a7a04-b7f9-4401-a97b-2ef76cc0cb42-tempo-conf\") pod \"tempo-data-science-tempostack-compactor-594786c479-qqgkv\" (UID: \"c74a7a04-b7f9-4401-a97b-2ef76cc0cb42\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-compactor-594786c479-qqgkv"
Oct 30 21:21:39.241447 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:21:39.241422    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tempo-data-science-tempostack-compactor-mtls\" (UniqueName: \"kubernetes.io/secret/c74a7a04-b7f9-4401-a97b-2ef76cc0cb42-tempo-data-science-tempostack-compactor-mtls\") pod \"tempo-data-science-tempostack-compactor-594786c479-qqgkv\" (UID: \"c74a7a04-b7f9-4401-a97b-2ef76cc0cb42\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-compactor-594786c479-qqgkv"
Oct 30 21:21:39.300062 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:21:39.300026    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bhq2j\" (UniqueName: \"kubernetes.io/projected/c74a7a04-b7f9-4401-a97b-2ef76cc0cb42-kube-api-access-bhq2j\") pod \"tempo-data-science-tempostack-compactor-594786c479-qqgkv\" (UID: \"c74a7a04-b7f9-4401-a97b-2ef76cc0cb42\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-compactor-594786c479-qqgkv"
Oct 30 21:21:39.350777 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:21:39.350749    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/tempo-data-science-tempostack-compactor-594786c479-qqgkv"
Oct 30 21:21:39.606792 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:21:39.606760    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/tempo-data-science-tempostack-querier-66cf97989c-bbdff"]
Oct 30 21:21:39.611020 ip-10-0-142-4 kubenswrapper[4060]: W1030 21:21:39.610992    4060 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89a032e2_2d7b_43d7_bdd3_8cf4408e9e8a.slice/crio-4c5e098d1d08026378423ec4de0f4fddcdc7637673c67f1d5b65fbdf94635be1 WatchSource:0}: Error finding container 4c5e098d1d08026378423ec4de0f4fddcdc7637673c67f1d5b65fbdf94635be1: Status 404 returned error can't find the container with id 4c5e098d1d08026378423ec4de0f4fddcdc7637673c67f1d5b65fbdf94635be1
Oct 30 21:21:39.729807 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:21:39.729777    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/tempo-data-science-tempostack-compactor-594786c479-qqgkv"]
Oct 30 21:21:39.733484 ip-10-0-142-4 kubenswrapper[4060]: W1030 21:21:39.733452    4060 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc74a7a04_b7f9_4401_a97b_2ef76cc0cb42.slice/crio-d0935b948458b6ded58400520d7c75ba27424deeab630b7b60ac312dab2945b9 WatchSource:0}: Error finding container d0935b948458b6ded58400520d7c75ba27424deeab630b7b60ac312dab2945b9: Status 404 returned error can't find the container with id d0935b948458b6ded58400520d7c75ba27424deeab630b7b60ac312dab2945b9
Oct 30 21:21:39.906243 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:21:39.906142    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/tempo-data-science-tempostack-distributor-5d4b69f56-lk8q4" event={"ID":"79dff00b-7000-4e8d-872a-30822842afa0","Type":"ContainerStarted","Data":"9c741dc16e3a9c5ce874f7ca4abdda87ef0ffb3b3dac59150fe7adf1c397af8f"}
Oct 30 21:21:39.906243 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:21:39.906211    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/tempo-data-science-tempostack-distributor-5d4b69f56-lk8q4" event={"ID":"79dff00b-7000-4e8d-872a-30822842afa0","Type":"ContainerStarted","Data":"8d22a385dd3fa76f7d107711d0fe7bc3cc225c71a37300b643cda8b581f19bdb"}
Oct 30 21:21:39.906243 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:21:39.906242    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/tempo-data-science-tempostack-distributor-5d4b69f56-lk8q4"
Oct 30 21:21:39.907829 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:21:39.907805    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/tempo-data-science-tempostack-querier-66cf97989c-bbdff" event={"ID":"89a032e2-2d7b-43d7-bdd3-8cf4408e9e8a","Type":"ContainerStarted","Data":"02a670f320d7efbee273d8b4886278473f9b2111a2834d2d183e01595bebf071"}
Oct 30 21:21:39.907962 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:21:39.907865    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/tempo-data-science-tempostack-querier-66cf97989c-bbdff"
Oct 30 21:21:39.907962 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:21:39.907890    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/tempo-data-science-tempostack-querier-66cf97989c-bbdff" event={"ID":"89a032e2-2d7b-43d7-bdd3-8cf4408e9e8a","Type":"ContainerStarted","Data":"4c5e098d1d08026378423ec4de0f4fddcdc7637673c67f1d5b65fbdf94635be1"}
Oct 30 21:21:39.909362 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:21:39.909340    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/tempo-data-science-tempostack-compactor-594786c479-qqgkv" event={"ID":"c74a7a04-b7f9-4401-a97b-2ef76cc0cb42","Type":"ContainerStarted","Data":"b7eda03ed2a8cb02eb614761c5d0998ae990d130cc99b3c7cbaf757200aea3ae"}
Oct 30 21:21:39.909455 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:21:39.909376    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/tempo-data-science-tempostack-compactor-594786c479-qqgkv" event={"ID":"c74a7a04-b7f9-4401-a97b-2ef76cc0cb42","Type":"ContainerStarted","Data":"d0935b948458b6ded58400520d7c75ba27424deeab630b7b60ac312dab2945b9"}
Oct 30 21:21:39.909546 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:21:39.909480    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/tempo-data-science-tempostack-compactor-594786c479-qqgkv"
Oct 30 21:21:40.024888 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:21:40.024832    4060 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/tempo-data-science-tempostack-distributor-5d4b69f56-lk8q4" podStartSLOduration=2.024817181 podStartE2EDuration="2.024817181s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:21:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:21:40.023363748 +0000 UTC m=+2718.780362067" watchObservedRunningTime="2026-10-30 21:21:40.024817181 +0000 UTC m=+2718.781815478"
Oct 30 21:21:40.142938 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:21:40.142874    4060 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/tempo-data-science-tempostack-compactor-594786c479-qqgkv" podStartSLOduration=2.14285864 podStartE2EDuration="2.14285864s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:21:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:21:40.140693755 +0000 UTC m=+2718.897692077" watchObservedRunningTime="2026-10-30 21:21:40.14285864 +0000 UTC m=+2718.899856938"
Oct 30 21:21:40.260970 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:21:40.260912    4060 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/tempo-data-science-tempostack-querier-66cf97989c-bbdff" podStartSLOduration=2.260890307 podStartE2EDuration="2.260890307s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:21:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:21:40.258337546 +0000 UTC m=+2719.015335843" watchObservedRunningTime="2026-10-30 21:21:40.260890307 +0000 UTC m=+2719.017888609"
Oct 30 21:21:41.035062 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:21:41.035031    4060 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/tempo-data-science-tempostack-gateway-5c5f4bc4d8-dbfsr"]
Oct 30 21:21:41.038730 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:21:41.038713    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/tempo-data-science-tempostack-gateway-5c5f4bc4d8-dbfsr"
Oct 30 21:21:41.091206 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:21:41.091170    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"tempo-data-science-tempostack-gateway\""
Oct 30 21:21:41.091366 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:21:41.091206    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"tempo-data-science-tempostack-gateway\""
Oct 30 21:21:41.091366 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:21:41.091216    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"tempo-data-science-tempostack-gateway-dockercfg-vnmrf\""
Oct 30 21:21:41.091366 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:21:41.091244    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"tempo-data-science-tempostack-gateway-cabundle\""
Oct 30 21:21:41.091366 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:21:41.091247    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"tempo-data-science-tempostack-gateway-mtls\""
Oct 30 21:21:41.091366 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:21:41.091292    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"tempo-data-science-tempostack-gateway-tls\""
Oct 30 21:21:41.142384 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:21:41.142351    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/tempo-data-science-tempostack-gateway-5c5f4bc4d8-dbfsr"]
Oct 30 21:21:41.155781 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:21:41.155753    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tempo-data-science-tempostack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ac095a8-1f1d-4ee4-a60e-d3fb36184d3e-tempo-data-science-tempostack-ca-bundle\") pod \"tempo-data-science-tempostack-gateway-5c5f4bc4d8-dbfsr\" (UID: \"1ac095a8-1f1d-4ee4-a60e-d3fb36184d3e\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-gateway-5c5f4bc4d8-dbfsr"
Oct 30 21:21:41.155907 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:21:41.155789    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rhcnv\" (UniqueName: \"kubernetes.io/projected/1ac095a8-1f1d-4ee4-a60e-d3fb36184d3e-kube-api-access-rhcnv\") pod \"tempo-data-science-tempostack-gateway-5c5f4bc4d8-dbfsr\" (UID: \"1ac095a8-1f1d-4ee4-a60e-d3fb36184d3e\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-gateway-5c5f4bc4d8-dbfsr"
Oct 30 21:21:41.155907 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:21:41.155812    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rbac\" (UniqueName: \"kubernetes.io/configmap/1ac095a8-1f1d-4ee4-a60e-d3fb36184d3e-rbac\") pod \"tempo-data-science-tempostack-gateway-5c5f4bc4d8-dbfsr\" (UID: \"1ac095a8-1f1d-4ee4-a60e-d3fb36184d3e\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-gateway-5c5f4bc4d8-dbfsr"
Oct 30 21:21:41.155907 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:21:41.155877    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs\" (UniqueName: \"kubernetes.io/secret/1ac095a8-1f1d-4ee4-a60e-d3fb36184d3e-serving-certs\") pod \"tempo-data-science-tempostack-gateway-5c5f4bc4d8-dbfsr\" (UID: \"1ac095a8-1f1d-4ee4-a60e-d3fb36184d3e\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-gateway-5c5f4bc4d8-dbfsr"
Oct 30 21:21:41.156028 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:21:41.156009    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tempo-data-science-tempostack-gateway-mtls\" (UniqueName: \"kubernetes.io/secret/1ac095a8-1f1d-4ee4-a60e-d3fb36184d3e-tempo-data-science-tempostack-gateway-mtls\") pod \"tempo-data-science-tempostack-gateway-5c5f4bc4d8-dbfsr\" (UID: \"1ac095a8-1f1d-4ee4-a60e-d3fb36184d3e\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-gateway-5c5f4bc4d8-dbfsr"
Oct 30 21:21:41.156063 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:21:41.156050    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tenant\" (UniqueName: \"kubernetes.io/secret/1ac095a8-1f1d-4ee4-a60e-d3fb36184d3e-tenant\") pod \"tempo-data-science-tempostack-gateway-5c5f4bc4d8-dbfsr\" (UID: \"1ac095a8-1f1d-4ee4-a60e-d3fb36184d3e\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-gateway-5c5f4bc4d8-dbfsr"
Oct 30 21:21:41.156155 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:21:41.156141    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle\" (UniqueName: \"kubernetes.io/configmap/1ac095a8-1f1d-4ee4-a60e-d3fb36184d3e-cabundle\") pod \"tempo-data-science-tempostack-gateway-5c5f4bc4d8-dbfsr\" (UID: \"1ac095a8-1f1d-4ee4-a60e-d3fb36184d3e\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-gateway-5c5f4bc4d8-dbfsr"
Oct 30 21:21:41.257157 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:21:41.257121    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle\" (UniqueName: \"kubernetes.io/configmap/1ac095a8-1f1d-4ee4-a60e-d3fb36184d3e-cabundle\") pod \"tempo-data-science-tempostack-gateway-5c5f4bc4d8-dbfsr\" (UID: \"1ac095a8-1f1d-4ee4-a60e-d3fb36184d3e\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-gateway-5c5f4bc4d8-dbfsr"
Oct 30 21:21:41.257375 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:21:41.257161    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tempo-data-science-tempostack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ac095a8-1f1d-4ee4-a60e-d3fb36184d3e-tempo-data-science-tempostack-ca-bundle\") pod \"tempo-data-science-tempostack-gateway-5c5f4bc4d8-dbfsr\" (UID: \"1ac095a8-1f1d-4ee4-a60e-d3fb36184d3e\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-gateway-5c5f4bc4d8-dbfsr"
Oct 30 21:21:41.257375 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:21:41.257198    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rhcnv\" (UniqueName: \"kubernetes.io/projected/1ac095a8-1f1d-4ee4-a60e-d3fb36184d3e-kube-api-access-rhcnv\") pod \"tempo-data-science-tempostack-gateway-5c5f4bc4d8-dbfsr\" (UID: \"1ac095a8-1f1d-4ee4-a60e-d3fb36184d3e\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-gateway-5c5f4bc4d8-dbfsr"
Oct 30 21:21:41.257375 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:21:41.257221    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"rbac\" (UniqueName: \"kubernetes.io/configmap/1ac095a8-1f1d-4ee4-a60e-d3fb36184d3e-rbac\") pod \"tempo-data-science-tempostack-gateway-5c5f4bc4d8-dbfsr\" (UID: \"1ac095a8-1f1d-4ee4-a60e-d3fb36184d3e\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-gateway-5c5f4bc4d8-dbfsr"
Oct 30 21:21:41.257375 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:21:41.257333    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs\" (UniqueName: \"kubernetes.io/secret/1ac095a8-1f1d-4ee4-a60e-d3fb36184d3e-serving-certs\") pod \"tempo-data-science-tempostack-gateway-5c5f4bc4d8-dbfsr\" (UID: \"1ac095a8-1f1d-4ee4-a60e-d3fb36184d3e\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-gateway-5c5f4bc4d8-dbfsr"
Oct 30 21:21:41.257610 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:21:41.257417    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tempo-data-science-tempostack-gateway-mtls\" (UniqueName: \"kubernetes.io/secret/1ac095a8-1f1d-4ee4-a60e-d3fb36184d3e-tempo-data-science-tempostack-gateway-mtls\") pod \"tempo-data-science-tempostack-gateway-5c5f4bc4d8-dbfsr\" (UID: \"1ac095a8-1f1d-4ee4-a60e-d3fb36184d3e\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-gateway-5c5f4bc4d8-dbfsr"
Oct 30 21:21:41.257610 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:21:41.257482    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tenant\" (UniqueName: \"kubernetes.io/secret/1ac095a8-1f1d-4ee4-a60e-d3fb36184d3e-tenant\") pod \"tempo-data-science-tempostack-gateway-5c5f4bc4d8-dbfsr\" (UID: \"1ac095a8-1f1d-4ee4-a60e-d3fb36184d3e\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-gateway-5c5f4bc4d8-dbfsr"
Oct 30 21:21:41.258022 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:21:41.258001    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tempo-data-science-tempostack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ac095a8-1f1d-4ee4-a60e-d3fb36184d3e-tempo-data-science-tempostack-ca-bundle\") pod \"tempo-data-science-tempostack-gateway-5c5f4bc4d8-dbfsr\" (UID: \"1ac095a8-1f1d-4ee4-a60e-d3fb36184d3e\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-gateway-5c5f4bc4d8-dbfsr"
Oct 30 21:21:41.258022 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:21:41.258011    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rbac\" (UniqueName: \"kubernetes.io/configmap/1ac095a8-1f1d-4ee4-a60e-d3fb36184d3e-rbac\") pod \"tempo-data-science-tempostack-gateway-5c5f4bc4d8-dbfsr\" (UID: \"1ac095a8-1f1d-4ee4-a60e-d3fb36184d3e\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-gateway-5c5f4bc4d8-dbfsr"
Oct 30 21:21:41.258170 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:21:41.258110    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle\" (UniqueName: \"kubernetes.io/configmap/1ac095a8-1f1d-4ee4-a60e-d3fb36184d3e-cabundle\") pod \"tempo-data-science-tempostack-gateway-5c5f4bc4d8-dbfsr\" (UID: \"1ac095a8-1f1d-4ee4-a60e-d3fb36184d3e\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-gateway-5c5f4bc4d8-dbfsr"
Oct 30 21:21:41.259960 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:21:41.259934    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tenant\" (UniqueName: \"kubernetes.io/secret/1ac095a8-1f1d-4ee4-a60e-d3fb36184d3e-tenant\") pod \"tempo-data-science-tempostack-gateway-5c5f4bc4d8-dbfsr\" (UID: \"1ac095a8-1f1d-4ee4-a60e-d3fb36184d3e\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-gateway-5c5f4bc4d8-dbfsr"
Oct 30 21:21:41.259960 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:21:41.259955    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tempo-data-science-tempostack-gateway-mtls\" (UniqueName: \"kubernetes.io/secret/1ac095a8-1f1d-4ee4-a60e-d3fb36184d3e-tempo-data-science-tempostack-gateway-mtls\") pod \"tempo-data-science-tempostack-gateway-5c5f4bc4d8-dbfsr\" (UID: \"1ac095a8-1f1d-4ee4-a60e-d3fb36184d3e\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-gateway-5c5f4bc4d8-dbfsr"
Oct 30 21:21:41.260122 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:21:41.260071    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs\" (UniqueName: \"kubernetes.io/secret/1ac095a8-1f1d-4ee4-a60e-d3fb36184d3e-serving-certs\") pod \"tempo-data-science-tempostack-gateway-5c5f4bc4d8-dbfsr\" (UID: \"1ac095a8-1f1d-4ee4-a60e-d3fb36184d3e\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-gateway-5c5f4bc4d8-dbfsr"
Oct 30 21:21:41.318330 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:21:41.318252    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rhcnv\" (UniqueName: \"kubernetes.io/projected/1ac095a8-1f1d-4ee4-a60e-d3fb36184d3e-kube-api-access-rhcnv\") pod \"tempo-data-science-tempostack-gateway-5c5f4bc4d8-dbfsr\" (UID: \"1ac095a8-1f1d-4ee4-a60e-d3fb36184d3e\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-gateway-5c5f4bc4d8-dbfsr"
Oct 30 21:21:41.353961 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:21:41.353931    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/tempo-data-science-tempostack-gateway-5c5f4bc4d8-dbfsr"
Oct 30 21:21:41.827843 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:21:41.827804    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/tempo-data-science-tempostack-gateway-5c5f4bc4d8-dbfsr"]
Oct 30 21:21:41.865408 ip-10-0-142-4 kubenswrapper[4060]: W1030 21:21:41.865378    4060 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ac095a8_1f1d_4ee4_a60e_d3fb36184d3e.slice/crio-686c976f9b9be8632ff64c4f0ce890d58cfef012df2d965c81707e56363b673f WatchSource:0}: Error finding container 686c976f9b9be8632ff64c4f0ce890d58cfef012df2d965c81707e56363b673f: Status 404 returned error can't find the container with id 686c976f9b9be8632ff64c4f0ce890d58cfef012df2d965c81707e56363b673f
Oct 30 21:21:41.919469 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:21:41.919441    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/tempo-data-science-tempostack-gateway-5c5f4bc4d8-dbfsr" event={"ID":"1ac095a8-1f1d-4ee4-a60e-d3fb36184d3e","Type":"ContainerStarted","Data":"686c976f9b9be8632ff64c4f0ce890d58cfef012df2d965c81707e56363b673f"}
Oct 30 21:21:42.149616 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:21:42.149536    4060 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v2f4x" containerName="extractor"
Oct 30 21:21:42.927809 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:21:42.927773    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/tempo-data-science-tempostack-gateway-5c5f4bc4d8-dbfsr" event={"ID":"1ac095a8-1f1d-4ee4-a60e-d3fb36184d3e","Type":"ContainerStarted","Data":"373914afbd5e2abf0374bb0e6825b1d68c571af1806ac76967d75ec468991117"}
Oct 30 21:21:42.928279 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:21:42.927832    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/tempo-data-science-tempostack-gateway-5c5f4bc4d8-dbfsr" event={"ID":"1ac095a8-1f1d-4ee4-a60e-d3fb36184d3e","Type":"ContainerStarted","Data":"d8eab5d9d65bc5ab426abb9c260d9a1cf964f67c9ac8a37b75c27e01f1851e92"}
Oct 30 21:21:42.928279 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:21:42.927968    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/tempo-data-science-tempostack-gateway-5c5f4bc4d8-dbfsr"
Oct 30 21:21:42.928279 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:21:42.928023    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/tempo-data-science-tempostack-gateway-5c5f4bc4d8-dbfsr"
Oct 30 21:21:42.929715 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:21:42.929689    4060 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/tempo-data-science-tempostack-gateway-5c5f4bc4d8-dbfsr" podUID="1ac095a8-1f1d-4ee4-a60e-d3fb36184d3e" containerName="tempo-gateway-opa" probeResult="failure" output="Get \"http://10.133.0.100:8083/ready\": dial tcp 10.133.0.100:8083: connect: connection refused"
Oct 30 21:21:42.929811 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:21:42.929690    4060 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/tempo-data-science-tempostack-gateway-5c5f4bc4d8-dbfsr" podUID="1ac095a8-1f1d-4ee4-a60e-d3fb36184d3e" containerName="tempo-gateway" probeResult="failure" output="Get \"https://10.133.0.100:8081/ready\": dial tcp 10.133.0.100:8081: connect: connection refused"
Oct 30 21:21:43.147204 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:21:43.147149    4060 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/tempo-data-science-tempostack-gateway-5c5f4bc4d8-dbfsr" podStartSLOduration=3.147134814 podStartE2EDuration="3.147134814s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:21:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:21:43.096534682 +0000 UTC m=+2721.853532980" watchObservedRunningTime="2026-10-30 21:21:43.147134814 +0000 UTC m=+2721.904133111"
Oct 30 21:21:43.878688 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:21:43.878651    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/korrel8r-5d45699dc4-22dth"
Oct 30 21:21:43.934991 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:21:43.934960    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/tempo-data-science-tempostack-gateway-5c5f4bc4d8-dbfsr"
Oct 30 21:21:44.156796 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:21:44.156721    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/tempo-data-science-tempostack-gateway-5c5f4bc4d8-dbfsr"
Oct 30 21:22:00.920559 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:22:00.920522    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/tempo-data-science-tempostack-distributor-5d4b69f56-lk8q4"
Oct 30 21:22:00.921527 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:22:00.921483    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/tempo-data-science-tempostack-querier-66cf97989c-bbdff"
Oct 30 21:22:00.927520 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:22:00.927466    4060 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/tempo-data-science-tempostack-compactor-594786c479-qqgkv" podUID="c74a7a04-b7f9-4401-a97b-2ef76cc0cb42" containerName="tempo" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 21:22:10.918561 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:22:10.918424    4060 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/tempo-data-science-tempostack-compactor-594786c479-qqgkv" podUID="c74a7a04-b7f9-4401-a97b-2ef76cc0cb42" containerName="tempo" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 21:22:12.150373 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:22:12.150339    4060 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v2f4x" containerName="extractor"
Oct 30 21:22:20.918544 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:22:20.918480    4060 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/tempo-data-science-tempostack-compactor-594786c479-qqgkv" podUID="c74a7a04-b7f9-4401-a97b-2ef76cc0cb42" containerName="tempo" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 21:22:30.918866 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:22:30.918800    4060 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/tempo-data-science-tempostack-compactor-594786c479-qqgkv" podUID="c74a7a04-b7f9-4401-a97b-2ef76cc0cb42" containerName="tempo" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 21:22:40.918986 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:22:40.918956    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/tempo-data-science-tempostack-compactor-594786c479-qqgkv"
Oct 30 21:22:42.150843 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:22:42.150813    4060 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v2f4x" containerName="extractor"
Oct 30 21:22:47.993384 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:22:47.993348    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:22:47.993927 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:22:47.993609    4060 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-collector-0" podUID="12dd915a-40b8-4607-ab2b-2bbe0532f87b" containerName="otc-container" containerID="cri-o://8faa714fc2ee4b7992c014a1fd916b9f872087ba88c76233cb4f2d84d7d8dd45" gracePeriod=30
Oct 30 21:22:48.233587 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:22:48.233530    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:22:48.237565 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:22:48.237538    4060 generic.go:356] "Generic (PLEG): container finished" podID="12dd915a-40b8-4607-ab2b-2bbe0532f87b" containerID="8faa714fc2ee4b7992c014a1fd916b9f872087ba88c76233cb4f2d84d7d8dd45" exitCode=0
Oct 30 21:22:48.237687 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:22:48.237586    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:22:48.237687 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:22:48.237623    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"12dd915a-40b8-4607-ab2b-2bbe0532f87b","Type":"ContainerDied","Data":"8faa714fc2ee4b7992c014a1fd916b9f872087ba88c76233cb4f2d84d7d8dd45"}
Oct 30 21:22:48.237687 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:22:48.237681    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"12dd915a-40b8-4607-ab2b-2bbe0532f87b","Type":"ContainerDied","Data":"efa3055d3e97a57975c5852f9ac747e8c6023b6be0046d3bb4c1ae6a4f656e10"}
Oct 30 21:22:48.237800 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:22:48.237703    4060 scope.go:122] "RemoveContainer" containerID="8faa714fc2ee4b7992c014a1fd916b9f872087ba88c76233cb4f2d84d7d8dd45"
Oct 30 21:22:48.247317 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:22:48.247293    4060 scope.go:122] "RemoveContainer" containerID="8faa714fc2ee4b7992c014a1fd916b9f872087ba88c76233cb4f2d84d7d8dd45"
Oct 30 21:22:48.247606 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:22:48.247588    4060 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8faa714fc2ee4b7992c014a1fd916b9f872087ba88c76233cb4f2d84d7d8dd45\": container with ID starting with 8faa714fc2ee4b7992c014a1fd916b9f872087ba88c76233cb4f2d84d7d8dd45 not found: ID does not exist" containerID="8faa714fc2ee4b7992c014a1fd916b9f872087ba88c76233cb4f2d84d7d8dd45"
Oct 30 21:22:48.247673 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:22:48.247615    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8faa714fc2ee4b7992c014a1fd916b9f872087ba88c76233cb4f2d84d7d8dd45"} err="failed to get container status \"8faa714fc2ee4b7992c014a1fd916b9f872087ba88c76233cb4f2d84d7d8dd45\": rpc error: code = NotFound desc = could not find container \"8faa714fc2ee4b7992c014a1fd916b9f872087ba88c76233cb4f2d84d7d8dd45\": container with ID starting with 8faa714fc2ee4b7992c014a1fd916b9f872087ba88c76233cb4f2d84d7d8dd45 not found: ID does not exist"
Oct 30 21:22:48.325411 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:22:48.325378    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/12dd915a-40b8-4607-ab2b-2bbe0532f87b-kube-api-access-8jgtj\" (UniqueName: \"kubernetes.io/projected/12dd915a-40b8-4607-ab2b-2bbe0532f87b-kube-api-access-8jgtj\") pod \"12dd915a-40b8-4607-ab2b-2bbe0532f87b\" (UID: \"12dd915a-40b8-4607-ab2b-2bbe0532f87b\") "
Oct 30 21:22:48.325624 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:22:48.325441    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/12dd915a-40b8-4607-ab2b-2bbe0532f87b-otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/12dd915a-40b8-4607-ab2b-2bbe0532f87b-otlp-tls-certs\") pod \"12dd915a-40b8-4607-ab2b-2bbe0532f87b\" (UID: \"12dd915a-40b8-4607-ab2b-2bbe0532f87b\") "
Oct 30 21:22:48.325624 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:22:48.325536    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/12dd915a-40b8-4607-ab2b-2bbe0532f87b-otc-internal\" (UniqueName: \"kubernetes.io/configmap/12dd915a-40b8-4607-ab2b-2bbe0532f87b-otc-internal\") pod \"12dd915a-40b8-4607-ab2b-2bbe0532f87b\" (UID: \"12dd915a-40b8-4607-ab2b-2bbe0532f87b\") "
Oct 30 21:22:48.325624 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:22:48.325587    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/12dd915a-40b8-4607-ab2b-2bbe0532f87b-monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/12dd915a-40b8-4607-ab2b-2bbe0532f87b-monitoring-tls-certs\") pod \"12dd915a-40b8-4607-ab2b-2bbe0532f87b\" (UID: \"12dd915a-40b8-4607-ab2b-2bbe0532f87b\") "
Oct 30 21:22:48.325914 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:22:48.325891    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/12dd915a-40b8-4607-ab2b-2bbe0532f87b-otc-internal" pod "12dd915a-40b8-4607-ab2b-2bbe0532f87b" (UID: "12dd915a-40b8-4607-ab2b-2bbe0532f87b"). InnerVolumeSpecName "otc-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:22:48.327661 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:22:48.327636    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/12dd915a-40b8-4607-ab2b-2bbe0532f87b-kube-api-access-8jgtj" pod "12dd915a-40b8-4607-ab2b-2bbe0532f87b" (UID: "12dd915a-40b8-4607-ab2b-2bbe0532f87b"). InnerVolumeSpecName "kube-api-access-8jgtj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:22:48.327761 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:22:48.327676    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/12dd915a-40b8-4607-ab2b-2bbe0532f87b-monitoring-tls-certs" pod "12dd915a-40b8-4607-ab2b-2bbe0532f87b" (UID: "12dd915a-40b8-4607-ab2b-2bbe0532f87b"). InnerVolumeSpecName "monitoring-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:22:48.327761 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:22:48.327711    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/12dd915a-40b8-4607-ab2b-2bbe0532f87b-otlp-tls-certs" pod "12dd915a-40b8-4607-ab2b-2bbe0532f87b" (UID: "12dd915a-40b8-4607-ab2b-2bbe0532f87b"). InnerVolumeSpecName "otlp-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:22:48.426805 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:22:48.426778    4060 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8jgtj\" (UniqueName: \"kubernetes.io/projected/12dd915a-40b8-4607-ab2b-2bbe0532f87b-kube-api-access-8jgtj\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:22:48.426805 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:22:48.426802    4060 reconciler_common.go:299] "Volume detached for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/12dd915a-40b8-4607-ab2b-2bbe0532f87b-otlp-tls-certs\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:22:48.426805 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:22:48.426812    4060 reconciler_common.go:299] "Volume detached for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/12dd915a-40b8-4607-ab2b-2bbe0532f87b-otc-internal\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:22:48.427047 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:22:48.426822    4060 reconciler_common.go:299] "Volume detached for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/12dd915a-40b8-4607-ab2b-2bbe0532f87b-monitoring-tls-certs\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:22:48.657617 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:22:48.657586    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:22:48.665706 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:22:48.663811    4060 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:22:48.736587 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:22:48.736548    4060 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:22:48.736918 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:22:48.736906    4060 cpu_manager.go:414] "containerMap: removing container" podUID="12dd915a-40b8-4607-ab2b-2bbe0532f87b" containerName="otc-container"
Oct 30 21:22:48.736966 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:22:48.736920    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="12dd915a-40b8-4607-ab2b-2bbe0532f87b" containerName="otc-container"
Oct 30 21:22:48.737004 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:22:48.736985    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="12dd915a-40b8-4607-ab2b-2bbe0532f87b" containerName="otc-container"
Oct 30 21:22:48.741329 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:22:48.741314    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:22:48.794196 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:22:48.794162    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-monitoring-tls\""
Oct 30 21:22:48.794356 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:22:48.794292    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-54f83bab\""
Oct 30 21:22:48.794356 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:22:48.794325    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-dockercfg-phj8t\""
Oct 30 21:22:48.794459 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:22:48.794372    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-headless-tls\""
Oct 30 21:22:48.801832 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:22:48.801773    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:22:48.829742 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:22:48.829707    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/ddb01da8-fe29-4375-a8d8-4dc33d953ef7-monitoring-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"ddb01da8-fe29-4375-a8d8-4dc33d953ef7\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:22:48.829897 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:22:48.829745    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/ddb01da8-fe29-4375-a8d8-4dc33d953ef7-otlp-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"ddb01da8-fe29-4375-a8d8-4dc33d953ef7\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:22:48.829897 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:22:48.829776    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/ddb01da8-fe29-4375-a8d8-4dc33d953ef7-otc-internal\") pod \"data-science-collector-collector-0\" (UID: \"ddb01da8-fe29-4375-a8d8-4dc33d953ef7\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:22:48.829991 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:22:48.829931    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zxsjw\" (UniqueName: \"kubernetes.io/projected/ddb01da8-fe29-4375-a8d8-4dc33d953ef7-kube-api-access-zxsjw\") pod \"data-science-collector-collector-0\" (UID: \"ddb01da8-fe29-4375-a8d8-4dc33d953ef7\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:22:48.930936 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:22:48.930902    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/ddb01da8-fe29-4375-a8d8-4dc33d953ef7-otc-internal\") pod \"data-science-collector-collector-0\" (UID: \"ddb01da8-fe29-4375-a8d8-4dc33d953ef7\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:22:48.931122 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:22:48.930944    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zxsjw\" (UniqueName: \"kubernetes.io/projected/ddb01da8-fe29-4375-a8d8-4dc33d953ef7-kube-api-access-zxsjw\") pod \"data-science-collector-collector-0\" (UID: \"ddb01da8-fe29-4375-a8d8-4dc33d953ef7\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:22:48.931122 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:22:48.931007    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/ddb01da8-fe29-4375-a8d8-4dc33d953ef7-monitoring-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"ddb01da8-fe29-4375-a8d8-4dc33d953ef7\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:22:48.931122 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:22:48.931026    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/ddb01da8-fe29-4375-a8d8-4dc33d953ef7-otlp-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"ddb01da8-fe29-4375-a8d8-4dc33d953ef7\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:22:48.931642 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:22:48.931622    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/ddb01da8-fe29-4375-a8d8-4dc33d953ef7-otc-internal\") pod \"data-science-collector-collector-0\" (UID: \"ddb01da8-fe29-4375-a8d8-4dc33d953ef7\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:22:48.933457 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:22:48.933421    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/ddb01da8-fe29-4375-a8d8-4dc33d953ef7-monitoring-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"ddb01da8-fe29-4375-a8d8-4dc33d953ef7\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:22:48.933589 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:22:48.933512    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/ddb01da8-fe29-4375-a8d8-4dc33d953ef7-otlp-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"ddb01da8-fe29-4375-a8d8-4dc33d953ef7\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:22:48.992182 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:22:48.992156    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zxsjw\" (UniqueName: \"kubernetes.io/projected/ddb01da8-fe29-4375-a8d8-4dc33d953ef7-kube-api-access-zxsjw\") pod \"data-science-collector-collector-0\" (UID: \"ddb01da8-fe29-4375-a8d8-4dc33d953ef7\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:22:49.054181 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:22:49.054101    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:22:49.427508 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:22:49.427409    4060 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="12dd915a-40b8-4607-ab2b-2bbe0532f87b" path="/var/lib/kubelet/pods/12dd915a-40b8-4607-ab2b-2bbe0532f87b/volumes"
Oct 30 21:22:49.429545 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:22:49.429504    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:22:49.431019 ip-10-0-142-4 kubenswrapper[4060]: W1030 21:22:49.430993    4060 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podddb01da8_fe29_4375_a8d8_4dc33d953ef7.slice/crio-c9eb8ddedeb0c3cd416b9c9e70c1af3552064354ff1361cc055bbb5ebae6e7c9 WatchSource:0}: Error finding container c9eb8ddedeb0c3cd416b9c9e70c1af3552064354ff1361cc055bbb5ebae6e7c9: Status 404 returned error can't find the container with id c9eb8ddedeb0c3cd416b9c9e70c1af3552064354ff1361cc055bbb5ebae6e7c9
Oct 30 21:22:49.433081 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:22:49.433050    4060 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 21:22:49.433155 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:22:49.433105    4060 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 21:22:50.250238 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:22:50.250198    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"ddb01da8-fe29-4375-a8d8-4dc33d953ef7","Type":"ContainerStarted","Data":"575e58da883dcaee72bdb99b601c8abd807077dfefcd33054eb90334b8afffdf"}
Oct 30 21:22:50.250640 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:22:50.250256    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"ddb01da8-fe29-4375-a8d8-4dc33d953ef7","Type":"ContainerStarted","Data":"c9eb8ddedeb0c3cd416b9c9e70c1af3552064354ff1361cc055bbb5ebae6e7c9"}
Oct 30 21:22:50.368693 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:22:50.368647    4060 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-collector-0" podStartSLOduration=2.3686338940000002 podStartE2EDuration="2.368633894s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:22:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:22:50.36681715 +0000 UTC m=+2789.123815445" watchObservedRunningTime="2026-10-30 21:22:50.368633894 +0000 UTC m=+2789.125632193"
Oct 30 21:22:54.109981 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:22:54.109946    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/korrel8r-5d45699dc4-22dth"]
Oct 30 21:22:54.110552 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:22:54.110146    4060 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/korrel8r-5d45699dc4-22dth" podUID="df137507-d9aa-49a6-8ecf-ff2215870fb3" containerName="korrel8r" containerID="cri-o://0eaa5823e6e566ccb65160a1fb4135828f130cf652080080a4d4a25d3c238c93" gracePeriod=30
Oct 30 21:22:54.274470 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:22:54.274439    4060 generic.go:356] "Generic (PLEG): container finished" podID="df137507-d9aa-49a6-8ecf-ff2215870fb3" containerID="0eaa5823e6e566ccb65160a1fb4135828f130cf652080080a4d4a25d3c238c93" exitCode=0
Oct 30 21:22:54.274635 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:22:54.274521    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/korrel8r-5d45699dc4-22dth" event={"ID":"df137507-d9aa-49a6-8ecf-ff2215870fb3","Type":"ContainerDied","Data":"0eaa5823e6e566ccb65160a1fb4135828f130cf652080080a4d4a25d3c238c93"}
Oct 30 21:22:54.360750 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:22:54.360695    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/korrel8r-5d45699dc4-22dth"
Oct 30 21:22:54.478588 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:22:54.478554    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/df137507-d9aa-49a6-8ecf-ff2215870fb3-config\" (UniqueName: \"kubernetes.io/configmap/df137507-d9aa-49a6-8ecf-ff2215870fb3-config\") pod \"df137507-d9aa-49a6-8ecf-ff2215870fb3\" (UID: \"df137507-d9aa-49a6-8ecf-ff2215870fb3\") "
Oct 30 21:22:54.478739 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:22:54.478605    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/df137507-d9aa-49a6-8ecf-ff2215870fb3-kube-api-access-8zr27\" (UniqueName: \"kubernetes.io/projected/df137507-d9aa-49a6-8ecf-ff2215870fb3-kube-api-access-8zr27\") pod \"df137507-d9aa-49a6-8ecf-ff2215870fb3\" (UID: \"df137507-d9aa-49a6-8ecf-ff2215870fb3\") "
Oct 30 21:22:54.478739 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:22:54.478639    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/df137507-d9aa-49a6-8ecf-ff2215870fb3-tls\" (UniqueName: \"kubernetes.io/secret/df137507-d9aa-49a6-8ecf-ff2215870fb3-tls\") pod \"df137507-d9aa-49a6-8ecf-ff2215870fb3\" (UID: \"df137507-d9aa-49a6-8ecf-ff2215870fb3\") "
Oct 30 21:22:54.479393 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:22:54.479365    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/df137507-d9aa-49a6-8ecf-ff2215870fb3-config" pod "df137507-d9aa-49a6-8ecf-ff2215870fb3" (UID: "df137507-d9aa-49a6-8ecf-ff2215870fb3"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:22:54.480956 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:22:54.480927    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/df137507-d9aa-49a6-8ecf-ff2215870fb3-kube-api-access-8zr27" pod "df137507-d9aa-49a6-8ecf-ff2215870fb3" (UID: "df137507-d9aa-49a6-8ecf-ff2215870fb3"). InnerVolumeSpecName "kube-api-access-8zr27". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:22:54.481167 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:22:54.481059    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/df137507-d9aa-49a6-8ecf-ff2215870fb3-tls" pod "df137507-d9aa-49a6-8ecf-ff2215870fb3" (UID: "df137507-d9aa-49a6-8ecf-ff2215870fb3"). InnerVolumeSpecName "tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:22:54.579642 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:22:54.579612    4060 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8zr27\" (UniqueName: \"kubernetes.io/projected/df137507-d9aa-49a6-8ecf-ff2215870fb3-kube-api-access-8zr27\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:22:54.579642 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:22:54.579637    4060 reconciler_common.go:299] "Volume detached for volume \"tls\" (UniqueName: \"kubernetes.io/secret/df137507-d9aa-49a6-8ecf-ff2215870fb3-tls\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:22:54.579642 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:22:54.579646    4060 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/df137507-d9aa-49a6-8ecf-ff2215870fb3-config\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:22:55.280409 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:22:55.280377    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/korrel8r-5d45699dc4-22dth"
Oct 30 21:22:55.280867 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:22:55.280423    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/korrel8r-5d45699dc4-22dth" event={"ID":"df137507-d9aa-49a6-8ecf-ff2215870fb3","Type":"ContainerDied","Data":"afa77b0dfdcfaea63629b962d3cd4aaa5c8c62e66588e44e26fe92aab76ea3e4"}
Oct 30 21:22:55.280867 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:22:55.280480    4060 scope.go:122] "RemoveContainer" containerID="0eaa5823e6e566ccb65160a1fb4135828f130cf652080080a4d4a25d3c238c93"
Oct 30 21:22:55.434677 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:22:55.434646    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:22:55.434851 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:22:55.434816    4060 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-collector-0" podUID="ddb01da8-fe29-4375-a8d8-4dc33d953ef7" containerName="otc-container" containerID="cri-o://575e58da883dcaee72bdb99b601c8abd807077dfefcd33054eb90334b8afffdf" gracePeriod=30
Oct 30 21:22:55.446336 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:22:55.446312    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/korrel8r-5d45699dc4-22dth"]
Oct 30 21:22:55.471910 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:22:55.471881    4060 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/korrel8r-5d45699dc4-22dth"]
Oct 30 21:22:55.690333 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:22:55.690311    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:22:55.791476 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:22:55.791450    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ddb01da8-fe29-4375-a8d8-4dc33d953ef7-monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/ddb01da8-fe29-4375-a8d8-4dc33d953ef7-monitoring-tls-certs\") pod \"ddb01da8-fe29-4375-a8d8-4dc33d953ef7\" (UID: \"ddb01da8-fe29-4375-a8d8-4dc33d953ef7\") "
Oct 30 21:22:55.791476 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:22:55.791481    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ddb01da8-fe29-4375-a8d8-4dc33d953ef7-otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/ddb01da8-fe29-4375-a8d8-4dc33d953ef7-otlp-tls-certs\") pod \"ddb01da8-fe29-4375-a8d8-4dc33d953ef7\" (UID: \"ddb01da8-fe29-4375-a8d8-4dc33d953ef7\") "
Oct 30 21:22:55.791733 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:22:55.791555    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ddb01da8-fe29-4375-a8d8-4dc33d953ef7-kube-api-access-zxsjw\" (UniqueName: \"kubernetes.io/projected/ddb01da8-fe29-4375-a8d8-4dc33d953ef7-kube-api-access-zxsjw\") pod \"ddb01da8-fe29-4375-a8d8-4dc33d953ef7\" (UID: \"ddb01da8-fe29-4375-a8d8-4dc33d953ef7\") "
Oct 30 21:22:55.791733 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:22:55.791601    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ddb01da8-fe29-4375-a8d8-4dc33d953ef7-otc-internal\" (UniqueName: \"kubernetes.io/configmap/ddb01da8-fe29-4375-a8d8-4dc33d953ef7-otc-internal\") pod \"ddb01da8-fe29-4375-a8d8-4dc33d953ef7\" (UID: \"ddb01da8-fe29-4375-a8d8-4dc33d953ef7\") "
Oct 30 21:22:55.792233 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:22:55.792204    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ddb01da8-fe29-4375-a8d8-4dc33d953ef7-otc-internal" pod "ddb01da8-fe29-4375-a8d8-4dc33d953ef7" (UID: "ddb01da8-fe29-4375-a8d8-4dc33d953ef7"). InnerVolumeSpecName "otc-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:22:55.794345 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:22:55.794317    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ddb01da8-fe29-4375-a8d8-4dc33d953ef7-otlp-tls-certs" pod "ddb01da8-fe29-4375-a8d8-4dc33d953ef7" (UID: "ddb01da8-fe29-4375-a8d8-4dc33d953ef7"). InnerVolumeSpecName "otlp-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:22:55.796003 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:22:55.795971    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ddb01da8-fe29-4375-a8d8-4dc33d953ef7-monitoring-tls-certs" pod "ddb01da8-fe29-4375-a8d8-4dc33d953ef7" (UID: "ddb01da8-fe29-4375-a8d8-4dc33d953ef7"). InnerVolumeSpecName "monitoring-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:22:55.796087 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:22:55.796017    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ddb01da8-fe29-4375-a8d8-4dc33d953ef7-kube-api-access-zxsjw" pod "ddb01da8-fe29-4375-a8d8-4dc33d953ef7" (UID: "ddb01da8-fe29-4375-a8d8-4dc33d953ef7"). InnerVolumeSpecName "kube-api-access-zxsjw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:22:55.893108 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:22:55.893031    4060 reconciler_common.go:299] "Volume detached for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/ddb01da8-fe29-4375-a8d8-4dc33d953ef7-monitoring-tls-certs\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:22:55.893108 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:22:55.893061    4060 reconciler_common.go:299] "Volume detached for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/ddb01da8-fe29-4375-a8d8-4dc33d953ef7-otlp-tls-certs\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:22:55.893108 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:22:55.893071    4060 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zxsjw\" (UniqueName: \"kubernetes.io/projected/ddb01da8-fe29-4375-a8d8-4dc33d953ef7-kube-api-access-zxsjw\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:22:55.893108 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:22:55.893081    4060 reconciler_common.go:299] "Volume detached for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/ddb01da8-fe29-4375-a8d8-4dc33d953ef7-otc-internal\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:22:56.289379 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:22:56.289344    4060 generic.go:356] "Generic (PLEG): container finished" podID="ddb01da8-fe29-4375-a8d8-4dc33d953ef7" containerID="575e58da883dcaee72bdb99b601c8abd807077dfefcd33054eb90334b8afffdf" exitCode=0
Oct 30 21:22:56.289883 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:22:56.289395    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:22:56.289883 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:22:56.289425    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"ddb01da8-fe29-4375-a8d8-4dc33d953ef7","Type":"ContainerDied","Data":"575e58da883dcaee72bdb99b601c8abd807077dfefcd33054eb90334b8afffdf"}
Oct 30 21:22:56.289883 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:22:56.289477    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"ddb01da8-fe29-4375-a8d8-4dc33d953ef7","Type":"ContainerDied","Data":"c9eb8ddedeb0c3cd416b9c9e70c1af3552064354ff1361cc055bbb5ebae6e7c9"}
Oct 30 21:22:56.289883 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:22:56.289521    4060 scope.go:122] "RemoveContainer" containerID="575e58da883dcaee72bdb99b601c8abd807077dfefcd33054eb90334b8afffdf"
Oct 30 21:22:56.299863 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:22:56.299581    4060 scope.go:122] "RemoveContainer" containerID="575e58da883dcaee72bdb99b601c8abd807077dfefcd33054eb90334b8afffdf"
Oct 30 21:22:56.299951 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:22:56.299865    4060 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"575e58da883dcaee72bdb99b601c8abd807077dfefcd33054eb90334b8afffdf\": container with ID starting with 575e58da883dcaee72bdb99b601c8abd807077dfefcd33054eb90334b8afffdf not found: ID does not exist" containerID="575e58da883dcaee72bdb99b601c8abd807077dfefcd33054eb90334b8afffdf"
Oct 30 21:22:56.299951 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:22:56.299921    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"575e58da883dcaee72bdb99b601c8abd807077dfefcd33054eb90334b8afffdf"} err="failed to get container status \"575e58da883dcaee72bdb99b601c8abd807077dfefcd33054eb90334b8afffdf\": rpc error: code = NotFound desc = could not find container \"575e58da883dcaee72bdb99b601c8abd807077dfefcd33054eb90334b8afffdf\": container with ID starting with 575e58da883dcaee72bdb99b601c8abd807077dfefcd33054eb90334b8afffdf not found: ID does not exist"
Oct 30 21:22:56.440710 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:22:56.440679    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/tempo-data-science-tempostack-querier-66cf97989c-bbdff"]
Oct 30 21:22:56.441082 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:22:56.441055    4060 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/tempo-data-science-tempostack-querier-66cf97989c-bbdff" podUID="89a032e2-2d7b-43d7-bdd3-8cf4408e9e8a" containerName="tempo" containerID="cri-o://02a670f320d7efbee273d8b4886278473f9b2111a2834d2d183e01595bebf071" gracePeriod=30
Oct 30 21:22:56.446089 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:22:56.446064    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/tempo-data-science-tempostack-compactor-594786c479-qqgkv"]
Oct 30 21:22:56.446296 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:22:56.446270    4060 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/tempo-data-science-tempostack-compactor-594786c479-qqgkv" podUID="c74a7a04-b7f9-4401-a97b-2ef76cc0cb42" containerName="tempo" containerID="cri-o://b7eda03ed2a8cb02eb614761c5d0998ae990d130cc99b3c7cbaf757200aea3ae" gracePeriod=30
Oct 30 21:22:56.453384 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:22:56.453357    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/tempo-data-science-tempostack-gateway-5c5f4bc4d8-dbfsr"]
Oct 30 21:22:56.453658 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:22:56.453631    4060 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/tempo-data-science-tempostack-gateway-5c5f4bc4d8-dbfsr" podUID="1ac095a8-1f1d-4ee4-a60e-d3fb36184d3e" containerName="tempo-gateway" containerID="cri-o://d8eab5d9d65bc5ab426abb9c260d9a1cf964f67c9ac8a37b75c27e01f1851e92" gracePeriod=30
Oct 30 21:22:56.453718 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:22:56.453663    4060 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/tempo-data-science-tempostack-gateway-5c5f4bc4d8-dbfsr" podUID="1ac095a8-1f1d-4ee4-a60e-d3fb36184d3e" containerName="tempo-gateway-opa" containerID="cri-o://373914afbd5e2abf0374bb0e6825b1d68c571af1806ac76967d75ec468991117" gracePeriod=30
Oct 30 21:22:56.461971 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:22:56.461944    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/tempo-data-science-tempostack-distributor-5d4b69f56-lk8q4"]
Oct 30 21:22:56.462171 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:22:56.462146    4060 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/tempo-data-science-tempostack-distributor-5d4b69f56-lk8q4" podUID="79dff00b-7000-4e8d-872a-30822842afa0" containerName="tempo" containerID="cri-o://9c741dc16e3a9c5ce874f7ca4abdda87ef0ffb3b3dac59150fe7adf1c397af8f" gracePeriod=30
Oct 30 21:22:56.467552 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:22:56.467438    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:22:56.473230 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:22:56.473205    4060 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:22:57.298585 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:22:57.298554    4060 generic.go:356] "Generic (PLEG): container finished" podID="1ac095a8-1f1d-4ee4-a60e-d3fb36184d3e" containerID="373914afbd5e2abf0374bb0e6825b1d68c571af1806ac76967d75ec468991117" exitCode=0
Oct 30 21:22:57.299017 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:22:57.298631    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/tempo-data-science-tempostack-gateway-5c5f4bc4d8-dbfsr" event={"ID":"1ac095a8-1f1d-4ee4-a60e-d3fb36184d3e","Type":"ContainerDied","Data":"373914afbd5e2abf0374bb0e6825b1d68c571af1806ac76967d75ec468991117"}
Oct 30 21:22:57.300294 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:22:57.300274    4060 generic.go:356] "Generic (PLEG): container finished" podID="79dff00b-7000-4e8d-872a-30822842afa0" containerID="9c741dc16e3a9c5ce874f7ca4abdda87ef0ffb3b3dac59150fe7adf1c397af8f" exitCode=0
Oct 30 21:22:57.300413 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:22:57.300346    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/tempo-data-science-tempostack-distributor-5d4b69f56-lk8q4" event={"ID":"79dff00b-7000-4e8d-872a-30822842afa0","Type":"ContainerDied","Data":"9c741dc16e3a9c5ce874f7ca4abdda87ef0ffb3b3dac59150fe7adf1c397af8f"}
Oct 30 21:22:57.426696 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:22:57.426627    4060 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ddb01da8-fe29-4375-a8d8-4dc33d953ef7" path="/var/lib/kubelet/pods/ddb01da8-fe29-4375-a8d8-4dc33d953ef7/volumes"
Oct 30 21:22:57.427099 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:22:57.427079    4060 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="df137507-d9aa-49a6-8ecf-ff2215870fb3" path="/var/lib/kubelet/pods/df137507-d9aa-49a6-8ecf-ff2215870fb3/volumes"
Oct 30 21:22:57.427711 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:22:57.427694    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/tempo-data-science-tempostack-distributor-5d4b69f56-lk8q4"
Oct 30 21:22:57.506388 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:22:57.506359    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/79dff00b-7000-4e8d-872a-30822842afa0-tempo-conf\" (UniqueName: \"kubernetes.io/configmap/79dff00b-7000-4e8d-872a-30822842afa0-tempo-conf\") pod \"79dff00b-7000-4e8d-872a-30822842afa0\" (UID: \"79dff00b-7000-4e8d-872a-30822842afa0\") "
Oct 30 21:22:57.506570 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:22:57.506411    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/79dff00b-7000-4e8d-872a-30822842afa0-kube-api-access-2xb6m\" (UniqueName: \"kubernetes.io/projected/79dff00b-7000-4e8d-872a-30822842afa0-kube-api-access-2xb6m\") pod \"79dff00b-7000-4e8d-872a-30822842afa0\" (UID: \"79dff00b-7000-4e8d-872a-30822842afa0\") "
Oct 30 21:22:57.506570 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:22:57.506448    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/79dff00b-7000-4e8d-872a-30822842afa0-tempo-data-science-tempostack-distributor-mtls\" (UniqueName: \"kubernetes.io/secret/79dff00b-7000-4e8d-872a-30822842afa0-tempo-data-science-tempostack-distributor-mtls\") pod \"79dff00b-7000-4e8d-872a-30822842afa0\" (UID: \"79dff00b-7000-4e8d-872a-30822842afa0\") "
Oct 30 21:22:57.506570 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:22:57.506487    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/79dff00b-7000-4e8d-872a-30822842afa0-tempo-tmp-storage\" (UniqueName: \"kubernetes.io/empty-dir/79dff00b-7000-4e8d-872a-30822842afa0-tempo-tmp-storage\") pod \"79dff00b-7000-4e8d-872a-30822842afa0\" (UID: \"79dff00b-7000-4e8d-872a-30822842afa0\") "
Oct 30 21:22:57.506757 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:22:57.506607    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/79dff00b-7000-4e8d-872a-30822842afa0-tempo-data-science-tempostack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79dff00b-7000-4e8d-872a-30822842afa0-tempo-data-science-tempostack-ca-bundle\") pod \"79dff00b-7000-4e8d-872a-30822842afa0\" (UID: \"79dff00b-7000-4e8d-872a-30822842afa0\") "
Oct 30 21:22:57.506817 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:22:57.506799    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/79dff00b-7000-4e8d-872a-30822842afa0-tempo-tmp-storage" pod "79dff00b-7000-4e8d-872a-30822842afa0" (UID: "79dff00b-7000-4e8d-872a-30822842afa0"). InnerVolumeSpecName "tempo-tmp-storage". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:22:57.506989 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:22:57.506964    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/79dff00b-7000-4e8d-872a-30822842afa0-tempo-conf" pod "79dff00b-7000-4e8d-872a-30822842afa0" (UID: "79dff00b-7000-4e8d-872a-30822842afa0"). InnerVolumeSpecName "tempo-conf". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:22:57.507074 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:22:57.506992    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/79dff00b-7000-4e8d-872a-30822842afa0-tempo-data-science-tempostack-ca-bundle" pod "79dff00b-7000-4e8d-872a-30822842afa0" (UID: "79dff00b-7000-4e8d-872a-30822842afa0"). InnerVolumeSpecName "tempo-data-science-tempostack-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:22:57.507074 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:22:57.507036    4060 reconciler_common.go:299] "Volume detached for volume \"tempo-tmp-storage\" (UniqueName: \"kubernetes.io/empty-dir/79dff00b-7000-4e8d-872a-30822842afa0-tempo-tmp-storage\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:22:57.508658 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:22:57.508636    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/79dff00b-7000-4e8d-872a-30822842afa0-tempo-data-science-tempostack-distributor-mtls" pod "79dff00b-7000-4e8d-872a-30822842afa0" (UID: "79dff00b-7000-4e8d-872a-30822842afa0"). InnerVolumeSpecName "tempo-data-science-tempostack-distributor-mtls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:22:57.508724 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:22:57.508691    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/79dff00b-7000-4e8d-872a-30822842afa0-kube-api-access-2xb6m" pod "79dff00b-7000-4e8d-872a-30822842afa0" (UID: "79dff00b-7000-4e8d-872a-30822842afa0"). InnerVolumeSpecName "kube-api-access-2xb6m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:22:57.607419 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:22:57.607383    4060 reconciler_common.go:299] "Volume detached for volume \"tempo-data-science-tempostack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79dff00b-7000-4e8d-872a-30822842afa0-tempo-data-science-tempostack-ca-bundle\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:22:57.607419 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:22:57.607418    4060 reconciler_common.go:299] "Volume detached for volume \"tempo-conf\" (UniqueName: \"kubernetes.io/configmap/79dff00b-7000-4e8d-872a-30822842afa0-tempo-conf\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:22:57.607634 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:22:57.607461    4060 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2xb6m\" (UniqueName: \"kubernetes.io/projected/79dff00b-7000-4e8d-872a-30822842afa0-kube-api-access-2xb6m\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:22:57.607634 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:22:57.607475    4060 reconciler_common.go:299] "Volume detached for volume \"tempo-data-science-tempostack-distributor-mtls\" (UniqueName: \"kubernetes.io/secret/79dff00b-7000-4e8d-872a-30822842afa0-tempo-data-science-tempostack-distributor-mtls\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:22:57.702645 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:22:57.702623    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/tempo-data-science-tempostack-gateway-5c5f4bc4d8-dbfsr"
Oct 30 21:22:57.809716 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:22:57.809652    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/1ac095a8-1f1d-4ee4-a60e-d3fb36184d3e-tempo-data-science-tempostack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ac095a8-1f1d-4ee4-a60e-d3fb36184d3e-tempo-data-science-tempostack-ca-bundle\") pod \"1ac095a8-1f1d-4ee4-a60e-d3fb36184d3e\" (UID: \"1ac095a8-1f1d-4ee4-a60e-d3fb36184d3e\") "
Oct 30 21:22:57.809865 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:22:57.809733    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/1ac095a8-1f1d-4ee4-a60e-d3fb36184d3e-tempo-data-science-tempostack-gateway-mtls\" (UniqueName: \"kubernetes.io/secret/1ac095a8-1f1d-4ee4-a60e-d3fb36184d3e-tempo-data-science-tempostack-gateway-mtls\") pod \"1ac095a8-1f1d-4ee4-a60e-d3fb36184d3e\" (UID: \"1ac095a8-1f1d-4ee4-a60e-d3fb36184d3e\") "
Oct 30 21:22:57.809865 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:22:57.809826    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/1ac095a8-1f1d-4ee4-a60e-d3fb36184d3e-rbac\" (UniqueName: \"kubernetes.io/configmap/1ac095a8-1f1d-4ee4-a60e-d3fb36184d3e-rbac\") pod \"1ac095a8-1f1d-4ee4-a60e-d3fb36184d3e\" (UID: \"1ac095a8-1f1d-4ee4-a60e-d3fb36184d3e\") "
Oct 30 21:22:57.810052 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:22:57.809880    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/1ac095a8-1f1d-4ee4-a60e-d3fb36184d3e-tenant\" (UniqueName: \"kubernetes.io/secret/1ac095a8-1f1d-4ee4-a60e-d3fb36184d3e-tenant\") pod \"1ac095a8-1f1d-4ee4-a60e-d3fb36184d3e\" (UID: \"1ac095a8-1f1d-4ee4-a60e-d3fb36184d3e\") "
Oct 30 21:22:57.810052 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:22:57.809920    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1ac095a8-1f1d-4ee4-a60e-d3fb36184d3e-kube-api-access-rhcnv\" (UniqueName: \"kubernetes.io/projected/1ac095a8-1f1d-4ee4-a60e-d3fb36184d3e-kube-api-access-rhcnv\") pod \"1ac095a8-1f1d-4ee4-a60e-d3fb36184d3e\" (UID: \"1ac095a8-1f1d-4ee4-a60e-d3fb36184d3e\") "
Oct 30 21:22:57.810052 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:22:57.809975    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/1ac095a8-1f1d-4ee4-a60e-d3fb36184d3e-cabundle\" (UniqueName: \"kubernetes.io/configmap/1ac095a8-1f1d-4ee4-a60e-d3fb36184d3e-cabundle\") pod \"1ac095a8-1f1d-4ee4-a60e-d3fb36184d3e\" (UID: \"1ac095a8-1f1d-4ee4-a60e-d3fb36184d3e\") "
Oct 30 21:22:57.810052 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:22:57.810023    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/1ac095a8-1f1d-4ee4-a60e-d3fb36184d3e-serving-certs\" (UniqueName: \"kubernetes.io/secret/1ac095a8-1f1d-4ee4-a60e-d3fb36184d3e-serving-certs\") pod \"1ac095a8-1f1d-4ee4-a60e-d3fb36184d3e\" (UID: \"1ac095a8-1f1d-4ee4-a60e-d3fb36184d3e\") "
Oct 30 21:22:57.810264 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:22:57.810080    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1ac095a8-1f1d-4ee4-a60e-d3fb36184d3e-tempo-data-science-tempostack-ca-bundle" pod "1ac095a8-1f1d-4ee4-a60e-d3fb36184d3e" (UID: "1ac095a8-1f1d-4ee4-a60e-d3fb36184d3e"). InnerVolumeSpecName "tempo-data-science-tempostack-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:22:57.810264 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:22:57.810189    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1ac095a8-1f1d-4ee4-a60e-d3fb36184d3e-rbac" pod "1ac095a8-1f1d-4ee4-a60e-d3fb36184d3e" (UID: "1ac095a8-1f1d-4ee4-a60e-d3fb36184d3e"). InnerVolumeSpecName "rbac". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:22:57.810362 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:22:57.810281    4060 reconciler_common.go:299] "Volume detached for volume \"tempo-data-science-tempostack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ac095a8-1f1d-4ee4-a60e-d3fb36184d3e-tempo-data-science-tempostack-ca-bundle\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:22:57.810362 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:22:57.810301    4060 reconciler_common.go:299] "Volume detached for volume \"rbac\" (UniqueName: \"kubernetes.io/configmap/1ac095a8-1f1d-4ee4-a60e-d3fb36184d3e-rbac\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:22:57.810449 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:22:57.810411    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1ac095a8-1f1d-4ee4-a60e-d3fb36184d3e-cabundle" pod "1ac095a8-1f1d-4ee4-a60e-d3fb36184d3e" (UID: "1ac095a8-1f1d-4ee4-a60e-d3fb36184d3e"). InnerVolumeSpecName "cabundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:22:57.811946 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:22:57.811924    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1ac095a8-1f1d-4ee4-a60e-d3fb36184d3e-tempo-data-science-tempostack-gateway-mtls" pod "1ac095a8-1f1d-4ee4-a60e-d3fb36184d3e" (UID: "1ac095a8-1f1d-4ee4-a60e-d3fb36184d3e"). InnerVolumeSpecName "tempo-data-science-tempostack-gateway-mtls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:22:57.812099 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:22:57.812084    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1ac095a8-1f1d-4ee4-a60e-d3fb36184d3e-serving-certs" pod "1ac095a8-1f1d-4ee4-a60e-d3fb36184d3e" (UID: "1ac095a8-1f1d-4ee4-a60e-d3fb36184d3e"). InnerVolumeSpecName "serving-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:22:57.812386 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:22:57.812365    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ac095a8-1f1d-4ee4-a60e-d3fb36184d3e-kube-api-access-rhcnv" pod "1ac095a8-1f1d-4ee4-a60e-d3fb36184d3e" (UID: "1ac095a8-1f1d-4ee4-a60e-d3fb36184d3e"). InnerVolumeSpecName "kube-api-access-rhcnv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:22:57.815950 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:22:57.815931    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1ac095a8-1f1d-4ee4-a60e-d3fb36184d3e-tenant" pod "1ac095a8-1f1d-4ee4-a60e-d3fb36184d3e" (UID: "1ac095a8-1f1d-4ee4-a60e-d3fb36184d3e"). InnerVolumeSpecName "tenant". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:22:57.911302 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:22:57.911271    4060 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rhcnv\" (UniqueName: \"kubernetes.io/projected/1ac095a8-1f1d-4ee4-a60e-d3fb36184d3e-kube-api-access-rhcnv\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:22:57.911302 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:22:57.911300    4060 reconciler_common.go:299] "Volume detached for volume \"cabundle\" (UniqueName: \"kubernetes.io/configmap/1ac095a8-1f1d-4ee4-a60e-d3fb36184d3e-cabundle\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:22:57.911522 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:22:57.911313    4060 reconciler_common.go:299] "Volume detached for volume \"serving-certs\" (UniqueName: \"kubernetes.io/secret/1ac095a8-1f1d-4ee4-a60e-d3fb36184d3e-serving-certs\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:22:57.911522 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:22:57.911327    4060 reconciler_common.go:299] "Volume detached for volume \"tempo-data-science-tempostack-gateway-mtls\" (UniqueName: \"kubernetes.io/secret/1ac095a8-1f1d-4ee4-a60e-d3fb36184d3e-tempo-data-science-tempostack-gateway-mtls\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:22:57.911522 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:22:57.911340    4060 reconciler_common.go:299] "Volume detached for volume \"tenant\" (UniqueName: \"kubernetes.io/secret/1ac095a8-1f1d-4ee4-a60e-d3fb36184d3e-tenant\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:22:58.307346 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:22:58.307314    4060 generic.go:356] "Generic (PLEG): container finished" podID="1ac095a8-1f1d-4ee4-a60e-d3fb36184d3e" containerID="d8eab5d9d65bc5ab426abb9c260d9a1cf964f67c9ac8a37b75c27e01f1851e92" exitCode=0
Oct 30 21:22:58.307858 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:22:58.307372    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/tempo-data-science-tempostack-gateway-5c5f4bc4d8-dbfsr"
Oct 30 21:22:58.307858 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:22:58.307400    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/tempo-data-science-tempostack-gateway-5c5f4bc4d8-dbfsr" event={"ID":"1ac095a8-1f1d-4ee4-a60e-d3fb36184d3e","Type":"ContainerDied","Data":"d8eab5d9d65bc5ab426abb9c260d9a1cf964f67c9ac8a37b75c27e01f1851e92"}
Oct 30 21:22:58.307858 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:22:58.307532    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/tempo-data-science-tempostack-gateway-5c5f4bc4d8-dbfsr" event={"ID":"1ac095a8-1f1d-4ee4-a60e-d3fb36184d3e","Type":"ContainerDied","Data":"686c976f9b9be8632ff64c4f0ce890d58cfef012df2d965c81707e56363b673f"}
Oct 30 21:22:58.307858 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:22:58.307575    4060 scope.go:122] "RemoveContainer" containerID="373914afbd5e2abf0374bb0e6825b1d68c571af1806ac76967d75ec468991117"
Oct 30 21:22:58.308925 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:22:58.308895    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/tempo-data-science-tempostack-distributor-5d4b69f56-lk8q4" event={"ID":"79dff00b-7000-4e8d-872a-30822842afa0","Type":"ContainerDied","Data":"8d22a385dd3fa76f7d107711d0fe7bc3cc225c71a37300b643cda8b581f19bdb"}
Oct 30 21:22:58.309038 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:22:58.308941    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/tempo-data-science-tempostack-distributor-5d4b69f56-lk8q4"
Oct 30 21:22:58.316250 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:22:58.316235    4060 scope.go:122] "RemoveContainer" containerID="d8eab5d9d65bc5ab426abb9c260d9a1cf964f67c9ac8a37b75c27e01f1851e92"
Oct 30 21:22:58.324695 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:22:58.324674    4060 scope.go:122] "RemoveContainer" containerID="373914afbd5e2abf0374bb0e6825b1d68c571af1806ac76967d75ec468991117"
Oct 30 21:22:58.324941 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:22:58.324924    4060 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"373914afbd5e2abf0374bb0e6825b1d68c571af1806ac76967d75ec468991117\": container with ID starting with 373914afbd5e2abf0374bb0e6825b1d68c571af1806ac76967d75ec468991117 not found: ID does not exist" containerID="373914afbd5e2abf0374bb0e6825b1d68c571af1806ac76967d75ec468991117"
Oct 30 21:22:58.325002 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:22:58.324948    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"373914afbd5e2abf0374bb0e6825b1d68c571af1806ac76967d75ec468991117"} err="failed to get container status \"373914afbd5e2abf0374bb0e6825b1d68c571af1806ac76967d75ec468991117\": rpc error: code = NotFound desc = could not find container \"373914afbd5e2abf0374bb0e6825b1d68c571af1806ac76967d75ec468991117\": container with ID starting with 373914afbd5e2abf0374bb0e6825b1d68c571af1806ac76967d75ec468991117 not found: ID does not exist"
Oct 30 21:22:58.325002 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:22:58.324964    4060 scope.go:122] "RemoveContainer" containerID="d8eab5d9d65bc5ab426abb9c260d9a1cf964f67c9ac8a37b75c27e01f1851e92"
Oct 30 21:22:58.325199 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:22:58.325182    4060 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d8eab5d9d65bc5ab426abb9c260d9a1cf964f67c9ac8a37b75c27e01f1851e92\": container with ID starting with d8eab5d9d65bc5ab426abb9c260d9a1cf964f67c9ac8a37b75c27e01f1851e92 not found: ID does not exist" containerID="d8eab5d9d65bc5ab426abb9c260d9a1cf964f67c9ac8a37b75c27e01f1851e92"
Oct 30 21:22:58.325242 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:22:58.325204    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d8eab5d9d65bc5ab426abb9c260d9a1cf964f67c9ac8a37b75c27e01f1851e92"} err="failed to get container status \"d8eab5d9d65bc5ab426abb9c260d9a1cf964f67c9ac8a37b75c27e01f1851e92\": rpc error: code = NotFound desc = could not find container \"d8eab5d9d65bc5ab426abb9c260d9a1cf964f67c9ac8a37b75c27e01f1851e92\": container with ID starting with d8eab5d9d65bc5ab426abb9c260d9a1cf964f67c9ac8a37b75c27e01f1851e92 not found: ID does not exist"
Oct 30 21:22:58.325242 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:22:58.325219    4060 scope.go:122] "RemoveContainer" containerID="9c741dc16e3a9c5ce874f7ca4abdda87ef0ffb3b3dac59150fe7adf1c397af8f"
Oct 30 21:22:58.472740 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:22:58.472711    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/tempo-data-science-tempostack-gateway-5c5f4bc4d8-dbfsr"]
Oct 30 21:22:58.522092 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:22:58.522068    4060 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/tempo-data-science-tempostack-gateway-5c5f4bc4d8-dbfsr"]
Oct 30 21:22:58.585550 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:22:58.585467    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/tempo-data-science-tempostack-distributor-5d4b69f56-lk8q4"]
Oct 30 21:22:58.590283 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:22:58.590258    4060 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/tempo-data-science-tempostack-distributor-5d4b69f56-lk8q4"]
Oct 30 21:22:59.426973 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:22:59.426939    4060 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="1ac095a8-1f1d-4ee4-a60e-d3fb36184d3e" path="/var/lib/kubelet/pods/1ac095a8-1f1d-4ee4-a60e-d3fb36184d3e/volumes"
Oct 30 21:22:59.427407 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:22:59.427393    4060 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="79dff00b-7000-4e8d-872a-30822842afa0" path="/var/lib/kubelet/pods/79dff00b-7000-4e8d-872a-30822842afa0/volumes"
Oct 30 21:23:00.918838 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:00.918790    4060 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/tempo-data-science-tempostack-querier-66cf97989c-bbdff" podUID="89a032e2-2d7b-43d7-bdd3-8cf4408e9e8a" containerName="tempo" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 21:23:00.919301 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:00.919275    4060 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/tempo-data-science-tempostack-compactor-594786c479-qqgkv" podUID="c74a7a04-b7f9-4401-a97b-2ef76cc0cb42" containerName="tempo" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 21:23:10.918485 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:10.918445    4060 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/tempo-data-science-tempostack-compactor-594786c479-qqgkv" podUID="c74a7a04-b7f9-4401-a97b-2ef76cc0cb42" containerName="tempo" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 21:23:10.919265 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:10.918487    4060 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/tempo-data-science-tempostack-querier-66cf97989c-bbdff" podUID="89a032e2-2d7b-43d7-bdd3-8cf4408e9e8a" containerName="tempo" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 21:23:12.149832 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:23:12.149795    4060 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v2f4x" containerName="extractor"
Oct 30 21:23:17.694415 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:17.694389    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/tempo-data-science-tempostack-compactor-594786c479-qqgkv"
Oct 30 21:23:17.774173 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:17.774105    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c74a7a04-b7f9-4401-a97b-2ef76cc0cb42-tempo-data-science-tempostack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c74a7a04-b7f9-4401-a97b-2ef76cc0cb42-tempo-data-science-tempostack-ca-bundle\") pod \"c74a7a04-b7f9-4401-a97b-2ef76cc0cb42\" (UID: \"c74a7a04-b7f9-4401-a97b-2ef76cc0cb42\") "
Oct 30 21:23:17.774173 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:17.774160    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/c74a7a04-b7f9-4401-a97b-2ef76cc0cb42-tempo-data-science-tempostack-compactor-mtls\" (UniqueName: \"kubernetes.io/secret/c74a7a04-b7f9-4401-a97b-2ef76cc0cb42-tempo-data-science-tempostack-compactor-mtls\") pod \"c74a7a04-b7f9-4401-a97b-2ef76cc0cb42\" (UID: \"c74a7a04-b7f9-4401-a97b-2ef76cc0cb42\") "
Oct 30 21:23:17.774338 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:17.774191    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c74a7a04-b7f9-4401-a97b-2ef76cc0cb42-kube-api-access-bhq2j\" (UniqueName: \"kubernetes.io/projected/c74a7a04-b7f9-4401-a97b-2ef76cc0cb42-kube-api-access-bhq2j\") pod \"c74a7a04-b7f9-4401-a97b-2ef76cc0cb42\" (UID: \"c74a7a04-b7f9-4401-a97b-2ef76cc0cb42\") "
Oct 30 21:23:17.774338 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:17.774213    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c74a7a04-b7f9-4401-a97b-2ef76cc0cb42-tempo-tmp-storage\" (UniqueName: \"kubernetes.io/empty-dir/c74a7a04-b7f9-4401-a97b-2ef76cc0cb42-tempo-tmp-storage\") pod \"c74a7a04-b7f9-4401-a97b-2ef76cc0cb42\" (UID: \"c74a7a04-b7f9-4401-a97b-2ef76cc0cb42\") "
Oct 30 21:23:17.774599 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:17.774573    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c74a7a04-b7f9-4401-a97b-2ef76cc0cb42-tempo-data-science-tempostack-ca-bundle" pod "c74a7a04-b7f9-4401-a97b-2ef76cc0cb42" (UID: "c74a7a04-b7f9-4401-a97b-2ef76cc0cb42"). InnerVolumeSpecName "tempo-data-science-tempostack-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:23:17.774648 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:17.774608    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c74a7a04-b7f9-4401-a97b-2ef76cc0cb42-tempo-tmp-storage" pod "c74a7a04-b7f9-4401-a97b-2ef76cc0cb42" (UID: "c74a7a04-b7f9-4401-a97b-2ef76cc0cb42"). InnerVolumeSpecName "tempo-tmp-storage". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:23:17.776365 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:17.776335    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c74a7a04-b7f9-4401-a97b-2ef76cc0cb42-kube-api-access-bhq2j" pod "c74a7a04-b7f9-4401-a97b-2ef76cc0cb42" (UID: "c74a7a04-b7f9-4401-a97b-2ef76cc0cb42"). InnerVolumeSpecName "kube-api-access-bhq2j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:23:17.776471 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:17.776381    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c74a7a04-b7f9-4401-a97b-2ef76cc0cb42-tempo-data-science-tempostack-compactor-mtls" pod "c74a7a04-b7f9-4401-a97b-2ef76cc0cb42" (UID: "c74a7a04-b7f9-4401-a97b-2ef76cc0cb42"). InnerVolumeSpecName "tempo-data-science-tempostack-compactor-mtls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:23:17.874951 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:17.874917    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c74a7a04-b7f9-4401-a97b-2ef76cc0cb42-tempo-conf\" (UniqueName: \"kubernetes.io/configmap/c74a7a04-b7f9-4401-a97b-2ef76cc0cb42-tempo-conf\") pod \"c74a7a04-b7f9-4401-a97b-2ef76cc0cb42\" (UID: \"c74a7a04-b7f9-4401-a97b-2ef76cc0cb42\") "
Oct 30 21:23:17.875121 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:17.875058    4060 reconciler_common.go:299] "Volume detached for volume \"tempo-data-science-tempostack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c74a7a04-b7f9-4401-a97b-2ef76cc0cb42-tempo-data-science-tempostack-ca-bundle\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:23:17.875121 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:17.875070    4060 reconciler_common.go:299] "Volume detached for volume \"tempo-data-science-tempostack-compactor-mtls\" (UniqueName: \"kubernetes.io/secret/c74a7a04-b7f9-4401-a97b-2ef76cc0cb42-tempo-data-science-tempostack-compactor-mtls\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:23:17.875121 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:17.875081    4060 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bhq2j\" (UniqueName: \"kubernetes.io/projected/c74a7a04-b7f9-4401-a97b-2ef76cc0cb42-kube-api-access-bhq2j\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:23:17.875121 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:17.875091    4060 reconciler_common.go:299] "Volume detached for volume \"tempo-tmp-storage\" (UniqueName: \"kubernetes.io/empty-dir/c74a7a04-b7f9-4401-a97b-2ef76cc0cb42-tempo-tmp-storage\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:23:17.875369 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:17.875342    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c74a7a04-b7f9-4401-a97b-2ef76cc0cb42-tempo-conf" pod "c74a7a04-b7f9-4401-a97b-2ef76cc0cb42" (UID: "c74a7a04-b7f9-4401-a97b-2ef76cc0cb42"). InnerVolumeSpecName "tempo-conf". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:23:17.975513 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:17.975457    4060 reconciler_common.go:299] "Volume detached for volume \"tempo-conf\" (UniqueName: \"kubernetes.io/configmap/c74a7a04-b7f9-4401-a97b-2ef76cc0cb42-tempo-conf\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:23:18.404593 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:18.404556    4060 generic.go:356] "Generic (PLEG): container finished" podID="c74a7a04-b7f9-4401-a97b-2ef76cc0cb42" containerID="b7eda03ed2a8cb02eb614761c5d0998ae990d130cc99b3c7cbaf757200aea3ae" exitCode=0
Oct 30 21:23:18.404770 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:18.404610    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/tempo-data-science-tempostack-compactor-594786c479-qqgkv"
Oct 30 21:23:18.404770 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:18.404642    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/tempo-data-science-tempostack-compactor-594786c479-qqgkv" event={"ID":"c74a7a04-b7f9-4401-a97b-2ef76cc0cb42","Type":"ContainerDied","Data":"b7eda03ed2a8cb02eb614761c5d0998ae990d130cc99b3c7cbaf757200aea3ae"}
Oct 30 21:23:18.404770 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:18.404696    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/tempo-data-science-tempostack-compactor-594786c479-qqgkv" event={"ID":"c74a7a04-b7f9-4401-a97b-2ef76cc0cb42","Type":"ContainerDied","Data":"d0935b948458b6ded58400520d7c75ba27424deeab630b7b60ac312dab2945b9"}
Oct 30 21:23:18.404770 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:18.404718    4060 scope.go:122] "RemoveContainer" containerID="b7eda03ed2a8cb02eb614761c5d0998ae990d130cc99b3c7cbaf757200aea3ae"
Oct 30 21:23:18.413252 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:18.413234    4060 scope.go:122] "RemoveContainer" containerID="b7eda03ed2a8cb02eb614761c5d0998ae990d130cc99b3c7cbaf757200aea3ae"
Oct 30 21:23:18.413525 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:23:18.413505    4060 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b7eda03ed2a8cb02eb614761c5d0998ae990d130cc99b3c7cbaf757200aea3ae\": container with ID starting with b7eda03ed2a8cb02eb614761c5d0998ae990d130cc99b3c7cbaf757200aea3ae not found: ID does not exist" containerID="b7eda03ed2a8cb02eb614761c5d0998ae990d130cc99b3c7cbaf757200aea3ae"
Oct 30 21:23:18.413573 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:18.413535    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b7eda03ed2a8cb02eb614761c5d0998ae990d130cc99b3c7cbaf757200aea3ae"} err="failed to get container status \"b7eda03ed2a8cb02eb614761c5d0998ae990d130cc99b3c7cbaf757200aea3ae\": rpc error: code = NotFound desc = could not find container \"b7eda03ed2a8cb02eb614761c5d0998ae990d130cc99b3c7cbaf757200aea3ae\": container with ID starting with b7eda03ed2a8cb02eb614761c5d0998ae990d130cc99b3c7cbaf757200aea3ae not found: ID does not exist"
Oct 30 21:23:18.568823 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:18.568791    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/tempo-data-science-tempostack-compactor-594786c479-qqgkv"]
Oct 30 21:23:18.618151 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:18.618124    4060 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/tempo-data-science-tempostack-compactor-594786c479-qqgkv"]
Oct 30 21:23:19.426347 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:19.426316    4060 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c74a7a04-b7f9-4401-a97b-2ef76cc0cb42" path="/var/lib/kubelet/pods/c74a7a04-b7f9-4401-a97b-2ef76cc0cb42/volumes"
Oct 30 21:23:20.918516 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:20.918463    4060 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/tempo-data-science-tempostack-querier-66cf97989c-bbdff" podUID="89a032e2-2d7b-43d7-bdd3-8cf4408e9e8a" containerName="tempo" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 21:23:20.918908 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:20.918580    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/tempo-data-science-tempostack-querier-66cf97989c-bbdff"
Oct 30 21:23:26.594401 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:26.594376    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/tempo-data-science-tempostack-querier-66cf97989c-bbdff"
Oct 30 21:23:26.632016 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:26.631992    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/89a032e2-2d7b-43d7-bdd3-8cf4408e9e8a-kube-api-access-vfbfj\" (UniqueName: \"kubernetes.io/projected/89a032e2-2d7b-43d7-bdd3-8cf4408e9e8a-kube-api-access-vfbfj\") pod \"89a032e2-2d7b-43d7-bdd3-8cf4408e9e8a\" (UID: \"89a032e2-2d7b-43d7-bdd3-8cf4408e9e8a\") "
Oct 30 21:23:26.632129 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:26.632027    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/89a032e2-2d7b-43d7-bdd3-8cf4408e9e8a-tempo-data-science-tempostack-querier-mtls\" (UniqueName: \"kubernetes.io/secret/89a032e2-2d7b-43d7-bdd3-8cf4408e9e8a-tempo-data-science-tempostack-querier-mtls\") pod \"89a032e2-2d7b-43d7-bdd3-8cf4408e9e8a\" (UID: \"89a032e2-2d7b-43d7-bdd3-8cf4408e9e8a\") "
Oct 30 21:23:26.632129 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:26.632061    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/89a032e2-2d7b-43d7-bdd3-8cf4408e9e8a-tempo-conf\" (UniqueName: \"kubernetes.io/configmap/89a032e2-2d7b-43d7-bdd3-8cf4408e9e8a-tempo-conf\") pod \"89a032e2-2d7b-43d7-bdd3-8cf4408e9e8a\" (UID: \"89a032e2-2d7b-43d7-bdd3-8cf4408e9e8a\") "
Oct 30 21:23:26.632455 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:26.632431    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/89a032e2-2d7b-43d7-bdd3-8cf4408e9e8a-tempo-conf" pod "89a032e2-2d7b-43d7-bdd3-8cf4408e9e8a" (UID: "89a032e2-2d7b-43d7-bdd3-8cf4408e9e8a"). InnerVolumeSpecName "tempo-conf". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:23:26.634023 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:26.633996    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/89a032e2-2d7b-43d7-bdd3-8cf4408e9e8a-tempo-data-science-tempostack-querier-mtls" pod "89a032e2-2d7b-43d7-bdd3-8cf4408e9e8a" (UID: "89a032e2-2d7b-43d7-bdd3-8cf4408e9e8a"). InnerVolumeSpecName "tempo-data-science-tempostack-querier-mtls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:23:26.634119 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:26.634022    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/89a032e2-2d7b-43d7-bdd3-8cf4408e9e8a-kube-api-access-vfbfj" pod "89a032e2-2d7b-43d7-bdd3-8cf4408e9e8a" (UID: "89a032e2-2d7b-43d7-bdd3-8cf4408e9e8a"). InnerVolumeSpecName "kube-api-access-vfbfj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:23:26.732524 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:26.732485    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/89a032e2-2d7b-43d7-bdd3-8cf4408e9e8a-tempo-tmp-storage\" (UniqueName: \"kubernetes.io/empty-dir/89a032e2-2d7b-43d7-bdd3-8cf4408e9e8a-tempo-tmp-storage\") pod \"89a032e2-2d7b-43d7-bdd3-8cf4408e9e8a\" (UID: \"89a032e2-2d7b-43d7-bdd3-8cf4408e9e8a\") "
Oct 30 21:23:26.732657 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:26.732539    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/89a032e2-2d7b-43d7-bdd3-8cf4408e9e8a-tempo-data-science-tempostack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/89a032e2-2d7b-43d7-bdd3-8cf4408e9e8a-tempo-data-science-tempostack-ca-bundle\") pod \"89a032e2-2d7b-43d7-bdd3-8cf4408e9e8a\" (UID: \"89a032e2-2d7b-43d7-bdd3-8cf4408e9e8a\") "
Oct 30 21:23:26.732702 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:26.732669    4060 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vfbfj\" (UniqueName: \"kubernetes.io/projected/89a032e2-2d7b-43d7-bdd3-8cf4408e9e8a-kube-api-access-vfbfj\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:23:26.732702 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:26.732688    4060 reconciler_common.go:299] "Volume detached for volume \"tempo-data-science-tempostack-querier-mtls\" (UniqueName: \"kubernetes.io/secret/89a032e2-2d7b-43d7-bdd3-8cf4408e9e8a-tempo-data-science-tempostack-querier-mtls\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:23:26.732769 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:26.732703    4060 reconciler_common.go:299] "Volume detached for volume \"tempo-conf\" (UniqueName: \"kubernetes.io/configmap/89a032e2-2d7b-43d7-bdd3-8cf4408e9e8a-tempo-conf\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:23:26.732816 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:26.732765    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/89a032e2-2d7b-43d7-bdd3-8cf4408e9e8a-tempo-tmp-storage" pod "89a032e2-2d7b-43d7-bdd3-8cf4408e9e8a" (UID: "89a032e2-2d7b-43d7-bdd3-8cf4408e9e8a"). InnerVolumeSpecName "tempo-tmp-storage". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:23:26.732898 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:26.732883    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/89a032e2-2d7b-43d7-bdd3-8cf4408e9e8a-tempo-data-science-tempostack-ca-bundle" pod "89a032e2-2d7b-43d7-bdd3-8cf4408e9e8a" (UID: "89a032e2-2d7b-43d7-bdd3-8cf4408e9e8a"). InnerVolumeSpecName "tempo-data-science-tempostack-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:23:26.833804 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:26.833766    4060 reconciler_common.go:299] "Volume detached for volume \"tempo-tmp-storage\" (UniqueName: \"kubernetes.io/empty-dir/89a032e2-2d7b-43d7-bdd3-8cf4408e9e8a-tempo-tmp-storage\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:23:26.833804 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:26.833798    4060 reconciler_common.go:299] "Volume detached for volume \"tempo-data-science-tempostack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/89a032e2-2d7b-43d7-bdd3-8cf4408e9e8a-tempo-data-science-tempostack-ca-bundle\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:23:27.451322 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:27.451294    4060 generic.go:356] "Generic (PLEG): container finished" podID="89a032e2-2d7b-43d7-bdd3-8cf4408e9e8a" containerID="02a670f320d7efbee273d8b4886278473f9b2111a2834d2d183e01595bebf071" exitCode=137
Oct 30 21:23:27.451480 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:27.451352    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/tempo-data-science-tempostack-querier-66cf97989c-bbdff" event={"ID":"89a032e2-2d7b-43d7-bdd3-8cf4408e9e8a","Type":"ContainerDied","Data":"02a670f320d7efbee273d8b4886278473f9b2111a2834d2d183e01595bebf071"}
Oct 30 21:23:27.451480 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:27.451362    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/tempo-data-science-tempostack-querier-66cf97989c-bbdff"
Oct 30 21:23:27.451480 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:27.451389    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/tempo-data-science-tempostack-querier-66cf97989c-bbdff" event={"ID":"89a032e2-2d7b-43d7-bdd3-8cf4408e9e8a","Type":"ContainerDied","Data":"4c5e098d1d08026378423ec4de0f4fddcdc7637673c67f1d5b65fbdf94635be1"}
Oct 30 21:23:27.451480 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:27.451409    4060 scope.go:122] "RemoveContainer" containerID="02a670f320d7efbee273d8b4886278473f9b2111a2834d2d183e01595bebf071"
Oct 30 21:23:27.459905 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:27.459884    4060 scope.go:122] "RemoveContainer" containerID="02a670f320d7efbee273d8b4886278473f9b2111a2834d2d183e01595bebf071"
Oct 30 21:23:27.460160 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:23:27.460143    4060 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"02a670f320d7efbee273d8b4886278473f9b2111a2834d2d183e01595bebf071\": container with ID starting with 02a670f320d7efbee273d8b4886278473f9b2111a2834d2d183e01595bebf071 not found: ID does not exist" containerID="02a670f320d7efbee273d8b4886278473f9b2111a2834d2d183e01595bebf071"
Oct 30 21:23:27.460203 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:27.460171    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"02a670f320d7efbee273d8b4886278473f9b2111a2834d2d183e01595bebf071"} err="failed to get container status \"02a670f320d7efbee273d8b4886278473f9b2111a2834d2d183e01595bebf071\": rpc error: code = NotFound desc = could not find container \"02a670f320d7efbee273d8b4886278473f9b2111a2834d2d183e01595bebf071\": container with ID starting with 02a670f320d7efbee273d8b4886278473f9b2111a2834d2d183e01595bebf071 not found: ID does not exist"
Oct 30 21:23:27.614200 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:27.614170    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/tempo-data-science-tempostack-querier-66cf97989c-bbdff"]
Oct 30 21:23:27.663502 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:27.663462    4060 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/tempo-data-science-tempostack-querier-66cf97989c-bbdff"]
Oct 30 21:23:29.426977 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:29.426945    4060 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="89a032e2-2d7b-43d7-bdd3-8cf4408e9e8a" path="/var/lib/kubelet/pods/89a032e2-2d7b-43d7-bdd3-8cf4408e9e8a/volumes"
Oct 30 21:23:42.150660 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:23:42.150587    4060 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v2f4x" containerName="extractor"
Oct 30 21:23:46.015689 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:46.015645    4060 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/korrel8r-5d45699dc4-dvjrm"]
Oct 30 21:23:46.016088 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:46.015933    4060 cpu_manager.go:414] "containerMap: removing container" podUID="ddb01da8-fe29-4375-a8d8-4dc33d953ef7" containerName="otc-container"
Oct 30 21:23:46.016088 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:46.015945    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ddb01da8-fe29-4375-a8d8-4dc33d953ef7" containerName="otc-container"
Oct 30 21:23:46.016088 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:46.015956    4060 cpu_manager.go:414] "containerMap: removing container" podUID="79dff00b-7000-4e8d-872a-30822842afa0" containerName="tempo"
Oct 30 21:23:46.016088 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:46.015961    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="79dff00b-7000-4e8d-872a-30822842afa0" containerName="tempo"
Oct 30 21:23:46.016088 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:46.015972    4060 cpu_manager.go:414] "containerMap: removing container" podUID="df137507-d9aa-49a6-8ecf-ff2215870fb3" containerName="korrel8r"
Oct 30 21:23:46.016088 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:46.015977    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="df137507-d9aa-49a6-8ecf-ff2215870fb3" containerName="korrel8r"
Oct 30 21:23:46.016088 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:46.015992    4060 cpu_manager.go:414] "containerMap: removing container" podUID="89a032e2-2d7b-43d7-bdd3-8cf4408e9e8a" containerName="tempo"
Oct 30 21:23:46.016088 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:46.015997    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="89a032e2-2d7b-43d7-bdd3-8cf4408e9e8a" containerName="tempo"
Oct 30 21:23:46.016088 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:46.016006    4060 cpu_manager.go:414] "containerMap: removing container" podUID="c74a7a04-b7f9-4401-a97b-2ef76cc0cb42" containerName="tempo"
Oct 30 21:23:46.016088 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:46.016011    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c74a7a04-b7f9-4401-a97b-2ef76cc0cb42" containerName="tempo"
Oct 30 21:23:46.016088 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:46.016017    4060 cpu_manager.go:414] "containerMap: removing container" podUID="1ac095a8-1f1d-4ee4-a60e-d3fb36184d3e" containerName="tempo-gateway"
Oct 30 21:23:46.016088 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:46.016022    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1ac095a8-1f1d-4ee4-a60e-d3fb36184d3e" containerName="tempo-gateway"
Oct 30 21:23:46.016088 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:46.016032    4060 cpu_manager.go:414] "containerMap: removing container" podUID="1ac095a8-1f1d-4ee4-a60e-d3fb36184d3e" containerName="tempo-gateway-opa"
Oct 30 21:23:46.016088 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:46.016036    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1ac095a8-1f1d-4ee4-a60e-d3fb36184d3e" containerName="tempo-gateway-opa"
Oct 30 21:23:46.016088 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:46.016081    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="df137507-d9aa-49a6-8ecf-ff2215870fb3" containerName="korrel8r"
Oct 30 21:23:46.016088 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:46.016089    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="89a032e2-2d7b-43d7-bdd3-8cf4408e9e8a" containerName="tempo"
Oct 30 21:23:46.016088 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:46.016095    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="c74a7a04-b7f9-4401-a97b-2ef76cc0cb42" containerName="tempo"
Oct 30 21:23:46.016681 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:46.016101    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="1ac095a8-1f1d-4ee4-a60e-d3fb36184d3e" containerName="tempo-gateway"
Oct 30 21:23:46.016681 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:46.016108    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="1ac095a8-1f1d-4ee4-a60e-d3fb36184d3e" containerName="tempo-gateway-opa"
Oct 30 21:23:46.016681 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:46.016114    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="ddb01da8-fe29-4375-a8d8-4dc33d953ef7" containerName="otc-container"
Oct 30 21:23:46.016681 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:46.016120    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="79dff00b-7000-4e8d-872a-30822842afa0" containerName="tempo"
Oct 30 21:23:46.020339 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:46.020319    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/korrel8r-5d45699dc4-dvjrm"
Oct 30 21:23:46.079962 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:46.079928    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2e49a3bc-a84a-495a-bc5a-6505b0980d03-config\") pod \"korrel8r-5d45699dc4-dvjrm\" (UID: \"2e49a3bc-a84a-495a-bc5a-6505b0980d03\") " pod="redhat-ods-monitoring/korrel8r-5d45699dc4-dvjrm"
Oct 30 21:23:46.080114 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:46.079977    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cmmn7\" (UniqueName: \"kubernetes.io/projected/2e49a3bc-a84a-495a-bc5a-6505b0980d03-kube-api-access-cmmn7\") pod \"korrel8r-5d45699dc4-dvjrm\" (UID: \"2e49a3bc-a84a-495a-bc5a-6505b0980d03\") " pod="redhat-ods-monitoring/korrel8r-5d45699dc4-dvjrm"
Oct 30 21:23:46.080114 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:46.080034    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/2e49a3bc-a84a-495a-bc5a-6505b0980d03-tls\") pod \"korrel8r-5d45699dc4-dvjrm\" (UID: \"2e49a3bc-a84a-495a-bc5a-6505b0980d03\") " pod="redhat-ods-monitoring/korrel8r-5d45699dc4-dvjrm"
Oct 30 21:23:46.122024 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:46.121987    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"korrel8r-dockercfg-7k95g\""
Oct 30 21:23:46.122024 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:46.122001    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"kube-root-ca.crt\""
Oct 30 21:23:46.122024 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:46.122000    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"openshift-service-ca.crt\""
Oct 30 21:23:46.122255 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:46.122117    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"korrel8r-config\""
Oct 30 21:23:46.122322 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:46.122308    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"korrel8r-tls\""
Oct 30 21:23:46.123885 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:46.123867    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/korrel8r-5d45699dc4-dvjrm"]
Oct 30 21:23:46.180583 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:46.180555    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2e49a3bc-a84a-495a-bc5a-6505b0980d03-config\") pod \"korrel8r-5d45699dc4-dvjrm\" (UID: \"2e49a3bc-a84a-495a-bc5a-6505b0980d03\") " pod="redhat-ods-monitoring/korrel8r-5d45699dc4-dvjrm"
Oct 30 21:23:46.180730 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:46.180600    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cmmn7\" (UniqueName: \"kubernetes.io/projected/2e49a3bc-a84a-495a-bc5a-6505b0980d03-kube-api-access-cmmn7\") pod \"korrel8r-5d45699dc4-dvjrm\" (UID: \"2e49a3bc-a84a-495a-bc5a-6505b0980d03\") " pod="redhat-ods-monitoring/korrel8r-5d45699dc4-dvjrm"
Oct 30 21:23:46.180730 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:46.180715    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/2e49a3bc-a84a-495a-bc5a-6505b0980d03-tls\") pod \"korrel8r-5d45699dc4-dvjrm\" (UID: \"2e49a3bc-a84a-495a-bc5a-6505b0980d03\") " pod="redhat-ods-monitoring/korrel8r-5d45699dc4-dvjrm"
Oct 30 21:23:46.181273 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:46.181256    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2e49a3bc-a84a-495a-bc5a-6505b0980d03-config\") pod \"korrel8r-5d45699dc4-dvjrm\" (UID: \"2e49a3bc-a84a-495a-bc5a-6505b0980d03\") " pod="redhat-ods-monitoring/korrel8r-5d45699dc4-dvjrm"
Oct 30 21:23:46.183245 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:46.183224    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls\" (UniqueName: \"kubernetes.io/secret/2e49a3bc-a84a-495a-bc5a-6505b0980d03-tls\") pod \"korrel8r-5d45699dc4-dvjrm\" (UID: \"2e49a3bc-a84a-495a-bc5a-6505b0980d03\") " pod="redhat-ods-monitoring/korrel8r-5d45699dc4-dvjrm"
Oct 30 21:23:46.241747 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:46.241716    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cmmn7\" (UniqueName: \"kubernetes.io/projected/2e49a3bc-a84a-495a-bc5a-6505b0980d03-kube-api-access-cmmn7\") pod \"korrel8r-5d45699dc4-dvjrm\" (UID: \"2e49a3bc-a84a-495a-bc5a-6505b0980d03\") " pod="redhat-ods-monitoring/korrel8r-5d45699dc4-dvjrm"
Oct 30 21:23:46.332739 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:46.332665    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/korrel8r-5d45699dc4-dvjrm"
Oct 30 21:23:46.702788 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:46.702764    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/korrel8r-5d45699dc4-dvjrm"]
Oct 30 21:23:46.704967 ip-10-0-142-4 kubenswrapper[4060]: W1030 21:23:46.704934    4060 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e49a3bc_a84a_495a_bc5a_6505b0980d03.slice/crio-9b4515874c4f01efe213dc6c88cc0b5eccf2dea6e769f3a19061b19042fd545b WatchSource:0}: Error finding container 9b4515874c4f01efe213dc6c88cc0b5eccf2dea6e769f3a19061b19042fd545b: Status 404 returned error can't find the container with id 9b4515874c4f01efe213dc6c88cc0b5eccf2dea6e769f3a19061b19042fd545b
Oct 30 21:23:47.540614 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:47.540577    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/korrel8r-5d45699dc4-dvjrm" event={"ID":"2e49a3bc-a84a-495a-bc5a-6505b0980d03","Type":"ContainerStarted","Data":"57835526f489ed3fc34ef939e36f1d3caad387f79e57f8ed8f16bb0a6a7d1a84"}
Oct 30 21:23:47.541074 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:47.540643    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/korrel8r-5d45699dc4-dvjrm" event={"ID":"2e49a3bc-a84a-495a-bc5a-6505b0980d03","Type":"ContainerStarted","Data":"9b4515874c4f01efe213dc6c88cc0b5eccf2dea6e769f3a19061b19042fd545b"}
Oct 30 21:23:47.541074 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:47.540694    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/korrel8r-5d45699dc4-dvjrm"
Oct 30 21:23:47.659740 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:47.659689    4060 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/korrel8r-5d45699dc4-dvjrm" podStartSLOduration=2.659673591 podStartE2EDuration="2.659673591s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:23:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:23:47.658045336 +0000 UTC m=+2846.415043658" watchObservedRunningTime="2026-10-30 21:23:47.659673591 +0000 UTC m=+2846.416671889"
Oct 30 21:23:48.031180 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:48.031143    4060 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:23:48.034995 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:48.034973    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:23:48.087597 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:48.087571    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-monitoring-tls\""
Oct 30 21:23:48.087597 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:48.087572    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-headless-tls\""
Oct 30 21:23:48.087805 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:48.087571    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-dockercfg-nfqbf\""
Oct 30 21:23:48.087805 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:48.087581    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-54f83bab\""
Oct 30 21:23:48.095261 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:48.095231    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/0e609f01-5583-47d2-b404-d1494dd50018-otc-internal\") pod \"data-science-collector-collector-0\" (UID: \"0e609f01-5583-47d2-b404-d1494dd50018\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:23:48.095391 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:48.095280    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/0e609f01-5583-47d2-b404-d1494dd50018-monitoring-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"0e609f01-5583-47d2-b404-d1494dd50018\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:23:48.095391 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:48.095304    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vdz49\" (UniqueName: \"kubernetes.io/projected/0e609f01-5583-47d2-b404-d1494dd50018-kube-api-access-vdz49\") pod \"data-science-collector-collector-0\" (UID: \"0e609f01-5583-47d2-b404-d1494dd50018\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:23:48.095527 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:48.095413    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/0e609f01-5583-47d2-b404-d1494dd50018-otlp-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"0e609f01-5583-47d2-b404-d1494dd50018\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:23:48.138621 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:48.138592    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:23:48.196861 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:48.196835    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/0e609f01-5583-47d2-b404-d1494dd50018-otc-internal\") pod \"data-science-collector-collector-0\" (UID: \"0e609f01-5583-47d2-b404-d1494dd50018\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:23:48.197022 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:48.196891    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/0e609f01-5583-47d2-b404-d1494dd50018-monitoring-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"0e609f01-5583-47d2-b404-d1494dd50018\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:23:48.197022 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:48.196919    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vdz49\" (UniqueName: \"kubernetes.io/projected/0e609f01-5583-47d2-b404-d1494dd50018-kube-api-access-vdz49\") pod \"data-science-collector-collector-0\" (UID: \"0e609f01-5583-47d2-b404-d1494dd50018\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:23:48.197022 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:48.196949    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/0e609f01-5583-47d2-b404-d1494dd50018-otlp-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"0e609f01-5583-47d2-b404-d1494dd50018\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:23:48.197705 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:48.197682    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/0e609f01-5583-47d2-b404-d1494dd50018-otc-internal\") pod \"data-science-collector-collector-0\" (UID: \"0e609f01-5583-47d2-b404-d1494dd50018\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:23:48.199484 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:48.199460    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/0e609f01-5583-47d2-b404-d1494dd50018-otlp-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"0e609f01-5583-47d2-b404-d1494dd50018\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:23:48.199582 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:48.199484    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/0e609f01-5583-47d2-b404-d1494dd50018-monitoring-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"0e609f01-5583-47d2-b404-d1494dd50018\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:23:48.259011 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:48.258978    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vdz49\" (UniqueName: \"kubernetes.io/projected/0e609f01-5583-47d2-b404-d1494dd50018-kube-api-access-vdz49\") pod \"data-science-collector-collector-0\" (UID: \"0e609f01-5583-47d2-b404-d1494dd50018\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:23:48.349051 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:48.348980    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:23:48.720361 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:48.720336    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:23:48.722667 ip-10-0-142-4 kubenswrapper[4060]: W1030 21:23:48.722639    4060 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e609f01_5583_47d2_b404_d1494dd50018.slice/crio-a054ed4fe1cb047f1257efefecb5ac921ffa9724d6216fd9f8a0c1d2da5a1512 WatchSource:0}: Error finding container a054ed4fe1cb047f1257efefecb5ac921ffa9724d6216fd9f8a0c1d2da5a1512: Status 404 returned error can't find the container with id a054ed4fe1cb047f1257efefecb5ac921ffa9724d6216fd9f8a0c1d2da5a1512
Oct 30 21:23:48.725363 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:48.725326    4060 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 21:23:48.725442 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:48.725397    4060 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 21:23:49.551754 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:49.551722    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"0e609f01-5583-47d2-b404-d1494dd50018","Type":"ContainerStarted","Data":"2545bb04628a3d848e1e82e8163c270e7594ca67137b00ce989094b0969273f4"}
Oct 30 21:23:49.551929 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:49.551770    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"0e609f01-5583-47d2-b404-d1494dd50018","Type":"ContainerStarted","Data":"a054ed4fe1cb047f1257efefecb5ac921ffa9724d6216fd9f8a0c1d2da5a1512"}
Oct 30 21:23:49.668555 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:49.668485    4060 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-collector-0" podStartSLOduration=2.66846838 podStartE2EDuration="2.66846838s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:23:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:23:49.667876471 +0000 UTC m=+2848.424874770" watchObservedRunningTime="2026-10-30 21:23:49.66846838 +0000 UTC m=+2848.425466679"
Oct 30 21:23:51.059150 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:51.059115    4060 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/tempo-data-science-tempostack-distributor-875fd9856-5cl6b"]
Oct 30 21:23:51.062359 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:51.062340    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/tempo-data-science-tempostack-distributor-875fd9856-5cl6b"
Oct 30 21:23:51.114726 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:51.114701    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"tempo-data-science-tempostack-ca-bundle\""
Oct 30 21:23:51.119101 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:51.119080    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tempo-conf\" (UniqueName: \"kubernetes.io/configmap/5f8f3035-2e64-46b1-947b-2ec7890b8f9c-tempo-conf\") pod \"tempo-data-science-tempostack-distributor-875fd9856-5cl6b\" (UID: \"5f8f3035-2e64-46b1-947b-2ec7890b8f9c\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-distributor-875fd9856-5cl6b"
Oct 30 21:23:51.119172 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:51.119118    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tempo-data-science-tempostack-distributor-mtls\" (UniqueName: \"kubernetes.io/secret/5f8f3035-2e64-46b1-947b-2ec7890b8f9c-tempo-data-science-tempostack-distributor-mtls\") pod \"tempo-data-science-tempostack-distributor-875fd9856-5cl6b\" (UID: \"5f8f3035-2e64-46b1-947b-2ec7890b8f9c\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-distributor-875fd9856-5cl6b"
Oct 30 21:23:51.119249 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:51.119225    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tempo-data-science-tempostack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f8f3035-2e64-46b1-947b-2ec7890b8f9c-tempo-data-science-tempostack-ca-bundle\") pod \"tempo-data-science-tempostack-distributor-875fd9856-5cl6b\" (UID: \"5f8f3035-2e64-46b1-947b-2ec7890b8f9c\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-distributor-875fd9856-5cl6b"
Oct 30 21:23:51.119339 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:51.119324    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9tsb8\" (UniqueName: \"kubernetes.io/projected/5f8f3035-2e64-46b1-947b-2ec7890b8f9c-kube-api-access-9tsb8\") pod \"tempo-data-science-tempostack-distributor-875fd9856-5cl6b\" (UID: \"5f8f3035-2e64-46b1-947b-2ec7890b8f9c\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-distributor-875fd9856-5cl6b"
Oct 30 21:23:51.119385 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:51.119356    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tempo-tmp-storage\" (UniqueName: \"kubernetes.io/empty-dir/5f8f3035-2e64-46b1-947b-2ec7890b8f9c-tempo-tmp-storage\") pod \"tempo-data-science-tempostack-distributor-875fd9856-5cl6b\" (UID: \"5f8f3035-2e64-46b1-947b-2ec7890b8f9c\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-distributor-875fd9856-5cl6b"
Oct 30 21:23:51.164271 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:51.164241    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"tempo-data-science-tempostack\""
Oct 30 21:23:51.164424 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:51.164302    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"tempo-data-science-tempostack-distributor-mtls\""
Oct 30 21:23:51.164424 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:51.164402    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"tempo-data-science-tempostack-dockercfg-jflh2\""
Oct 30 21:23:51.171551 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:51.167784    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/tempo-data-science-tempostack-distributor-875fd9856-5cl6b"]
Oct 30 21:23:51.220877 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:51.220840    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9tsb8\" (UniqueName: \"kubernetes.io/projected/5f8f3035-2e64-46b1-947b-2ec7890b8f9c-kube-api-access-9tsb8\") pod \"tempo-data-science-tempostack-distributor-875fd9856-5cl6b\" (UID: \"5f8f3035-2e64-46b1-947b-2ec7890b8f9c\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-distributor-875fd9856-5cl6b"
Oct 30 21:23:51.221042 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:51.220900    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tempo-tmp-storage\" (UniqueName: \"kubernetes.io/empty-dir/5f8f3035-2e64-46b1-947b-2ec7890b8f9c-tempo-tmp-storage\") pod \"tempo-data-science-tempostack-distributor-875fd9856-5cl6b\" (UID: \"5f8f3035-2e64-46b1-947b-2ec7890b8f9c\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-distributor-875fd9856-5cl6b"
Oct 30 21:23:51.221042 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:51.220931    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tempo-conf\" (UniqueName: \"kubernetes.io/configmap/5f8f3035-2e64-46b1-947b-2ec7890b8f9c-tempo-conf\") pod \"tempo-data-science-tempostack-distributor-875fd9856-5cl6b\" (UID: \"5f8f3035-2e64-46b1-947b-2ec7890b8f9c\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-distributor-875fd9856-5cl6b"
Oct 30 21:23:51.221042 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:51.220973    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tempo-data-science-tempostack-distributor-mtls\" (UniqueName: \"kubernetes.io/secret/5f8f3035-2e64-46b1-947b-2ec7890b8f9c-tempo-data-science-tempostack-distributor-mtls\") pod \"tempo-data-science-tempostack-distributor-875fd9856-5cl6b\" (UID: \"5f8f3035-2e64-46b1-947b-2ec7890b8f9c\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-distributor-875fd9856-5cl6b"
Oct 30 21:23:51.221219 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:51.221054    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tempo-data-science-tempostack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f8f3035-2e64-46b1-947b-2ec7890b8f9c-tempo-data-science-tempostack-ca-bundle\") pod \"tempo-data-science-tempostack-distributor-875fd9856-5cl6b\" (UID: \"5f8f3035-2e64-46b1-947b-2ec7890b8f9c\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-distributor-875fd9856-5cl6b"
Oct 30 21:23:51.221726 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:51.221702    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tempo-tmp-storage\" (UniqueName: \"kubernetes.io/empty-dir/5f8f3035-2e64-46b1-947b-2ec7890b8f9c-tempo-tmp-storage\") pod \"tempo-data-science-tempostack-distributor-875fd9856-5cl6b\" (UID: \"5f8f3035-2e64-46b1-947b-2ec7890b8f9c\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-distributor-875fd9856-5cl6b"
Oct 30 21:23:51.221936 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:51.221912    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tempo-data-science-tempostack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f8f3035-2e64-46b1-947b-2ec7890b8f9c-tempo-data-science-tempostack-ca-bundle\") pod \"tempo-data-science-tempostack-distributor-875fd9856-5cl6b\" (UID: \"5f8f3035-2e64-46b1-947b-2ec7890b8f9c\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-distributor-875fd9856-5cl6b"
Oct 30 21:23:51.222158 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:51.222134    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tempo-conf\" (UniqueName: \"kubernetes.io/configmap/5f8f3035-2e64-46b1-947b-2ec7890b8f9c-tempo-conf\") pod \"tempo-data-science-tempostack-distributor-875fd9856-5cl6b\" (UID: \"5f8f3035-2e64-46b1-947b-2ec7890b8f9c\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-distributor-875fd9856-5cl6b"
Oct 30 21:23:51.223465 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:51.223440    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tempo-data-science-tempostack-distributor-mtls\" (UniqueName: \"kubernetes.io/secret/5f8f3035-2e64-46b1-947b-2ec7890b8f9c-tempo-data-science-tempostack-distributor-mtls\") pod \"tempo-data-science-tempostack-distributor-875fd9856-5cl6b\" (UID: \"5f8f3035-2e64-46b1-947b-2ec7890b8f9c\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-distributor-875fd9856-5cl6b"
Oct 30 21:23:51.281456 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:51.281429    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9tsb8\" (UniqueName: \"kubernetes.io/projected/5f8f3035-2e64-46b1-947b-2ec7890b8f9c-kube-api-access-9tsb8\") pod \"tempo-data-science-tempostack-distributor-875fd9856-5cl6b\" (UID: \"5f8f3035-2e64-46b1-947b-2ec7890b8f9c\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-distributor-875fd9856-5cl6b"
Oct 30 21:23:51.374556 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:51.374478    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/tempo-data-science-tempostack-distributor-875fd9856-5cl6b"
Oct 30 21:23:51.702554 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:51.702517    4060 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/tempo-data-science-tempostack-querier-67687b6bdb-sf6hx"]
Oct 30 21:23:51.706032 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:51.706012    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/tempo-data-science-tempostack-querier-67687b6bdb-sf6hx"
Oct 30 21:23:51.758207 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:51.758175    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"gcs-secret\""
Oct 30 21:23:51.758207 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:51.758175    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"tempo-data-science-tempostack-querier-mtls\""
Oct 30 21:23:51.769040 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:51.769016    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/tempo-data-science-tempostack-querier-67687b6bdb-sf6hx"]
Oct 30 21:23:51.802763 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:51.802714    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/tempo-data-science-tempostack-distributor-875fd9856-5cl6b"]
Oct 30 21:23:51.804979 ip-10-0-142-4 kubenswrapper[4060]: W1030 21:23:51.804952    4060 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f8f3035_2e64_46b1_947b_2ec7890b8f9c.slice/crio-39a2a273203c1014d0becef89798750e525a45f9956c06710df2927e497b4909 WatchSource:0}: Error finding container 39a2a273203c1014d0becef89798750e525a45f9956c06710df2927e497b4909: Status 404 returned error can't find the container with id 39a2a273203c1014d0becef89798750e525a45f9956c06710df2927e497b4909
Oct 30 21:23:51.825986 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:51.825959    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tempo-data-science-tempostack-querier-mtls\" (UniqueName: \"kubernetes.io/secret/2127c7e6-0f35-40cb-a3d2-d566fd31c339-tempo-data-science-tempostack-querier-mtls\") pod \"tempo-data-science-tempostack-querier-67687b6bdb-sf6hx\" (UID: \"2127c7e6-0f35-40cb-a3d2-d566fd31c339\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-querier-67687b6bdb-sf6hx"
Oct 30 21:23:51.826084 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:51.826003    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tempo-conf\" (UniqueName: \"kubernetes.io/configmap/2127c7e6-0f35-40cb-a3d2-d566fd31c339-tempo-conf\") pod \"tempo-data-science-tempostack-querier-67687b6bdb-sf6hx\" (UID: \"2127c7e6-0f35-40cb-a3d2-d566fd31c339\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-querier-67687b6bdb-sf6hx"
Oct 30 21:23:51.826123 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:51.826108    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tempo-data-science-tempostack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2127c7e6-0f35-40cb-a3d2-d566fd31c339-tempo-data-science-tempostack-ca-bundle\") pod \"tempo-data-science-tempostack-querier-67687b6bdb-sf6hx\" (UID: \"2127c7e6-0f35-40cb-a3d2-d566fd31c339\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-querier-67687b6bdb-sf6hx"
Oct 30 21:23:51.826164 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:51.826154    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"storage-gcs-key\" (UniqueName: \"kubernetes.io/secret/2127c7e6-0f35-40cb-a3d2-d566fd31c339-storage-gcs-key\") pod \"tempo-data-science-tempostack-querier-67687b6bdb-sf6hx\" (UID: \"2127c7e6-0f35-40cb-a3d2-d566fd31c339\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-querier-67687b6bdb-sf6hx"
Oct 30 21:23:51.826198 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:51.826176    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8p6t5\" (UniqueName: \"kubernetes.io/projected/2127c7e6-0f35-40cb-a3d2-d566fd31c339-kube-api-access-8p6t5\") pod \"tempo-data-science-tempostack-querier-67687b6bdb-sf6hx\" (UID: \"2127c7e6-0f35-40cb-a3d2-d566fd31c339\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-querier-67687b6bdb-sf6hx"
Oct 30 21:23:51.826232 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:51.826204    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tempo-tmp-storage\" (UniqueName: \"kubernetes.io/empty-dir/2127c7e6-0f35-40cb-a3d2-d566fd31c339-tempo-tmp-storage\") pod \"tempo-data-science-tempostack-querier-67687b6bdb-sf6hx\" (UID: \"2127c7e6-0f35-40cb-a3d2-d566fd31c339\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-querier-67687b6bdb-sf6hx"
Oct 30 21:23:51.875827 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:51.875791    4060 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/tempo-data-science-tempostack-compactor-7b87dc544b-9bdpj"]
Oct 30 21:23:51.879084 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:51.879062    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/tempo-data-science-tempostack-compactor-7b87dc544b-9bdpj"
Oct 30 21:23:51.927631 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:51.927602    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tempo-tmp-storage\" (UniqueName: \"kubernetes.io/empty-dir/9645925e-c718-4971-9b22-2d632b38d1b3-tempo-tmp-storage\") pod \"tempo-data-science-tempostack-compactor-7b87dc544b-9bdpj\" (UID: \"9645925e-c718-4971-9b22-2d632b38d1b3\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-compactor-7b87dc544b-9bdpj"
Oct 30 21:23:51.927765 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:51.927645    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tempo-data-science-tempostack-querier-mtls\" (UniqueName: \"kubernetes.io/secret/2127c7e6-0f35-40cb-a3d2-d566fd31c339-tempo-data-science-tempostack-querier-mtls\") pod \"tempo-data-science-tempostack-querier-67687b6bdb-sf6hx\" (UID: \"2127c7e6-0f35-40cb-a3d2-d566fd31c339\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-querier-67687b6bdb-sf6hx"
Oct 30 21:23:51.927765 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:51.927666    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tempo-conf\" (UniqueName: \"kubernetes.io/configmap/9645925e-c718-4971-9b22-2d632b38d1b3-tempo-conf\") pod \"tempo-data-science-tempostack-compactor-7b87dc544b-9bdpj\" (UID: \"9645925e-c718-4971-9b22-2d632b38d1b3\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-compactor-7b87dc544b-9bdpj"
Oct 30 21:23:51.927765 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:51.927719    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tempo-data-science-tempostack-compactor-mtls\" (UniqueName: \"kubernetes.io/secret/9645925e-c718-4971-9b22-2d632b38d1b3-tempo-data-science-tempostack-compactor-mtls\") pod \"tempo-data-science-tempostack-compactor-7b87dc544b-9bdpj\" (UID: \"9645925e-c718-4971-9b22-2d632b38d1b3\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-compactor-7b87dc544b-9bdpj"
Oct 30 21:23:51.927941 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:51.927852    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"storage-gcs-key\" (UniqueName: \"kubernetes.io/secret/9645925e-c718-4971-9b22-2d632b38d1b3-storage-gcs-key\") pod \"tempo-data-science-tempostack-compactor-7b87dc544b-9bdpj\" (UID: \"9645925e-c718-4971-9b22-2d632b38d1b3\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-compactor-7b87dc544b-9bdpj"
Oct 30 21:23:51.927941 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:51.927881    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tempo-conf\" (UniqueName: \"kubernetes.io/configmap/2127c7e6-0f35-40cb-a3d2-d566fd31c339-tempo-conf\") pod \"tempo-data-science-tempostack-querier-67687b6bdb-sf6hx\" (UID: \"2127c7e6-0f35-40cb-a3d2-d566fd31c339\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-querier-67687b6bdb-sf6hx"
Oct 30 21:23:51.927941 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:51.927905    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tempo-data-science-tempostack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9645925e-c718-4971-9b22-2d632b38d1b3-tempo-data-science-tempostack-ca-bundle\") pod \"tempo-data-science-tempostack-compactor-7b87dc544b-9bdpj\" (UID: \"9645925e-c718-4971-9b22-2d632b38d1b3\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-compactor-7b87dc544b-9bdpj"
Oct 30 21:23:51.928110 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:51.927952    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tempo-data-science-tempostack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2127c7e6-0f35-40cb-a3d2-d566fd31c339-tempo-data-science-tempostack-ca-bundle\") pod \"tempo-data-science-tempostack-querier-67687b6bdb-sf6hx\" (UID: \"2127c7e6-0f35-40cb-a3d2-d566fd31c339\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-querier-67687b6bdb-sf6hx"
Oct 30 21:23:51.928110 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:51.928050    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"storage-gcs-key\" (UniqueName: \"kubernetes.io/secret/2127c7e6-0f35-40cb-a3d2-d566fd31c339-storage-gcs-key\") pod \"tempo-data-science-tempostack-querier-67687b6bdb-sf6hx\" (UID: \"2127c7e6-0f35-40cb-a3d2-d566fd31c339\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-querier-67687b6bdb-sf6hx"
Oct 30 21:23:51.928110 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:51.928087    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8p6t5\" (UniqueName: \"kubernetes.io/projected/2127c7e6-0f35-40cb-a3d2-d566fd31c339-kube-api-access-8p6t5\") pod \"tempo-data-science-tempostack-querier-67687b6bdb-sf6hx\" (UID: \"2127c7e6-0f35-40cb-a3d2-d566fd31c339\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-querier-67687b6bdb-sf6hx"
Oct 30 21:23:51.928238 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:51.928136    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tempo-tmp-storage\" (UniqueName: \"kubernetes.io/empty-dir/2127c7e6-0f35-40cb-a3d2-d566fd31c339-tempo-tmp-storage\") pod \"tempo-data-science-tempostack-querier-67687b6bdb-sf6hx\" (UID: \"2127c7e6-0f35-40cb-a3d2-d566fd31c339\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-querier-67687b6bdb-sf6hx"
Oct 30 21:23:51.928238 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:51.928169    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mthj4\" (UniqueName: \"kubernetes.io/projected/9645925e-c718-4971-9b22-2d632b38d1b3-kube-api-access-mthj4\") pod \"tempo-data-science-tempostack-compactor-7b87dc544b-9bdpj\" (UID: \"9645925e-c718-4971-9b22-2d632b38d1b3\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-compactor-7b87dc544b-9bdpj"
Oct 30 21:23:51.928624 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:51.928598    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tempo-tmp-storage\" (UniqueName: \"kubernetes.io/empty-dir/2127c7e6-0f35-40cb-a3d2-d566fd31c339-tempo-tmp-storage\") pod \"tempo-data-science-tempostack-querier-67687b6bdb-sf6hx\" (UID: \"2127c7e6-0f35-40cb-a3d2-d566fd31c339\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-querier-67687b6bdb-sf6hx"
Oct 30 21:23:51.928734 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:51.928670    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tempo-data-science-tempostack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2127c7e6-0f35-40cb-a3d2-d566fd31c339-tempo-data-science-tempostack-ca-bundle\") pod \"tempo-data-science-tempostack-querier-67687b6bdb-sf6hx\" (UID: \"2127c7e6-0f35-40cb-a3d2-d566fd31c339\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-querier-67687b6bdb-sf6hx"
Oct 30 21:23:51.928830 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:51.928814    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tempo-conf\" (UniqueName: \"kubernetes.io/configmap/2127c7e6-0f35-40cb-a3d2-d566fd31c339-tempo-conf\") pod \"tempo-data-science-tempostack-querier-67687b6bdb-sf6hx\" (UID: \"2127c7e6-0f35-40cb-a3d2-d566fd31c339\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-querier-67687b6bdb-sf6hx"
Oct 30 21:23:51.930167 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:51.930139    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tempo-data-science-tempostack-querier-mtls\" (UniqueName: \"kubernetes.io/secret/2127c7e6-0f35-40cb-a3d2-d566fd31c339-tempo-data-science-tempostack-querier-mtls\") pod \"tempo-data-science-tempostack-querier-67687b6bdb-sf6hx\" (UID: \"2127c7e6-0f35-40cb-a3d2-d566fd31c339\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-querier-67687b6bdb-sf6hx"
Oct 30 21:23:51.930320 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:51.930305    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"storage-gcs-key\" (UniqueName: \"kubernetes.io/secret/2127c7e6-0f35-40cb-a3d2-d566fd31c339-storage-gcs-key\") pod \"tempo-data-science-tempostack-querier-67687b6bdb-sf6hx\" (UID: \"2127c7e6-0f35-40cb-a3d2-d566fd31c339\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-querier-67687b6bdb-sf6hx"
Oct 30 21:23:51.931804 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:51.931788    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"tempo-data-science-tempostack-compactor-mtls\""
Oct 30 21:23:51.941620 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:51.941588    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/tempo-data-science-tempostack-compactor-7b87dc544b-9bdpj"]
Oct 30 21:23:51.989287 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:51.989225    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8p6t5\" (UniqueName: \"kubernetes.io/projected/2127c7e6-0f35-40cb-a3d2-d566fd31c339-kube-api-access-8p6t5\") pod \"tempo-data-science-tempostack-querier-67687b6bdb-sf6hx\" (UID: \"2127c7e6-0f35-40cb-a3d2-d566fd31c339\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-querier-67687b6bdb-sf6hx"
Oct 30 21:23:52.018364 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:52.018331    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/tempo-data-science-tempostack-querier-67687b6bdb-sf6hx"
Oct 30 21:23:52.029026 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:52.028996    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mthj4\" (UniqueName: \"kubernetes.io/projected/9645925e-c718-4971-9b22-2d632b38d1b3-kube-api-access-mthj4\") pod \"tempo-data-science-tempostack-compactor-7b87dc544b-9bdpj\" (UID: \"9645925e-c718-4971-9b22-2d632b38d1b3\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-compactor-7b87dc544b-9bdpj"
Oct 30 21:23:52.029181 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:52.029162    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tempo-tmp-storage\" (UniqueName: \"kubernetes.io/empty-dir/9645925e-c718-4971-9b22-2d632b38d1b3-tempo-tmp-storage\") pod \"tempo-data-science-tempostack-compactor-7b87dc544b-9bdpj\" (UID: \"9645925e-c718-4971-9b22-2d632b38d1b3\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-compactor-7b87dc544b-9bdpj"
Oct 30 21:23:52.029237 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:52.029213    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tempo-conf\" (UniqueName: \"kubernetes.io/configmap/9645925e-c718-4971-9b22-2d632b38d1b3-tempo-conf\") pod \"tempo-data-science-tempostack-compactor-7b87dc544b-9bdpj\" (UID: \"9645925e-c718-4971-9b22-2d632b38d1b3\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-compactor-7b87dc544b-9bdpj"
Oct 30 21:23:52.029304 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:52.029245    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tempo-data-science-tempostack-compactor-mtls\" (UniqueName: \"kubernetes.io/secret/9645925e-c718-4971-9b22-2d632b38d1b3-tempo-data-science-tempostack-compactor-mtls\") pod \"tempo-data-science-tempostack-compactor-7b87dc544b-9bdpj\" (UID: \"9645925e-c718-4971-9b22-2d632b38d1b3\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-compactor-7b87dc544b-9bdpj"
Oct 30 21:23:52.029304 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:52.029282    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"storage-gcs-key\" (UniqueName: \"kubernetes.io/secret/9645925e-c718-4971-9b22-2d632b38d1b3-storage-gcs-key\") pod \"tempo-data-science-tempostack-compactor-7b87dc544b-9bdpj\" (UID: \"9645925e-c718-4971-9b22-2d632b38d1b3\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-compactor-7b87dc544b-9bdpj"
Oct 30 21:23:52.029409 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:52.029333    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tempo-data-science-tempostack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9645925e-c718-4971-9b22-2d632b38d1b3-tempo-data-science-tempostack-ca-bundle\") pod \"tempo-data-science-tempostack-compactor-7b87dc544b-9bdpj\" (UID: \"9645925e-c718-4971-9b22-2d632b38d1b3\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-compactor-7b87dc544b-9bdpj"
Oct 30 21:23:52.029780 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:52.029701    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tempo-tmp-storage\" (UniqueName: \"kubernetes.io/empty-dir/9645925e-c718-4971-9b22-2d632b38d1b3-tempo-tmp-storage\") pod \"tempo-data-science-tempostack-compactor-7b87dc544b-9bdpj\" (UID: \"9645925e-c718-4971-9b22-2d632b38d1b3\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-compactor-7b87dc544b-9bdpj"
Oct 30 21:23:52.030083 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:52.030059    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tempo-data-science-tempostack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9645925e-c718-4971-9b22-2d632b38d1b3-tempo-data-science-tempostack-ca-bundle\") pod \"tempo-data-science-tempostack-compactor-7b87dc544b-9bdpj\" (UID: \"9645925e-c718-4971-9b22-2d632b38d1b3\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-compactor-7b87dc544b-9bdpj"
Oct 30 21:23:52.030242 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:52.030221    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tempo-conf\" (UniqueName: \"kubernetes.io/configmap/9645925e-c718-4971-9b22-2d632b38d1b3-tempo-conf\") pod \"tempo-data-science-tempostack-compactor-7b87dc544b-9bdpj\" (UID: \"9645925e-c718-4971-9b22-2d632b38d1b3\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-compactor-7b87dc544b-9bdpj"
Oct 30 21:23:52.031997 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:52.031974    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"storage-gcs-key\" (UniqueName: \"kubernetes.io/secret/9645925e-c718-4971-9b22-2d632b38d1b3-storage-gcs-key\") pod \"tempo-data-science-tempostack-compactor-7b87dc544b-9bdpj\" (UID: \"9645925e-c718-4971-9b22-2d632b38d1b3\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-compactor-7b87dc544b-9bdpj"
Oct 30 21:23:52.032136 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:52.032119    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tempo-data-science-tempostack-compactor-mtls\" (UniqueName: \"kubernetes.io/secret/9645925e-c718-4971-9b22-2d632b38d1b3-tempo-data-science-tempostack-compactor-mtls\") pod \"tempo-data-science-tempostack-compactor-7b87dc544b-9bdpj\" (UID: \"9645925e-c718-4971-9b22-2d632b38d1b3\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-compactor-7b87dc544b-9bdpj"
Oct 30 21:23:52.091613 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:52.091579    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mthj4\" (UniqueName: \"kubernetes.io/projected/9645925e-c718-4971-9b22-2d632b38d1b3-kube-api-access-mthj4\") pod \"tempo-data-science-tempostack-compactor-7b87dc544b-9bdpj\" (UID: \"9645925e-c718-4971-9b22-2d632b38d1b3\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-compactor-7b87dc544b-9bdpj"
Oct 30 21:23:52.190816 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:52.190781    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/tempo-data-science-tempostack-compactor-7b87dc544b-9bdpj"
Oct 30 21:23:52.449853 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:52.449828    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/tempo-data-science-tempostack-querier-67687b6bdb-sf6hx"]
Oct 30 21:23:52.451423 ip-10-0-142-4 kubenswrapper[4060]: W1030 21:23:52.451396    4060 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2127c7e6_0f35_40cb_a3d2_d566fd31c339.slice/crio-564c58301d7fa22c247786533f8037052969dcbca6111dc70286f9e5a46fcbc6 WatchSource:0}: Error finding container 564c58301d7fa22c247786533f8037052969dcbca6111dc70286f9e5a46fcbc6: Status 404 returned error can't find the container with id 564c58301d7fa22c247786533f8037052969dcbca6111dc70286f9e5a46fcbc6
Oct 30 21:23:52.565990 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:52.565965    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/tempo-data-science-tempostack-compactor-7b87dc544b-9bdpj"]
Oct 30 21:23:52.569091 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:52.568546    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/tempo-data-science-tempostack-distributor-875fd9856-5cl6b" event={"ID":"5f8f3035-2e64-46b1-947b-2ec7890b8f9c","Type":"ContainerStarted","Data":"a9fa93d2b3ea79d3836cdd3886de95cdf42e161d8118f88a9e0e36c67f385125"}
Oct 30 21:23:52.569091 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:52.568609    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/tempo-data-science-tempostack-distributor-875fd9856-5cl6b" event={"ID":"5f8f3035-2e64-46b1-947b-2ec7890b8f9c","Type":"ContainerStarted","Data":"39a2a273203c1014d0becef89798750e525a45f9956c06710df2927e497b4909"}
Oct 30 21:23:52.569091 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:52.568640    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/tempo-data-science-tempostack-distributor-875fd9856-5cl6b"
Oct 30 21:23:52.569091 ip-10-0-142-4 kubenswrapper[4060]: W1030 21:23:52.568685    4060 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9645925e_c718_4971_9b22_2d632b38d1b3.slice/crio-b2e9049d328de36d29cc6aab84b1f3750d2e24421da9519201851e9cec47a54e WatchSource:0}: Error finding container b2e9049d328de36d29cc6aab84b1f3750d2e24421da9519201851e9cec47a54e: Status 404 returned error can't find the container with id b2e9049d328de36d29cc6aab84b1f3750d2e24421da9519201851e9cec47a54e
Oct 30 21:23:52.571537 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:52.571508    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/tempo-data-science-tempostack-querier-67687b6bdb-sf6hx" event={"ID":"2127c7e6-0f35-40cb-a3d2-d566fd31c339","Type":"ContainerStarted","Data":"564c58301d7fa22c247786533f8037052969dcbca6111dc70286f9e5a46fcbc6"}
Oct 30 21:23:52.687012 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:52.686953    4060 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/tempo-data-science-tempostack-distributor-875fd9856-5cl6b" podStartSLOduration=1.6869376470000002 podStartE2EDuration="1.686937647s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:23:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:23:52.685866484 +0000 UTC m=+2851.442864818" watchObservedRunningTime="2026-10-30 21:23:52.686937647 +0000 UTC m=+2851.443935944"
Oct 30 21:23:53.571648 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:53.571612    4060 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/tempo-data-science-tempostack-query-frontend-fb899c58-dlbzl"]
Oct 30 21:23:53.575575 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:53.575549    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/tempo-data-science-tempostack-query-frontend-fb899c58-dlbzl"
Oct 30 21:23:53.577971 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:53.577949    4060 generic.go:356] "Generic (PLEG): container finished" podID="2127c7e6-0f35-40cb-a3d2-d566fd31c339" containerID="6bbaee132c11ca0219a378dbcc979e075624a10dc0a1726f4b49bf69a1aad298" exitCode=1
Oct 30 21:23:53.578129 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:53.578013    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/tempo-data-science-tempostack-querier-67687b6bdb-sf6hx" event={"ID":"2127c7e6-0f35-40cb-a3d2-d566fd31c339","Type":"ContainerDied","Data":"6bbaee132c11ca0219a378dbcc979e075624a10dc0a1726f4b49bf69a1aad298"}
Oct 30 21:23:53.578260 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:53.578244    4060 scope.go:122] "RemoveContainer" containerID="6bbaee132c11ca0219a378dbcc979e075624a10dc0a1726f4b49bf69a1aad298"
Oct 30 21:23:53.579832 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:53.579714    4060 generic.go:356] "Generic (PLEG): container finished" podID="9645925e-c718-4971-9b22-2d632b38d1b3" containerID="9109f94668e3949716e5050a306a4863c9d6616706f9d79d28ffa40afbc343a4" exitCode=1
Oct 30 21:23:53.579906 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:53.579840    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/tempo-data-science-tempostack-compactor-7b87dc544b-9bdpj" event={"ID":"9645925e-c718-4971-9b22-2d632b38d1b3","Type":"ContainerDied","Data":"9109f94668e3949716e5050a306a4863c9d6616706f9d79d28ffa40afbc343a4"}
Oct 30 21:23:53.579906 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:53.579886    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/tempo-data-science-tempostack-compactor-7b87dc544b-9bdpj" event={"ID":"9645925e-c718-4971-9b22-2d632b38d1b3","Type":"ContainerStarted","Data":"b2e9049d328de36d29cc6aab84b1f3750d2e24421da9519201851e9cec47a54e"}
Oct 30 21:23:53.580016 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:53.579977    4060 scope.go:122] "RemoveContainer" containerID="9109f94668e3949716e5050a306a4863c9d6616706f9d79d28ffa40afbc343a4"
Oct 30 21:23:53.644846 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:53.644818    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"storage-gcs-key\" (UniqueName: \"kubernetes.io/secret/d36a0e75-3848-4561-9fd0-b01a20389236-storage-gcs-key\") pod \"tempo-data-science-tempostack-query-frontend-fb899c58-dlbzl\" (UID: \"d36a0e75-3848-4561-9fd0-b01a20389236\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-query-frontend-fb899c58-dlbzl"
Oct 30 21:23:53.644975 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:53.644956    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tempo-data-science-tempostack-query-frontend-mtls\" (UniqueName: \"kubernetes.io/secret/d36a0e75-3848-4561-9fd0-b01a20389236-tempo-data-science-tempostack-query-frontend-mtls\") pod \"tempo-data-science-tempostack-query-frontend-fb899c58-dlbzl\" (UID: \"d36a0e75-3848-4561-9fd0-b01a20389236\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-query-frontend-fb899c58-dlbzl"
Oct 30 21:23:53.645116 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:53.645097    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tempo-tmp-storage\" (UniqueName: \"kubernetes.io/empty-dir/d36a0e75-3848-4561-9fd0-b01a20389236-tempo-tmp-storage\") pod \"tempo-data-science-tempostack-query-frontend-fb899c58-dlbzl\" (UID: \"d36a0e75-3848-4561-9fd0-b01a20389236\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-query-frontend-fb899c58-dlbzl"
Oct 30 21:23:53.646088 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:53.646056    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tempo-conf\" (UniqueName: \"kubernetes.io/configmap/d36a0e75-3848-4561-9fd0-b01a20389236-tempo-conf\") pod \"tempo-data-science-tempostack-query-frontend-fb899c58-dlbzl\" (UID: \"d36a0e75-3848-4561-9fd0-b01a20389236\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-query-frontend-fb899c58-dlbzl"
Oct 30 21:23:53.646185 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:53.646134    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tempo-data-science-tempostack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d36a0e75-3848-4561-9fd0-b01a20389236-tempo-data-science-tempostack-ca-bundle\") pod \"tempo-data-science-tempostack-query-frontend-fb899c58-dlbzl\" (UID: \"d36a0e75-3848-4561-9fd0-b01a20389236\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-query-frontend-fb899c58-dlbzl"
Oct 30 21:23:53.646185 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:53.646176    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k8zlq\" (UniqueName: \"kubernetes.io/projected/d36a0e75-3848-4561-9fd0-b01a20389236-kube-api-access-k8zlq\") pod \"tempo-data-science-tempostack-query-frontend-fb899c58-dlbzl\" (UID: \"d36a0e75-3848-4561-9fd0-b01a20389236\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-query-frontend-fb899c58-dlbzl"
Oct 30 21:23:53.679131 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:53.679100    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"tempo-data-science-tempostack-query-frontend-mtls\""
Oct 30 21:23:53.681033 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:53.681006    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/tempo-data-science-tempostack-query-frontend-fb899c58-dlbzl"]
Oct 30 21:23:53.747173 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:53.747138    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"storage-gcs-key\" (UniqueName: \"kubernetes.io/secret/d36a0e75-3848-4561-9fd0-b01a20389236-storage-gcs-key\") pod \"tempo-data-science-tempostack-query-frontend-fb899c58-dlbzl\" (UID: \"d36a0e75-3848-4561-9fd0-b01a20389236\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-query-frontend-fb899c58-dlbzl"
Oct 30 21:23:53.747358 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:53.747189    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tempo-data-science-tempostack-query-frontend-mtls\" (UniqueName: \"kubernetes.io/secret/d36a0e75-3848-4561-9fd0-b01a20389236-tempo-data-science-tempostack-query-frontend-mtls\") pod \"tempo-data-science-tempostack-query-frontend-fb899c58-dlbzl\" (UID: \"d36a0e75-3848-4561-9fd0-b01a20389236\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-query-frontend-fb899c58-dlbzl"
Oct 30 21:23:53.747358 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:53.747218    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tempo-tmp-storage\" (UniqueName: \"kubernetes.io/empty-dir/d36a0e75-3848-4561-9fd0-b01a20389236-tempo-tmp-storage\") pod \"tempo-data-science-tempostack-query-frontend-fb899c58-dlbzl\" (UID: \"d36a0e75-3848-4561-9fd0-b01a20389236\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-query-frontend-fb899c58-dlbzl"
Oct 30 21:23:53.747358 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:53.747241    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tempo-conf\" (UniqueName: \"kubernetes.io/configmap/d36a0e75-3848-4561-9fd0-b01a20389236-tempo-conf\") pod \"tempo-data-science-tempostack-query-frontend-fb899c58-dlbzl\" (UID: \"d36a0e75-3848-4561-9fd0-b01a20389236\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-query-frontend-fb899c58-dlbzl"
Oct 30 21:23:53.747358 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:53.747260    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tempo-data-science-tempostack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d36a0e75-3848-4561-9fd0-b01a20389236-tempo-data-science-tempostack-ca-bundle\") pod \"tempo-data-science-tempostack-query-frontend-fb899c58-dlbzl\" (UID: \"d36a0e75-3848-4561-9fd0-b01a20389236\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-query-frontend-fb899c58-dlbzl"
Oct 30 21:23:53.747358 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:53.747278    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8zlq\" (UniqueName: \"kubernetes.io/projected/d36a0e75-3848-4561-9fd0-b01a20389236-kube-api-access-k8zlq\") pod \"tempo-data-science-tempostack-query-frontend-fb899c58-dlbzl\" (UID: \"d36a0e75-3848-4561-9fd0-b01a20389236\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-query-frontend-fb899c58-dlbzl"
Oct 30 21:23:53.747706 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:53.747672    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tempo-tmp-storage\" (UniqueName: \"kubernetes.io/empty-dir/d36a0e75-3848-4561-9fd0-b01a20389236-tempo-tmp-storage\") pod \"tempo-data-science-tempostack-query-frontend-fb899c58-dlbzl\" (UID: \"d36a0e75-3848-4561-9fd0-b01a20389236\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-query-frontend-fb899c58-dlbzl"
Oct 30 21:23:53.748148 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:53.748119    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tempo-data-science-tempostack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d36a0e75-3848-4561-9fd0-b01a20389236-tempo-data-science-tempostack-ca-bundle\") pod \"tempo-data-science-tempostack-query-frontend-fb899c58-dlbzl\" (UID: \"d36a0e75-3848-4561-9fd0-b01a20389236\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-query-frontend-fb899c58-dlbzl"
Oct 30 21:23:53.748245 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:53.748152    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tempo-conf\" (UniqueName: \"kubernetes.io/configmap/d36a0e75-3848-4561-9fd0-b01a20389236-tempo-conf\") pod \"tempo-data-science-tempostack-query-frontend-fb899c58-dlbzl\" (UID: \"d36a0e75-3848-4561-9fd0-b01a20389236\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-query-frontend-fb899c58-dlbzl"
Oct 30 21:23:53.749562 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:53.749545    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"storage-gcs-key\" (UniqueName: \"kubernetes.io/secret/d36a0e75-3848-4561-9fd0-b01a20389236-storage-gcs-key\") pod \"tempo-data-science-tempostack-query-frontend-fb899c58-dlbzl\" (UID: \"d36a0e75-3848-4561-9fd0-b01a20389236\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-query-frontend-fb899c58-dlbzl"
Oct 30 21:23:53.749800 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:53.749782    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tempo-data-science-tempostack-query-frontend-mtls\" (UniqueName: \"kubernetes.io/secret/d36a0e75-3848-4561-9fd0-b01a20389236-tempo-data-science-tempostack-query-frontend-mtls\") pod \"tempo-data-science-tempostack-query-frontend-fb899c58-dlbzl\" (UID: \"d36a0e75-3848-4561-9fd0-b01a20389236\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-query-frontend-fb899c58-dlbzl"
Oct 30 21:23:53.808280 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:53.808247    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k8zlq\" (UniqueName: \"kubernetes.io/projected/d36a0e75-3848-4561-9fd0-b01a20389236-kube-api-access-k8zlq\") pod \"tempo-data-science-tempostack-query-frontend-fb899c58-dlbzl\" (UID: \"d36a0e75-3848-4561-9fd0-b01a20389236\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-query-frontend-fb899c58-dlbzl"
Oct 30 21:23:53.876344 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:53.876264    4060 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/tempo-data-science-tempostack-gateway-5795b58d6b-2shpz"]
Oct 30 21:23:53.881011 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:53.880985    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/tempo-data-science-tempostack-gateway-5795b58d6b-2shpz"
Oct 30 21:23:53.892056 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:53.892029    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/tempo-data-science-tempostack-query-frontend-fb899c58-dlbzl"
Oct 30 21:23:53.934402 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:53.933847    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"tempo-data-science-tempostack-gateway-cabundle\""
Oct 30 21:23:53.934402 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:53.933947    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"tempo-data-science-tempostack-gateway\""
Oct 30 21:23:53.934402 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:53.934137    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"tempo-data-science-tempostack-gateway\""
Oct 30 21:23:53.934402 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:53.934235    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"tempo-data-science-tempostack-gateway-dockercfg-jcvnx\""
Oct 30 21:23:53.934402 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:53.934296    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"tempo-data-science-tempostack-gateway-tls\""
Oct 30 21:23:53.934402 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:53.934353    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"tempo-data-science-tempostack-gateway-mtls\""
Oct 30 21:23:53.944025 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:53.943886    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/tempo-data-science-tempostack-gateway-5795b58d6b-2shpz"]
Oct 30 21:23:53.950611 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:53.949755    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tenant\" (UniqueName: \"kubernetes.io/secret/0c495fa4-697a-449d-98fd-8d4cc4505a6b-tenant\") pod \"tempo-data-science-tempostack-gateway-5795b58d6b-2shpz\" (UID: \"0c495fa4-697a-449d-98fd-8d4cc4505a6b\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-gateway-5795b58d6b-2shpz"
Oct 30 21:23:53.950611 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:53.949819    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs\" (UniqueName: \"kubernetes.io/secret/0c495fa4-697a-449d-98fd-8d4cc4505a6b-serving-certs\") pod \"tempo-data-science-tempostack-gateway-5795b58d6b-2shpz\" (UID: \"0c495fa4-697a-449d-98fd-8d4cc4505a6b\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-gateway-5795b58d6b-2shpz"
Oct 30 21:23:53.950611 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:53.949845    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle\" (UniqueName: \"kubernetes.io/configmap/0c495fa4-697a-449d-98fd-8d4cc4505a6b-cabundle\") pod \"tempo-data-science-tempostack-gateway-5795b58d6b-2shpz\" (UID: \"0c495fa4-697a-449d-98fd-8d4cc4505a6b\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-gateway-5795b58d6b-2shpz"
Oct 30 21:23:53.950611 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:53.950020    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tempo-data-science-tempostack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c495fa4-697a-449d-98fd-8d4cc4505a6b-tempo-data-science-tempostack-ca-bundle\") pod \"tempo-data-science-tempostack-gateway-5795b58d6b-2shpz\" (UID: \"0c495fa4-697a-449d-98fd-8d4cc4505a6b\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-gateway-5795b58d6b-2shpz"
Oct 30 21:23:53.950611 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:53.950083    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rbac\" (UniqueName: \"kubernetes.io/configmap/0c495fa4-697a-449d-98fd-8d4cc4505a6b-rbac\") pod \"tempo-data-science-tempostack-gateway-5795b58d6b-2shpz\" (UID: \"0c495fa4-697a-449d-98fd-8d4cc4505a6b\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-gateway-5795b58d6b-2shpz"
Oct 30 21:23:53.950611 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:53.950115    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tempo-data-science-tempostack-gateway-mtls\" (UniqueName: \"kubernetes.io/secret/0c495fa4-697a-449d-98fd-8d4cc4505a6b-tempo-data-science-tempostack-gateway-mtls\") pod \"tempo-data-science-tempostack-gateway-5795b58d6b-2shpz\" (UID: \"0c495fa4-697a-449d-98fd-8d4cc4505a6b\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-gateway-5795b58d6b-2shpz"
Oct 30 21:23:53.950611 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:53.950222    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tgfdl\" (UniqueName: \"kubernetes.io/projected/0c495fa4-697a-449d-98fd-8d4cc4505a6b-kube-api-access-tgfdl\") pod \"tempo-data-science-tempostack-gateway-5795b58d6b-2shpz\" (UID: \"0c495fa4-697a-449d-98fd-8d4cc4505a6b\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-gateway-5795b58d6b-2shpz"
Oct 30 21:23:54.051673 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:54.051635    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tempo-data-science-tempostack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c495fa4-697a-449d-98fd-8d4cc4505a6b-tempo-data-science-tempostack-ca-bundle\") pod \"tempo-data-science-tempostack-gateway-5795b58d6b-2shpz\" (UID: \"0c495fa4-697a-449d-98fd-8d4cc4505a6b\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-gateway-5795b58d6b-2shpz"
Oct 30 21:23:54.051864 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:54.051688    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"rbac\" (UniqueName: \"kubernetes.io/configmap/0c495fa4-697a-449d-98fd-8d4cc4505a6b-rbac\") pod \"tempo-data-science-tempostack-gateway-5795b58d6b-2shpz\" (UID: \"0c495fa4-697a-449d-98fd-8d4cc4505a6b\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-gateway-5795b58d6b-2shpz"
Oct 30 21:23:54.051864 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:54.051805    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tempo-data-science-tempostack-gateway-mtls\" (UniqueName: \"kubernetes.io/secret/0c495fa4-697a-449d-98fd-8d4cc4505a6b-tempo-data-science-tempostack-gateway-mtls\") pod \"tempo-data-science-tempostack-gateway-5795b58d6b-2shpz\" (UID: \"0c495fa4-697a-449d-98fd-8d4cc4505a6b\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-gateway-5795b58d6b-2shpz"
Oct 30 21:23:54.051864 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:54.051843    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tgfdl\" (UniqueName: \"kubernetes.io/projected/0c495fa4-697a-449d-98fd-8d4cc4505a6b-kube-api-access-tgfdl\") pod \"tempo-data-science-tempostack-gateway-5795b58d6b-2shpz\" (UID: \"0c495fa4-697a-449d-98fd-8d4cc4505a6b\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-gateway-5795b58d6b-2shpz"
Oct 30 21:23:54.052045 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:54.051883    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tenant\" (UniqueName: \"kubernetes.io/secret/0c495fa4-697a-449d-98fd-8d4cc4505a6b-tenant\") pod \"tempo-data-science-tempostack-gateway-5795b58d6b-2shpz\" (UID: \"0c495fa4-697a-449d-98fd-8d4cc4505a6b\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-gateway-5795b58d6b-2shpz"
Oct 30 21:23:54.052045 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:54.051930    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs\" (UniqueName: \"kubernetes.io/secret/0c495fa4-697a-449d-98fd-8d4cc4505a6b-serving-certs\") pod \"tempo-data-science-tempostack-gateway-5795b58d6b-2shpz\" (UID: \"0c495fa4-697a-449d-98fd-8d4cc4505a6b\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-gateway-5795b58d6b-2shpz"
Oct 30 21:23:54.052045 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:54.051945    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle\" (UniqueName: \"kubernetes.io/configmap/0c495fa4-697a-449d-98fd-8d4cc4505a6b-cabundle\") pod \"tempo-data-science-tempostack-gateway-5795b58d6b-2shpz\" (UID: \"0c495fa4-697a-449d-98fd-8d4cc4505a6b\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-gateway-5795b58d6b-2shpz"
Oct 30 21:23:54.052455 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:54.052425    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rbac\" (UniqueName: \"kubernetes.io/configmap/0c495fa4-697a-449d-98fd-8d4cc4505a6b-rbac\") pod \"tempo-data-science-tempostack-gateway-5795b58d6b-2shpz\" (UID: \"0c495fa4-697a-449d-98fd-8d4cc4505a6b\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-gateway-5795b58d6b-2shpz"
Oct 30 21:23:54.052581 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:54.052433    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tempo-data-science-tempostack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c495fa4-697a-449d-98fd-8d4cc4505a6b-tempo-data-science-tempostack-ca-bundle\") pod \"tempo-data-science-tempostack-gateway-5795b58d6b-2shpz\" (UID: \"0c495fa4-697a-449d-98fd-8d4cc4505a6b\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-gateway-5795b58d6b-2shpz"
Oct 30 21:23:54.052646 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:54.052612    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle\" (UniqueName: \"kubernetes.io/configmap/0c495fa4-697a-449d-98fd-8d4cc4505a6b-cabundle\") pod \"tempo-data-science-tempostack-gateway-5795b58d6b-2shpz\" (UID: \"0c495fa4-697a-449d-98fd-8d4cc4505a6b\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-gateway-5795b58d6b-2shpz"
Oct 30 21:23:54.054539 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:54.054513    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tempo-data-science-tempostack-gateway-mtls\" (UniqueName: \"kubernetes.io/secret/0c495fa4-697a-449d-98fd-8d4cc4505a6b-tempo-data-science-tempostack-gateway-mtls\") pod \"tempo-data-science-tempostack-gateway-5795b58d6b-2shpz\" (UID: \"0c495fa4-697a-449d-98fd-8d4cc4505a6b\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-gateway-5795b58d6b-2shpz"
Oct 30 21:23:54.054656 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:54.054566    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tenant\" (UniqueName: \"kubernetes.io/secret/0c495fa4-697a-449d-98fd-8d4cc4505a6b-tenant\") pod \"tempo-data-science-tempostack-gateway-5795b58d6b-2shpz\" (UID: \"0c495fa4-697a-449d-98fd-8d4cc4505a6b\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-gateway-5795b58d6b-2shpz"
Oct 30 21:23:54.054781 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:54.054668    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs\" (UniqueName: \"kubernetes.io/secret/0c495fa4-697a-449d-98fd-8d4cc4505a6b-serving-certs\") pod \"tempo-data-science-tempostack-gateway-5795b58d6b-2shpz\" (UID: \"0c495fa4-697a-449d-98fd-8d4cc4505a6b\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-gateway-5795b58d6b-2shpz"
Oct 30 21:23:54.118700 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:54.118662    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tgfdl\" (UniqueName: \"kubernetes.io/projected/0c495fa4-697a-449d-98fd-8d4cc4505a6b-kube-api-access-tgfdl\") pod \"tempo-data-science-tempostack-gateway-5795b58d6b-2shpz\" (UID: \"0c495fa4-697a-449d-98fd-8d4cc4505a6b\") " pod="redhat-ods-monitoring/tempo-data-science-tempostack-gateway-5795b58d6b-2shpz"
Oct 30 21:23:54.196810 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:54.196734    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/tempo-data-science-tempostack-gateway-5795b58d6b-2shpz"
Oct 30 21:23:54.317465 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:54.317442    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/tempo-data-science-tempostack-query-frontend-fb899c58-dlbzl"]
Oct 30 21:23:54.319063 ip-10-0-142-4 kubenswrapper[4060]: W1030 21:23:54.319040    4060 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd36a0e75_3848_4561_9fd0_b01a20389236.slice/crio-afe1cc7f7feaa11f091ba230fa269810143db9d2ac8e07f28953cb4c98b09d02 WatchSource:0}: Error finding container afe1cc7f7feaa11f091ba230fa269810143db9d2ac8e07f28953cb4c98b09d02: Status 404 returned error can't find the container with id afe1cc7f7feaa11f091ba230fa269810143db9d2ac8e07f28953cb4c98b09d02
Oct 30 21:23:54.574580 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:54.574553    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/tempo-data-science-tempostack-gateway-5795b58d6b-2shpz"]
Oct 30 21:23:54.576718 ip-10-0-142-4 kubenswrapper[4060]: W1030 21:23:54.576689    4060 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c495fa4_697a_449d_98fd_8d4cc4505a6b.slice/crio-822d66aeafca6df8e52d26395f9026d0a93d02ed78d56a050e73a86022b7edcf WatchSource:0}: Error finding container 822d66aeafca6df8e52d26395f9026d0a93d02ed78d56a050e73a86022b7edcf: Status 404 returned error can't find the container with id 822d66aeafca6df8e52d26395f9026d0a93d02ed78d56a050e73a86022b7edcf
Oct 30 21:23:54.586942 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:54.586918    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/tempo-data-science-tempostack-query-frontend-fb899c58-dlbzl" event={"ID":"d36a0e75-3848-4561-9fd0-b01a20389236","Type":"ContainerStarted","Data":"afe1cc7f7feaa11f091ba230fa269810143db9d2ac8e07f28953cb4c98b09d02"}
Oct 30 21:23:54.593004 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:54.592981    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/tempo-data-science-tempostack-querier-67687b6bdb-sf6hx" event={"ID":"2127c7e6-0f35-40cb-a3d2-d566fd31c339","Type":"ContainerStarted","Data":"417c96956059d19396252fd57617af54f4e166b67b7ed8a995452973700a9bf3"}
Oct 30 21:23:54.593131 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:54.593103    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/tempo-data-science-tempostack-querier-67687b6bdb-sf6hx"
Oct 30 21:23:54.595108 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:54.595085    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/tempo-data-science-tempostack-compactor-7b87dc544b-9bdpj" event={"ID":"9645925e-c718-4971-9b22-2d632b38d1b3","Type":"ContainerStarted","Data":"22c115a0c9437dc638f26e6000375a32a49a2bfc1cc2791e6e5dd3d9f60b1eea"}
Oct 30 21:23:54.595217 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:54.595181    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/tempo-data-science-tempostack-compactor-7b87dc544b-9bdpj"
Oct 30 21:23:54.596393 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:54.596373    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/tempo-data-science-tempostack-gateway-5795b58d6b-2shpz" event={"ID":"0c495fa4-697a-449d-98fd-8d4cc4505a6b","Type":"ContainerStarted","Data":"822d66aeafca6df8e52d26395f9026d0a93d02ed78d56a050e73a86022b7edcf"}
Oct 30 21:23:54.713330 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:54.713272    4060 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/tempo-data-science-tempostack-querier-67687b6bdb-sf6hx" podStartSLOduration=3.713258184 podStartE2EDuration="3.713258184s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:23:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:23:54.71204558 +0000 UTC m=+2853.469043907" watchObservedRunningTime="2026-10-30 21:23:54.713258184 +0000 UTC m=+2853.470256482"
Oct 30 21:23:54.829590 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:54.829478    4060 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/tempo-data-science-tempostack-compactor-7b87dc544b-9bdpj" podStartSLOduration=3.829463407 podStartE2EDuration="3.829463407s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:23:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:23:54.829133445 +0000 UTC m=+2853.586131755" watchObservedRunningTime="2026-10-30 21:23:54.829463407 +0000 UTC m=+2853.586461706"
Oct 30 21:23:55.602643 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:55.602608    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/tempo-data-science-tempostack-gateway-5795b58d6b-2shpz" event={"ID":"0c495fa4-697a-449d-98fd-8d4cc4505a6b","Type":"ContainerStarted","Data":"d05a7606da3af79d27fd7b113580274b734a9076c349c2ad7a67640e1a3a69f5"}
Oct 30 21:23:55.603108 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:55.602671    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/tempo-data-science-tempostack-gateway-5795b58d6b-2shpz" event={"ID":"0c495fa4-697a-449d-98fd-8d4cc4505a6b","Type":"ContainerStarted","Data":"ebe371779a29125ea57fe4cbb2024ac72e5295ff9faf4fc77bc96fec08def47b"}
Oct 30 21:23:55.603108 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:55.602707    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/tempo-data-science-tempostack-gateway-5795b58d6b-2shpz"
Oct 30 21:23:55.603108 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:55.602831    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/tempo-data-science-tempostack-gateway-5795b58d6b-2shpz"
Oct 30 21:23:55.604533 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:55.604477    4060 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/tempo-data-science-tempostack-gateway-5795b58d6b-2shpz" podUID="0c495fa4-697a-449d-98fd-8d4cc4505a6b" containerName="tempo-gateway" probeResult="failure" output="Get \"https://10.133.0.108:8081/ready\": dial tcp 10.133.0.108:8081: connect: connection refused"
Oct 30 21:23:55.604661 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:55.604511    4060 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/tempo-data-science-tempostack-gateway-5795b58d6b-2shpz" podUID="0c495fa4-697a-449d-98fd-8d4cc4505a6b" containerName="tempo-gateway-opa" probeResult="failure" output="Get \"http://10.133.0.108:8083/ready\": dial tcp 10.133.0.108:8083: connect: connection refused"
Oct 30 21:23:55.604661 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:55.604637    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/tempo-data-science-tempostack-query-frontend-fb899c58-dlbzl" event={"ID":"d36a0e75-3848-4561-9fd0-b01a20389236","Type":"ContainerStarted","Data":"6d6f70b2f2440ecc8e5dada46decddb8c76bb431cf4697dc948b154c7b12792d"}
Oct 30 21:23:55.604768 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:55.604737    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/tempo-data-science-tempostack-query-frontend-fb899c58-dlbzl"
Oct 30 21:23:55.726224 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:55.726156    4060 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/tempo-data-science-tempostack-gateway-5795b58d6b-2shpz" podStartSLOduration=2.726138165 podStartE2EDuration="2.726138165s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:23:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:23:55.722368611 +0000 UTC m=+2854.479366909" watchObservedRunningTime="2026-10-30 21:23:55.726138165 +0000 UTC m=+2854.483136464"
Oct 30 21:23:55.841442 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:55.841386    4060 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/tempo-data-science-tempostack-query-frontend-fb899c58-dlbzl" podStartSLOduration=2.8413712479999997 podStartE2EDuration="2.841371248s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:23:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:23:55.839730757 +0000 UTC m=+2854.596729058" watchObservedRunningTime="2026-10-30 21:23:55.841371248 +0000 UTC m=+2854.598369545"
Oct 30 21:23:56.756131 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:56.756096    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/tempo-data-science-tempostack-gateway-5795b58d6b-2shpz"
Oct 30 21:23:56.958376 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:56.958343    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/tempo-data-science-tempostack-gateway-5795b58d6b-2shpz"
Oct 30 21:23:58.547724 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:23:58.547694    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/korrel8r-5d45699dc4-dvjrm"
Oct 30 21:24:12.150054 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:24:12.150021    4060 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v2f4x" containerName="extractor"
Oct 30 21:24:13.585531 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:24:13.585488    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/tempo-data-science-tempostack-distributor-875fd9856-5cl6b"
Oct 30 21:24:15.609974 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:24:15.609937    4060 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/tempo-data-science-tempostack-compactor-7b87dc544b-9bdpj" podUID="9645925e-c718-4971-9b22-2d632b38d1b3" containerName="tempo" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 21:24:15.610419 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:24:15.610404    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/tempo-data-science-tempostack-querier-67687b6bdb-sf6hx"
Oct 30 21:24:16.339546 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:24:16.339458    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/tempo-data-science-tempostack-distributor-875fd9856-5cl6b"]
Oct 30 21:24:16.339683 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:24:16.339663    4060 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/tempo-data-science-tempostack-distributor-875fd9856-5cl6b" podUID="5f8f3035-2e64-46b1-947b-2ec7890b8f9c" containerName="tempo" containerID="cri-o://a9fa93d2b3ea79d3836cdd3886de95cdf42e161d8118f88a9e0e36c67f385125" gracePeriod=30
Oct 30 21:24:16.509183 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:24:16.509152    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/tempo-data-science-tempostack-querier-67687b6bdb-sf6hx"]
Oct 30 21:24:16.509373 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:24:16.509327    4060 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/tempo-data-science-tempostack-querier-67687b6bdb-sf6hx" podUID="2127c7e6-0f35-40cb-a3d2-d566fd31c339" containerName="tempo" containerID="cri-o://417c96956059d19396252fd57617af54f4e166b67b7ed8a995452973700a9bf3" gracePeriod=30
Oct 30 21:24:16.855555 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:24:16.855524    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/tempo-data-science-tempostack-query-frontend-fb899c58-dlbzl"
Oct 30 21:24:17.294655 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:24:17.294631    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/tempo-data-science-tempostack-distributor-875fd9856-5cl6b"
Oct 30 21:24:17.360590 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:24:17.360558    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/5f8f3035-2e64-46b1-947b-2ec7890b8f9c-tempo-conf\" (UniqueName: \"kubernetes.io/configmap/5f8f3035-2e64-46b1-947b-2ec7890b8f9c-tempo-conf\") pod \"5f8f3035-2e64-46b1-947b-2ec7890b8f9c\" (UID: \"5f8f3035-2e64-46b1-947b-2ec7890b8f9c\") "
Oct 30 21:24:17.360762 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:24:17.360622    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/5f8f3035-2e64-46b1-947b-2ec7890b8f9c-tempo-data-science-tempostack-distributor-mtls\" (UniqueName: \"kubernetes.io/secret/5f8f3035-2e64-46b1-947b-2ec7890b8f9c-tempo-data-science-tempostack-distributor-mtls\") pod \"5f8f3035-2e64-46b1-947b-2ec7890b8f9c\" (UID: \"5f8f3035-2e64-46b1-947b-2ec7890b8f9c\") "
Oct 30 21:24:17.360762 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:24:17.360642    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/5f8f3035-2e64-46b1-947b-2ec7890b8f9c-tempo-data-science-tempostack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f8f3035-2e64-46b1-947b-2ec7890b8f9c-tempo-data-science-tempostack-ca-bundle\") pod \"5f8f3035-2e64-46b1-947b-2ec7890b8f9c\" (UID: \"5f8f3035-2e64-46b1-947b-2ec7890b8f9c\") "
Oct 30 21:24:17.360762 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:24:17.360745    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5f8f3035-2e64-46b1-947b-2ec7890b8f9c-kube-api-access-9tsb8\" (UniqueName: \"kubernetes.io/projected/5f8f3035-2e64-46b1-947b-2ec7890b8f9c-kube-api-access-9tsb8\") pod \"5f8f3035-2e64-46b1-947b-2ec7890b8f9c\" (UID: \"5f8f3035-2e64-46b1-947b-2ec7890b8f9c\") "
Oct 30 21:24:17.360936 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:24:17.360812    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5f8f3035-2e64-46b1-947b-2ec7890b8f9c-tempo-tmp-storage\" (UniqueName: \"kubernetes.io/empty-dir/5f8f3035-2e64-46b1-947b-2ec7890b8f9c-tempo-tmp-storage\") pod \"5f8f3035-2e64-46b1-947b-2ec7890b8f9c\" (UID: \"5f8f3035-2e64-46b1-947b-2ec7890b8f9c\") "
Oct 30 21:24:17.361128 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:24:17.361103    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f8f3035-2e64-46b1-947b-2ec7890b8f9c-tempo-tmp-storage" pod "5f8f3035-2e64-46b1-947b-2ec7890b8f9c" (UID: "5f8f3035-2e64-46b1-947b-2ec7890b8f9c"). InnerVolumeSpecName "tempo-tmp-storage". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:24:17.361242 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:24:17.361022    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5f8f3035-2e64-46b1-947b-2ec7890b8f9c-tempo-data-science-tempostack-ca-bundle" pod "5f8f3035-2e64-46b1-947b-2ec7890b8f9c" (UID: "5f8f3035-2e64-46b1-947b-2ec7890b8f9c"). InnerVolumeSpecName "tempo-data-science-tempostack-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:24:17.361242 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:24:17.361140    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5f8f3035-2e64-46b1-947b-2ec7890b8f9c-tempo-conf" pod "5f8f3035-2e64-46b1-947b-2ec7890b8f9c" (UID: "5f8f3035-2e64-46b1-947b-2ec7890b8f9c"). InnerVolumeSpecName "tempo-conf". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:24:17.362855 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:24:17.362829    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5f8f3035-2e64-46b1-947b-2ec7890b8f9c-tempo-data-science-tempostack-distributor-mtls" pod "5f8f3035-2e64-46b1-947b-2ec7890b8f9c" (UID: "5f8f3035-2e64-46b1-947b-2ec7890b8f9c"). InnerVolumeSpecName "tempo-data-science-tempostack-distributor-mtls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:24:17.362952 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:24:17.362903    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5f8f3035-2e64-46b1-947b-2ec7890b8f9c-kube-api-access-9tsb8" pod "5f8f3035-2e64-46b1-947b-2ec7890b8f9c" (UID: "5f8f3035-2e64-46b1-947b-2ec7890b8f9c"). InnerVolumeSpecName "kube-api-access-9tsb8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:24:17.461847 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:24:17.461816    4060 reconciler_common.go:299] "Volume detached for volume \"tempo-data-science-tempostack-distributor-mtls\" (UniqueName: \"kubernetes.io/secret/5f8f3035-2e64-46b1-947b-2ec7890b8f9c-tempo-data-science-tempostack-distributor-mtls\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:24:17.462071 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:24:17.462044    4060 reconciler_common.go:299] "Volume detached for volume \"tempo-data-science-tempostack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f8f3035-2e64-46b1-947b-2ec7890b8f9c-tempo-data-science-tempostack-ca-bundle\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:24:17.462169 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:24:17.462073    4060 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9tsb8\" (UniqueName: \"kubernetes.io/projected/5f8f3035-2e64-46b1-947b-2ec7890b8f9c-kube-api-access-9tsb8\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:24:17.462169 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:24:17.462088    4060 reconciler_common.go:299] "Volume detached for volume \"tempo-tmp-storage\" (UniqueName: \"kubernetes.io/empty-dir/5f8f3035-2e64-46b1-947b-2ec7890b8f9c-tempo-tmp-storage\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:24:17.462169 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:24:17.462097    4060 reconciler_common.go:299] "Volume detached for volume \"tempo-conf\" (UniqueName: \"kubernetes.io/configmap/5f8f3035-2e64-46b1-947b-2ec7890b8f9c-tempo-conf\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:24:17.711085 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:24:17.711052    4060 generic.go:356] "Generic (PLEG): container finished" podID="5f8f3035-2e64-46b1-947b-2ec7890b8f9c" containerID="a9fa93d2b3ea79d3836cdd3886de95cdf42e161d8118f88a9e0e36c67f385125" exitCode=0
Oct 30 21:24:17.711238 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:24:17.711101    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/tempo-data-science-tempostack-distributor-875fd9856-5cl6b" event={"ID":"5f8f3035-2e64-46b1-947b-2ec7890b8f9c","Type":"ContainerDied","Data":"a9fa93d2b3ea79d3836cdd3886de95cdf42e161d8118f88a9e0e36c67f385125"}
Oct 30 21:24:17.711238 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:24:17.711144    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/tempo-data-science-tempostack-distributor-875fd9856-5cl6b" event={"ID":"5f8f3035-2e64-46b1-947b-2ec7890b8f9c","Type":"ContainerDied","Data":"39a2a273203c1014d0becef89798750e525a45f9956c06710df2927e497b4909"}
Oct 30 21:24:17.711238 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:24:17.711165    4060 scope.go:122] "RemoveContainer" containerID="a9fa93d2b3ea79d3836cdd3886de95cdf42e161d8118f88a9e0e36c67f385125"
Oct 30 21:24:17.711238 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:24:17.711108    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/tempo-data-science-tempostack-distributor-875fd9856-5cl6b"
Oct 30 21:24:17.719695 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:24:17.719676    4060 scope.go:122] "RemoveContainer" containerID="a9fa93d2b3ea79d3836cdd3886de95cdf42e161d8118f88a9e0e36c67f385125"
Oct 30 21:24:17.719961 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:24:17.719940    4060 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a9fa93d2b3ea79d3836cdd3886de95cdf42e161d8118f88a9e0e36c67f385125\": container with ID starting with a9fa93d2b3ea79d3836cdd3886de95cdf42e161d8118f88a9e0e36c67f385125 not found: ID does not exist" containerID="a9fa93d2b3ea79d3836cdd3886de95cdf42e161d8118f88a9e0e36c67f385125"
Oct 30 21:24:17.720016 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:24:17.719970    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a9fa93d2b3ea79d3836cdd3886de95cdf42e161d8118f88a9e0e36c67f385125"} err="failed to get container status \"a9fa93d2b3ea79d3836cdd3886de95cdf42e161d8118f88a9e0e36c67f385125\": rpc error: code = NotFound desc = could not find container \"a9fa93d2b3ea79d3836cdd3886de95cdf42e161d8118f88a9e0e36c67f385125\": container with ID starting with a9fa93d2b3ea79d3836cdd3886de95cdf42e161d8118f88a9e0e36c67f385125 not found: ID does not exist"
Oct 30 21:24:17.876108 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:24:17.876073    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/tempo-data-science-tempostack-distributor-875fd9856-5cl6b"]
Oct 30 21:24:17.925123 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:24:17.925088    4060 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/tempo-data-science-tempostack-distributor-875fd9856-5cl6b"]
Oct 30 21:24:19.426797 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:24:19.426764    4060 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="5f8f3035-2e64-46b1-947b-2ec7890b8f9c" path="/var/lib/kubelet/pods/5f8f3035-2e64-46b1-947b-2ec7890b8f9c/volumes"
Oct 30 21:24:21.990636 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:24:21.990606    4060 scope.go:122] "RemoveContainer" containerID="737cfb22d648edbfbfbcdaf3371da75c79070481c8e93aee36c9e0b75970fdc3"
Oct 30 21:24:25.609360 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:24:25.609319    4060 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/tempo-data-science-tempostack-compactor-7b87dc544b-9bdpj" podUID="9645925e-c718-4971-9b22-2d632b38d1b3" containerName="tempo" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 21:24:25.609916 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:24:25.609756    4060 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/tempo-data-science-tempostack-querier-67687b6bdb-sf6hx" podUID="2127c7e6-0f35-40cb-a3d2-d566fd31c339" containerName="tempo" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 21:24:35.608956 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:24:35.608906    4060 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/tempo-data-science-tempostack-querier-67687b6bdb-sf6hx" podUID="2127c7e6-0f35-40cb-a3d2-d566fd31c339" containerName="tempo" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 21:24:35.609462 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:24:35.609435    4060 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/tempo-data-science-tempostack-compactor-7b87dc544b-9bdpj" podUID="9645925e-c718-4971-9b22-2d632b38d1b3" containerName="tempo" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 21:24:42.150889 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:24:42.150852    4060 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v2f4x" containerName="extractor"
Oct 30 21:24:45.609227 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:24:45.609185    4060 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/tempo-data-science-tempostack-querier-67687b6bdb-sf6hx" podUID="2127c7e6-0f35-40cb-a3d2-d566fd31c339" containerName="tempo" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 21:24:45.609707 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:24:45.609318    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/tempo-data-science-tempostack-querier-67687b6bdb-sf6hx"
Oct 30 21:24:45.609707 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:24:45.609647    4060 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/tempo-data-science-tempostack-compactor-7b87dc544b-9bdpj" podUID="9645925e-c718-4971-9b22-2d632b38d1b3" containerName="tempo" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 21:24:46.533604 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:24:46.533571    4060 cadvisor_stats_provider.go:569] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2127c7e6_0f35_40cb_a3d2_d566fd31c339.slice/crio-conmon-417c96956059d19396252fd57617af54f4e166b67b7ed8a995452973700a9bf3.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2127c7e6_0f35_40cb_a3d2_d566fd31c339.slice/crio-417c96956059d19396252fd57617af54f4e166b67b7ed8a995452973700a9bf3.scope\": RecentStats: unable to find data in memory cache]"
Oct 30 21:24:46.533729 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:24:46.533630    4060 cadvisor_stats_provider.go:569] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2127c7e6_0f35_40cb_a3d2_d566fd31c339.slice/crio-conmon-417c96956059d19396252fd57617af54f4e166b67b7ed8a995452973700a9bf3.scope\": RecentStats: unable to find data in memory cache]"
Oct 30 21:24:46.533790 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:24:46.533757    4060 cadvisor_stats_provider.go:569] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2127c7e6_0f35_40cb_a3d2_d566fd31c339.slice/crio-conmon-417c96956059d19396252fd57617af54f4e166b67b7ed8a995452973700a9bf3.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2127c7e6_0f35_40cb_a3d2_d566fd31c339.slice/crio-417c96956059d19396252fd57617af54f4e166b67b7ed8a995452973700a9bf3.scope\": RecentStats: unable to find data in memory cache]"
Oct 30 21:24:46.859318 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:24:46.859229    4060 generic.go:356] "Generic (PLEG): container finished" podID="2127c7e6-0f35-40cb-a3d2-d566fd31c339" containerID="417c96956059d19396252fd57617af54f4e166b67b7ed8a995452973700a9bf3" exitCode=137
Oct 30 21:24:46.859318 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:24:46.859304    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/tempo-data-science-tempostack-querier-67687b6bdb-sf6hx" event={"ID":"2127c7e6-0f35-40cb-a3d2-d566fd31c339","Type":"ContainerDied","Data":"417c96956059d19396252fd57617af54f4e166b67b7ed8a995452973700a9bf3"}
Oct 30 21:24:46.859781 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:24:46.859393    4060 scope.go:122] "RemoveContainer" containerID="6bbaee132c11ca0219a378dbcc979e075624a10dc0a1726f4b49bf69a1aad298"
Oct 30 21:24:47.143733 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:24:47.143707    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/tempo-data-science-tempostack-querier-67687b6bdb-sf6hx"
Oct 30 21:24:47.195844 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:24:47.195819    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/2127c7e6-0f35-40cb-a3d2-d566fd31c339-tempo-data-science-tempostack-querier-mtls\" (UniqueName: \"kubernetes.io/secret/2127c7e6-0f35-40cb-a3d2-d566fd31c339-tempo-data-science-tempostack-querier-mtls\") pod \"2127c7e6-0f35-40cb-a3d2-d566fd31c339\" (UID: \"2127c7e6-0f35-40cb-a3d2-d566fd31c339\") "
Oct 30 21:24:47.195979 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:24:47.195905    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2127c7e6-0f35-40cb-a3d2-d566fd31c339-tempo-data-science-tempostack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2127c7e6-0f35-40cb-a3d2-d566fd31c339-tempo-data-science-tempostack-ca-bundle\") pod \"2127c7e6-0f35-40cb-a3d2-d566fd31c339\" (UID: \"2127c7e6-0f35-40cb-a3d2-d566fd31c339\") "
Oct 30 21:24:47.195979 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:24:47.195939    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2127c7e6-0f35-40cb-a3d2-d566fd31c339-tempo-tmp-storage\" (UniqueName: \"kubernetes.io/empty-dir/2127c7e6-0f35-40cb-a3d2-d566fd31c339-tempo-tmp-storage\") pod \"2127c7e6-0f35-40cb-a3d2-d566fd31c339\" (UID: \"2127c7e6-0f35-40cb-a3d2-d566fd31c339\") "
Oct 30 21:24:47.196106 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:24:47.196006    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2127c7e6-0f35-40cb-a3d2-d566fd31c339-tempo-conf\" (UniqueName: \"kubernetes.io/configmap/2127c7e6-0f35-40cb-a3d2-d566fd31c339-tempo-conf\") pod \"2127c7e6-0f35-40cb-a3d2-d566fd31c339\" (UID: \"2127c7e6-0f35-40cb-a3d2-d566fd31c339\") "
Oct 30 21:24:47.196106 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:24:47.196057    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/2127c7e6-0f35-40cb-a3d2-d566fd31c339-storage-gcs-key\" (UniqueName: \"kubernetes.io/secret/2127c7e6-0f35-40cb-a3d2-d566fd31c339-storage-gcs-key\") pod \"2127c7e6-0f35-40cb-a3d2-d566fd31c339\" (UID: \"2127c7e6-0f35-40cb-a3d2-d566fd31c339\") "
Oct 30 21:24:47.196106 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:24:47.196093    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2127c7e6-0f35-40cb-a3d2-d566fd31c339-kube-api-access-8p6t5\" (UniqueName: \"kubernetes.io/projected/2127c7e6-0f35-40cb-a3d2-d566fd31c339-kube-api-access-8p6t5\") pod \"2127c7e6-0f35-40cb-a3d2-d566fd31c339\" (UID: \"2127c7e6-0f35-40cb-a3d2-d566fd31c339\") "
Oct 30 21:24:47.196355 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:24:47.196326    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2127c7e6-0f35-40cb-a3d2-d566fd31c339-tempo-tmp-storage" pod "2127c7e6-0f35-40cb-a3d2-d566fd31c339" (UID: "2127c7e6-0f35-40cb-a3d2-d566fd31c339"). InnerVolumeSpecName "tempo-tmp-storage". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:24:47.196519 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:24:47.196481    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2127c7e6-0f35-40cb-a3d2-d566fd31c339-tempo-conf" pod "2127c7e6-0f35-40cb-a3d2-d566fd31c339" (UID: "2127c7e6-0f35-40cb-a3d2-d566fd31c339"). InnerVolumeSpecName "tempo-conf". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:24:47.196643 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:24:47.196381    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2127c7e6-0f35-40cb-a3d2-d566fd31c339-tempo-data-science-tempostack-ca-bundle" pod "2127c7e6-0f35-40cb-a3d2-d566fd31c339" (UID: "2127c7e6-0f35-40cb-a3d2-d566fd31c339"). InnerVolumeSpecName "tempo-data-science-tempostack-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:24:47.197975 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:24:47.197951    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2127c7e6-0f35-40cb-a3d2-d566fd31c339-tempo-data-science-tempostack-querier-mtls" pod "2127c7e6-0f35-40cb-a3d2-d566fd31c339" (UID: "2127c7e6-0f35-40cb-a3d2-d566fd31c339"). InnerVolumeSpecName "tempo-data-science-tempostack-querier-mtls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:24:47.198216 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:24:47.198195    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2127c7e6-0f35-40cb-a3d2-d566fd31c339-storage-gcs-key" pod "2127c7e6-0f35-40cb-a3d2-d566fd31c339" (UID: "2127c7e6-0f35-40cb-a3d2-d566fd31c339"). InnerVolumeSpecName "storage-gcs-key". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:24:47.198531 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:24:47.198513    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2127c7e6-0f35-40cb-a3d2-d566fd31c339-kube-api-access-8p6t5" pod "2127c7e6-0f35-40cb-a3d2-d566fd31c339" (UID: "2127c7e6-0f35-40cb-a3d2-d566fd31c339"). InnerVolumeSpecName "kube-api-access-8p6t5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:24:47.297684 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:24:47.297655    4060 reconciler_common.go:299] "Volume detached for volume \"tempo-data-science-tempostack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2127c7e6-0f35-40cb-a3d2-d566fd31c339-tempo-data-science-tempostack-ca-bundle\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:24:47.297684 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:24:47.297680    4060 reconciler_common.go:299] "Volume detached for volume \"tempo-tmp-storage\" (UniqueName: \"kubernetes.io/empty-dir/2127c7e6-0f35-40cb-a3d2-d566fd31c339-tempo-tmp-storage\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:24:47.297684 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:24:47.297689    4060 reconciler_common.go:299] "Volume detached for volume \"tempo-conf\" (UniqueName: \"kubernetes.io/configmap/2127c7e6-0f35-40cb-a3d2-d566fd31c339-tempo-conf\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:24:47.297904 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:24:47.297698    4060 reconciler_common.go:299] "Volume detached for volume \"storage-gcs-key\" (UniqueName: \"kubernetes.io/secret/2127c7e6-0f35-40cb-a3d2-d566fd31c339-storage-gcs-key\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:24:47.297904 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:24:47.297707    4060 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8p6t5\" (UniqueName: \"kubernetes.io/projected/2127c7e6-0f35-40cb-a3d2-d566fd31c339-kube-api-access-8p6t5\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:24:47.297904 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:24:47.297718    4060 reconciler_common.go:299] "Volume detached for volume \"tempo-data-science-tempostack-querier-mtls\" (UniqueName: \"kubernetes.io/secret/2127c7e6-0f35-40cb-a3d2-d566fd31c339-tempo-data-science-tempostack-querier-mtls\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:24:47.865591 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:24:47.865553    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/tempo-data-science-tempostack-querier-67687b6bdb-sf6hx" event={"ID":"2127c7e6-0f35-40cb-a3d2-d566fd31c339","Type":"ContainerDied","Data":"564c58301d7fa22c247786533f8037052969dcbca6111dc70286f9e5a46fcbc6"}
Oct 30 21:24:47.866022 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:24:47.865625    4060 scope.go:122] "RemoveContainer" containerID="417c96956059d19396252fd57617af54f4e166b67b7ed8a995452973700a9bf3"
Oct 30 21:24:47.866022 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:24:47.865627    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/tempo-data-science-tempostack-querier-67687b6bdb-sf6hx"
Oct 30 21:24:48.031349 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:24:48.031318    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/tempo-data-science-tempostack-querier-67687b6bdb-sf6hx"]
Oct 30 21:24:48.079696 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:24:48.079663    4060 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/tempo-data-science-tempostack-querier-67687b6bdb-sf6hx"]
Oct 30 21:24:49.427805 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:24:49.427773    4060 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2127c7e6-0f35-40cb-a3d2-d566fd31c339" path="/var/lib/kubelet/pods/2127c7e6-0f35-40cb-a3d2-d566fd31c339/volumes"
Oct 30 21:24:55.608697 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:24:55.608665    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/tempo-data-science-tempostack-compactor-7b87dc544b-9bdpj"
Oct 30 21:24:56.339445 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:24:56.339410    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/tempo-data-science-tempostack-compactor-7b87dc544b-9bdpj"]
Oct 30 21:24:56.339721 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:24:56.339691    4060 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/tempo-data-science-tempostack-compactor-7b87dc544b-9bdpj" podUID="9645925e-c718-4971-9b22-2d632b38d1b3" containerName="tempo" containerID="cri-o://22c115a0c9437dc638f26e6000375a32a49a2bfc1cc2791e6e5dd3d9f60b1eea" gracePeriod=30
Oct 30 21:24:58.290517 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:24:58.290479    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/tempo-data-science-tempostack-compactor-7b87dc544b-9bdpj"
Oct 30 21:24:58.391548 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:24:58.391427    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/9645925e-c718-4971-9b22-2d632b38d1b3-tempo-data-science-tempostack-compactor-mtls\" (UniqueName: \"kubernetes.io/secret/9645925e-c718-4971-9b22-2d632b38d1b3-tempo-data-science-tempostack-compactor-mtls\") pod \"9645925e-c718-4971-9b22-2d632b38d1b3\" (UID: \"9645925e-c718-4971-9b22-2d632b38d1b3\") "
Oct 30 21:24:58.391548 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:24:58.391461    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9645925e-c718-4971-9b22-2d632b38d1b3-tempo-conf\" (UniqueName: \"kubernetes.io/configmap/9645925e-c718-4971-9b22-2d632b38d1b3-tempo-conf\") pod \"9645925e-c718-4971-9b22-2d632b38d1b3\" (UID: \"9645925e-c718-4971-9b22-2d632b38d1b3\") "
Oct 30 21:24:58.391548 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:24:58.391536    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9645925e-c718-4971-9b22-2d632b38d1b3-tempo-tmp-storage\" (UniqueName: \"kubernetes.io/empty-dir/9645925e-c718-4971-9b22-2d632b38d1b3-tempo-tmp-storage\") pod \"9645925e-c718-4971-9b22-2d632b38d1b3\" (UID: \"9645925e-c718-4971-9b22-2d632b38d1b3\") "
Oct 30 21:24:58.391822 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:24:58.391582    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9645925e-c718-4971-9b22-2d632b38d1b3-tempo-data-science-tempostack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9645925e-c718-4971-9b22-2d632b38d1b3-tempo-data-science-tempostack-ca-bundle\") pod \"9645925e-c718-4971-9b22-2d632b38d1b3\" (UID: \"9645925e-c718-4971-9b22-2d632b38d1b3\") "
Oct 30 21:24:58.391822 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:24:58.391680    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/9645925e-c718-4971-9b22-2d632b38d1b3-storage-gcs-key\" (UniqueName: \"kubernetes.io/secret/9645925e-c718-4971-9b22-2d632b38d1b3-storage-gcs-key\") pod \"9645925e-c718-4971-9b22-2d632b38d1b3\" (UID: \"9645925e-c718-4971-9b22-2d632b38d1b3\") "
Oct 30 21:24:58.392017 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:24:58.391899    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9645925e-c718-4971-9b22-2d632b38d1b3-kube-api-access-mthj4\" (UniqueName: \"kubernetes.io/projected/9645925e-c718-4971-9b22-2d632b38d1b3-kube-api-access-mthj4\") pod \"9645925e-c718-4971-9b22-2d632b38d1b3\" (UID: \"9645925e-c718-4971-9b22-2d632b38d1b3\") "
Oct 30 21:24:58.392017 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:24:58.391974    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9645925e-c718-4971-9b22-2d632b38d1b3-tempo-tmp-storage" pod "9645925e-c718-4971-9b22-2d632b38d1b3" (UID: "9645925e-c718-4971-9b22-2d632b38d1b3"). InnerVolumeSpecName "tempo-tmp-storage". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:24:58.392154 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:24:58.392087    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9645925e-c718-4971-9b22-2d632b38d1b3-tempo-conf" pod "9645925e-c718-4971-9b22-2d632b38d1b3" (UID: "9645925e-c718-4971-9b22-2d632b38d1b3"). InnerVolumeSpecName "tempo-conf". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:24:58.392154 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:24:58.392129    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9645925e-c718-4971-9b22-2d632b38d1b3-tempo-data-science-tempostack-ca-bundle" pod "9645925e-c718-4971-9b22-2d632b38d1b3" (UID: "9645925e-c718-4971-9b22-2d632b38d1b3"). InnerVolumeSpecName "tempo-data-science-tempostack-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:24:58.392278 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:24:58.392262    4060 reconciler_common.go:299] "Volume detached for volume \"tempo-tmp-storage\" (UniqueName: \"kubernetes.io/empty-dir/9645925e-c718-4971-9b22-2d632b38d1b3-tempo-tmp-storage\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:24:58.392332 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:24:58.392285    4060 reconciler_common.go:299] "Volume detached for volume \"tempo-data-science-tempostack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9645925e-c718-4971-9b22-2d632b38d1b3-tempo-data-science-tempostack-ca-bundle\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:24:58.392332 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:24:58.392303    4060 reconciler_common.go:299] "Volume detached for volume \"tempo-conf\" (UniqueName: \"kubernetes.io/configmap/9645925e-c718-4971-9b22-2d632b38d1b3-tempo-conf\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:24:58.393693 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:24:58.393669    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9645925e-c718-4971-9b22-2d632b38d1b3-storage-gcs-key" pod "9645925e-c718-4971-9b22-2d632b38d1b3" (UID: "9645925e-c718-4971-9b22-2d632b38d1b3"). InnerVolumeSpecName "storage-gcs-key". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:24:58.393797 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:24:58.393689    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9645925e-c718-4971-9b22-2d632b38d1b3-tempo-data-science-tempostack-compactor-mtls" pod "9645925e-c718-4971-9b22-2d632b38d1b3" (UID: "9645925e-c718-4971-9b22-2d632b38d1b3"). InnerVolumeSpecName "tempo-data-science-tempostack-compactor-mtls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:24:58.393935 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:24:58.393917    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9645925e-c718-4971-9b22-2d632b38d1b3-kube-api-access-mthj4" pod "9645925e-c718-4971-9b22-2d632b38d1b3" (UID: "9645925e-c718-4971-9b22-2d632b38d1b3"). InnerVolumeSpecName "kube-api-access-mthj4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:24:58.493255 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:24:58.493224    4060 reconciler_common.go:299] "Volume detached for volume \"storage-gcs-key\" (UniqueName: \"kubernetes.io/secret/9645925e-c718-4971-9b22-2d632b38d1b3-storage-gcs-key\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:24:58.493255 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:24:58.493249    4060 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mthj4\" (UniqueName: \"kubernetes.io/projected/9645925e-c718-4971-9b22-2d632b38d1b3-kube-api-access-mthj4\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:24:58.493255 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:24:58.493260    4060 reconciler_common.go:299] "Volume detached for volume \"tempo-data-science-tempostack-compactor-mtls\" (UniqueName: \"kubernetes.io/secret/9645925e-c718-4971-9b22-2d632b38d1b3-tempo-data-science-tempostack-compactor-mtls\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:24:58.923594 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:24:58.923566    4060 generic.go:356] "Generic (PLEG): container finished" podID="9645925e-c718-4971-9b22-2d632b38d1b3" containerID="22c115a0c9437dc638f26e6000375a32a49a2bfc1cc2791e6e5dd3d9f60b1eea" exitCode=0
Oct 30 21:24:58.923785 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:24:58.923617    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/tempo-data-science-tempostack-compactor-7b87dc544b-9bdpj"
Oct 30 21:24:58.923785 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:24:58.923657    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/tempo-data-science-tempostack-compactor-7b87dc544b-9bdpj" event={"ID":"9645925e-c718-4971-9b22-2d632b38d1b3","Type":"ContainerDied","Data":"22c115a0c9437dc638f26e6000375a32a49a2bfc1cc2791e6e5dd3d9f60b1eea"}
Oct 30 21:24:58.923785 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:24:58.923724    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/tempo-data-science-tempostack-compactor-7b87dc544b-9bdpj" event={"ID":"9645925e-c718-4971-9b22-2d632b38d1b3","Type":"ContainerDied","Data":"b2e9049d328de36d29cc6aab84b1f3750d2e24421da9519201851e9cec47a54e"}
Oct 30 21:24:58.923785 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:24:58.923746    4060 scope.go:122] "RemoveContainer" containerID="22c115a0c9437dc638f26e6000375a32a49a2bfc1cc2791e6e5dd3d9f60b1eea"
Oct 30 21:24:58.933239 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:24:58.933221    4060 scope.go:122] "RemoveContainer" containerID="9109f94668e3949716e5050a306a4863c9d6616706f9d79d28ffa40afbc343a4"
Oct 30 21:24:58.941358 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:24:58.941342    4060 scope.go:122] "RemoveContainer" containerID="22c115a0c9437dc638f26e6000375a32a49a2bfc1cc2791e6e5dd3d9f60b1eea"
Oct 30 21:24:58.941620 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:24:58.941602    4060 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"22c115a0c9437dc638f26e6000375a32a49a2bfc1cc2791e6e5dd3d9f60b1eea\": container with ID starting with 22c115a0c9437dc638f26e6000375a32a49a2bfc1cc2791e6e5dd3d9f60b1eea not found: ID does not exist" containerID="22c115a0c9437dc638f26e6000375a32a49a2bfc1cc2791e6e5dd3d9f60b1eea"
Oct 30 21:24:58.941672 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:24:58.941629    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"22c115a0c9437dc638f26e6000375a32a49a2bfc1cc2791e6e5dd3d9f60b1eea"} err="failed to get container status \"22c115a0c9437dc638f26e6000375a32a49a2bfc1cc2791e6e5dd3d9f60b1eea\": rpc error: code = NotFound desc = could not find container \"22c115a0c9437dc638f26e6000375a32a49a2bfc1cc2791e6e5dd3d9f60b1eea\": container with ID starting with 22c115a0c9437dc638f26e6000375a32a49a2bfc1cc2791e6e5dd3d9f60b1eea not found: ID does not exist"
Oct 30 21:24:58.941672 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:24:58.941644    4060 scope.go:122] "RemoveContainer" containerID="9109f94668e3949716e5050a306a4863c9d6616706f9d79d28ffa40afbc343a4"
Oct 30 21:24:58.941847 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:24:58.941834    4060 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9109f94668e3949716e5050a306a4863c9d6616706f9d79d28ffa40afbc343a4\": container with ID starting with 9109f94668e3949716e5050a306a4863c9d6616706f9d79d28ffa40afbc343a4 not found: ID does not exist" containerID="9109f94668e3949716e5050a306a4863c9d6616706f9d79d28ffa40afbc343a4"
Oct 30 21:24:58.941890 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:24:58.941850    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9109f94668e3949716e5050a306a4863c9d6616706f9d79d28ffa40afbc343a4"} err="failed to get container status \"9109f94668e3949716e5050a306a4863c9d6616706f9d79d28ffa40afbc343a4\": rpc error: code = NotFound desc = could not find container \"9109f94668e3949716e5050a306a4863c9d6616706f9d79d28ffa40afbc343a4\": container with ID starting with 9109f94668e3949716e5050a306a4863c9d6616706f9d79d28ffa40afbc343a4 not found: ID does not exist"
Oct 30 21:24:59.087929 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:24:59.087898    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/tempo-data-science-tempostack-compactor-7b87dc544b-9bdpj"]
Oct 30 21:24:59.092197 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:24:59.092177    4060 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/tempo-data-science-tempostack-compactor-7b87dc544b-9bdpj"]
Oct 30 21:24:59.427150 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:24:59.427119    4060 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9645925e-c718-4971-9b22-2d632b38d1b3" path="/var/lib/kubelet/pods/9645925e-c718-4971-9b22-2d632b38d1b3/volumes"
Oct 30 21:25:03.642574 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:03.642475    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:25:03.642956 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:03.642755    4060 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-collector-0" podUID="0e609f01-5583-47d2-b404-d1494dd50018" containerName="otc-container" containerID="cri-o://2545bb04628a3d848e1e82e8163c270e7594ca67137b00ce989094b0969273f4" gracePeriod=30
Oct 30 21:25:03.887462 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:03.887434    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:25:03.950182 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:03.950151    4060 generic.go:356] "Generic (PLEG): container finished" podID="0e609f01-5583-47d2-b404-d1494dd50018" containerID="2545bb04628a3d848e1e82e8163c270e7594ca67137b00ce989094b0969273f4" exitCode=0
Oct 30 21:25:03.950347 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:03.950200    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:25:03.950347 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:03.950214    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"0e609f01-5583-47d2-b404-d1494dd50018","Type":"ContainerDied","Data":"2545bb04628a3d848e1e82e8163c270e7594ca67137b00ce989094b0969273f4"}
Oct 30 21:25:03.950347 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:03.950260    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"0e609f01-5583-47d2-b404-d1494dd50018","Type":"ContainerDied","Data":"a054ed4fe1cb047f1257efefecb5ac921ffa9724d6216fd9f8a0c1d2da5a1512"}
Oct 30 21:25:03.950347 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:03.950281    4060 scope.go:122] "RemoveContainer" containerID="2545bb04628a3d848e1e82e8163c270e7594ca67137b00ce989094b0969273f4"
Oct 30 21:25:03.958195 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:03.958179    4060 scope.go:122] "RemoveContainer" containerID="2545bb04628a3d848e1e82e8163c270e7594ca67137b00ce989094b0969273f4"
Oct 30 21:25:03.958434 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:25:03.958417    4060 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2545bb04628a3d848e1e82e8163c270e7594ca67137b00ce989094b0969273f4\": container with ID starting with 2545bb04628a3d848e1e82e8163c270e7594ca67137b00ce989094b0969273f4 not found: ID does not exist" containerID="2545bb04628a3d848e1e82e8163c270e7594ca67137b00ce989094b0969273f4"
Oct 30 21:25:03.958480 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:03.958444    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2545bb04628a3d848e1e82e8163c270e7594ca67137b00ce989094b0969273f4"} err="failed to get container status \"2545bb04628a3d848e1e82e8163c270e7594ca67137b00ce989094b0969273f4\": rpc error: code = NotFound desc = could not find container \"2545bb04628a3d848e1e82e8163c270e7594ca67137b00ce989094b0969273f4\": container with ID starting with 2545bb04628a3d848e1e82e8163c270e7594ca67137b00ce989094b0969273f4 not found: ID does not exist"
Oct 30 21:25:04.038695 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:04.038663    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/0e609f01-5583-47d2-b404-d1494dd50018-otc-internal\" (UniqueName: \"kubernetes.io/configmap/0e609f01-5583-47d2-b404-d1494dd50018-otc-internal\") pod \"0e609f01-5583-47d2-b404-d1494dd50018\" (UID: \"0e609f01-5583-47d2-b404-d1494dd50018\") "
Oct 30 21:25:04.038878 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:04.038708    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/0e609f01-5583-47d2-b404-d1494dd50018-monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/0e609f01-5583-47d2-b404-d1494dd50018-monitoring-tls-certs\") pod \"0e609f01-5583-47d2-b404-d1494dd50018\" (UID: \"0e609f01-5583-47d2-b404-d1494dd50018\") "
Oct 30 21:25:04.038878 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:04.038795    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0e609f01-5583-47d2-b404-d1494dd50018-kube-api-access-vdz49\" (UniqueName: \"kubernetes.io/projected/0e609f01-5583-47d2-b404-d1494dd50018-kube-api-access-vdz49\") pod \"0e609f01-5583-47d2-b404-d1494dd50018\" (UID: \"0e609f01-5583-47d2-b404-d1494dd50018\") "
Oct 30 21:25:04.038878 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:04.038812    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/0e609f01-5583-47d2-b404-d1494dd50018-otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/0e609f01-5583-47d2-b404-d1494dd50018-otlp-tls-certs\") pod \"0e609f01-5583-47d2-b404-d1494dd50018\" (UID: \"0e609f01-5583-47d2-b404-d1494dd50018\") "
Oct 30 21:25:04.039055 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:04.039017    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0e609f01-5583-47d2-b404-d1494dd50018-otc-internal" pod "0e609f01-5583-47d2-b404-d1494dd50018" (UID: "0e609f01-5583-47d2-b404-d1494dd50018"). InnerVolumeSpecName "otc-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:25:04.040898 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:04.040872    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0e609f01-5583-47d2-b404-d1494dd50018-monitoring-tls-certs" pod "0e609f01-5583-47d2-b404-d1494dd50018" (UID: "0e609f01-5583-47d2-b404-d1494dd50018"). InnerVolumeSpecName "monitoring-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:25:04.040898 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:04.040890    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0e609f01-5583-47d2-b404-d1494dd50018-otlp-tls-certs" pod "0e609f01-5583-47d2-b404-d1494dd50018" (UID: "0e609f01-5583-47d2-b404-d1494dd50018"). InnerVolumeSpecName "otlp-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:25:04.041047 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:04.040948    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0e609f01-5583-47d2-b404-d1494dd50018-kube-api-access-vdz49" pod "0e609f01-5583-47d2-b404-d1494dd50018" (UID: "0e609f01-5583-47d2-b404-d1494dd50018"). InnerVolumeSpecName "kube-api-access-vdz49". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:25:04.139956 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:04.139924    4060 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vdz49\" (UniqueName: \"kubernetes.io/projected/0e609f01-5583-47d2-b404-d1494dd50018-kube-api-access-vdz49\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:25:04.139956 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:04.139952    4060 reconciler_common.go:299] "Volume detached for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/0e609f01-5583-47d2-b404-d1494dd50018-otlp-tls-certs\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:25:04.139956 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:04.139962    4060 reconciler_common.go:299] "Volume detached for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/0e609f01-5583-47d2-b404-d1494dd50018-otc-internal\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:25:04.140179 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:04.139972    4060 reconciler_common.go:299] "Volume detached for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/0e609f01-5583-47d2-b404-d1494dd50018-monitoring-tls-certs\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:25:04.372285 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:04.372246    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:25:04.376646 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:04.376622    4060 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:25:04.455501 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:04.455466    4060 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:25:04.455803 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:04.455791    4060 cpu_manager.go:414] "containerMap: removing container" podUID="2127c7e6-0f35-40cb-a3d2-d566fd31c339" containerName="tempo"
Oct 30 21:25:04.455859 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:04.455805    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2127c7e6-0f35-40cb-a3d2-d566fd31c339" containerName="tempo"
Oct 30 21:25:04.455859 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:04.455817    4060 cpu_manager.go:414] "containerMap: removing container" podUID="5f8f3035-2e64-46b1-947b-2ec7890b8f9c" containerName="tempo"
Oct 30 21:25:04.455859 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:04.455822    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5f8f3035-2e64-46b1-947b-2ec7890b8f9c" containerName="tempo"
Oct 30 21:25:04.455859 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:04.455838    4060 cpu_manager.go:414] "containerMap: removing container" podUID="0e609f01-5583-47d2-b404-d1494dd50018" containerName="otc-container"
Oct 30 21:25:04.455859 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:04.455843    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0e609f01-5583-47d2-b404-d1494dd50018" containerName="otc-container"
Oct 30 21:25:04.455859 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:04.455857    4060 cpu_manager.go:414] "containerMap: removing container" podUID="9645925e-c718-4971-9b22-2d632b38d1b3" containerName="tempo"
Oct 30 21:25:04.456046 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:04.455862    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9645925e-c718-4971-9b22-2d632b38d1b3" containerName="tempo"
Oct 30 21:25:04.456046 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:04.455870    4060 cpu_manager.go:414] "containerMap: removing container" podUID="9645925e-c718-4971-9b22-2d632b38d1b3" containerName="tempo"
Oct 30 21:25:04.456046 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:04.455875    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9645925e-c718-4971-9b22-2d632b38d1b3" containerName="tempo"
Oct 30 21:25:04.456046 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:04.455921    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="0e609f01-5583-47d2-b404-d1494dd50018" containerName="otc-container"
Oct 30 21:25:04.456046 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:04.455930    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="9645925e-c718-4971-9b22-2d632b38d1b3" containerName="tempo"
Oct 30 21:25:04.456046 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:04.455936    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="9645925e-c718-4971-9b22-2d632b38d1b3" containerName="tempo"
Oct 30 21:25:04.456046 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:04.455942    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="2127c7e6-0f35-40cb-a3d2-d566fd31c339" containerName="tempo"
Oct 30 21:25:04.456046 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:04.455948    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="5f8f3035-2e64-46b1-947b-2ec7890b8f9c" containerName="tempo"
Oct 30 21:25:04.456046 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:04.455954    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="2127c7e6-0f35-40cb-a3d2-d566fd31c339" containerName="tempo"
Oct 30 21:25:04.460433 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:04.460415    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:25:04.512833 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:04.512750    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-headless-tls\""
Oct 30 21:25:04.512833 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:04.512788    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-monitoring-tls\""
Oct 30 21:25:04.513085 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:04.512850    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-dockercfg-nfqbf\""
Oct 30 21:25:04.513085 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:04.512957    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-54f83bab\""
Oct 30 21:25:04.519325 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:04.519300    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:25:04.543604 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:04.543577    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bq27d\" (UniqueName: \"kubernetes.io/projected/ecc4a380-c444-44e4-9f0c-e7a5309e8bd3-kube-api-access-bq27d\") pod \"data-science-collector-collector-0\" (UID: \"ecc4a380-c444-44e4-9f0c-e7a5309e8bd3\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:25:04.543604 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:04.543607    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/ecc4a380-c444-44e4-9f0c-e7a5309e8bd3-otlp-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"ecc4a380-c444-44e4-9f0c-e7a5309e8bd3\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:25:04.543807 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:04.543631    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/ecc4a380-c444-44e4-9f0c-e7a5309e8bd3-otc-internal\") pod \"data-science-collector-collector-0\" (UID: \"ecc4a380-c444-44e4-9f0c-e7a5309e8bd3\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:25:04.543844 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:04.543810    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/ecc4a380-c444-44e4-9f0c-e7a5309e8bd3-monitoring-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"ecc4a380-c444-44e4-9f0c-e7a5309e8bd3\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:25:04.644767 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:04.644728    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/ecc4a380-c444-44e4-9f0c-e7a5309e8bd3-monitoring-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"ecc4a380-c444-44e4-9f0c-e7a5309e8bd3\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:25:04.644767 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:04.644769    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bq27d\" (UniqueName: \"kubernetes.io/projected/ecc4a380-c444-44e4-9f0c-e7a5309e8bd3-kube-api-access-bq27d\") pod \"data-science-collector-collector-0\" (UID: \"ecc4a380-c444-44e4-9f0c-e7a5309e8bd3\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:25:04.645287 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:04.644878    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/ecc4a380-c444-44e4-9f0c-e7a5309e8bd3-otlp-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"ecc4a380-c444-44e4-9f0c-e7a5309e8bd3\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:25:04.645287 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:04.644921    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/ecc4a380-c444-44e4-9f0c-e7a5309e8bd3-otc-internal\") pod \"data-science-collector-collector-0\" (UID: \"ecc4a380-c444-44e4-9f0c-e7a5309e8bd3\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:25:04.645587 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:04.645569    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/ecc4a380-c444-44e4-9f0c-e7a5309e8bd3-otc-internal\") pod \"data-science-collector-collector-0\" (UID: \"ecc4a380-c444-44e4-9f0c-e7a5309e8bd3\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:25:04.647195 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:04.647171    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/ecc4a380-c444-44e4-9f0c-e7a5309e8bd3-otlp-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"ecc4a380-c444-44e4-9f0c-e7a5309e8bd3\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:25:04.647294 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:04.647233    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/ecc4a380-c444-44e4-9f0c-e7a5309e8bd3-monitoring-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"ecc4a380-c444-44e4-9f0c-e7a5309e8bd3\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:25:04.705396 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:04.705361    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bq27d\" (UniqueName: \"kubernetes.io/projected/ecc4a380-c444-44e4-9f0c-e7a5309e8bd3-kube-api-access-bq27d\") pod \"data-science-collector-collector-0\" (UID: \"ecc4a380-c444-44e4-9f0c-e7a5309e8bd3\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:25:04.772368 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:04.772288    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:25:05.145678 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:05.145642    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:25:05.147780 ip-10-0-142-4 kubenswrapper[4060]: W1030 21:25:05.147755    4060 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podecc4a380_c444_44e4_9f0c_e7a5309e8bd3.slice/crio-93f74cfa78c3101365f82fff4f1d7d1661ab31d91b1417753a95309a12357ba6 WatchSource:0}: Error finding container 93f74cfa78c3101365f82fff4f1d7d1661ab31d91b1417753a95309a12357ba6: Status 404 returned error can't find the container with id 93f74cfa78c3101365f82fff4f1d7d1661ab31d91b1417753a95309a12357ba6
Oct 30 21:25:05.150479 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:05.150447    4060 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 21:25:05.150573 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:05.150556    4060 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 21:25:05.426929 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:05.426845    4060 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="0e609f01-5583-47d2-b404-d1494dd50018" path="/var/lib/kubelet/pods/0e609f01-5583-47d2-b404-d1494dd50018/volumes"
Oct 30 21:25:05.962260 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:05.962221    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"ecc4a380-c444-44e4-9f0c-e7a5309e8bd3","Type":"ContainerStarted","Data":"61888f20d4bcd263806bcc4b22769f93334795b3c3cd00d3b70a1428256ac07d"}
Oct 30 21:25:05.962771 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:05.962274    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"ecc4a380-c444-44e4-9f0c-e7a5309e8bd3","Type":"ContainerStarted","Data":"93f74cfa78c3101365f82fff4f1d7d1661ab31d91b1417753a95309a12357ba6"}
Oct 30 21:25:06.085226 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:06.085169    4060 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-collector-0" podStartSLOduration=2.085151997 podStartE2EDuration="2.085151997s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:25:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:25:06.082810255 +0000 UTC m=+2924.839808565" watchObservedRunningTime="2026-10-30 21:25:06.085151997 +0000 UTC m=+2924.842150297"
Oct 30 21:25:12.150073 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:25:12.150038    4060 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v2f4x" containerName="extractor"
Oct 30 21:25:36.634027 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:36.633991    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/korrel8r-5d45699dc4-dvjrm"]
Oct 30 21:25:36.634581 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:36.634208    4060 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/korrel8r-5d45699dc4-dvjrm" podUID="2e49a3bc-a84a-495a-bc5a-6505b0980d03" containerName="korrel8r" containerID="cri-o://57835526f489ed3fc34ef939e36f1d3caad387f79e57f8ed8f16bb0a6a7d1a84" gracePeriod=30
Oct 30 21:25:36.876608 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:36.876583    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/korrel8r-5d45699dc4-dvjrm"
Oct 30 21:25:36.914360 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:36.914291    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2e49a3bc-a84a-495a-bc5a-6505b0980d03-kube-api-access-cmmn7\" (UniqueName: \"kubernetes.io/projected/2e49a3bc-a84a-495a-bc5a-6505b0980d03-kube-api-access-cmmn7\") pod \"2e49a3bc-a84a-495a-bc5a-6505b0980d03\" (UID: \"2e49a3bc-a84a-495a-bc5a-6505b0980d03\") "
Oct 30 21:25:36.914360 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:36.914328    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/2e49a3bc-a84a-495a-bc5a-6505b0980d03-tls\" (UniqueName: \"kubernetes.io/secret/2e49a3bc-a84a-495a-bc5a-6505b0980d03-tls\") pod \"2e49a3bc-a84a-495a-bc5a-6505b0980d03\" (UID: \"2e49a3bc-a84a-495a-bc5a-6505b0980d03\") "
Oct 30 21:25:36.914591 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:36.914375    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2e49a3bc-a84a-495a-bc5a-6505b0980d03-config\" (UniqueName: \"kubernetes.io/configmap/2e49a3bc-a84a-495a-bc5a-6505b0980d03-config\") pod \"2e49a3bc-a84a-495a-bc5a-6505b0980d03\" (UID: \"2e49a3bc-a84a-495a-bc5a-6505b0980d03\") "
Oct 30 21:25:36.914813 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:36.914785    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2e49a3bc-a84a-495a-bc5a-6505b0980d03-config" pod "2e49a3bc-a84a-495a-bc5a-6505b0980d03" (UID: "2e49a3bc-a84a-495a-bc5a-6505b0980d03"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:25:36.916368 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:36.916348    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e49a3bc-a84a-495a-bc5a-6505b0980d03-kube-api-access-cmmn7" pod "2e49a3bc-a84a-495a-bc5a-6505b0980d03" (UID: "2e49a3bc-a84a-495a-bc5a-6505b0980d03"). InnerVolumeSpecName "kube-api-access-cmmn7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:25:36.916857 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:36.916833    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2e49a3bc-a84a-495a-bc5a-6505b0980d03-tls" pod "2e49a3bc-a84a-495a-bc5a-6505b0980d03" (UID: "2e49a3bc-a84a-495a-bc5a-6505b0980d03"). InnerVolumeSpecName "tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:25:37.015799 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:37.015758    4060 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2e49a3bc-a84a-495a-bc5a-6505b0980d03-config\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:25:37.015799 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:37.015798    4060 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cmmn7\" (UniqueName: \"kubernetes.io/projected/2e49a3bc-a84a-495a-bc5a-6505b0980d03-kube-api-access-cmmn7\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:25:37.016043 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:37.015816    4060 reconciler_common.go:299] "Volume detached for volume \"tls\" (UniqueName: \"kubernetes.io/secret/2e49a3bc-a84a-495a-bc5a-6505b0980d03-tls\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:25:37.106564 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:37.106523    4060 generic.go:356] "Generic (PLEG): container finished" podID="2e49a3bc-a84a-495a-bc5a-6505b0980d03" containerID="57835526f489ed3fc34ef939e36f1d3caad387f79e57f8ed8f16bb0a6a7d1a84" exitCode=0
Oct 30 21:25:37.106734 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:37.106596    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/korrel8r-5d45699dc4-dvjrm"
Oct 30 21:25:37.106734 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:37.106610    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/korrel8r-5d45699dc4-dvjrm" event={"ID":"2e49a3bc-a84a-495a-bc5a-6505b0980d03","Type":"ContainerDied","Data":"57835526f489ed3fc34ef939e36f1d3caad387f79e57f8ed8f16bb0a6a7d1a84"}
Oct 30 21:25:37.106734 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:37.106686    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/korrel8r-5d45699dc4-dvjrm" event={"ID":"2e49a3bc-a84a-495a-bc5a-6505b0980d03","Type":"ContainerDied","Data":"9b4515874c4f01efe213dc6c88cc0b5eccf2dea6e769f3a19061b19042fd545b"}
Oct 30 21:25:37.106734 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:37.106708    4060 scope.go:122] "RemoveContainer" containerID="57835526f489ed3fc34ef939e36f1d3caad387f79e57f8ed8f16bb0a6a7d1a84"
Oct 30 21:25:37.115088 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:37.115072    4060 scope.go:122] "RemoveContainer" containerID="57835526f489ed3fc34ef939e36f1d3caad387f79e57f8ed8f16bb0a6a7d1a84"
Oct 30 21:25:37.115332 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:25:37.115315    4060 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"57835526f489ed3fc34ef939e36f1d3caad387f79e57f8ed8f16bb0a6a7d1a84\": container with ID starting with 57835526f489ed3fc34ef939e36f1d3caad387f79e57f8ed8f16bb0a6a7d1a84 not found: ID does not exist" containerID="57835526f489ed3fc34ef939e36f1d3caad387f79e57f8ed8f16bb0a6a7d1a84"
Oct 30 21:25:37.115370 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:37.115342    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"57835526f489ed3fc34ef939e36f1d3caad387f79e57f8ed8f16bb0a6a7d1a84"} err="failed to get container status \"57835526f489ed3fc34ef939e36f1d3caad387f79e57f8ed8f16bb0a6a7d1a84\": rpc error: code = NotFound desc = could not find container \"57835526f489ed3fc34ef939e36f1d3caad387f79e57f8ed8f16bb0a6a7d1a84\": container with ID starting with 57835526f489ed3fc34ef939e36f1d3caad387f79e57f8ed8f16bb0a6a7d1a84 not found: ID does not exist"
Oct 30 21:25:37.271023 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:37.270995    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/korrel8r-5d45699dc4-dvjrm"]
Oct 30 21:25:37.281387 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:37.281351    4060 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/korrel8r-5d45699dc4-dvjrm"]
Oct 30 21:25:37.426899 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:37.426860    4060 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2e49a3bc-a84a-495a-bc5a-6505b0980d03" path="/var/lib/kubelet/pods/2e49a3bc-a84a-495a-bc5a-6505b0980d03/volumes"
Oct 30 21:25:37.942866 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:37.942829    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:25:37.943341 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:37.943082    4060 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-collector-0" podUID="ecc4a380-c444-44e4-9f0c-e7a5309e8bd3" containerName="otc-container" containerID="cri-o://61888f20d4bcd263806bcc4b22769f93334795b3c3cd00d3b70a1428256ac07d" gracePeriod=30
Oct 30 21:25:38.115527 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:38.115469    4060 generic.go:356] "Generic (PLEG): container finished" podID="ecc4a380-c444-44e4-9f0c-e7a5309e8bd3" containerID="61888f20d4bcd263806bcc4b22769f93334795b3c3cd00d3b70a1428256ac07d" exitCode=0
Oct 30 21:25:38.115679 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:38.115527    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"ecc4a380-c444-44e4-9f0c-e7a5309e8bd3","Type":"ContainerDied","Data":"61888f20d4bcd263806bcc4b22769f93334795b3c3cd00d3b70a1428256ac07d"}
Oct 30 21:25:38.189773 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:38.189747    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:25:38.226401 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:38.226373    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ecc4a380-c444-44e4-9f0c-e7a5309e8bd3-otc-internal\" (UniqueName: \"kubernetes.io/configmap/ecc4a380-c444-44e4-9f0c-e7a5309e8bd3-otc-internal\") pod \"ecc4a380-c444-44e4-9f0c-e7a5309e8bd3\" (UID: \"ecc4a380-c444-44e4-9f0c-e7a5309e8bd3\") "
Oct 30 21:25:38.226615 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:38.226435    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ecc4a380-c444-44e4-9f0c-e7a5309e8bd3-monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/ecc4a380-c444-44e4-9f0c-e7a5309e8bd3-monitoring-tls-certs\") pod \"ecc4a380-c444-44e4-9f0c-e7a5309e8bd3\" (UID: \"ecc4a380-c444-44e4-9f0c-e7a5309e8bd3\") "
Oct 30 21:25:38.226615 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:38.226537    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ecc4a380-c444-44e4-9f0c-e7a5309e8bd3-kube-api-access-bq27d\" (UniqueName: \"kubernetes.io/projected/ecc4a380-c444-44e4-9f0c-e7a5309e8bd3-kube-api-access-bq27d\") pod \"ecc4a380-c444-44e4-9f0c-e7a5309e8bd3\" (UID: \"ecc4a380-c444-44e4-9f0c-e7a5309e8bd3\") "
Oct 30 21:25:38.226615 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:38.226587    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ecc4a380-c444-44e4-9f0c-e7a5309e8bd3-otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/ecc4a380-c444-44e4-9f0c-e7a5309e8bd3-otlp-tls-certs\") pod \"ecc4a380-c444-44e4-9f0c-e7a5309e8bd3\" (UID: \"ecc4a380-c444-44e4-9f0c-e7a5309e8bd3\") "
Oct 30 21:25:38.226801 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:38.226779    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ecc4a380-c444-44e4-9f0c-e7a5309e8bd3-otc-internal" pod "ecc4a380-c444-44e4-9f0c-e7a5309e8bd3" (UID: "ecc4a380-c444-44e4-9f0c-e7a5309e8bd3"). InnerVolumeSpecName "otc-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:25:38.228475 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:38.228447    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ecc4a380-c444-44e4-9f0c-e7a5309e8bd3-monitoring-tls-certs" pod "ecc4a380-c444-44e4-9f0c-e7a5309e8bd3" (UID: "ecc4a380-c444-44e4-9f0c-e7a5309e8bd3"). InnerVolumeSpecName "monitoring-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:25:38.228600 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:38.228530    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ecc4a380-c444-44e4-9f0c-e7a5309e8bd3-kube-api-access-bq27d" pod "ecc4a380-c444-44e4-9f0c-e7a5309e8bd3" (UID: "ecc4a380-c444-44e4-9f0c-e7a5309e8bd3"). InnerVolumeSpecName "kube-api-access-bq27d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:25:38.228600 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:38.228539    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ecc4a380-c444-44e4-9f0c-e7a5309e8bd3-otlp-tls-certs" pod "ecc4a380-c444-44e4-9f0c-e7a5309e8bd3" (UID: "ecc4a380-c444-44e4-9f0c-e7a5309e8bd3"). InnerVolumeSpecName "otlp-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:25:38.327994 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:38.327967    4060 reconciler_common.go:299] "Volume detached for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/ecc4a380-c444-44e4-9f0c-e7a5309e8bd3-otc-internal\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:25:38.327994 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:38.327995    4060 reconciler_common.go:299] "Volume detached for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/ecc4a380-c444-44e4-9f0c-e7a5309e8bd3-monitoring-tls-certs\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:25:38.328186 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:38.328005    4060 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bq27d\" (UniqueName: \"kubernetes.io/projected/ecc4a380-c444-44e4-9f0c-e7a5309e8bd3-kube-api-access-bq27d\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:25:38.328186 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:38.328014    4060 reconciler_common.go:299] "Volume detached for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/ecc4a380-c444-44e4-9f0c-e7a5309e8bd3-otlp-tls-certs\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:25:38.915792 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:38.915761    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/tempo-data-science-tempostack-query-frontend-fb899c58-dlbzl"]
Oct 30 21:25:38.916019 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:38.915992    4060 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/tempo-data-science-tempostack-query-frontend-fb899c58-dlbzl" podUID="d36a0e75-3848-4561-9fd0-b01a20389236" containerName="tempo" containerID="cri-o://6d6f70b2f2440ecc8e5dada46decddb8c76bb431cf4697dc948b154c7b12792d" gracePeriod=30
Oct 30 21:25:38.921562 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:38.921535    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/tempo-data-science-tempostack-gateway-5795b58d6b-2shpz"]
Oct 30 21:25:38.921772 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:38.921739    4060 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/tempo-data-science-tempostack-gateway-5795b58d6b-2shpz" podUID="0c495fa4-697a-449d-98fd-8d4cc4505a6b" containerName="tempo-gateway" containerID="cri-o://ebe371779a29125ea57fe4cbb2024ac72e5295ff9faf4fc77bc96fec08def47b" gracePeriod=30
Oct 30 21:25:38.921902 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:38.921885    4060 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/tempo-data-science-tempostack-gateway-5795b58d6b-2shpz" podUID="0c495fa4-697a-449d-98fd-8d4cc4505a6b" containerName="tempo-gateway-opa" containerID="cri-o://d05a7606da3af79d27fd7b113580274b734a9076c349c2ad7a67640e1a3a69f5" gracePeriod=30
Oct 30 21:25:39.123287 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:39.123257    4060 generic.go:356] "Generic (PLEG): container finished" podID="0c495fa4-697a-449d-98fd-8d4cc4505a6b" containerID="d05a7606da3af79d27fd7b113580274b734a9076c349c2ad7a67640e1a3a69f5" exitCode=0
Oct 30 21:25:39.123688 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:39.123327    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/tempo-data-science-tempostack-gateway-5795b58d6b-2shpz" event={"ID":"0c495fa4-697a-449d-98fd-8d4cc4505a6b","Type":"ContainerDied","Data":"d05a7606da3af79d27fd7b113580274b734a9076c349c2ad7a67640e1a3a69f5"}
Oct 30 21:25:39.124717 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:39.124694    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"ecc4a380-c444-44e4-9f0c-e7a5309e8bd3","Type":"ContainerDied","Data":"93f74cfa78c3101365f82fff4f1d7d1661ab31d91b1417753a95309a12357ba6"}
Oct 30 21:25:39.124847 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:39.124720    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:25:39.124847 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:39.124751    4060 scope.go:122] "RemoveContainer" containerID="61888f20d4bcd263806bcc4b22769f93334795b3c3cd00d3b70a1428256ac07d"
Oct 30 21:25:39.271862 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:39.271831    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:25:39.278528 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:39.278474    4060 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:25:39.427394 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:39.427359    4060 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ecc4a380-c444-44e4-9f0c-e7a5309e8bd3" path="/var/lib/kubelet/pods/ecc4a380-c444-44e4-9f0c-e7a5309e8bd3/volumes"
Oct 30 21:25:40.132026 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:40.131998    4060 generic.go:356] "Generic (PLEG): container finished" podID="0c495fa4-697a-449d-98fd-8d4cc4505a6b" containerID="ebe371779a29125ea57fe4cbb2024ac72e5295ff9faf4fc77bc96fec08def47b" exitCode=0
Oct 30 21:25:40.132431 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:40.132076    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/tempo-data-science-tempostack-gateway-5795b58d6b-2shpz" event={"ID":"0c495fa4-697a-449d-98fd-8d4cc4505a6b","Type":"ContainerDied","Data":"ebe371779a29125ea57fe4cbb2024ac72e5295ff9faf4fc77bc96fec08def47b"}
Oct 30 21:25:40.162717 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:40.162692    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/tempo-data-science-tempostack-gateway-5795b58d6b-2shpz"
Oct 30 21:25:40.244877 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:40.244843    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/0c495fa4-697a-449d-98fd-8d4cc4505a6b-tempo-data-science-tempostack-gateway-mtls\" (UniqueName: \"kubernetes.io/secret/0c495fa4-697a-449d-98fd-8d4cc4505a6b-tempo-data-science-tempostack-gateway-mtls\") pod \"0c495fa4-697a-449d-98fd-8d4cc4505a6b\" (UID: \"0c495fa4-697a-449d-98fd-8d4cc4505a6b\") "
Oct 30 21:25:40.245001 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:40.244910    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/0c495fa4-697a-449d-98fd-8d4cc4505a6b-tempo-data-science-tempostack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c495fa4-697a-449d-98fd-8d4cc4505a6b-tempo-data-science-tempostack-ca-bundle\") pod \"0c495fa4-697a-449d-98fd-8d4cc4505a6b\" (UID: \"0c495fa4-697a-449d-98fd-8d4cc4505a6b\") "
Oct 30 21:25:40.245001 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:40.244938    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0c495fa4-697a-449d-98fd-8d4cc4505a6b-kube-api-access-tgfdl\" (UniqueName: \"kubernetes.io/projected/0c495fa4-697a-449d-98fd-8d4cc4505a6b-kube-api-access-tgfdl\") pod \"0c495fa4-697a-449d-98fd-8d4cc4505a6b\" (UID: \"0c495fa4-697a-449d-98fd-8d4cc4505a6b\") "
Oct 30 21:25:40.245001 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:40.244971    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/0c495fa4-697a-449d-98fd-8d4cc4505a6b-serving-certs\" (UniqueName: \"kubernetes.io/secret/0c495fa4-697a-449d-98fd-8d4cc4505a6b-serving-certs\") pod \"0c495fa4-697a-449d-98fd-8d4cc4505a6b\" (UID: \"0c495fa4-697a-449d-98fd-8d4cc4505a6b\") "
Oct 30 21:25:40.245157 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:40.245016    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/0c495fa4-697a-449d-98fd-8d4cc4505a6b-cabundle\" (UniqueName: \"kubernetes.io/configmap/0c495fa4-697a-449d-98fd-8d4cc4505a6b-cabundle\") pod \"0c495fa4-697a-449d-98fd-8d4cc4505a6b\" (UID: \"0c495fa4-697a-449d-98fd-8d4cc4505a6b\") "
Oct 30 21:25:40.245157 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:40.245055    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/0c495fa4-697a-449d-98fd-8d4cc4505a6b-rbac\" (UniqueName: \"kubernetes.io/configmap/0c495fa4-697a-449d-98fd-8d4cc4505a6b-rbac\") pod \"0c495fa4-697a-449d-98fd-8d4cc4505a6b\" (UID: \"0c495fa4-697a-449d-98fd-8d4cc4505a6b\") "
Oct 30 21:25:40.245157 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:40.245091    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/0c495fa4-697a-449d-98fd-8d4cc4505a6b-tenant\" (UniqueName: \"kubernetes.io/secret/0c495fa4-697a-449d-98fd-8d4cc4505a6b-tenant\") pod \"0c495fa4-697a-449d-98fd-8d4cc4505a6b\" (UID: \"0c495fa4-697a-449d-98fd-8d4cc4505a6b\") "
Oct 30 21:25:40.245517 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:40.245470    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0c495fa4-697a-449d-98fd-8d4cc4505a6b-tempo-data-science-tempostack-ca-bundle" pod "0c495fa4-697a-449d-98fd-8d4cc4505a6b" (UID: "0c495fa4-697a-449d-98fd-8d4cc4505a6b"). InnerVolumeSpecName "tempo-data-science-tempostack-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:25:40.245517 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:40.245486    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0c495fa4-697a-449d-98fd-8d4cc4505a6b-cabundle" pod "0c495fa4-697a-449d-98fd-8d4cc4505a6b" (UID: "0c495fa4-697a-449d-98fd-8d4cc4505a6b"). InnerVolumeSpecName "cabundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:25:40.245729 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:40.245476    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0c495fa4-697a-449d-98fd-8d4cc4505a6b-rbac" pod "0c495fa4-697a-449d-98fd-8d4cc4505a6b" (UID: "0c495fa4-697a-449d-98fd-8d4cc4505a6b"). InnerVolumeSpecName "rbac". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:25:40.247217 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:40.247192    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0c495fa4-697a-449d-98fd-8d4cc4505a6b-tempo-data-science-tempostack-gateway-mtls" pod "0c495fa4-697a-449d-98fd-8d4cc4505a6b" (UID: "0c495fa4-697a-449d-98fd-8d4cc4505a6b"). InnerVolumeSpecName "tempo-data-science-tempostack-gateway-mtls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:25:40.247336 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:40.247236    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0c495fa4-697a-449d-98fd-8d4cc4505a6b-serving-certs" pod "0c495fa4-697a-449d-98fd-8d4cc4505a6b" (UID: "0c495fa4-697a-449d-98fd-8d4cc4505a6b"). InnerVolumeSpecName "serving-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:25:40.247336 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:40.247296    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0c495fa4-697a-449d-98fd-8d4cc4505a6b-kube-api-access-tgfdl" pod "0c495fa4-697a-449d-98fd-8d4cc4505a6b" (UID: "0c495fa4-697a-449d-98fd-8d4cc4505a6b"). InnerVolumeSpecName "kube-api-access-tgfdl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:25:40.250835 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:40.250791    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0c495fa4-697a-449d-98fd-8d4cc4505a6b-tenant" pod "0c495fa4-697a-449d-98fd-8d4cc4505a6b" (UID: "0c495fa4-697a-449d-98fd-8d4cc4505a6b"). InnerVolumeSpecName "tenant". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:25:40.346293 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:40.346258    4060 reconciler_common.go:299] "Volume detached for volume \"rbac\" (UniqueName: \"kubernetes.io/configmap/0c495fa4-697a-449d-98fd-8d4cc4505a6b-rbac\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:25:40.346293 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:40.346285    4060 reconciler_common.go:299] "Volume detached for volume \"tenant\" (UniqueName: \"kubernetes.io/secret/0c495fa4-697a-449d-98fd-8d4cc4505a6b-tenant\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:25:40.346293 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:40.346298    4060 reconciler_common.go:299] "Volume detached for volume \"tempo-data-science-tempostack-gateway-mtls\" (UniqueName: \"kubernetes.io/secret/0c495fa4-697a-449d-98fd-8d4cc4505a6b-tempo-data-science-tempostack-gateway-mtls\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:25:40.346551 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:40.346314    4060 reconciler_common.go:299] "Volume detached for volume \"tempo-data-science-tempostack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c495fa4-697a-449d-98fd-8d4cc4505a6b-tempo-data-science-tempostack-ca-bundle\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:25:40.346551 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:40.346327    4060 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tgfdl\" (UniqueName: \"kubernetes.io/projected/0c495fa4-697a-449d-98fd-8d4cc4505a6b-kube-api-access-tgfdl\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:25:40.346551 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:40.346340    4060 reconciler_common.go:299] "Volume detached for volume \"serving-certs\" (UniqueName: \"kubernetes.io/secret/0c495fa4-697a-449d-98fd-8d4cc4505a6b-serving-certs\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:25:40.346551 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:40.346351    4060 reconciler_common.go:299] "Volume detached for volume \"cabundle\" (UniqueName: \"kubernetes.io/configmap/0c495fa4-697a-449d-98fd-8d4cc4505a6b-cabundle\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:25:41.140278 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:41.140245    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/tempo-data-science-tempostack-gateway-5795b58d6b-2shpz" event={"ID":"0c495fa4-697a-449d-98fd-8d4cc4505a6b","Type":"ContainerDied","Data":"822d66aeafca6df8e52d26395f9026d0a93d02ed78d56a050e73a86022b7edcf"}
Oct 30 21:25:41.140698 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:41.140305    4060 scope.go:122] "RemoveContainer" containerID="d05a7606da3af79d27fd7b113580274b734a9076c349c2ad7a67640e1a3a69f5"
Oct 30 21:25:41.140698 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:41.140251    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/tempo-data-science-tempostack-gateway-5795b58d6b-2shpz"
Oct 30 21:25:41.148536 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:41.148519    4060 scope.go:122] "RemoveContainer" containerID="ebe371779a29125ea57fe4cbb2024ac72e5295ff9faf4fc77bc96fec08def47b"
Oct 30 21:25:41.353783 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:41.353753    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/tempo-data-science-tempostack-gateway-5795b58d6b-2shpz"]
Oct 30 21:25:41.410759 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:41.410671    4060 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/tempo-data-science-tempostack-gateway-5795b58d6b-2shpz"]
Oct 30 21:25:41.426020 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:41.425989    4060 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="0c495fa4-697a-449d-98fd-8d4cc4505a6b" path="/var/lib/kubelet/pods/0c495fa4-697a-449d-98fd-8d4cc4505a6b/volumes"
Oct 30 21:25:42.151194 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:25:42.151159    4060 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v2f4x" containerName="extractor"
Oct 30 21:25:46.661681 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:46.661637    4060 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/tempo-data-science-tempostack-query-frontend-fb899c58-dlbzl" podUID="d36a0e75-3848-4561-9fd0-b01a20389236" containerName="tempo" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 21:25:46.974016 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:46.973981    4060 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/korrel8r-6644769df5-b8fbh"]
Oct 30 21:25:46.974275 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:46.974264    4060 cpu_manager.go:414] "containerMap: removing container" podUID="2e49a3bc-a84a-495a-bc5a-6505b0980d03" containerName="korrel8r"
Oct 30 21:25:46.974324 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:46.974276    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2e49a3bc-a84a-495a-bc5a-6505b0980d03" containerName="korrel8r"
Oct 30 21:25:46.974324 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:46.974288    4060 cpu_manager.go:414] "containerMap: removing container" podUID="2127c7e6-0f35-40cb-a3d2-d566fd31c339" containerName="tempo"
Oct 30 21:25:46.974324 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:46.974294    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2127c7e6-0f35-40cb-a3d2-d566fd31c339" containerName="tempo"
Oct 30 21:25:46.974324 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:46.974305    4060 cpu_manager.go:414] "containerMap: removing container" podUID="0c495fa4-697a-449d-98fd-8d4cc4505a6b" containerName="tempo-gateway"
Oct 30 21:25:46.974324 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:46.974310    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0c495fa4-697a-449d-98fd-8d4cc4505a6b" containerName="tempo-gateway"
Oct 30 21:25:46.974324 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:46.974318    4060 cpu_manager.go:414] "containerMap: removing container" podUID="ecc4a380-c444-44e4-9f0c-e7a5309e8bd3" containerName="otc-container"
Oct 30 21:25:46.974324 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:46.974323    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ecc4a380-c444-44e4-9f0c-e7a5309e8bd3" containerName="otc-container"
Oct 30 21:25:46.974557 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:46.974337    4060 cpu_manager.go:414] "containerMap: removing container" podUID="0c495fa4-697a-449d-98fd-8d4cc4505a6b" containerName="tempo-gateway-opa"
Oct 30 21:25:46.974557 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:46.974342    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0c495fa4-697a-449d-98fd-8d4cc4505a6b" containerName="tempo-gateway-opa"
Oct 30 21:25:46.974557 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:46.974389    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="0c495fa4-697a-449d-98fd-8d4cc4505a6b" containerName="tempo-gateway-opa"
Oct 30 21:25:46.974557 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:46.974398    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="2e49a3bc-a84a-495a-bc5a-6505b0980d03" containerName="korrel8r"
Oct 30 21:25:46.974557 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:46.974406    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="0c495fa4-697a-449d-98fd-8d4cc4505a6b" containerName="tempo-gateway"
Oct 30 21:25:46.974557 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:46.974412    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="ecc4a380-c444-44e4-9f0c-e7a5309e8bd3" containerName="otc-container"
Oct 30 21:25:46.978458 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:46.978442    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/korrel8r-6644769df5-b8fbh"
Oct 30 21:25:47.030650 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:47.030619    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"korrel8r-config\""
Oct 30 21:25:47.079879 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:47.079845    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"korrel8r-dockercfg-42bpv\""
Oct 30 21:25:47.080062 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:47.079931    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"korrel8r-tls\""
Oct 30 21:25:47.081617 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:47.081593    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/korrel8r-6644769df5-b8fbh"]
Oct 30 21:25:47.101343 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:47.101318    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/041683db-c204-4001-9170-5661a3507bce-tls\") pod \"korrel8r-6644769df5-b8fbh\" (UID: \"041683db-c204-4001-9170-5661a3507bce\") " pod="redhat-ods-monitoring/korrel8r-6644769df5-b8fbh"
Oct 30 21:25:47.101473 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:47.101365    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/041683db-c204-4001-9170-5661a3507bce-config\") pod \"korrel8r-6644769df5-b8fbh\" (UID: \"041683db-c204-4001-9170-5661a3507bce\") " pod="redhat-ods-monitoring/korrel8r-6644769df5-b8fbh"
Oct 30 21:25:47.101473 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:47.101447    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bgbxl\" (UniqueName: \"kubernetes.io/projected/041683db-c204-4001-9170-5661a3507bce-kube-api-access-bgbxl\") pod \"korrel8r-6644769df5-b8fbh\" (UID: \"041683db-c204-4001-9170-5661a3507bce\") " pod="redhat-ods-monitoring/korrel8r-6644769df5-b8fbh"
Oct 30 21:25:47.201943 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:47.201913    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/041683db-c204-4001-9170-5661a3507bce-tls\") pod \"korrel8r-6644769df5-b8fbh\" (UID: \"041683db-c204-4001-9170-5661a3507bce\") " pod="redhat-ods-monitoring/korrel8r-6644769df5-b8fbh"
Oct 30 21:25:47.202100 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:47.201958    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/041683db-c204-4001-9170-5661a3507bce-config\") pod \"korrel8r-6644769df5-b8fbh\" (UID: \"041683db-c204-4001-9170-5661a3507bce\") " pod="redhat-ods-monitoring/korrel8r-6644769df5-b8fbh"
Oct 30 21:25:47.202100 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:47.201998    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bgbxl\" (UniqueName: \"kubernetes.io/projected/041683db-c204-4001-9170-5661a3507bce-kube-api-access-bgbxl\") pod \"korrel8r-6644769df5-b8fbh\" (UID: \"041683db-c204-4001-9170-5661a3507bce\") " pod="redhat-ods-monitoring/korrel8r-6644769df5-b8fbh"
Oct 30 21:25:47.202705 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:47.202684    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/041683db-c204-4001-9170-5661a3507bce-config\") pod \"korrel8r-6644769df5-b8fbh\" (UID: \"041683db-c204-4001-9170-5661a3507bce\") " pod="redhat-ods-monitoring/korrel8r-6644769df5-b8fbh"
Oct 30 21:25:47.204379 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:47.204357    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls\" (UniqueName: \"kubernetes.io/secret/041683db-c204-4001-9170-5661a3507bce-tls\") pod \"korrel8r-6644769df5-b8fbh\" (UID: \"041683db-c204-4001-9170-5661a3507bce\") " pod="redhat-ods-monitoring/korrel8r-6644769df5-b8fbh"
Oct 30 21:25:47.263148 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:47.263090    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bgbxl\" (UniqueName: \"kubernetes.io/projected/041683db-c204-4001-9170-5661a3507bce-kube-api-access-bgbxl\") pod \"korrel8r-6644769df5-b8fbh\" (UID: \"041683db-c204-4001-9170-5661a3507bce\") " pod="redhat-ods-monitoring/korrel8r-6644769df5-b8fbh"
Oct 30 21:25:47.290017 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:47.289991    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/korrel8r-6644769df5-b8fbh"
Oct 30 21:25:47.659523 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:47.659483    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/korrel8r-6644769df5-b8fbh"]
Oct 30 21:25:47.661913 ip-10-0-142-4 kubenswrapper[4060]: W1030 21:25:47.661885    4060 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod041683db_c204_4001_9170_5661a3507bce.slice/crio-dda6fab3a984dccacb30cbb7474b392d515b070e8ca19ff2868e352f6584cd78 WatchSource:0}: Error finding container dda6fab3a984dccacb30cbb7474b392d515b070e8ca19ff2868e352f6584cd78: Status 404 returned error can't find the container with id dda6fab3a984dccacb30cbb7474b392d515b070e8ca19ff2868e352f6584cd78
Oct 30 21:25:48.173918 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:48.173884    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/korrel8r-6644769df5-b8fbh" event={"ID":"041683db-c204-4001-9170-5661a3507bce","Type":"ContainerStarted","Data":"b74a927e8d6b8fb22217c9923dc05b56a126aea17ba76d17d09f7d543f0826fb"}
Oct 30 21:25:48.174086 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:48.173943    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/korrel8r-6644769df5-b8fbh" event={"ID":"041683db-c204-4001-9170-5661a3507bce","Type":"ContainerStarted","Data":"dda6fab3a984dccacb30cbb7474b392d515b070e8ca19ff2868e352f6584cd78"}
Oct 30 21:25:48.174086 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:48.173969    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/korrel8r-6644769df5-b8fbh"
Oct 30 21:25:48.292288 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:48.292229    4060 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/korrel8r-6644769df5-b8fbh" podStartSLOduration=2.292214672 podStartE2EDuration="2.292214672s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:25:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:25:48.290064884 +0000 UTC m=+2967.047063196" watchObservedRunningTime="2026-10-30 21:25:48.292214672 +0000 UTC m=+2967.049212984"
Oct 30 21:25:48.962279 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:48.962245    4060 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:25:48.965569 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:48.965548    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:25:49.017616 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:49.017582    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/d624e89b-7309-4900-937d-5211578fac37-monitoring-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"d624e89b-7309-4900-937d-5211578fac37\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:25:49.017616 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:49.017615    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/d624e89b-7309-4900-937d-5211578fac37-otc-internal\") pod \"data-science-collector-collector-0\" (UID: \"d624e89b-7309-4900-937d-5211578fac37\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:25:49.017847 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:49.017631    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-74c67\" (UniqueName: \"kubernetes.io/projected/d624e89b-7309-4900-937d-5211578fac37-kube-api-access-74c67\") pod \"data-science-collector-collector-0\" (UID: \"d624e89b-7309-4900-937d-5211578fac37\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:25:49.017847 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:49.017711    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/d624e89b-7309-4900-937d-5211578fac37-otlp-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"d624e89b-7309-4900-937d-5211578fac37\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:25:49.021660 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:49.021638    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-dockercfg-8qdwd\""
Oct 30 21:25:49.035724 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:49.035706    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-monitoring-tls\""
Oct 30 21:25:49.071267 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:49.071240    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-headless-tls\""
Oct 30 21:25:49.073114 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:49.073084    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:25:49.085670 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:49.085650    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-af329f19\""
Oct 30 21:25:49.118714 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:49.118684    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/d624e89b-7309-4900-937d-5211578fac37-monitoring-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"d624e89b-7309-4900-937d-5211578fac37\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:25:49.118714 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:49.118714    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/d624e89b-7309-4900-937d-5211578fac37-otc-internal\") pod \"data-science-collector-collector-0\" (UID: \"d624e89b-7309-4900-937d-5211578fac37\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:25:49.118898 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:49.118733    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-74c67\" (UniqueName: \"kubernetes.io/projected/d624e89b-7309-4900-937d-5211578fac37-kube-api-access-74c67\") pod \"data-science-collector-collector-0\" (UID: \"d624e89b-7309-4900-937d-5211578fac37\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:25:49.118898 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:49.118761    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/d624e89b-7309-4900-937d-5211578fac37-otlp-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"d624e89b-7309-4900-937d-5211578fac37\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:25:49.119429 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:49.119408    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/d624e89b-7309-4900-937d-5211578fac37-otc-internal\") pod \"data-science-collector-collector-0\" (UID: \"d624e89b-7309-4900-937d-5211578fac37\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:25:49.121165 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:49.121142    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/d624e89b-7309-4900-937d-5211578fac37-monitoring-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"d624e89b-7309-4900-937d-5211578fac37\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:25:49.121260 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:49.121147    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/d624e89b-7309-4900-937d-5211578fac37-otlp-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"d624e89b-7309-4900-937d-5211578fac37\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:25:49.180507 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:49.180462    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-74c67\" (UniqueName: \"kubernetes.io/projected/d624e89b-7309-4900-937d-5211578fac37-kube-api-access-74c67\") pod \"data-science-collector-collector-0\" (UID: \"d624e89b-7309-4900-937d-5211578fac37\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:25:49.278260 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:49.278184    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:25:49.672043 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:49.671968    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:25:49.685557 ip-10-0-142-4 kubenswrapper[4060]: W1030 21:25:49.685530    4060 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd624e89b_7309_4900_937d_5211578fac37.slice/crio-e18f4b2b4881ddeb5e1c76e2bff56f9e818c542562b05a9a965c02df97558b93 WatchSource:0}: Error finding container e18f4b2b4881ddeb5e1c76e2bff56f9e818c542562b05a9a965c02df97558b93: Status 404 returned error can't find the container with id e18f4b2b4881ddeb5e1c76e2bff56f9e818c542562b05a9a965c02df97558b93
Oct 30 21:25:49.688295 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:49.688263    4060 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 21:25:49.688384 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:49.688322    4060 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 21:25:50.184867 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:50.184829    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"d624e89b-7309-4900-937d-5211578fac37","Type":"ContainerStarted","Data":"67c6e9f0facd708c361d6503cb1502abfe39eb43bf49e6426c88bd61738801f4"}
Oct 30 21:25:50.185254 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:50.184885    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"d624e89b-7309-4900-937d-5211578fac37","Type":"ContainerStarted","Data":"e18f4b2b4881ddeb5e1c76e2bff56f9e818c542562b05a9a965c02df97558b93"}
Oct 30 21:25:50.305344 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:50.305292    4060 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-collector-0" podStartSLOduration=2.305273941 podStartE2EDuration="2.305273941s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:25:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:25:50.303266499 +0000 UTC m=+2969.060264796" watchObservedRunningTime="2026-10-30 21:25:50.305273941 +0000 UTC m=+2969.062272238"
Oct 30 21:25:56.613748 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:56.613704    4060 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/tempo-data-science-tempostack-query-frontend-fb899c58-dlbzl" podUID="d36a0e75-3848-4561-9fd0-b01a20389236" containerName="tempo" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 21:25:59.181383 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:25:59.181352    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/korrel8r-6644769df5-b8fbh"
Oct 30 21:26:06.657403 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:06.657365    4060 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/tempo-data-science-tempostack-query-frontend-fb899c58-dlbzl" podUID="d36a0e75-3848-4561-9fd0-b01a20389236" containerName="tempo" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 21:26:06.657866 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:06.657481    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/tempo-data-science-tempostack-query-frontend-fb899c58-dlbzl"
Oct 30 21:26:09.068219 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:09.068197    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/tempo-data-science-tempostack-query-frontend-fb899c58-dlbzl"
Oct 30 21:26:09.183218 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:09.183151    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d36a0e75-3848-4561-9fd0-b01a20389236-tempo-conf\" (UniqueName: \"kubernetes.io/configmap/d36a0e75-3848-4561-9fd0-b01a20389236-tempo-conf\") pod \"d36a0e75-3848-4561-9fd0-b01a20389236\" (UID: \"d36a0e75-3848-4561-9fd0-b01a20389236\") "
Oct 30 21:26:09.183218 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:09.183184    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d36a0e75-3848-4561-9fd0-b01a20389236-tempo-data-science-tempostack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d36a0e75-3848-4561-9fd0-b01a20389236-tempo-data-science-tempostack-ca-bundle\") pod \"d36a0e75-3848-4561-9fd0-b01a20389236\" (UID: \"d36a0e75-3848-4561-9fd0-b01a20389236\") "
Oct 30 21:26:09.183452 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:09.183222    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d36a0e75-3848-4561-9fd0-b01a20389236-kube-api-access-k8zlq\" (UniqueName: \"kubernetes.io/projected/d36a0e75-3848-4561-9fd0-b01a20389236-kube-api-access-k8zlq\") pod \"d36a0e75-3848-4561-9fd0-b01a20389236\" (UID: \"d36a0e75-3848-4561-9fd0-b01a20389236\") "
Oct 30 21:26:09.183452 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:09.183266    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d36a0e75-3848-4561-9fd0-b01a20389236-tempo-data-science-tempostack-query-frontend-mtls\" (UniqueName: \"kubernetes.io/secret/d36a0e75-3848-4561-9fd0-b01a20389236-tempo-data-science-tempostack-query-frontend-mtls\") pod \"d36a0e75-3848-4561-9fd0-b01a20389236\" (UID: \"d36a0e75-3848-4561-9fd0-b01a20389236\") "
Oct 30 21:26:09.183452 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:09.183322    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d36a0e75-3848-4561-9fd0-b01a20389236-storage-gcs-key\" (UniqueName: \"kubernetes.io/secret/d36a0e75-3848-4561-9fd0-b01a20389236-storage-gcs-key\") pod \"d36a0e75-3848-4561-9fd0-b01a20389236\" (UID: \"d36a0e75-3848-4561-9fd0-b01a20389236\") "
Oct 30 21:26:09.183452 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:09.183397    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d36a0e75-3848-4561-9fd0-b01a20389236-tempo-tmp-storage\" (UniqueName: \"kubernetes.io/empty-dir/d36a0e75-3848-4561-9fd0-b01a20389236-tempo-tmp-storage\") pod \"d36a0e75-3848-4561-9fd0-b01a20389236\" (UID: \"d36a0e75-3848-4561-9fd0-b01a20389236\") "
Oct 30 21:26:09.183707 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:09.183645    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d36a0e75-3848-4561-9fd0-b01a20389236-tempo-data-science-tempostack-ca-bundle" pod "d36a0e75-3848-4561-9fd0-b01a20389236" (UID: "d36a0e75-3848-4561-9fd0-b01a20389236"). InnerVolumeSpecName "tempo-data-science-tempostack-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:26:09.183871 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:09.183838    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d36a0e75-3848-4561-9fd0-b01a20389236-tempo-tmp-storage" pod "d36a0e75-3848-4561-9fd0-b01a20389236" (UID: "d36a0e75-3848-4561-9fd0-b01a20389236"). InnerVolumeSpecName "tempo-tmp-storage". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:26:09.183972 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:09.183848    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d36a0e75-3848-4561-9fd0-b01a20389236-tempo-conf" pod "d36a0e75-3848-4561-9fd0-b01a20389236" (UID: "d36a0e75-3848-4561-9fd0-b01a20389236"). InnerVolumeSpecName "tempo-conf". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:26:09.185477 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:09.185451    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d36a0e75-3848-4561-9fd0-b01a20389236-kube-api-access-k8zlq" pod "d36a0e75-3848-4561-9fd0-b01a20389236" (UID: "d36a0e75-3848-4561-9fd0-b01a20389236"). InnerVolumeSpecName "kube-api-access-k8zlq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:26:09.185477 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:09.185468    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d36a0e75-3848-4561-9fd0-b01a20389236-storage-gcs-key" pod "d36a0e75-3848-4561-9fd0-b01a20389236" (UID: "d36a0e75-3848-4561-9fd0-b01a20389236"). InnerVolumeSpecName "storage-gcs-key". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:26:09.185668 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:09.185555    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d36a0e75-3848-4561-9fd0-b01a20389236-tempo-data-science-tempostack-query-frontend-mtls" pod "d36a0e75-3848-4561-9fd0-b01a20389236" (UID: "d36a0e75-3848-4561-9fd0-b01a20389236"). InnerVolumeSpecName "tempo-data-science-tempostack-query-frontend-mtls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:26:09.272979 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:09.272947    4060 generic.go:356] "Generic (PLEG): container finished" podID="d36a0e75-3848-4561-9fd0-b01a20389236" containerID="6d6f70b2f2440ecc8e5dada46decddb8c76bb431cf4697dc948b154c7b12792d" exitCode=137
Oct 30 21:26:09.273171 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:09.273001    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/tempo-data-science-tempostack-query-frontend-fb899c58-dlbzl"
Oct 30 21:26:09.273171 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:09.273015    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/tempo-data-science-tempostack-query-frontend-fb899c58-dlbzl" event={"ID":"d36a0e75-3848-4561-9fd0-b01a20389236","Type":"ContainerDied","Data":"6d6f70b2f2440ecc8e5dada46decddb8c76bb431cf4697dc948b154c7b12792d"}
Oct 30 21:26:09.273171 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:09.273057    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/tempo-data-science-tempostack-query-frontend-fb899c58-dlbzl" event={"ID":"d36a0e75-3848-4561-9fd0-b01a20389236","Type":"ContainerDied","Data":"afe1cc7f7feaa11f091ba230fa269810143db9d2ac8e07f28953cb4c98b09d02"}
Oct 30 21:26:09.273171 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:09.273078    4060 scope.go:122] "RemoveContainer" containerID="6d6f70b2f2440ecc8e5dada46decddb8c76bb431cf4697dc948b154c7b12792d"
Oct 30 21:26:09.282029 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:09.282008    4060 scope.go:122] "RemoveContainer" containerID="6d6f70b2f2440ecc8e5dada46decddb8c76bb431cf4697dc948b154c7b12792d"
Oct 30 21:26:09.282295 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:26:09.282276    4060 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6d6f70b2f2440ecc8e5dada46decddb8c76bb431cf4697dc948b154c7b12792d\": container with ID starting with 6d6f70b2f2440ecc8e5dada46decddb8c76bb431cf4697dc948b154c7b12792d not found: ID does not exist" containerID="6d6f70b2f2440ecc8e5dada46decddb8c76bb431cf4697dc948b154c7b12792d"
Oct 30 21:26:09.282344 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:09.282304    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d6f70b2f2440ecc8e5dada46decddb8c76bb431cf4697dc948b154c7b12792d"} err="failed to get container status \"6d6f70b2f2440ecc8e5dada46decddb8c76bb431cf4697dc948b154c7b12792d\": rpc error: code = NotFound desc = could not find container \"6d6f70b2f2440ecc8e5dada46decddb8c76bb431cf4697dc948b154c7b12792d\": container with ID starting with 6d6f70b2f2440ecc8e5dada46decddb8c76bb431cf4697dc948b154c7b12792d not found: ID does not exist"
Oct 30 21:26:09.284687 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:09.284671    4060 reconciler_common.go:299] "Volume detached for volume \"tempo-conf\" (UniqueName: \"kubernetes.io/configmap/d36a0e75-3848-4561-9fd0-b01a20389236-tempo-conf\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:26:09.284738 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:09.284691    4060 reconciler_common.go:299] "Volume detached for volume \"tempo-data-science-tempostack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d36a0e75-3848-4561-9fd0-b01a20389236-tempo-data-science-tempostack-ca-bundle\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:26:09.284738 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:09.284703    4060 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k8zlq\" (UniqueName: \"kubernetes.io/projected/d36a0e75-3848-4561-9fd0-b01a20389236-kube-api-access-k8zlq\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:26:09.284738 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:09.284713    4060 reconciler_common.go:299] "Volume detached for volume \"tempo-data-science-tempostack-query-frontend-mtls\" (UniqueName: \"kubernetes.io/secret/d36a0e75-3848-4561-9fd0-b01a20389236-tempo-data-science-tempostack-query-frontend-mtls\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:26:09.284738 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:09.284723    4060 reconciler_common.go:299] "Volume detached for volume \"storage-gcs-key\" (UniqueName: \"kubernetes.io/secret/d36a0e75-3848-4561-9fd0-b01a20389236-storage-gcs-key\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:26:09.284738 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:09.284731    4060 reconciler_common.go:299] "Volume detached for volume \"tempo-tmp-storage\" (UniqueName: \"kubernetes.io/empty-dir/d36a0e75-3848-4561-9fd0-b01a20389236-tempo-tmp-storage\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:26:09.436677 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:09.436602    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/tempo-data-science-tempostack-query-frontend-fb899c58-dlbzl"]
Oct 30 21:26:09.442114 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:09.442078    4060 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/tempo-data-science-tempostack-query-frontend-fb899c58-dlbzl"]
Oct 30 21:26:11.427775 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:11.427740    4060 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d36a0e75-3848-4561-9fd0-b01a20389236" path="/var/lib/kubelet/pods/d36a0e75-3848-4561-9fd0-b01a20389236/volumes"
Oct 30 21:26:11.633282 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:11.633248    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/korrel8r-6644769df5-b8fbh"]
Oct 30 21:26:11.633465 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:11.633442    4060 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/korrel8r-6644769df5-b8fbh" podUID="041683db-c204-4001-9170-5661a3507bce" containerName="korrel8r" containerID="cri-o://b74a927e8d6b8fb22217c9923dc05b56a126aea17ba76d17d09f7d543f0826fb" gracePeriod=30
Oct 30 21:26:11.871413 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:11.871389    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/korrel8r-6644769df5-b8fbh"
Oct 30 21:26:12.008897 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:12.008819    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/041683db-c204-4001-9170-5661a3507bce-kube-api-access-bgbxl\" (UniqueName: \"kubernetes.io/projected/041683db-c204-4001-9170-5661a3507bce-kube-api-access-bgbxl\") pod \"041683db-c204-4001-9170-5661a3507bce\" (UID: \"041683db-c204-4001-9170-5661a3507bce\") "
Oct 30 21:26:12.009063 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:12.008921    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/041683db-c204-4001-9170-5661a3507bce-tls\" (UniqueName: \"kubernetes.io/secret/041683db-c204-4001-9170-5661a3507bce-tls\") pod \"041683db-c204-4001-9170-5661a3507bce\" (UID: \"041683db-c204-4001-9170-5661a3507bce\") "
Oct 30 21:26:12.009063 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:12.008988    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/041683db-c204-4001-9170-5661a3507bce-config\" (UniqueName: \"kubernetes.io/configmap/041683db-c204-4001-9170-5661a3507bce-config\") pod \"041683db-c204-4001-9170-5661a3507bce\" (UID: \"041683db-c204-4001-9170-5661a3507bce\") "
Oct 30 21:26:12.009379 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:12.009350    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/041683db-c204-4001-9170-5661a3507bce-config" pod "041683db-c204-4001-9170-5661a3507bce" (UID: "041683db-c204-4001-9170-5661a3507bce"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:26:12.011451 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:12.011428    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/041683db-c204-4001-9170-5661a3507bce-tls" pod "041683db-c204-4001-9170-5661a3507bce" (UID: "041683db-c204-4001-9170-5661a3507bce"). InnerVolumeSpecName "tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:26:12.011451 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:12.011444    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/041683db-c204-4001-9170-5661a3507bce-kube-api-access-bgbxl" pod "041683db-c204-4001-9170-5661a3507bce" (UID: "041683db-c204-4001-9170-5661a3507bce"). InnerVolumeSpecName "kube-api-access-bgbxl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:26:12.110268 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:12.110241    4060 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bgbxl\" (UniqueName: \"kubernetes.io/projected/041683db-c204-4001-9170-5661a3507bce-kube-api-access-bgbxl\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:26:12.110268 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:12.110264    4060 reconciler_common.go:299] "Volume detached for volume \"tls\" (UniqueName: \"kubernetes.io/secret/041683db-c204-4001-9170-5661a3507bce-tls\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:26:12.110268 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:12.110274    4060 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/041683db-c204-4001-9170-5661a3507bce-config\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:26:12.149135 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:26:12.149097    4060 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v2f4x" containerName="extractor"
Oct 30 21:26:12.288868 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:12.288783    4060 generic.go:356] "Generic (PLEG): container finished" podID="041683db-c204-4001-9170-5661a3507bce" containerID="b74a927e8d6b8fb22217c9923dc05b56a126aea17ba76d17d09f7d543f0826fb" exitCode=0
Oct 30 21:26:12.288868 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:12.288833    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/korrel8r-6644769df5-b8fbh"
Oct 30 21:26:12.289053 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:12.288867    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/korrel8r-6644769df5-b8fbh" event={"ID":"041683db-c204-4001-9170-5661a3507bce","Type":"ContainerDied","Data":"b74a927e8d6b8fb22217c9923dc05b56a126aea17ba76d17d09f7d543f0826fb"}
Oct 30 21:26:12.289053 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:12.288918    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/korrel8r-6644769df5-b8fbh" event={"ID":"041683db-c204-4001-9170-5661a3507bce","Type":"ContainerDied","Data":"dda6fab3a984dccacb30cbb7474b392d515b070e8ca19ff2868e352f6584cd78"}
Oct 30 21:26:12.289053 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:12.288939    4060 scope.go:122] "RemoveContainer" containerID="b74a927e8d6b8fb22217c9923dc05b56a126aea17ba76d17d09f7d543f0826fb"
Oct 30 21:26:12.297837 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:12.297818    4060 scope.go:122] "RemoveContainer" containerID="b74a927e8d6b8fb22217c9923dc05b56a126aea17ba76d17d09f7d543f0826fb"
Oct 30 21:26:12.298075 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:26:12.298056    4060 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b74a927e8d6b8fb22217c9923dc05b56a126aea17ba76d17d09f7d543f0826fb\": container with ID starting with b74a927e8d6b8fb22217c9923dc05b56a126aea17ba76d17d09f7d543f0826fb not found: ID does not exist" containerID="b74a927e8d6b8fb22217c9923dc05b56a126aea17ba76d17d09f7d543f0826fb"
Oct 30 21:26:12.298128 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:12.298084    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b74a927e8d6b8fb22217c9923dc05b56a126aea17ba76d17d09f7d543f0826fb"} err="failed to get container status \"b74a927e8d6b8fb22217c9923dc05b56a126aea17ba76d17d09f7d543f0826fb\": rpc error: code = NotFound desc = could not find container \"b74a927e8d6b8fb22217c9923dc05b56a126aea17ba76d17d09f7d543f0826fb\": container with ID starting with b74a927e8d6b8fb22217c9923dc05b56a126aea17ba76d17d09f7d543f0826fb not found: ID does not exist"
Oct 30 21:26:12.452725 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:12.452695    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/korrel8r-6644769df5-b8fbh"]
Oct 30 21:26:12.501334 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:12.501307    4060 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/korrel8r-6644769df5-b8fbh"]
Oct 30 21:26:12.994463 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:12.994426    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:26:12.994704 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:12.994665    4060 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-collector-0" podUID="d624e89b-7309-4900-937d-5211578fac37" containerName="otc-container" containerID="cri-o://67c6e9f0facd708c361d6503cb1502abfe39eb43bf49e6426c88bd61738801f4" gracePeriod=30
Oct 30 21:26:13.234627 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:13.234607    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:26:13.297535 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:13.297414    4060 generic.go:356] "Generic (PLEG): container finished" podID="d624e89b-7309-4900-937d-5211578fac37" containerID="67c6e9f0facd708c361d6503cb1502abfe39eb43bf49e6426c88bd61738801f4" exitCode=0
Oct 30 21:26:13.297535 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:13.297475    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:26:13.297535 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:13.297517    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"d624e89b-7309-4900-937d-5211578fac37","Type":"ContainerDied","Data":"67c6e9f0facd708c361d6503cb1502abfe39eb43bf49e6426c88bd61738801f4"}
Oct 30 21:26:13.297815 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:13.297571    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"d624e89b-7309-4900-937d-5211578fac37","Type":"ContainerDied","Data":"e18f4b2b4881ddeb5e1c76e2bff56f9e818c542562b05a9a965c02df97558b93"}
Oct 30 21:26:13.297815 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:13.297614    4060 scope.go:122] "RemoveContainer" containerID="67c6e9f0facd708c361d6503cb1502abfe39eb43bf49e6426c88bd61738801f4"
Oct 30 21:26:13.306881 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:13.306864    4060 scope.go:122] "RemoveContainer" containerID="67c6e9f0facd708c361d6503cb1502abfe39eb43bf49e6426c88bd61738801f4"
Oct 30 21:26:13.307175 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:26:13.307156    4060 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"67c6e9f0facd708c361d6503cb1502abfe39eb43bf49e6426c88bd61738801f4\": container with ID starting with 67c6e9f0facd708c361d6503cb1502abfe39eb43bf49e6426c88bd61738801f4 not found: ID does not exist" containerID="67c6e9f0facd708c361d6503cb1502abfe39eb43bf49e6426c88bd61738801f4"
Oct 30 21:26:13.307244 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:13.307189    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"67c6e9f0facd708c361d6503cb1502abfe39eb43bf49e6426c88bd61738801f4"} err="failed to get container status \"67c6e9f0facd708c361d6503cb1502abfe39eb43bf49e6426c88bd61738801f4\": rpc error: code = NotFound desc = could not find container \"67c6e9f0facd708c361d6503cb1502abfe39eb43bf49e6426c88bd61738801f4\": container with ID starting with 67c6e9f0facd708c361d6503cb1502abfe39eb43bf49e6426c88bd61738801f4 not found: ID does not exist"
Oct 30 21:26:13.320412 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:13.320390    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d624e89b-7309-4900-937d-5211578fac37-otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/d624e89b-7309-4900-937d-5211578fac37-otlp-tls-certs\") pod \"d624e89b-7309-4900-937d-5211578fac37\" (UID: \"d624e89b-7309-4900-937d-5211578fac37\") "
Oct 30 21:26:13.320525 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:13.320461    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d624e89b-7309-4900-937d-5211578fac37-kube-api-access-74c67\" (UniqueName: \"kubernetes.io/projected/d624e89b-7309-4900-937d-5211578fac37-kube-api-access-74c67\") pod \"d624e89b-7309-4900-937d-5211578fac37\" (UID: \"d624e89b-7309-4900-937d-5211578fac37\") "
Oct 30 21:26:13.320577 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:13.320525    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d624e89b-7309-4900-937d-5211578fac37-monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/d624e89b-7309-4900-937d-5211578fac37-monitoring-tls-certs\") pod \"d624e89b-7309-4900-937d-5211578fac37\" (UID: \"d624e89b-7309-4900-937d-5211578fac37\") "
Oct 30 21:26:13.320616 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:13.320581    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d624e89b-7309-4900-937d-5211578fac37-otc-internal\" (UniqueName: \"kubernetes.io/configmap/d624e89b-7309-4900-937d-5211578fac37-otc-internal\") pod \"d624e89b-7309-4900-937d-5211578fac37\" (UID: \"d624e89b-7309-4900-937d-5211578fac37\") "
Oct 30 21:26:13.320956 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:13.320934    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d624e89b-7309-4900-937d-5211578fac37-otc-internal" pod "d624e89b-7309-4900-937d-5211578fac37" (UID: "d624e89b-7309-4900-937d-5211578fac37"). InnerVolumeSpecName "otc-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:26:13.322512 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:13.322470    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d624e89b-7309-4900-937d-5211578fac37-monitoring-tls-certs" pod "d624e89b-7309-4900-937d-5211578fac37" (UID: "d624e89b-7309-4900-937d-5211578fac37"). InnerVolumeSpecName "monitoring-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:26:13.322588 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:13.322539    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d624e89b-7309-4900-937d-5211578fac37-otlp-tls-certs" pod "d624e89b-7309-4900-937d-5211578fac37" (UID: "d624e89b-7309-4900-937d-5211578fac37"). InnerVolumeSpecName "otlp-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:26:13.322631 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:13.322598    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d624e89b-7309-4900-937d-5211578fac37-kube-api-access-74c67" pod "d624e89b-7309-4900-937d-5211578fac37" (UID: "d624e89b-7309-4900-937d-5211578fac37"). InnerVolumeSpecName "kube-api-access-74c67". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:26:13.421856 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:13.421819    4060 reconciler_common.go:299] "Volume detached for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/d624e89b-7309-4900-937d-5211578fac37-otc-internal\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:26:13.421856 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:13.421846    4060 reconciler_common.go:299] "Volume detached for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/d624e89b-7309-4900-937d-5211578fac37-otlp-tls-certs\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:26:13.421856 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:13.421856    4060 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-74c67\" (UniqueName: \"kubernetes.io/projected/d624e89b-7309-4900-937d-5211578fac37-kube-api-access-74c67\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:26:13.421856 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:13.421865    4060 reconciler_common.go:299] "Volume detached for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/d624e89b-7309-4900-937d-5211578fac37-monitoring-tls-certs\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:26:13.426961 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:13.426935    4060 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="041683db-c204-4001-9170-5661a3507bce" path="/var/lib/kubelet/pods/041683db-c204-4001-9170-5661a3507bce/volumes"
Oct 30 21:26:13.713204 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:13.713172    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:26:13.715879 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:13.715853    4060 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:26:15.426931 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:15.426898    4060 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d624e89b-7309-4900-937d-5211578fac37" path="/var/lib/kubelet/pods/d624e89b-7309-4900-937d-5211578fac37/volumes"
Oct 30 21:26:27.489679 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:27.489644    4060 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-v6lq2"]
Oct 30 21:26:27.490115 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:27.489921    4060 cpu_manager.go:414] "containerMap: removing container" podUID="041683db-c204-4001-9170-5661a3507bce" containerName="korrel8r"
Oct 30 21:26:27.490115 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:27.489931    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="041683db-c204-4001-9170-5661a3507bce" containerName="korrel8r"
Oct 30 21:26:27.490115 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:27.489950    4060 cpu_manager.go:414] "containerMap: removing container" podUID="d624e89b-7309-4900-937d-5211578fac37" containerName="otc-container"
Oct 30 21:26:27.490115 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:27.489955    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d624e89b-7309-4900-937d-5211578fac37" containerName="otc-container"
Oct 30 21:26:27.490115 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:27.489966    4060 cpu_manager.go:414] "containerMap: removing container" podUID="d36a0e75-3848-4561-9fd0-b01a20389236" containerName="tempo"
Oct 30 21:26:27.490115 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:27.489972    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d36a0e75-3848-4561-9fd0-b01a20389236" containerName="tempo"
Oct 30 21:26:27.490115 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:27.490022    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="041683db-c204-4001-9170-5661a3507bce" containerName="korrel8r"
Oct 30 21:26:27.490115 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:27.490032    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="d624e89b-7309-4900-937d-5211578fac37" containerName="otc-container"
Oct 30 21:26:27.490115 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:27.490038    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="d36a0e75-3848-4561-9fd0-b01a20389236" containerName="tempo"
Oct 30 21:26:27.494280 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:27.494261    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-v6lq2"
Oct 30 21:26:27.548562 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:27.548530    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"openshift-service-ca.crt\""
Oct 30 21:26:27.597641 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:27.597612    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-prometheus-cluster-proxy-kube-rbac-proxy\""
Oct 30 21:26:27.597641 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:27.597616    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-prometheus-cluster-proxy-tls\""
Oct 30 21:26:27.597825 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:27.597670    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"prometheus-operated-tls\""
Oct 30 21:26:27.597825 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:27.597687    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"prometheus-web-tls-ca\""
Oct 30 21:26:27.597825 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:27.597753    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-prometheus-cluster-proxy-dockercfg-4ls56\""
Oct 30 21:26:27.599629 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:27.599608    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-v6lq2"]
Oct 30 21:26:27.636610 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:27.636580    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8c8f231f-5064-498b-bed5-c1d7213283b2-kube-rbac-proxy-config\") pod \"data-science-prometheus-cluster-proxy-545f759f7c-v6lq2\" (UID: \"8c8f231f-5064-498b-bed5-c1d7213283b2\") " pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-v6lq2"
Oct 30 21:26:27.636610 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:27.636610    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/8c8f231f-5064-498b-bed5-c1d7213283b2-tls\") pod \"data-science-prometheus-cluster-proxy-545f759f7c-v6lq2\" (UID: \"8c8f231f-5064-498b-bed5-c1d7213283b2\") " pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-v6lq2"
Oct 30 21:26:27.636786 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:27.636632    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-client-cert\" (UniqueName: \"kubernetes.io/secret/8c8f231f-5064-498b-bed5-c1d7213283b2-prometheus-client-cert\") pod \"data-science-prometheus-cluster-proxy-545f759f7c-v6lq2\" (UID: \"8c8f231f-5064-498b-bed5-c1d7213283b2\") " pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-v6lq2"
Oct 30 21:26:27.636786 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:27.636748    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-ca\" (UniqueName: \"kubernetes.io/configmap/8c8f231f-5064-498b-bed5-c1d7213283b2-prometheus-ca\") pod \"data-science-prometheus-cluster-proxy-545f759f7c-v6lq2\" (UID: \"8c8f231f-5064-498b-bed5-c1d7213283b2\") " pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-v6lq2"
Oct 30 21:26:27.636786 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:27.636774    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bkc4k\" (UniqueName: \"kubernetes.io/projected/8c8f231f-5064-498b-bed5-c1d7213283b2-kube-api-access-bkc4k\") pod \"data-science-prometheus-cluster-proxy-545f759f7c-v6lq2\" (UID: \"8c8f231f-5064-498b-bed5-c1d7213283b2\") " pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-v6lq2"
Oct 30 21:26:27.648737 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:27.648718    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"kube-root-ca.crt\""
Oct 30 21:26:27.737801 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:27.737765    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-client-cert\" (UniqueName: \"kubernetes.io/secret/8c8f231f-5064-498b-bed5-c1d7213283b2-prometheus-client-cert\") pod \"data-science-prometheus-cluster-proxy-545f759f7c-v6lq2\" (UID: \"8c8f231f-5064-498b-bed5-c1d7213283b2\") " pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-v6lq2"
Oct 30 21:26:27.737801 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:27.737805    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-ca\" (UniqueName: \"kubernetes.io/configmap/8c8f231f-5064-498b-bed5-c1d7213283b2-prometheus-ca\") pod \"data-science-prometheus-cluster-proxy-545f759f7c-v6lq2\" (UID: \"8c8f231f-5064-498b-bed5-c1d7213283b2\") " pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-v6lq2"
Oct 30 21:26:27.738046 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:27.737831    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bkc4k\" (UniqueName: \"kubernetes.io/projected/8c8f231f-5064-498b-bed5-c1d7213283b2-kube-api-access-bkc4k\") pod \"data-science-prometheus-cluster-proxy-545f759f7c-v6lq2\" (UID: \"8c8f231f-5064-498b-bed5-c1d7213283b2\") " pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-v6lq2"
Oct 30 21:26:27.738046 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:27.737918    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8c8f231f-5064-498b-bed5-c1d7213283b2-kube-rbac-proxy-config\") pod \"data-science-prometheus-cluster-proxy-545f759f7c-v6lq2\" (UID: \"8c8f231f-5064-498b-bed5-c1d7213283b2\") " pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-v6lq2"
Oct 30 21:26:27.738046 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:27.737943    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/8c8f231f-5064-498b-bed5-c1d7213283b2-tls\") pod \"data-science-prometheus-cluster-proxy-545f759f7c-v6lq2\" (UID: \"8c8f231f-5064-498b-bed5-c1d7213283b2\") " pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-v6lq2"
Oct 30 21:26:27.738531 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:27.738449    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-ca\" (UniqueName: \"kubernetes.io/configmap/8c8f231f-5064-498b-bed5-c1d7213283b2-prometheus-ca\") pod \"data-science-prometheus-cluster-proxy-545f759f7c-v6lq2\" (UID: \"8c8f231f-5064-498b-bed5-c1d7213283b2\") " pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-v6lq2"
Oct 30 21:26:27.740385 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:27.740331    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8c8f231f-5064-498b-bed5-c1d7213283b2-kube-rbac-proxy-config\") pod \"data-science-prometheus-cluster-proxy-545f759f7c-v6lq2\" (UID: \"8c8f231f-5064-498b-bed5-c1d7213283b2\") " pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-v6lq2"
Oct 30 21:26:27.740503 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:27.740408    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls\" (UniqueName: \"kubernetes.io/secret/8c8f231f-5064-498b-bed5-c1d7213283b2-tls\") pod \"data-science-prometheus-cluster-proxy-545f759f7c-v6lq2\" (UID: \"8c8f231f-5064-498b-bed5-c1d7213283b2\") " pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-v6lq2"
Oct 30 21:26:27.740571 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:27.740549    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-client-cert\" (UniqueName: \"kubernetes.io/secret/8c8f231f-5064-498b-bed5-c1d7213283b2-prometheus-client-cert\") pod \"data-science-prometheus-cluster-proxy-545f759f7c-v6lq2\" (UID: \"8c8f231f-5064-498b-bed5-c1d7213283b2\") " pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-v6lq2"
Oct 30 21:26:27.800239 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:27.800205    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bkc4k\" (UniqueName: \"kubernetes.io/projected/8c8f231f-5064-498b-bed5-c1d7213283b2-kube-api-access-bkc4k\") pod \"data-science-prometheus-cluster-proxy-545f759f7c-v6lq2\" (UID: \"8c8f231f-5064-498b-bed5-c1d7213283b2\") " pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-v6lq2"
Oct 30 21:26:27.806029 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:27.806006    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-v6lq2"
Oct 30 21:26:27.838188 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:27.838159    4060 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/korrel8r-5cbcc89b8f-5nfvc"]
Oct 30 21:26:27.841432 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:27.841414    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-5nfvc"
Oct 30 21:26:27.894544 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:27.894516    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"korrel8r-dockercfg-5dkhr\""
Oct 30 21:26:27.894689 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:27.894560    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"korrel8r-tls\""
Oct 30 21:26:27.901250 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:27.901225    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/korrel8r-5cbcc89b8f-5nfvc"]
Oct 30 21:26:27.939574 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:27.939548    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/0433e4cf-5e9a-4fac-aa4a-4b5fe8fbe5a0-tls\") pod \"korrel8r-5cbcc89b8f-5nfvc\" (UID: \"0433e4cf-5e9a-4fac-aa4a-4b5fe8fbe5a0\") " pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-5nfvc"
Oct 30 21:26:27.939694 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:27.939590    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0433e4cf-5e9a-4fac-aa4a-4b5fe8fbe5a0-config\") pod \"korrel8r-5cbcc89b8f-5nfvc\" (UID: \"0433e4cf-5e9a-4fac-aa4a-4b5fe8fbe5a0\") " pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-5nfvc"
Oct 30 21:26:27.939735 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:27.939718    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k2vmc\" (UniqueName: \"kubernetes.io/projected/0433e4cf-5e9a-4fac-aa4a-4b5fe8fbe5a0-kube-api-access-k2vmc\") pod \"korrel8r-5cbcc89b8f-5nfvc\" (UID: \"0433e4cf-5e9a-4fac-aa4a-4b5fe8fbe5a0\") " pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-5nfvc"
Oct 30 21:26:27.951720 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:27.951694    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"korrel8r-config\""
Oct 30 21:26:28.040188 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:28.040104    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k2vmc\" (UniqueName: \"kubernetes.io/projected/0433e4cf-5e9a-4fac-aa4a-4b5fe8fbe5a0-kube-api-access-k2vmc\") pod \"korrel8r-5cbcc89b8f-5nfvc\" (UID: \"0433e4cf-5e9a-4fac-aa4a-4b5fe8fbe5a0\") " pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-5nfvc"
Oct 30 21:26:28.040188 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:28.040145    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/0433e4cf-5e9a-4fac-aa4a-4b5fe8fbe5a0-tls\") pod \"korrel8r-5cbcc89b8f-5nfvc\" (UID: \"0433e4cf-5e9a-4fac-aa4a-4b5fe8fbe5a0\") " pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-5nfvc"
Oct 30 21:26:28.040188 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:28.040175    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0433e4cf-5e9a-4fac-aa4a-4b5fe8fbe5a0-config\") pod \"korrel8r-5cbcc89b8f-5nfvc\" (UID: \"0433e4cf-5e9a-4fac-aa4a-4b5fe8fbe5a0\") " pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-5nfvc"
Oct 30 21:26:28.040917 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:28.040897    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0433e4cf-5e9a-4fac-aa4a-4b5fe8fbe5a0-config\") pod \"korrel8r-5cbcc89b8f-5nfvc\" (UID: \"0433e4cf-5e9a-4fac-aa4a-4b5fe8fbe5a0\") " pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-5nfvc"
Oct 30 21:26:28.042375 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:28.042358    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls\" (UniqueName: \"kubernetes.io/secret/0433e4cf-5e9a-4fac-aa4a-4b5fe8fbe5a0-tls\") pod \"korrel8r-5cbcc89b8f-5nfvc\" (UID: \"0433e4cf-5e9a-4fac-aa4a-4b5fe8fbe5a0\") " pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-5nfvc"
Oct 30 21:26:28.100656 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:28.100634    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k2vmc\" (UniqueName: \"kubernetes.io/projected/0433e4cf-5e9a-4fac-aa4a-4b5fe8fbe5a0-kube-api-access-k2vmc\") pod \"korrel8r-5cbcc89b8f-5nfvc\" (UID: \"0433e4cf-5e9a-4fac-aa4a-4b5fe8fbe5a0\") " pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-5nfvc"
Oct 30 21:26:28.154974 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:28.154945    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-5nfvc"
Oct 30 21:26:28.177544 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:28.177520    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-v6lq2"]
Oct 30 21:26:28.179283 ip-10-0-142-4 kubenswrapper[4060]: W1030 21:26:28.179263    4060 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c8f231f_5064_498b_bed5_c1d7213283b2.slice/crio-bc759079e02825a733c79dfab38c4a04a0c89aa5829d6563ae3139ed81b05512 WatchSource:0}: Error finding container bc759079e02825a733c79dfab38c4a04a0c89aa5829d6563ae3139ed81b05512: Status 404 returned error can't find the container with id bc759079e02825a733c79dfab38c4a04a0c89aa5829d6563ae3139ed81b05512
Oct 30 21:26:28.366510 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:28.366410    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-v6lq2" event={"ID":"8c8f231f-5064-498b-bed5-c1d7213283b2","Type":"ContainerStarted","Data":"bc759079e02825a733c79dfab38c4a04a0c89aa5829d6563ae3139ed81b05512"}
Oct 30 21:26:28.528704 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:28.528677    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/korrel8r-5cbcc89b8f-5nfvc"]
Oct 30 21:26:28.531183 ip-10-0-142-4 kubenswrapper[4060]: W1030 21:26:28.531145    4060 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0433e4cf_5e9a_4fac_aa4a_4b5fe8fbe5a0.slice/crio-7b2c6821d02352e9b02bfba6bb232d742928e0889ea82f6a31f9c3007cb867f2 WatchSource:0}: Error finding container 7b2c6821d02352e9b02bfba6bb232d742928e0889ea82f6a31f9c3007cb867f2: Status 404 returned error can't find the container with id 7b2c6821d02352e9b02bfba6bb232d742928e0889ea82f6a31f9c3007cb867f2
Oct 30 21:26:29.372432 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:29.372389    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-v6lq2" event={"ID":"8c8f231f-5064-498b-bed5-c1d7213283b2","Type":"ContainerStarted","Data":"6a065204d5fcc5a29463fcb2eddec21f2ceb736a16d82127fd4a5a0ebdd1909d"}
Oct 30 21:26:29.372648 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:29.372510    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-v6lq2"
Oct 30 21:26:29.374063 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:29.374036    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-5nfvc" event={"ID":"0433e4cf-5e9a-4fac-aa4a-4b5fe8fbe5a0","Type":"ContainerStarted","Data":"cf93d9f6a79be741fa7b5fc3b095cc27e264caf9df9b24a006d56bc5f7bb5be5"}
Oct 30 21:26:29.374179 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:29.374078    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-5nfvc" event={"ID":"0433e4cf-5e9a-4fac-aa4a-4b5fe8fbe5a0","Type":"ContainerStarted","Data":"7b2c6821d02352e9b02bfba6bb232d742928e0889ea82f6a31f9c3007cb867f2"}
Oct 30 21:26:29.374179 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:29.374097    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-5nfvc"
Oct 30 21:26:29.489265 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:29.489218    4060 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-v6lq2" podStartSLOduration=2.489206167 podStartE2EDuration="2.489206167s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:26:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:26:29.488457849 +0000 UTC m=+3008.245456148" watchObservedRunningTime="2026-10-30 21:26:29.489206167 +0000 UTC m=+3008.246204476"
Oct 30 21:26:29.605372 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:29.605328    4060 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-5nfvc" podStartSLOduration=2.605315609 podStartE2EDuration="2.605315609s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:26:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:26:29.603770575 +0000 UTC m=+3008.360768865" watchObservedRunningTime="2026-10-30 21:26:29.605315609 +0000 UTC m=+3008.362313930"
Oct 30 21:26:32.285943 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:32.285902    4060 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:26:32.289192 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:32.289161    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:26:32.343418 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:32.343387    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-headless-tls\""
Oct 30 21:26:32.343596 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:32.343557    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-tls\""
Oct 30 21:26:32.375969 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:32.375938    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1359b997-6362-42d8-b7d9-781cf4dd6033-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"1359b997-6362-42d8-b7d9-781cf4dd6033\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:26:32.376104 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:32.375971    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mh2mw\" (UniqueName: \"kubernetes.io/projected/1359b997-6362-42d8-b7d9-781cf4dd6033-kube-api-access-mh2mw\") pod \"data-science-collector-collector-0\" (UID: \"1359b997-6362-42d8-b7d9-781cf4dd6033\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:26:32.376170 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:32.376112    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/1359b997-6362-42d8-b7d9-781cf4dd6033-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-0\" (UID: \"1359b997-6362-42d8-b7d9-781cf4dd6033\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:26:32.376240 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:32.376171    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/1359b997-6362-42d8-b7d9-781cf4dd6033-monitoring-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"1359b997-6362-42d8-b7d9-781cf4dd6033\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:26:32.376240 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:32.376223    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/1359b997-6362-42d8-b7d9-781cf4dd6033-otlp-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"1359b997-6362-42d8-b7d9-781cf4dd6033\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:26:32.376328 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:32.376256    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/1359b997-6362-42d8-b7d9-781cf4dd6033-otc-internal\") pod \"data-science-collector-collector-0\" (UID: \"1359b997-6362-42d8-b7d9-781cf4dd6033\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:26:32.392870 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:32.392817    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-monitoring-tls\""
Oct 30 21:26:32.392870 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:32.392867    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-ta-client-cert\""
Oct 30 21:26:32.393105 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:32.392959    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-dockercfg-mpgx5\""
Oct 30 21:26:32.393178 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:32.393138    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-a0f9182a\""
Oct 30 21:26:32.396021 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:32.395997    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:26:32.477633 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:32.477598    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/1359b997-6362-42d8-b7d9-781cf4dd6033-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-0\" (UID: \"1359b997-6362-42d8-b7d9-781cf4dd6033\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:26:32.477810 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:32.477640    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/1359b997-6362-42d8-b7d9-781cf4dd6033-monitoring-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"1359b997-6362-42d8-b7d9-781cf4dd6033\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:26:32.477912 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:32.477887    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/1359b997-6362-42d8-b7d9-781cf4dd6033-otlp-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"1359b997-6362-42d8-b7d9-781cf4dd6033\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:26:32.477973 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:32.477932    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/1359b997-6362-42d8-b7d9-781cf4dd6033-otc-internal\") pod \"data-science-collector-collector-0\" (UID: \"1359b997-6362-42d8-b7d9-781cf4dd6033\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:26:32.477973 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:32.477965    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1359b997-6362-42d8-b7d9-781cf4dd6033-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"1359b997-6362-42d8-b7d9-781cf4dd6033\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:26:32.478086 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:32.477994    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mh2mw\" (UniqueName: \"kubernetes.io/projected/1359b997-6362-42d8-b7d9-781cf4dd6033-kube-api-access-mh2mw\") pod \"data-science-collector-collector-0\" (UID: \"1359b997-6362-42d8-b7d9-781cf4dd6033\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:26:32.478086 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:26:32.478005    4060 secret.go:189] Couldn't get secret redhat-ods-monitoring/data-science-collector-collector-headless-tls: secret "data-science-collector-collector-headless-tls" not found
Oct 30 21:26:32.478196 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:26:32.478098    4060 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1359b997-6362-42d8-b7d9-781cf4dd6033-otlp-tls-certs podName:1359b997-6362-42d8-b7d9-781cf4dd6033 nodeName:}" failed. No retries permitted until 2026-10-30 21:26:32.978075834 +0000 UTC m=+3011.735074129 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "otlp-tls-certs" (UniqueName: "kubernetes.io/secret/1359b997-6362-42d8-b7d9-781cf4dd6033-otlp-tls-certs") pod "data-science-collector-collector-0" (UID: "1359b997-6362-42d8-b7d9-781cf4dd6033") : secret "data-science-collector-collector-headless-tls" not found
Oct 30 21:26:32.478752 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:32.478720    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/1359b997-6362-42d8-b7d9-781cf4dd6033-otc-internal\") pod \"data-science-collector-collector-0\" (UID: \"1359b997-6362-42d8-b7d9-781cf4dd6033\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:26:32.480204 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:32.480185    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1359b997-6362-42d8-b7d9-781cf4dd6033-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"1359b997-6362-42d8-b7d9-781cf4dd6033\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:26:32.480302 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:32.480260    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/1359b997-6362-42d8-b7d9-781cf4dd6033-monitoring-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"1359b997-6362-42d8-b7d9-781cf4dd6033\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:26:32.480453 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:32.480434    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/1359b997-6362-42d8-b7d9-781cf4dd6033-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-0\" (UID: \"1359b997-6362-42d8-b7d9-781cf4dd6033\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:26:32.544599 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:32.544534    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mh2mw\" (UniqueName: \"kubernetes.io/projected/1359b997-6362-42d8-b7d9-781cf4dd6033-kube-api-access-mh2mw\") pod \"data-science-collector-collector-0\" (UID: \"1359b997-6362-42d8-b7d9-781cf4dd6033\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:26:32.981102 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:32.981065    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/1359b997-6362-42d8-b7d9-781cf4dd6033-otlp-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"1359b997-6362-42d8-b7d9-781cf4dd6033\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:26:32.983415 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:32.983393    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/1359b997-6362-42d8-b7d9-781cf4dd6033-otlp-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"1359b997-6362-42d8-b7d9-781cf4dd6033\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:26:33.202338 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:33.202307    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:26:33.575848 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:33.575826    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:26:33.578047 ip-10-0-142-4 kubenswrapper[4060]: W1030 21:26:33.578008    4060 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1359b997_6362_42d8_b7d9_781cf4dd6033.slice/crio-084afaa8435dbeee5b1e2f906040471040737a6dbbdb52b7a67cd849f3b4bd2d WatchSource:0}: Error finding container 084afaa8435dbeee5b1e2f906040471040737a6dbbdb52b7a67cd849f3b4bd2d: Status 404 returned error can't find the container with id 084afaa8435dbeee5b1e2f906040471040737a6dbbdb52b7a67cd849f3b4bd2d
Oct 30 21:26:33.580141 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:33.580099    4060 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 21:26:33.580238 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:33.580173    4060 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 21:26:34.398825 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:34.398790    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"1359b997-6362-42d8-b7d9-781cf4dd6033","Type":"ContainerStarted","Data":"3863e20256ce5db7591ecffc8b08d684fad90b1f73f95cfbafcd1992f7f3b814"}
Oct 30 21:26:34.399006 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:34.398847    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"1359b997-6362-42d8-b7d9-781cf4dd6033","Type":"ContainerStarted","Data":"084afaa8435dbeee5b1e2f906040471040737a6dbbdb52b7a67cd849f3b4bd2d"}
Oct 30 21:26:34.567893 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:34.567844    4060 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-collector-0" podStartSLOduration=2.5678299620000002 podStartE2EDuration="2.567829962s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:26:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:26:34.517453528 +0000 UTC m=+3013.274451830" watchObservedRunningTime="2026-10-30 21:26:34.567829962 +0000 UTC m=+3013.324828260"
Oct 30 21:26:35.381619 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:35.381587    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-v6lq2"
Oct 30 21:26:40.381145 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:40.381105    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-5nfvc"
Oct 30 21:26:42.150674 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:26:42.150644    4060 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v2f4x" containerName="extractor"
Oct 30 21:26:46.124474 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:46.124436    4060 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"]
Oct 30 21:26:46.128276 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:46.128252    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:26:46.180511 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:46.180471    4060 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/prometheus-data-science-monitoringstack-1"]
Oct 30 21:26:46.184406 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:46.184387    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1"
Oct 30 21:26:46.190426 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:46.190404    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a43b743c-b9f0-40f9-a02b-b5631f82b41a-config-volume\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"a43b743c-b9f0-40f9-a02b-b5631f82b41a\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:26:46.190594 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:46.190460    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5g9rb\" (UniqueName: \"kubernetes.io/projected/a43b743c-b9f0-40f9-a02b-b5631f82b41a-kube-api-access-5g9rb\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"a43b743c-b9f0-40f9-a02b-b5631f82b41a\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:26:46.190789 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:46.190621    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a43b743c-b9f0-40f9-a02b-b5631f82b41a-tls-assets\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"a43b743c-b9f0-40f9-a02b-b5631f82b41a\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:26:46.190789 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:46.190659    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a43b743c-b9f0-40f9-a02b-b5631f82b41a-web-config\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"a43b743c-b9f0-40f9-a02b-b5631f82b41a\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:26:46.190900 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:46.190818    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-data-science-monitoringstack-db\" (UniqueName: \"kubernetes.io/empty-dir/a43b743c-b9f0-40f9-a02b-b5631f82b41a-alertmanager-data-science-monitoringstack-db\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"a43b743c-b9f0-40f9-a02b-b5631f82b41a\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:26:46.190990 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:46.190971    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a43b743c-b9f0-40f9-a02b-b5631f82b41a-cluster-tls-config\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"a43b743c-b9f0-40f9-a02b-b5631f82b41a\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:26:46.191038 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:46.191005    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a43b743c-b9f0-40f9-a02b-b5631f82b41a-config-out\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"a43b743c-b9f0-40f9-a02b-b5631f82b41a\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:26:46.195987 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:46.195966    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"alertmanager-data-science-monitoringstack-tls-assets-0\""
Oct 30 21:26:46.229425 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:46.229390    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"]
Oct 30 21:26:46.251966 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:46.251936    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/prometheus-data-science-monitoringstack-1"]
Oct 30 21:26:46.291641 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:46.291601    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a43b743c-b9f0-40f9-a02b-b5631f82b41a-tls-assets\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"a43b743c-b9f0-40f9-a02b-b5631f82b41a\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:26:46.291641 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:46.291644    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a43b743c-b9f0-40f9-a02b-b5631f82b41a-web-config\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"a43b743c-b9f0-40f9-a02b-b5631f82b41a\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:26:46.291905 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:46.291679    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-data-science-monitoringstack-db\" (UniqueName: \"kubernetes.io/empty-dir/a43b743c-b9f0-40f9-a02b-b5631f82b41a-alertmanager-data-science-monitoringstack-db\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"a43b743c-b9f0-40f9-a02b-b5631f82b41a\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:26:46.291905 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:46.291709    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a43b743c-b9f0-40f9-a02b-b5631f82b41a-cluster-tls-config\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"a43b743c-b9f0-40f9-a02b-b5631f82b41a\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:26:46.291905 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:46.291734    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a43b743c-b9f0-40f9-a02b-b5631f82b41a-config-out\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"a43b743c-b9f0-40f9-a02b-b5631f82b41a\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:26:46.291905 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:46.291773    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a43b743c-b9f0-40f9-a02b-b5631f82b41a-config-volume\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"a43b743c-b9f0-40f9-a02b-b5631f82b41a\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:26:46.291905 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:46.291822    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5g9rb\" (UniqueName: \"kubernetes.io/projected/a43b743c-b9f0-40f9-a02b-b5631f82b41a-kube-api-access-5g9rb\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"a43b743c-b9f0-40f9-a02b-b5631f82b41a\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:26:46.292215 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:46.292192    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-data-science-monitoringstack-db\" (UniqueName: \"kubernetes.io/empty-dir/a43b743c-b9f0-40f9-a02b-b5631f82b41a-alertmanager-data-science-monitoringstack-db\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"a43b743c-b9f0-40f9-a02b-b5631f82b41a\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:26:46.294067 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:46.294038    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a43b743c-b9f0-40f9-a02b-b5631f82b41a-config-out\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"a43b743c-b9f0-40f9-a02b-b5631f82b41a\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:26:46.294188 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:46.294111    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a43b743c-b9f0-40f9-a02b-b5631f82b41a-tls-assets\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"a43b743c-b9f0-40f9-a02b-b5631f82b41a\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:26:46.296903 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:46.296881    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"alertmanager-data-science-monitoringstack-cluster-tls-config\""
Oct 30 21:26:46.297163 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:46.297077    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"prometheus-data-science-monitoringstack-web-config\""
Oct 30 21:26:46.297163 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:46.297096    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"prometheus-data-science-monitoringstack-tls-assets-0\""
Oct 30 21:26:46.297163 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:46.297104    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-monitoringstack-prometheus-dockercfg-dfb6w\""
Oct 30 21:26:46.297163 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:46.297117    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"alertmanager-data-science-monitoringstack-web-config\""
Oct 30 21:26:46.297163 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:46.297129    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"prometheus-data-science-monitoringstack-thanos-prometheus-http-client-file\""
Oct 30 21:26:46.297163 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:46.297123    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"prometheus-data-science-monitoringstack\""
Oct 30 21:26:46.297163 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:46.297136    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"alertmanager-data-science-monitoringstack-generated\""
Oct 30 21:26:46.297163 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:46.297169    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"prometheus-web-tls-ca\""
Oct 30 21:26:46.297672 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:46.297213    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-monitoringstack-alertmanager-dockercfg-lg9b9\""
Oct 30 21:26:46.300630 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:46.300610    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"prometheus-data-science-monitoringstack-rulefiles-2\""
Oct 30 21:26:46.300754 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:46.300725    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"prometheus-data-science-monitoringstack-rulefiles-0\""
Oct 30 21:26:46.300754 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:46.300750    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"prometheus-data-science-monitoringstack-rulefiles-1\""
Oct 30 21:26:46.305897 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:46.305869    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a43b743c-b9f0-40f9-a02b-b5631f82b41a-config-volume\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"a43b743c-b9f0-40f9-a02b-b5631f82b41a\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:26:46.306317 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:46.306292    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a43b743c-b9f0-40f9-a02b-b5631f82b41a-cluster-tls-config\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"a43b743c-b9f0-40f9-a02b-b5631f82b41a\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:26:46.306540 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:46.306481    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a43b743c-b9f0-40f9-a02b-b5631f82b41a-web-config\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"a43b743c-b9f0-40f9-a02b-b5631f82b41a\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:26:46.353174 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:46.353147    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5g9rb\" (UniqueName: \"kubernetes.io/projected/a43b743c-b9f0-40f9-a02b-b5631f82b41a-kube-api-access-5g9rb\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"a43b743c-b9f0-40f9-a02b-b5631f82b41a\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:26:46.392346 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:46.392282    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bw6cp\" (UniqueName: \"kubernetes.io/projected/790881c5-8eb2-4233-ac15-657f5ae7ccec-kube-api-access-bw6cp\") pod \"prometheus-data-science-monitoringstack-1\" (UID: \"790881c5-8eb2-4233-ac15-657f5ae7ccec\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1"
Oct 30 21:26:46.392346 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:46.392318    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/790881c5-8eb2-4233-ac15-657f5ae7ccec-config\") pod \"prometheus-data-science-monitoringstack-1\" (UID: \"790881c5-8eb2-4233-ac15-657f5ae7ccec\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1"
Oct 30 21:26:46.392346 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:46.392341    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-data-science-monitoringstack-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/790881c5-8eb2-4233-ac15-657f5ae7ccec-prometheus-data-science-monitoringstack-rulefiles-2\") pod \"prometheus-data-science-monitoringstack-1\" (UID: \"790881c5-8eb2-4233-ac15-657f5ae7ccec\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1"
Oct 30 21:26:46.392567 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:46.392428    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/790881c5-8eb2-4233-ac15-657f5ae7ccec-web-config\") pod \"prometheus-data-science-monitoringstack-1\" (UID: \"790881c5-8eb2-4233-ac15-657f5ae7ccec\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1"
Oct 30 21:26:46.392567 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:46.392518    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config-tls-secret-cert-prometheus-operated-tls-f3457c70\" (UniqueName: \"kubernetes.io/secret/790881c5-8eb2-4233-ac15-657f5ae7ccec-web-config-tls-secret-cert-prometheus-operated-tls-f3457c70\") pod \"prometheus-data-science-monitoringstack-1\" (UID: \"790881c5-8eb2-4233-ac15-657f5ae7ccec\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1"
Oct 30 21:26:46.392567 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:46.392560    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-web-tls-ca\" (UniqueName: \"kubernetes.io/secret/790881c5-8eb2-4233-ac15-657f5ae7ccec-secret-prometheus-web-tls-ca\") pod \"prometheus-data-science-monitoringstack-1\" (UID: \"790881c5-8eb2-4233-ac15-657f5ae7ccec\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1"
Oct 30 21:26:46.392666 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:46.392588    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-data-science-monitoringstack-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/790881c5-8eb2-4233-ac15-657f5ae7ccec-prometheus-data-science-monitoringstack-rulefiles-0\") pod \"prometheus-data-science-monitoringstack-1\" (UID: \"790881c5-8eb2-4233-ac15-657f5ae7ccec\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1"
Oct 30 21:26:46.392666 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:46.392609    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-data-science-monitoringstack-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/790881c5-8eb2-4233-ac15-657f5ae7ccec-prometheus-data-science-monitoringstack-rulefiles-1\") pod \"prometheus-data-science-monitoringstack-1\" (UID: \"790881c5-8eb2-4233-ac15-657f5ae7ccec\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1"
Oct 30 21:26:46.392729 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:46.392670    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/790881c5-8eb2-4233-ac15-657f5ae7ccec-tls-assets\") pod \"prometheus-data-science-monitoringstack-1\" (UID: \"790881c5-8eb2-4233-ac15-657f5ae7ccec\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1"
Oct 30 21:26:46.392729 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:46.392706    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/790881c5-8eb2-4233-ac15-657f5ae7ccec-config-out\") pod \"prometheus-data-science-monitoringstack-1\" (UID: \"790881c5-8eb2-4233-ac15-657f5ae7ccec\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1"
Oct 30 21:26:46.392792 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:46.392733    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/790881c5-8eb2-4233-ac15-657f5ae7ccec-thanos-prometheus-http-client-file\") pod \"prometheus-data-science-monitoringstack-1\" (UID: \"790881c5-8eb2-4233-ac15-657f5ae7ccec\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1"
Oct 30 21:26:46.392792 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:46.392773    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config-tls-secret-key-prometheus-operated-tls-f3457c70\" (UniqueName: \"kubernetes.io/secret/790881c5-8eb2-4233-ac15-657f5ae7ccec-web-config-tls-secret-key-prometheus-operated-tls-f3457c70\") pod \"prometheus-data-science-monitoringstack-1\" (UID: \"790881c5-8eb2-4233-ac15-657f5ae7ccec\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1"
Oct 30 21:26:46.445580 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:46.445551    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:26:46.494440 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:46.494391    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-data-science-monitoringstack-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/790881c5-8eb2-4233-ac15-657f5ae7ccec-prometheus-data-science-monitoringstack-rulefiles-0\") pod \"prometheus-data-science-monitoringstack-1\" (UID: \"790881c5-8eb2-4233-ac15-657f5ae7ccec\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1"
Oct 30 21:26:46.494596 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:46.494452    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-data-science-monitoringstack-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/790881c5-8eb2-4233-ac15-657f5ae7ccec-prometheus-data-science-monitoringstack-rulefiles-1\") pod \"prometheus-data-science-monitoringstack-1\" (UID: \"790881c5-8eb2-4233-ac15-657f5ae7ccec\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1"
Oct 30 21:26:46.494596 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:46.494484    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/790881c5-8eb2-4233-ac15-657f5ae7ccec-tls-assets\") pod \"prometheus-data-science-monitoringstack-1\" (UID: \"790881c5-8eb2-4233-ac15-657f5ae7ccec\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1"
Oct 30 21:26:46.494596 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:46.494528    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/790881c5-8eb2-4233-ac15-657f5ae7ccec-config-out\") pod \"prometheus-data-science-monitoringstack-1\" (UID: \"790881c5-8eb2-4233-ac15-657f5ae7ccec\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1"
Oct 30 21:26:46.494596 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:46.494566    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/790881c5-8eb2-4233-ac15-657f5ae7ccec-thanos-prometheus-http-client-file\") pod \"prometheus-data-science-monitoringstack-1\" (UID: \"790881c5-8eb2-4233-ac15-657f5ae7ccec\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1"
Oct 30 21:26:46.494830 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:46.494624    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config-tls-secret-key-prometheus-operated-tls-f3457c70\" (UniqueName: \"kubernetes.io/secret/790881c5-8eb2-4233-ac15-657f5ae7ccec-web-config-tls-secret-key-prometheus-operated-tls-f3457c70\") pod \"prometheus-data-science-monitoringstack-1\" (UID: \"790881c5-8eb2-4233-ac15-657f5ae7ccec\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1"
Oct 30 21:26:46.494830 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:46.494666    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bw6cp\" (UniqueName: \"kubernetes.io/projected/790881c5-8eb2-4233-ac15-657f5ae7ccec-kube-api-access-bw6cp\") pod \"prometheus-data-science-monitoringstack-1\" (UID: \"790881c5-8eb2-4233-ac15-657f5ae7ccec\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1"
Oct 30 21:26:46.494830 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:46.494708    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/790881c5-8eb2-4233-ac15-657f5ae7ccec-config\") pod \"prometheus-data-science-monitoringstack-1\" (UID: \"790881c5-8eb2-4233-ac15-657f5ae7ccec\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1"
Oct 30 21:26:46.494830 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:46.494734    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-data-science-monitoringstack-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/790881c5-8eb2-4233-ac15-657f5ae7ccec-prometheus-data-science-monitoringstack-rulefiles-2\") pod \"prometheus-data-science-monitoringstack-1\" (UID: \"790881c5-8eb2-4233-ac15-657f5ae7ccec\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1"
Oct 30 21:26:46.494830 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:46.494762    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/790881c5-8eb2-4233-ac15-657f5ae7ccec-web-config\") pod \"prometheus-data-science-monitoringstack-1\" (UID: \"790881c5-8eb2-4233-ac15-657f5ae7ccec\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1"
Oct 30 21:26:46.494830 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:46.494822    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config-tls-secret-cert-prometheus-operated-tls-f3457c70\" (UniqueName: \"kubernetes.io/secret/790881c5-8eb2-4233-ac15-657f5ae7ccec-web-config-tls-secret-cert-prometheus-operated-tls-f3457c70\") pod \"prometheus-data-science-monitoringstack-1\" (UID: \"790881c5-8eb2-4233-ac15-657f5ae7ccec\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1"
Oct 30 21:26:46.495153 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:46.494857    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-web-tls-ca\" (UniqueName: \"kubernetes.io/secret/790881c5-8eb2-4233-ac15-657f5ae7ccec-secret-prometheus-web-tls-ca\") pod \"prometheus-data-science-monitoringstack-1\" (UID: \"790881c5-8eb2-4233-ac15-657f5ae7ccec\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1"
Oct 30 21:26:46.497437 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:46.497397    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-data-science-monitoringstack-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/790881c5-8eb2-4233-ac15-657f5ae7ccec-prometheus-data-science-monitoringstack-rulefiles-0\") pod \"prometheus-data-science-monitoringstack-1\" (UID: \"790881c5-8eb2-4233-ac15-657f5ae7ccec\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1"
Oct 30 21:26:46.498191 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:46.498158    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config-tls-secret-key-prometheus-operated-tls-f3457c70\" (UniqueName: \"kubernetes.io/secret/790881c5-8eb2-4233-ac15-657f5ae7ccec-web-config-tls-secret-key-prometheus-operated-tls-f3457c70\") pod \"prometheus-data-science-monitoringstack-1\" (UID: \"790881c5-8eb2-4233-ac15-657f5ae7ccec\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1"
Oct 30 21:26:46.498561 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:46.498537    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-web-tls-ca\" (UniqueName: \"kubernetes.io/secret/790881c5-8eb2-4233-ac15-657f5ae7ccec-secret-prometheus-web-tls-ca\") pod \"prometheus-data-science-monitoringstack-1\" (UID: \"790881c5-8eb2-4233-ac15-657f5ae7ccec\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1"
Oct 30 21:26:46.499822 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:46.499790    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-data-science-monitoringstack-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/790881c5-8eb2-4233-ac15-657f5ae7ccec-prometheus-data-science-monitoringstack-rulefiles-1\") pod \"prometheus-data-science-monitoringstack-1\" (UID: \"790881c5-8eb2-4233-ac15-657f5ae7ccec\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1"
Oct 30 21:26:46.500733 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:46.500180    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-data-science-monitoringstack-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/790881c5-8eb2-4233-ac15-657f5ae7ccec-prometheus-data-science-monitoringstack-rulefiles-2\") pod \"prometheus-data-science-monitoringstack-1\" (UID: \"790881c5-8eb2-4233-ac15-657f5ae7ccec\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1"
Oct 30 21:26:46.500733 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:46.500322    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/790881c5-8eb2-4233-ac15-657f5ae7ccec-config-out\") pod \"prometheus-data-science-monitoringstack-1\" (UID: \"790881c5-8eb2-4233-ac15-657f5ae7ccec\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1"
Oct 30 21:26:46.500733 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:46.500690    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/790881c5-8eb2-4233-ac15-657f5ae7ccec-thanos-prometheus-http-client-file\") pod \"prometheus-data-science-monitoringstack-1\" (UID: \"790881c5-8eb2-4233-ac15-657f5ae7ccec\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1"
Oct 30 21:26:46.501341 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:46.501323    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/790881c5-8eb2-4233-ac15-657f5ae7ccec-config\") pod \"prometheus-data-science-monitoringstack-1\" (UID: \"790881c5-8eb2-4233-ac15-657f5ae7ccec\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1"
Oct 30 21:26:46.501739 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:46.501687    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/790881c5-8eb2-4233-ac15-657f5ae7ccec-tls-assets\") pod \"prometheus-data-science-monitoringstack-1\" (UID: \"790881c5-8eb2-4233-ac15-657f5ae7ccec\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1"
Oct 30 21:26:46.503200 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:46.503173    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/790881c5-8eb2-4233-ac15-657f5ae7ccec-web-config\") pod \"prometheus-data-science-monitoringstack-1\" (UID: \"790881c5-8eb2-4233-ac15-657f5ae7ccec\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1"
Oct 30 21:26:46.503732 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:46.503715    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config-tls-secret-cert-prometheus-operated-tls-f3457c70\" (UniqueName: \"kubernetes.io/secret/790881c5-8eb2-4233-ac15-657f5ae7ccec-web-config-tls-secret-cert-prometheus-operated-tls-f3457c70\") pod \"prometheus-data-science-monitoringstack-1\" (UID: \"790881c5-8eb2-4233-ac15-657f5ae7ccec\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1"
Oct 30 21:26:46.557402 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:46.557366    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bw6cp\" (UniqueName: \"kubernetes.io/projected/790881c5-8eb2-4233-ac15-657f5ae7ccec-kube-api-access-bw6cp\") pod \"prometheus-data-science-monitoringstack-1\" (UID: \"790881c5-8eb2-4233-ac15-657f5ae7ccec\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1"
Oct 30 21:26:46.872193 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:46.872165    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"]
Oct 30 21:26:46.874956 ip-10-0-142-4 kubenswrapper[4060]: W1030 21:26:46.874930    4060 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda43b743c_b9f0_40f9_a02b_b5631f82b41a.slice/crio-20cfe73f1aeb3c5a7b219f7dab9a2bb97457772cb9f210f7aad585aa316e27ef WatchSource:0}: Error finding container 20cfe73f1aeb3c5a7b219f7dab9a2bb97457772cb9f210f7aad585aa316e27ef: Status 404 returned error can't find the container with id 20cfe73f1aeb3c5a7b219f7dab9a2bb97457772cb9f210f7aad585aa316e27ef
Oct 30 21:26:47.455532 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:47.455475    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0" event={"ID":"a43b743c-b9f0-40f9-a02b-b5631f82b41a","Type":"ContainerStarted","Data":"9d8f9a2912e1b943ab6df1f5f05c75aae0dbc6bf5983f1073e2cf248b7931309"}
Oct 30 21:26:47.455936 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:47.455572    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0" event={"ID":"a43b743c-b9f0-40f9-a02b-b5631f82b41a","Type":"ContainerStarted","Data":"20cfe73f1aeb3c5a7b219f7dab9a2bb97457772cb9f210f7aad585aa316e27ef"}
Oct 30 21:26:49.316512 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:49.316460    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-fb65aa63-2762-435b-a8ef-8892b9ffe1f6\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0913d5896cba88aba\") pod \"prometheus-data-science-monitoringstack-1\" (UID: \"790881c5-8eb2-4233-ac15-657f5ae7ccec\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1"
Oct 30 21:26:49.420606 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:49.420574    4060 operation_generator.go:1464] "Controller attach succeeded for volume \"pvc-fb65aa63-2762-435b-a8ef-8892b9ffe1f6\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0913d5896cba88aba\") pod \"prometheus-data-science-monitoringstack-1\" (UID: \"790881c5-8eb2-4233-ac15-657f5ae7ccec\") device path: \"\"" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1"
Oct 30 21:26:49.518222 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:49.518187    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"pvc-fb65aa63-2762-435b-a8ef-8892b9ffe1f6\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0913d5896cba88aba\") pod \"prometheus-data-science-monitoringstack-1\" (UID: \"790881c5-8eb2-4233-ac15-657f5ae7ccec\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1"
Oct 30 21:26:49.518416 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:49.518345    4060 operation_generator.go:515] "MountVolume.WaitForAttach entering for volume \"pvc-fb65aa63-2762-435b-a8ef-8892b9ffe1f6\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0913d5896cba88aba\") pod \"prometheus-data-science-monitoringstack-1\" (UID: \"790881c5-8eb2-4233-ac15-657f5ae7ccec\") DevicePath \"\"" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1"
Oct 30 21:26:49.570230 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:49.570154    4060 operation_generator.go:525] "MountVolume.WaitForAttach succeeded for volume \"pvc-fb65aa63-2762-435b-a8ef-8892b9ffe1f6\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0913d5896cba88aba\") pod \"prometheus-data-science-monitoringstack-1\" (UID: \"790881c5-8eb2-4233-ac15-657f5ae7ccec\") DevicePath \"csi-dbc62499abb3d22ac96b5aeec76b56804a0f706240b990b24aaa3954301809a6\"" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1"
Oct 30 21:26:49.711280 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:49.711246    4060 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"pvc-fb65aa63-2762-435b-a8ef-8892b9ffe1f6\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0913d5896cba88aba\") pod \"prometheus-data-science-monitoringstack-1\" (UID: \"790881c5-8eb2-4233-ac15-657f5ae7ccec\") device mount path \"/var/lib/kubelet/plugins/kubernetes.io/csi/ebs.csi.aws.com/6dcee51846c65e61e42d030ad34b511007d41c5710f282a3474b3969662e5f6c/globalmount\"" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1"
Oct 30 21:26:49.775321 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:49.775297    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pvc-fb65aa63-2762-435b-a8ef-8892b9ffe1f6\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0913d5896cba88aba\") pod \"prometheus-data-science-monitoringstack-1\" (UID: \"790881c5-8eb2-4233-ac15-657f5ae7ccec\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1"
Oct 30 21:26:50.104432 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:50.104395    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1"
Oct 30 21:26:50.471259 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:50.471234    4060 generic.go:356] "Generic (PLEG): container finished" podID="a43b743c-b9f0-40f9-a02b-b5631f82b41a" containerID="9d8f9a2912e1b943ab6df1f5f05c75aae0dbc6bf5983f1073e2cf248b7931309" exitCode=0
Oct 30 21:26:50.471786 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:50.471306    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0" event={"ID":"a43b743c-b9f0-40f9-a02b-b5631f82b41a","Type":"ContainerDied","Data":"9d8f9a2912e1b943ab6df1f5f05c75aae0dbc6bf5983f1073e2cf248b7931309"}
Oct 30 21:26:50.625105 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:50.625077    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/prometheus-data-science-monitoringstack-1"]
Oct 30 21:26:50.653620 ip-10-0-142-4 kubenswrapper[4060]: W1030 21:26:50.653595    4060 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod790881c5_8eb2_4233_ac15_657f5ae7ccec.slice/crio-27cb6d0c36ebe97fd0f36521d716e09be4e079107ca029c20ad110cd3a58f9ce WatchSource:0}: Error finding container 27cb6d0c36ebe97fd0f36521d716e09be4e079107ca029c20ad110cd3a58f9ce: Status 404 returned error can't find the container with id 27cb6d0c36ebe97fd0f36521d716e09be4e079107ca029c20ad110cd3a58f9ce
Oct 30 21:26:51.479283 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:51.479254    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0" event={"ID":"a43b743c-b9f0-40f9-a02b-b5631f82b41a","Type":"ContainerStarted","Data":"3f27725038d25b8ce636577cc882134b74a0d08255099dec2e62c2b578b4540b"}
Oct 30 21:26:51.479789 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:51.479318    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0" event={"ID":"a43b743c-b9f0-40f9-a02b-b5631f82b41a","Type":"ContainerStarted","Data":"30fc04fb9901bf6e193aecf979c7148c06beb7ea9e367a91193d8a7c8fc4395f"}
Oct 30 21:26:51.479789 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:51.479536    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:26:51.480874 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:51.480853    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1" event={"ID":"790881c5-8eb2-4233-ac15-657f5ae7ccec","Type":"ContainerStarted","Data":"3644d766fd95bcc8b8cca90d5975c116d954535eba6afe0f02255dc747e02bdf"}
Oct 30 21:26:51.480990 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:51.480915    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1" event={"ID":"790881c5-8eb2-4233-ac15-657f5ae7ccec","Type":"ContainerStarted","Data":"27cb6d0c36ebe97fd0f36521d716e09be4e079107ca029c20ad110cd3a58f9ce"}
Oct 30 21:26:51.603897 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:51.603847    4060 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0" podStartSLOduration=2.3188648 podStartE2EDuration="5.603832185s" totalImagesPullingTime="0s" totalInitContainerRuntime="3.284967385s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:26:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:26:51.602370536 +0000 UTC m=+3030.359368869" watchObservedRunningTime="2026-10-30 21:26:51.603832185 +0000 UTC m=+3030.360830506"
Oct 30 21:26:55.501930 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:55.501897    4060 generic.go:356] "Generic (PLEG): container finished" podID="790881c5-8eb2-4233-ac15-657f5ae7ccec" containerID="3644d766fd95bcc8b8cca90d5975c116d954535eba6afe0f02255dc747e02bdf" exitCode=0
Oct 30 21:26:55.502513 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:55.501970    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1" event={"ID":"790881c5-8eb2-4233-ac15-657f5ae7ccec","Type":"ContainerDied","Data":"3644d766fd95bcc8b8cca90d5975c116d954535eba6afe0f02255dc747e02bdf"}
Oct 30 21:26:55.972396 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:55.972376    4060 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 21:26:56.517705 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:56.517660    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1" event={"ID":"790881c5-8eb2-4233-ac15-657f5ae7ccec","Type":"ContainerStarted","Data":"3d83d425f164debc2b0cff955dd56d77615fc31e4d2be3e656b31dd938b0829b"}
Oct 30 21:26:56.518092 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:56.517775    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1" event={"ID":"790881c5-8eb2-4233-ac15-657f5ae7ccec","Type":"ContainerStarted","Data":"9e559607c7fe449ff89634190bd1ca5ae9fc08f0860be6fc42f4edc7fd06693d"}
Oct 30 21:26:57.487581 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:26:57.487550    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:27:00.540294 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:27:00.540254    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1" event={"ID":"790881c5-8eb2-4233-ac15-657f5ae7ccec","Type":"ContainerStarted","Data":"cddc211b2a5eaf6d6493e7a733eec68511533ead37020442bdf26109ed727e2e"}
Oct 30 21:27:00.816662 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:27:00.816560    4060 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1" podStartSLOduration=6.777477791 podStartE2EDuration="14.816544974s" totalImagesPullingTime="3.952341007s" totalInitContainerRuntime="4.086726176s" isStatefulPod=true podCreationTimestamp="2026-10-30 21:26:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:27:00.765189476 +0000 UTC m=+3039.522187773" watchObservedRunningTime="2026-10-30 21:27:00.816544974 +0000 UTC m=+3039.573543272"
Oct 30 21:27:05.104914 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:27:05.104878    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1"
Oct 30 21:27:05.105302 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:27:05.104950    4060 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1"
Oct 30 21:27:05.110126 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:27:05.110103    4060 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1"
Oct 30 21:27:05.571131 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:27:05.571103    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1"
Oct 30 21:27:12.153599 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:27:12.153559    4060 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v2f4x" containerName="extractor"
Oct 30 21:27:34.390157 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:27:34.390120    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:27:34.390716 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:27:34.390372    4060 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-collector-0" podUID="1359b997-6362-42d8-b7d9-781cf4dd6033" containerName="otc-container" containerID="cri-o://3863e20256ce5db7591ecffc8b08d684fad90b1f73f95cfbafcd1992f7f3b814" gracePeriod=30
Oct 30 21:27:36.715633 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:27:36.715594    4060 generic.go:356] "Generic (PLEG): container finished" podID="1359b997-6362-42d8-b7d9-781cf4dd6033" containerID="3863e20256ce5db7591ecffc8b08d684fad90b1f73f95cfbafcd1992f7f3b814" exitCode=0
Oct 30 21:27:36.715991 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:27:36.715644    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"1359b997-6362-42d8-b7d9-781cf4dd6033","Type":"ContainerDied","Data":"3863e20256ce5db7591ecffc8b08d684fad90b1f73f95cfbafcd1992f7f3b814"}
Oct 30 21:27:36.741389 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:27:36.741367    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:27:36.821558 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:27:36.821468    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1359b997-6362-42d8-b7d9-781cf4dd6033-kube-api-access-mh2mw\" (UniqueName: \"kubernetes.io/projected/1359b997-6362-42d8-b7d9-781cf4dd6033-kube-api-access-mh2mw\") pod \"1359b997-6362-42d8-b7d9-781cf4dd6033\" (UID: \"1359b997-6362-42d8-b7d9-781cf4dd6033\") "
Oct 30 21:27:36.821558 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:27:36.821525    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/1359b997-6362-42d8-b7d9-781cf4dd6033-data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/1359b997-6362-42d8-b7d9-781cf4dd6033-data-science-collector-ta-client-cert\") pod \"1359b997-6362-42d8-b7d9-781cf4dd6033\" (UID: \"1359b997-6362-42d8-b7d9-781cf4dd6033\") "
Oct 30 21:27:36.821767 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:27:36.821564    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/1359b997-6362-42d8-b7d9-781cf4dd6033-otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/1359b997-6362-42d8-b7d9-781cf4dd6033-otlp-tls-certs\") pod \"1359b997-6362-42d8-b7d9-781cf4dd6033\" (UID: \"1359b997-6362-42d8-b7d9-781cf4dd6033\") "
Oct 30 21:27:36.821767 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:27:36.821714    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/1359b997-6362-42d8-b7d9-781cf4dd6033-otc-internal\" (UniqueName: \"kubernetes.io/configmap/1359b997-6362-42d8-b7d9-781cf4dd6033-otc-internal\") pod \"1359b997-6362-42d8-b7d9-781cf4dd6033\" (UID: \"1359b997-6362-42d8-b7d9-781cf4dd6033\") "
Oct 30 21:27:36.821948 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:27:36.821765    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/1359b997-6362-42d8-b7d9-781cf4dd6033-monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/1359b997-6362-42d8-b7d9-781cf4dd6033-monitoring-tls-certs\") pod \"1359b997-6362-42d8-b7d9-781cf4dd6033\" (UID: \"1359b997-6362-42d8-b7d9-781cf4dd6033\") "
Oct 30 21:27:36.821948 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:27:36.821797    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/1359b997-6362-42d8-b7d9-781cf4dd6033-tls-certs\" (UniqueName: \"kubernetes.io/secret/1359b997-6362-42d8-b7d9-781cf4dd6033-tls-certs\") pod \"1359b997-6362-42d8-b7d9-781cf4dd6033\" (UID: \"1359b997-6362-42d8-b7d9-781cf4dd6033\") "
Oct 30 21:27:36.822108 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:27:36.822080    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1359b997-6362-42d8-b7d9-781cf4dd6033-otc-internal" pod "1359b997-6362-42d8-b7d9-781cf4dd6033" (UID: "1359b997-6362-42d8-b7d9-781cf4dd6033"). InnerVolumeSpecName "otc-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:27:36.823807 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:27:36.823773    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1359b997-6362-42d8-b7d9-781cf4dd6033-data-science-collector-ta-client-cert" pod "1359b997-6362-42d8-b7d9-781cf4dd6033" (UID: "1359b997-6362-42d8-b7d9-781cf4dd6033"). InnerVolumeSpecName "data-science-collector-ta-client-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:27:36.823928 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:27:36.823871    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1359b997-6362-42d8-b7d9-781cf4dd6033-otlp-tls-certs" pod "1359b997-6362-42d8-b7d9-781cf4dd6033" (UID: "1359b997-6362-42d8-b7d9-781cf4dd6033"). InnerVolumeSpecName "otlp-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:27:36.824063 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:27:36.824040    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1359b997-6362-42d8-b7d9-781cf4dd6033-tls-certs" pod "1359b997-6362-42d8-b7d9-781cf4dd6033" (UID: "1359b997-6362-42d8-b7d9-781cf4dd6033"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:27:36.824210 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:27:36.824177    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1359b997-6362-42d8-b7d9-781cf4dd6033-monitoring-tls-certs" pod "1359b997-6362-42d8-b7d9-781cf4dd6033" (UID: "1359b997-6362-42d8-b7d9-781cf4dd6033"). InnerVolumeSpecName "monitoring-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:27:36.824210 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:27:36.824191    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1359b997-6362-42d8-b7d9-781cf4dd6033-kube-api-access-mh2mw" pod "1359b997-6362-42d8-b7d9-781cf4dd6033" (UID: "1359b997-6362-42d8-b7d9-781cf4dd6033"). InnerVolumeSpecName "kube-api-access-mh2mw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:27:36.922504 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:27:36.922462    4060 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1359b997-6362-42d8-b7d9-781cf4dd6033-tls-certs\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:27:36.922504 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:27:36.922509    4060 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mh2mw\" (UniqueName: \"kubernetes.io/projected/1359b997-6362-42d8-b7d9-781cf4dd6033-kube-api-access-mh2mw\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:27:36.922705 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:27:36.922524    4060 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/1359b997-6362-42d8-b7d9-781cf4dd6033-data-science-collector-ta-client-cert\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:27:36.922705 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:27:36.922534    4060 reconciler_common.go:299] "Volume detached for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/1359b997-6362-42d8-b7d9-781cf4dd6033-otlp-tls-certs\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:27:36.922705 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:27:36.922548    4060 reconciler_common.go:299] "Volume detached for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/1359b997-6362-42d8-b7d9-781cf4dd6033-otc-internal\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:27:36.922705 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:27:36.922557    4060 reconciler_common.go:299] "Volume detached for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/1359b997-6362-42d8-b7d9-781cf4dd6033-monitoring-tls-certs\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:27:37.722227 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:27:37.722188    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"1359b997-6362-42d8-b7d9-781cf4dd6033","Type":"ContainerDied","Data":"084afaa8435dbeee5b1e2f906040471040737a6dbbdb52b7a67cd849f3b4bd2d"}
Oct 30 21:27:37.722227 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:27:37.722213    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:27:37.722709 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:27:37.722269    4060 scope.go:122] "RemoveContainer" containerID="3863e20256ce5db7591ecffc8b08d684fad90b1f73f95cfbafcd1992f7f3b814"
Oct 30 21:27:37.886842 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:27:37.886810    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:27:37.937519 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:27:37.937471    4060 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:27:37.968880 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:27:37.968851    4060 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:27:37.969302 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:27:37.969283    4060 cpu_manager.go:414] "containerMap: removing container" podUID="1359b997-6362-42d8-b7d9-781cf4dd6033" containerName="otc-container"
Oct 30 21:27:37.969302 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:27:37.969301    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1359b997-6362-42d8-b7d9-781cf4dd6033" containerName="otc-container"
Oct 30 21:27:37.969481 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:27:37.969375    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="1359b997-6362-42d8-b7d9-781cf4dd6033" containerName="otc-container"
Oct 30 21:27:37.974507 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:27:37.974441    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:27:38.026957 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:27:38.026868    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-headless-tls\""
Oct 30 21:27:38.026957 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:27:38.026906    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-a0f9182a\""
Oct 30 21:27:38.026957 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:27:38.026950    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-tls\""
Oct 30 21:27:38.027158 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:27:38.026969    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-dockercfg-mpgx5\""
Oct 30 21:27:38.027158 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:27:38.027017    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-monitoring-tls\""
Oct 30 21:27:38.027158 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:27:38.027026    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-ta-client-cert\""
Oct 30 21:27:38.030927 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:27:38.030887    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9e5d7b4f-19a2-4f84-981f-0f523ef7dd95-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"9e5d7b4f-19a2-4f84-981f-0f523ef7dd95\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:27:38.031009 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:27:38.030961    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/9e5d7b4f-19a2-4f84-981f-0f523ef7dd95-otlp-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"9e5d7b4f-19a2-4f84-981f-0f523ef7dd95\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:27:38.031049 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:27:38.031018    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/9e5d7b4f-19a2-4f84-981f-0f523ef7dd95-otc-internal\") pod \"data-science-collector-collector-0\" (UID: \"9e5d7b4f-19a2-4f84-981f-0f523ef7dd95\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:27:38.031083 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:27:38.031049    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gck9m\" (UniqueName: \"kubernetes.io/projected/9e5d7b4f-19a2-4f84-981f-0f523ef7dd95-kube-api-access-gck9m\") pod \"data-science-collector-collector-0\" (UID: \"9e5d7b4f-19a2-4f84-981f-0f523ef7dd95\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:27:38.031117 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:27:38.031081    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/9e5d7b4f-19a2-4f84-981f-0f523ef7dd95-monitoring-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"9e5d7b4f-19a2-4f84-981f-0f523ef7dd95\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:27:38.031172 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:27:38.031157    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/9e5d7b4f-19a2-4f84-981f-0f523ef7dd95-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-0\" (UID: \"9e5d7b4f-19a2-4f84-981f-0f523ef7dd95\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:27:38.049831 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:27:38.049807    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:27:38.131557 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:27:38.131529    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/9e5d7b4f-19a2-4f84-981f-0f523ef7dd95-monitoring-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"9e5d7b4f-19a2-4f84-981f-0f523ef7dd95\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:27:38.131717 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:27:38.131570    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/9e5d7b4f-19a2-4f84-981f-0f523ef7dd95-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-0\" (UID: \"9e5d7b4f-19a2-4f84-981f-0f523ef7dd95\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:27:38.131717 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:27:38.131612    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9e5d7b4f-19a2-4f84-981f-0f523ef7dd95-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"9e5d7b4f-19a2-4f84-981f-0f523ef7dd95\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:27:38.131717 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:27:38.131640    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/9e5d7b4f-19a2-4f84-981f-0f523ef7dd95-otlp-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"9e5d7b4f-19a2-4f84-981f-0f523ef7dd95\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:27:38.131717 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:27:38.131677    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/9e5d7b4f-19a2-4f84-981f-0f523ef7dd95-otc-internal\") pod \"data-science-collector-collector-0\" (UID: \"9e5d7b4f-19a2-4f84-981f-0f523ef7dd95\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:27:38.131717 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:27:38.131709    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gck9m\" (UniqueName: \"kubernetes.io/projected/9e5d7b4f-19a2-4f84-981f-0f523ef7dd95-kube-api-access-gck9m\") pod \"data-science-collector-collector-0\" (UID: \"9e5d7b4f-19a2-4f84-981f-0f523ef7dd95\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:27:38.132348 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:27:38.132326    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/9e5d7b4f-19a2-4f84-981f-0f523ef7dd95-otc-internal\") pod \"data-science-collector-collector-0\" (UID: \"9e5d7b4f-19a2-4f84-981f-0f523ef7dd95\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:27:38.134104 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:27:38.134082    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/9e5d7b4f-19a2-4f84-981f-0f523ef7dd95-monitoring-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"9e5d7b4f-19a2-4f84-981f-0f523ef7dd95\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:27:38.134221 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:27:38.134104    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/9e5d7b4f-19a2-4f84-981f-0f523ef7dd95-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-0\" (UID: \"9e5d7b4f-19a2-4f84-981f-0f523ef7dd95\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:27:38.134402 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:27:38.134385    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/9e5d7b4f-19a2-4f84-981f-0f523ef7dd95-otlp-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"9e5d7b4f-19a2-4f84-981f-0f523ef7dd95\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:27:38.134535 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:27:38.134517    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9e5d7b4f-19a2-4f84-981f-0f523ef7dd95-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"9e5d7b4f-19a2-4f84-981f-0f523ef7dd95\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:27:38.192412 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:27:38.192392    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gck9m\" (UniqueName: \"kubernetes.io/projected/9e5d7b4f-19a2-4f84-981f-0f523ef7dd95-kube-api-access-gck9m\") pod \"data-science-collector-collector-0\" (UID: \"9e5d7b4f-19a2-4f84-981f-0f523ef7dd95\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:27:38.288653 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:27:38.288600    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:27:38.660355 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:27:38.660330    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:27:38.662470 ip-10-0-142-4 kubenswrapper[4060]: W1030 21:27:38.662445    4060 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e5d7b4f_19a2_4f84_981f_0f523ef7dd95.slice/crio-6eea19aabbfbd9373e162a57b6557ac0ba14d0b6981cbc67da4a856999a8563e WatchSource:0}: Error finding container 6eea19aabbfbd9373e162a57b6557ac0ba14d0b6981cbc67da4a856999a8563e: Status 404 returned error can't find the container with id 6eea19aabbfbd9373e162a57b6557ac0ba14d0b6981cbc67da4a856999a8563e
Oct 30 21:27:38.664510 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:27:38.664456    4060 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 21:27:38.664591 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:27:38.664533    4060 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 21:27:38.730625 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:27:38.730599    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"9e5d7b4f-19a2-4f84-981f-0f523ef7dd95","Type":"ContainerStarted","Data":"47e18f5074c755c0826f1cf08634a78150f3269fe696449efae54620f63fa7e0"}
Oct 30 21:27:38.730947 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:27:38.730652    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"9e5d7b4f-19a2-4f84-981f-0f523ef7dd95","Type":"ContainerStarted","Data":"6eea19aabbfbd9373e162a57b6557ac0ba14d0b6981cbc67da4a856999a8563e"}
Oct 30 21:27:38.850915 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:27:38.850855    4060 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-collector-0" podStartSLOduration=1.850837155 podStartE2EDuration="1.850837155s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:27:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:27:38.849663189 +0000 UTC m=+3077.606661487" watchObservedRunningTime="2026-10-30 21:27:38.850837155 +0000 UTC m=+3077.607835452"
Oct 30 21:27:39.426638 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:27:39.426600    4060 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="1359b997-6362-42d8-b7d9-781cf4dd6033" path="/var/lib/kubelet/pods/1359b997-6362-42d8-b7d9-781cf4dd6033/volumes"
Oct 30 21:27:42.149982 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:27:42.149948    4060 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v2f4x" containerName="extractor"
Oct 30 21:28:12.150033 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:28:12.149954    4060 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v2f4x" containerName="extractor"
Oct 30 21:28:21.212626 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:28:21.212590    4060 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/korrel8r-66d6f7f696-d9zpr"]
Oct 30 21:28:21.215989 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:28:21.215973    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/korrel8r-66d6f7f696-d9zpr"
Oct 30 21:28:21.278411 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:28:21.278341    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/korrel8r-66d6f7f696-d9zpr"]
Oct 30 21:28:21.399302 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:28:21.399269    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/ccf3318a-747f-4304-95db-b331f2389d41-tls\") pod \"korrel8r-66d6f7f696-d9zpr\" (UID: \"ccf3318a-747f-4304-95db-b331f2389d41\") " pod="redhat-ods-monitoring/korrel8r-66d6f7f696-d9zpr"
Oct 30 21:28:21.399302 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:28:21.399303    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ccf3318a-747f-4304-95db-b331f2389d41-config\") pod \"korrel8r-66d6f7f696-d9zpr\" (UID: \"ccf3318a-747f-4304-95db-b331f2389d41\") " pod="redhat-ods-monitoring/korrel8r-66d6f7f696-d9zpr"
Oct 30 21:28:21.399534 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:28:21.399389    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m8b9r\" (UniqueName: \"kubernetes.io/projected/ccf3318a-747f-4304-95db-b331f2389d41-kube-api-access-m8b9r\") pod \"korrel8r-66d6f7f696-d9zpr\" (UID: \"ccf3318a-747f-4304-95db-b331f2389d41\") " pod="redhat-ods-monitoring/korrel8r-66d6f7f696-d9zpr"
Oct 30 21:28:21.500178 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:28:21.500109    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/ccf3318a-747f-4304-95db-b331f2389d41-tls\") pod \"korrel8r-66d6f7f696-d9zpr\" (UID: \"ccf3318a-747f-4304-95db-b331f2389d41\") " pod="redhat-ods-monitoring/korrel8r-66d6f7f696-d9zpr"
Oct 30 21:28:21.500178 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:28:21.500142    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ccf3318a-747f-4304-95db-b331f2389d41-config\") pod \"korrel8r-66d6f7f696-d9zpr\" (UID: \"ccf3318a-747f-4304-95db-b331f2389d41\") " pod="redhat-ods-monitoring/korrel8r-66d6f7f696-d9zpr"
Oct 30 21:28:21.500411 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:28:21.500205    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m8b9r\" (UniqueName: \"kubernetes.io/projected/ccf3318a-747f-4304-95db-b331f2389d41-kube-api-access-m8b9r\") pod \"korrel8r-66d6f7f696-d9zpr\" (UID: \"ccf3318a-747f-4304-95db-b331f2389d41\") " pod="redhat-ods-monitoring/korrel8r-66d6f7f696-d9zpr"
Oct 30 21:28:21.501080 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:28:21.501051    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ccf3318a-747f-4304-95db-b331f2389d41-config\") pod \"korrel8r-66d6f7f696-d9zpr\" (UID: \"ccf3318a-747f-4304-95db-b331f2389d41\") " pod="redhat-ods-monitoring/korrel8r-66d6f7f696-d9zpr"
Oct 30 21:28:21.502502 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:28:21.502471    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls\" (UniqueName: \"kubernetes.io/secret/ccf3318a-747f-4304-95db-b331f2389d41-tls\") pod \"korrel8r-66d6f7f696-d9zpr\" (UID: \"ccf3318a-747f-4304-95db-b331f2389d41\") " pod="redhat-ods-monitoring/korrel8r-66d6f7f696-d9zpr"
Oct 30 21:28:21.561622 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:28:21.561594    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m8b9r\" (UniqueName: \"kubernetes.io/projected/ccf3318a-747f-4304-95db-b331f2389d41-kube-api-access-m8b9r\") pod \"korrel8r-66d6f7f696-d9zpr\" (UID: \"ccf3318a-747f-4304-95db-b331f2389d41\") " pod="redhat-ods-monitoring/korrel8r-66d6f7f696-d9zpr"
Oct 30 21:28:21.828133 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:28:21.828050    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/korrel8r-66d6f7f696-d9zpr"
Oct 30 21:28:22.202585 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:28:22.202560    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/korrel8r-66d6f7f696-d9zpr"]
Oct 30 21:28:22.204561 ip-10-0-142-4 kubenswrapper[4060]: W1030 21:28:22.204526    4060 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podccf3318a_747f_4304_95db_b331f2389d41.slice/crio-cfb42b7f36e8805289a7fe8a14686627203454f477800b71def908b226b29cc5 WatchSource:0}: Error finding container cfb42b7f36e8805289a7fe8a14686627203454f477800b71def908b226b29cc5: Status 404 returned error can't find the container with id cfb42b7f36e8805289a7fe8a14686627203454f477800b71def908b226b29cc5
Oct 30 21:28:22.950830 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:28:22.950784    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/korrel8r-66d6f7f696-d9zpr" event={"ID":"ccf3318a-747f-4304-95db-b331f2389d41","Type":"ContainerStarted","Data":"5693dee38ce248fda11358fe086bb9ab898c4eba866caf5464e985cb55862883"}
Oct 30 21:28:22.951485 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:28:22.950844    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/korrel8r-66d6f7f696-d9zpr" event={"ID":"ccf3318a-747f-4304-95db-b331f2389d41","Type":"ContainerStarted","Data":"cfb42b7f36e8805289a7fe8a14686627203454f477800b71def908b226b29cc5"}
Oct 30 21:28:22.951485 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:28:22.950980    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/korrel8r-66d6f7f696-d9zpr"
Oct 30 21:28:23.068535 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:28:23.068467    4060 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/korrel8r-66d6f7f696-d9zpr" podStartSLOduration=2.068451563 podStartE2EDuration="2.068451563s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:28:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:28:23.066368047 +0000 UTC m=+3121.823366345" watchObservedRunningTime="2026-10-30 21:28:23.068451563 +0000 UTC m=+3121.825449860"
Oct 30 21:28:31.377632 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:28:31.377593    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:28:31.378167 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:28:31.377838    4060 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-collector-0" podUID="9e5d7b4f-19a2-4f84-981f-0f523ef7dd95" containerName="otc-container" containerID="cri-o://47e18f5074c755c0826f1cf08634a78150f3269fe696449efae54620f63fa7e0" gracePeriod=30
Oct 30 21:28:33.725763 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:28:33.725737    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:28:33.797386 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:28:33.797307    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/9e5d7b4f-19a2-4f84-981f-0f523ef7dd95-tls-certs\" (UniqueName: \"kubernetes.io/secret/9e5d7b4f-19a2-4f84-981f-0f523ef7dd95-tls-certs\") pod \"9e5d7b4f-19a2-4f84-981f-0f523ef7dd95\" (UID: \"9e5d7b4f-19a2-4f84-981f-0f523ef7dd95\") "
Oct 30 21:28:33.797386 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:28:33.797341    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9e5d7b4f-19a2-4f84-981f-0f523ef7dd95-kube-api-access-gck9m\" (UniqueName: \"kubernetes.io/projected/9e5d7b4f-19a2-4f84-981f-0f523ef7dd95-kube-api-access-gck9m\") pod \"9e5d7b4f-19a2-4f84-981f-0f523ef7dd95\" (UID: \"9e5d7b4f-19a2-4f84-981f-0f523ef7dd95\") "
Oct 30 21:28:33.797386 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:28:33.797381    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/9e5d7b4f-19a2-4f84-981f-0f523ef7dd95-data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/9e5d7b4f-19a2-4f84-981f-0f523ef7dd95-data-science-collector-ta-client-cert\") pod \"9e5d7b4f-19a2-4f84-981f-0f523ef7dd95\" (UID: \"9e5d7b4f-19a2-4f84-981f-0f523ef7dd95\") "
Oct 30 21:28:33.797711 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:28:33.797415    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9e5d7b4f-19a2-4f84-981f-0f523ef7dd95-otc-internal\" (UniqueName: \"kubernetes.io/configmap/9e5d7b4f-19a2-4f84-981f-0f523ef7dd95-otc-internal\") pod \"9e5d7b4f-19a2-4f84-981f-0f523ef7dd95\" (UID: \"9e5d7b4f-19a2-4f84-981f-0f523ef7dd95\") "
Oct 30 21:28:33.797906 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:28:33.797872    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9e5d7b4f-19a2-4f84-981f-0f523ef7dd95-otc-internal" pod "9e5d7b4f-19a2-4f84-981f-0f523ef7dd95" (UID: "9e5d7b4f-19a2-4f84-981f-0f523ef7dd95"). InnerVolumeSpecName "otc-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:28:33.799639 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:28:33.799610    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9e5d7b4f-19a2-4f84-981f-0f523ef7dd95-data-science-collector-ta-client-cert" pod "9e5d7b4f-19a2-4f84-981f-0f523ef7dd95" (UID: "9e5d7b4f-19a2-4f84-981f-0f523ef7dd95"). InnerVolumeSpecName "data-science-collector-ta-client-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:28:33.799639 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:28:33.799623    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9e5d7b4f-19a2-4f84-981f-0f523ef7dd95-tls-certs" pod "9e5d7b4f-19a2-4f84-981f-0f523ef7dd95" (UID: "9e5d7b4f-19a2-4f84-981f-0f523ef7dd95"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:28:33.799959 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:28:33.799929    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e5d7b4f-19a2-4f84-981f-0f523ef7dd95-kube-api-access-gck9m" pod "9e5d7b4f-19a2-4f84-981f-0f523ef7dd95" (UID: "9e5d7b4f-19a2-4f84-981f-0f523ef7dd95"). InnerVolumeSpecName "kube-api-access-gck9m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:28:33.897891 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:28:33.897850    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/9e5d7b4f-19a2-4f84-981f-0f523ef7dd95-monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/9e5d7b4f-19a2-4f84-981f-0f523ef7dd95-monitoring-tls-certs\") pod \"9e5d7b4f-19a2-4f84-981f-0f523ef7dd95\" (UID: \"9e5d7b4f-19a2-4f84-981f-0f523ef7dd95\") "
Oct 30 21:28:33.898093 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:28:33.897907    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/9e5d7b4f-19a2-4f84-981f-0f523ef7dd95-otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/9e5d7b4f-19a2-4f84-981f-0f523ef7dd95-otlp-tls-certs\") pod \"9e5d7b4f-19a2-4f84-981f-0f523ef7dd95\" (UID: \"9e5d7b4f-19a2-4f84-981f-0f523ef7dd95\") "
Oct 30 21:28:33.898171 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:28:33.898133    4060 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9e5d7b4f-19a2-4f84-981f-0f523ef7dd95-tls-certs\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:28:33.898171 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:28:33.898155    4060 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gck9m\" (UniqueName: \"kubernetes.io/projected/9e5d7b4f-19a2-4f84-981f-0f523ef7dd95-kube-api-access-gck9m\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:28:33.898253 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:28:33.898172    4060 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/9e5d7b4f-19a2-4f84-981f-0f523ef7dd95-data-science-collector-ta-client-cert\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:28:33.898253 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:28:33.898186    4060 reconciler_common.go:299] "Volume detached for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/9e5d7b4f-19a2-4f84-981f-0f523ef7dd95-otc-internal\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:28:33.900016 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:28:33.899983    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9e5d7b4f-19a2-4f84-981f-0f523ef7dd95-otlp-tls-certs" pod "9e5d7b4f-19a2-4f84-981f-0f523ef7dd95" (UID: "9e5d7b4f-19a2-4f84-981f-0f523ef7dd95"). InnerVolumeSpecName "otlp-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:28:33.900016 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:28:33.900006    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9e5d7b4f-19a2-4f84-981f-0f523ef7dd95-monitoring-tls-certs" pod "9e5d7b4f-19a2-4f84-981f-0f523ef7dd95" (UID: "9e5d7b4f-19a2-4f84-981f-0f523ef7dd95"). InnerVolumeSpecName "monitoring-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:28:33.958063 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:28:33.958034    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/korrel8r-66d6f7f696-d9zpr"
Oct 30 21:28:33.998930 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:28:33.998897    4060 reconciler_common.go:299] "Volume detached for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/9e5d7b4f-19a2-4f84-981f-0f523ef7dd95-monitoring-tls-certs\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:28:33.998930 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:28:33.998923    4060 reconciler_common.go:299] "Volume detached for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/9e5d7b4f-19a2-4f84-981f-0f523ef7dd95-otlp-tls-certs\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:28:34.010849 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:28:34.010818    4060 generic.go:356] "Generic (PLEG): container finished" podID="9e5d7b4f-19a2-4f84-981f-0f523ef7dd95" containerID="47e18f5074c755c0826f1cf08634a78150f3269fe696449efae54620f63fa7e0" exitCode=0
Oct 30 21:28:34.011017 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:28:34.010974    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"9e5d7b4f-19a2-4f84-981f-0f523ef7dd95","Type":"ContainerDied","Data":"47e18f5074c755c0826f1cf08634a78150f3269fe696449efae54620f63fa7e0"}
Oct 30 21:28:34.011083 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:28:34.011053    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"9e5d7b4f-19a2-4f84-981f-0f523ef7dd95","Type":"ContainerDied","Data":"6eea19aabbfbd9373e162a57b6557ac0ba14d0b6981cbc67da4a856999a8563e"}
Oct 30 21:28:34.011133 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:28:34.011092    4060 scope.go:122] "RemoveContainer" containerID="47e18f5074c755c0826f1cf08634a78150f3269fe696449efae54620f63fa7e0"
Oct 30 21:28:34.013956 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:28:34.011273    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:28:34.021516 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:28:34.021483    4060 scope.go:122] "RemoveContainer" containerID="47e18f5074c755c0826f1cf08634a78150f3269fe696449efae54620f63fa7e0"
Oct 30 21:28:34.021778 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:28:34.021759    4060 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"47e18f5074c755c0826f1cf08634a78150f3269fe696449efae54620f63fa7e0\": container with ID starting with 47e18f5074c755c0826f1cf08634a78150f3269fe696449efae54620f63fa7e0 not found: ID does not exist" containerID="47e18f5074c755c0826f1cf08634a78150f3269fe696449efae54620f63fa7e0"
Oct 30 21:28:34.021832 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:28:34.021785    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"47e18f5074c755c0826f1cf08634a78150f3269fe696449efae54620f63fa7e0"} err="failed to get container status \"47e18f5074c755c0826f1cf08634a78150f3269fe696449efae54620f63fa7e0\": rpc error: code = NotFound desc = could not find container \"47e18f5074c755c0826f1cf08634a78150f3269fe696449efae54620f63fa7e0\": container with ID starting with 47e18f5074c755c0826f1cf08634a78150f3269fe696449efae54620f63fa7e0 not found: ID does not exist"
Oct 30 21:28:34.107683 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:28:34.107609    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/korrel8r-5cbcc89b8f-5nfvc"]
Oct 30 21:28:34.107864 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:28:34.107816    4060 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-5nfvc" podUID="0433e4cf-5e9a-4fac-aa4a-4b5fe8fbe5a0" containerName="korrel8r" containerID="cri-o://cf93d9f6a79be741fa7b5fc3b095cc27e264caf9df9b24a006d56bc5f7bb5be5" gracePeriod=30
Oct 30 21:28:34.188906 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:28:34.188875    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:28:34.194937 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:28:34.194912    4060 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:28:34.271073 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:28:34.271040    4060 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:28:34.271393 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:28:34.271376    4060 cpu_manager.go:414] "containerMap: removing container" podUID="9e5d7b4f-19a2-4f84-981f-0f523ef7dd95" containerName="otc-container"
Oct 30 21:28:34.271393 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:28:34.271390    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9e5d7b4f-19a2-4f84-981f-0f523ef7dd95" containerName="otc-container"
Oct 30 21:28:34.271567 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:28:34.271466    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="9e5d7b4f-19a2-4f84-981f-0f523ef7dd95" containerName="otc-container"
Oct 30 21:28:34.274428 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:28:34.274409    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:28:34.301545 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:28:34.301514    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/a28b6c8f-9b23-4276-960f-0718df7f331d-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-0\" (UID: \"a28b6c8f-9b23-4276-960f-0718df7f331d\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:28:34.301686 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:28:34.301557    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j26pj\" (UniqueName: \"kubernetes.io/projected/a28b6c8f-9b23-4276-960f-0718df7f331d-kube-api-access-j26pj\") pod \"data-science-collector-collector-0\" (UID: \"a28b6c8f-9b23-4276-960f-0718df7f331d\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:28:34.301686 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:28:34.301576    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/a28b6c8f-9b23-4276-960f-0718df7f331d-otc-internal\") pod \"data-science-collector-collector-0\" (UID: \"a28b6c8f-9b23-4276-960f-0718df7f331d\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:28:34.301686 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:28:34.301594    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/a28b6c8f-9b23-4276-960f-0718df7f331d-otlp-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"a28b6c8f-9b23-4276-960f-0718df7f331d\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:28:34.301686 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:28:34.301610    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a28b6c8f-9b23-4276-960f-0718df7f331d-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"a28b6c8f-9b23-4276-960f-0718df7f331d\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:28:34.301878 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:28:34.301772    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/a28b6c8f-9b23-4276-960f-0718df7f331d-monitoring-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"a28b6c8f-9b23-4276-960f-0718df7f331d\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:28:34.327122 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:28:34.327095    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-6d9d4583\""
Oct 30 21:28:34.327122 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:28:34.327092    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-ta-client-cert\""
Oct 30 21:28:34.327345 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:28:34.327132    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-tls\""
Oct 30 21:28:34.327345 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:28:34.327143    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-dockercfg-mpgx5\""
Oct 30 21:28:34.327345 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:28:34.327169    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-monitoring-tls\""
Oct 30 21:28:34.327345 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:28:34.327258    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-headless-tls\""
Oct 30 21:28:34.334731 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:28:34.334706    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:28:34.356403 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:28:34.356377    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-5nfvc"
Oct 30 21:28:34.402917 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:28:34.402835    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/0433e4cf-5e9a-4fac-aa4a-4b5fe8fbe5a0-tls\" (UniqueName: \"kubernetes.io/secret/0433e4cf-5e9a-4fac-aa4a-4b5fe8fbe5a0-tls\") pod \"0433e4cf-5e9a-4fac-aa4a-4b5fe8fbe5a0\" (UID: \"0433e4cf-5e9a-4fac-aa4a-4b5fe8fbe5a0\") "
Oct 30 21:28:34.402917 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:28:34.402907    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0433e4cf-5e9a-4fac-aa4a-4b5fe8fbe5a0-kube-api-access-k2vmc\" (UniqueName: \"kubernetes.io/projected/0433e4cf-5e9a-4fac-aa4a-4b5fe8fbe5a0-kube-api-access-k2vmc\") pod \"0433e4cf-5e9a-4fac-aa4a-4b5fe8fbe5a0\" (UID: \"0433e4cf-5e9a-4fac-aa4a-4b5fe8fbe5a0\") "
Oct 30 21:28:34.403100 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:28:34.402954    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/0433e4cf-5e9a-4fac-aa4a-4b5fe8fbe5a0-config\" (UniqueName: \"kubernetes.io/configmap/0433e4cf-5e9a-4fac-aa4a-4b5fe8fbe5a0-config\") pod \"0433e4cf-5e9a-4fac-aa4a-4b5fe8fbe5a0\" (UID: \"0433e4cf-5e9a-4fac-aa4a-4b5fe8fbe5a0\") "
Oct 30 21:28:34.403100 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:28:34.403063    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/a28b6c8f-9b23-4276-960f-0718df7f331d-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-0\" (UID: \"a28b6c8f-9b23-4276-960f-0718df7f331d\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:28:34.403100 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:28:34.403092    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j26pj\" (UniqueName: \"kubernetes.io/projected/a28b6c8f-9b23-4276-960f-0718df7f331d-kube-api-access-j26pj\") pod \"data-science-collector-collector-0\" (UID: \"a28b6c8f-9b23-4276-960f-0718df7f331d\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:28:34.403235 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:28:34.403109    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/a28b6c8f-9b23-4276-960f-0718df7f331d-otc-internal\") pod \"data-science-collector-collector-0\" (UID: \"a28b6c8f-9b23-4276-960f-0718df7f331d\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:28:34.403235 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:28:34.403132    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/a28b6c8f-9b23-4276-960f-0718df7f331d-otlp-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"a28b6c8f-9b23-4276-960f-0718df7f331d\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:28:34.403235 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:28:34.403160    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a28b6c8f-9b23-4276-960f-0718df7f331d-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"a28b6c8f-9b23-4276-960f-0718df7f331d\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:28:34.403235 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:28:34.403202    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/a28b6c8f-9b23-4276-960f-0718df7f331d-monitoring-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"a28b6c8f-9b23-4276-960f-0718df7f331d\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:28:34.403621 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:28:34.403587    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0433e4cf-5e9a-4fac-aa4a-4b5fe8fbe5a0-config" pod "0433e4cf-5e9a-4fac-aa4a-4b5fe8fbe5a0" (UID: "0433e4cf-5e9a-4fac-aa4a-4b5fe8fbe5a0"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:28:34.404115 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:28:34.404091    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/a28b6c8f-9b23-4276-960f-0718df7f331d-otc-internal\") pod \"data-science-collector-collector-0\" (UID: \"a28b6c8f-9b23-4276-960f-0718df7f331d\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:28:34.405544 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:28:34.405524    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0433e4cf-5e9a-4fac-aa4a-4b5fe8fbe5a0-kube-api-access-k2vmc" pod "0433e4cf-5e9a-4fac-aa4a-4b5fe8fbe5a0" (UID: "0433e4cf-5e9a-4fac-aa4a-4b5fe8fbe5a0"). InnerVolumeSpecName "kube-api-access-k2vmc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:28:34.405629 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:28:34.405556    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0433e4cf-5e9a-4fac-aa4a-4b5fe8fbe5a0-tls" pod "0433e4cf-5e9a-4fac-aa4a-4b5fe8fbe5a0" (UID: "0433e4cf-5e9a-4fac-aa4a-4b5fe8fbe5a0"). InnerVolumeSpecName "tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:28:34.406164 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:28:34.406143    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/a28b6c8f-9b23-4276-960f-0718df7f331d-otlp-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"a28b6c8f-9b23-4276-960f-0718df7f331d\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:28:34.406245 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:28:34.406149    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/a28b6c8f-9b23-4276-960f-0718df7f331d-monitoring-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"a28b6c8f-9b23-4276-960f-0718df7f331d\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:28:34.406322 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:28:34.406302    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a28b6c8f-9b23-4276-960f-0718df7f331d-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"a28b6c8f-9b23-4276-960f-0718df7f331d\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:28:34.406359 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:28:34.406329    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/a28b6c8f-9b23-4276-960f-0718df7f331d-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-0\" (UID: \"a28b6c8f-9b23-4276-960f-0718df7f331d\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:28:34.466957 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:28:34.466932    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j26pj\" (UniqueName: \"kubernetes.io/projected/a28b6c8f-9b23-4276-960f-0718df7f331d-kube-api-access-j26pj\") pod \"data-science-collector-collector-0\" (UID: \"a28b6c8f-9b23-4276-960f-0718df7f331d\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:28:34.503963 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:28:34.503938    4060 reconciler_common.go:299] "Volume detached for volume \"tls\" (UniqueName: \"kubernetes.io/secret/0433e4cf-5e9a-4fac-aa4a-4b5fe8fbe5a0-tls\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:28:34.503963 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:28:34.503964    4060 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k2vmc\" (UniqueName: \"kubernetes.io/projected/0433e4cf-5e9a-4fac-aa4a-4b5fe8fbe5a0-kube-api-access-k2vmc\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:28:34.504106 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:28:34.503974    4060 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0433e4cf-5e9a-4fac-aa4a-4b5fe8fbe5a0-config\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:28:34.589398 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:28:34.589370    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:28:35.010957 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:28:35.010933    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:28:35.012979 ip-10-0-142-4 kubenswrapper[4060]: W1030 21:28:35.012942    4060 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda28b6c8f_9b23_4276_960f_0718df7f331d.slice/crio-e4cb54cd4c1f0e6f70ae196a05be84e19e39227bb8ee9d9602203aa3ea57cb16 WatchSource:0}: Error finding container e4cb54cd4c1f0e6f70ae196a05be84e19e39227bb8ee9d9602203aa3ea57cb16: Status 404 returned error can't find the container with id e4cb54cd4c1f0e6f70ae196a05be84e19e39227bb8ee9d9602203aa3ea57cb16
Oct 30 21:28:35.015209 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:28:35.015180    4060 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 21:28:35.015301 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:28:35.015235    4060 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 21:28:35.016819 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:28:35.016797    4060 generic.go:356] "Generic (PLEG): container finished" podID="0433e4cf-5e9a-4fac-aa4a-4b5fe8fbe5a0" containerID="cf93d9f6a79be741fa7b5fc3b095cc27e264caf9df9b24a006d56bc5f7bb5be5" exitCode=0
Oct 30 21:28:35.016942 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:28:35.016918    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-5nfvc"
Oct 30 21:28:35.017006 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:28:35.016936    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-5nfvc" event={"ID":"0433e4cf-5e9a-4fac-aa4a-4b5fe8fbe5a0","Type":"ContainerDied","Data":"cf93d9f6a79be741fa7b5fc3b095cc27e264caf9df9b24a006d56bc5f7bb5be5"}
Oct 30 21:28:35.017006 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:28:35.016973    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-5nfvc" event={"ID":"0433e4cf-5e9a-4fac-aa4a-4b5fe8fbe5a0","Type":"ContainerDied","Data":"7b2c6821d02352e9b02bfba6bb232d742928e0889ea82f6a31f9c3007cb867f2"}
Oct 30 21:28:35.017006 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:28:35.017003    4060 scope.go:122] "RemoveContainer" containerID="cf93d9f6a79be741fa7b5fc3b095cc27e264caf9df9b24a006d56bc5f7bb5be5"
Oct 30 21:28:35.027433 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:28:35.027410    4060 scope.go:122] "RemoveContainer" containerID="cf93d9f6a79be741fa7b5fc3b095cc27e264caf9df9b24a006d56bc5f7bb5be5"
Oct 30 21:28:35.027726 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:28:35.027702    4060 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cf93d9f6a79be741fa7b5fc3b095cc27e264caf9df9b24a006d56bc5f7bb5be5\": container with ID starting with cf93d9f6a79be741fa7b5fc3b095cc27e264caf9df9b24a006d56bc5f7bb5be5 not found: ID does not exist" containerID="cf93d9f6a79be741fa7b5fc3b095cc27e264caf9df9b24a006d56bc5f7bb5be5"
Oct 30 21:28:35.027838 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:28:35.027736    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cf93d9f6a79be741fa7b5fc3b095cc27e264caf9df9b24a006d56bc5f7bb5be5"} err="failed to get container status \"cf93d9f6a79be741fa7b5fc3b095cc27e264caf9df9b24a006d56bc5f7bb5be5\": rpc error: code = NotFound desc = could not find container \"cf93d9f6a79be741fa7b5fc3b095cc27e264caf9df9b24a006d56bc5f7bb5be5\": container with ID starting with cf93d9f6a79be741fa7b5fc3b095cc27e264caf9df9b24a006d56bc5f7bb5be5 not found: ID does not exist"
Oct 30 21:28:35.180729 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:28:35.180683    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/korrel8r-5cbcc89b8f-5nfvc"]
Oct 30 21:28:35.186208 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:28:35.186183    4060 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/korrel8r-5cbcc89b8f-5nfvc"]
Oct 30 21:28:35.426759 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:28:35.426690    4060 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="0433e4cf-5e9a-4fac-aa4a-4b5fe8fbe5a0" path="/var/lib/kubelet/pods/0433e4cf-5e9a-4fac-aa4a-4b5fe8fbe5a0/volumes"
Oct 30 21:28:35.427074 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:28:35.427060    4060 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9e5d7b4f-19a2-4f84-981f-0f523ef7dd95" path="/var/lib/kubelet/pods/9e5d7b4f-19a2-4f84-981f-0f523ef7dd95/volumes"
Oct 30 21:28:36.027151 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:28:36.027121    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"a28b6c8f-9b23-4276-960f-0718df7f331d","Type":"ContainerStarted","Data":"b409d05bf09e763c31bc1613b7c6216b700b9e42cab870bd98fda62bc69aa1ab"}
Oct 30 21:28:36.027528 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:28:36.027175    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"a28b6c8f-9b23-4276-960f-0718df7f331d","Type":"ContainerStarted","Data":"e4cb54cd4c1f0e6f70ae196a05be84e19e39227bb8ee9d9602203aa3ea57cb16"}
Oct 30 21:28:36.146374 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:28:36.146322    4060 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-collector-0" podStartSLOduration=2.146308893 podStartE2EDuration="2.146308893s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:28:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:28:36.144323018 +0000 UTC m=+3134.901321354" watchObservedRunningTime="2026-10-30 21:28:36.146308893 +0000 UTC m=+3134.903307192"
Oct 30 21:28:42.149867 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:28:42.149831    4060 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v2f4x" containerName="extractor"
Oct 30 21:28:54.759438 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:28:54.759409    4060 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/korrel8r-5cbcc89b8f-rgpnk"]
Oct 30 21:28:54.759979 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:28:54.759810    4060 cpu_manager.go:414] "containerMap: removing container" podUID="0433e4cf-5e9a-4fac-aa4a-4b5fe8fbe5a0" containerName="korrel8r"
Oct 30 21:28:54.759979 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:28:54.759824    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0433e4cf-5e9a-4fac-aa4a-4b5fe8fbe5a0" containerName="korrel8r"
Oct 30 21:28:54.759979 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:28:54.759881    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="0433e4cf-5e9a-4fac-aa4a-4b5fe8fbe5a0" containerName="korrel8r"
Oct 30 21:28:54.762681 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:28:54.762665    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-rgpnk"
Oct 30 21:28:54.821961 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:28:54.821929    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/korrel8r-5cbcc89b8f-rgpnk"]
Oct 30 21:28:54.879658 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:28:54.879620    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/66c4d221-6627-4e5f-abba-6b49050d6eba-config\") pod \"korrel8r-5cbcc89b8f-rgpnk\" (UID: \"66c4d221-6627-4e5f-abba-6b49050d6eba\") " pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-rgpnk"
Oct 30 21:28:54.879823 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:28:54.879690    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/66c4d221-6627-4e5f-abba-6b49050d6eba-tls\") pod \"korrel8r-5cbcc89b8f-rgpnk\" (UID: \"66c4d221-6627-4e5f-abba-6b49050d6eba\") " pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-rgpnk"
Oct 30 21:28:54.879897 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:28:54.879818    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tprx5\" (UniqueName: \"kubernetes.io/projected/66c4d221-6627-4e5f-abba-6b49050d6eba-kube-api-access-tprx5\") pod \"korrel8r-5cbcc89b8f-rgpnk\" (UID: \"66c4d221-6627-4e5f-abba-6b49050d6eba\") " pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-rgpnk"
Oct 30 21:28:54.981123 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:28:54.981091    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/66c4d221-6627-4e5f-abba-6b49050d6eba-config\") pod \"korrel8r-5cbcc89b8f-rgpnk\" (UID: \"66c4d221-6627-4e5f-abba-6b49050d6eba\") " pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-rgpnk"
Oct 30 21:28:54.981300 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:28:54.981137    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/66c4d221-6627-4e5f-abba-6b49050d6eba-tls\") pod \"korrel8r-5cbcc89b8f-rgpnk\" (UID: \"66c4d221-6627-4e5f-abba-6b49050d6eba\") " pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-rgpnk"
Oct 30 21:28:54.981300 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:28:54.981173    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tprx5\" (UniqueName: \"kubernetes.io/projected/66c4d221-6627-4e5f-abba-6b49050d6eba-kube-api-access-tprx5\") pod \"korrel8r-5cbcc89b8f-rgpnk\" (UID: \"66c4d221-6627-4e5f-abba-6b49050d6eba\") " pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-rgpnk"
Oct 30 21:28:54.981938 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:28:54.981917    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/66c4d221-6627-4e5f-abba-6b49050d6eba-config\") pod \"korrel8r-5cbcc89b8f-rgpnk\" (UID: \"66c4d221-6627-4e5f-abba-6b49050d6eba\") " pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-rgpnk"
Oct 30 21:28:54.983620 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:28:54.983572    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls\" (UniqueName: \"kubernetes.io/secret/66c4d221-6627-4e5f-abba-6b49050d6eba-tls\") pod \"korrel8r-5cbcc89b8f-rgpnk\" (UID: \"66c4d221-6627-4e5f-abba-6b49050d6eba\") " pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-rgpnk"
Oct 30 21:28:55.042292 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:28:55.042227    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tprx5\" (UniqueName: \"kubernetes.io/projected/66c4d221-6627-4e5f-abba-6b49050d6eba-kube-api-access-tprx5\") pod \"korrel8r-5cbcc89b8f-rgpnk\" (UID: \"66c4d221-6627-4e5f-abba-6b49050d6eba\") " pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-rgpnk"
Oct 30 21:28:55.074324 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:28:55.074302    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-rgpnk"
Oct 30 21:28:55.445296 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:28:55.445275    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/korrel8r-5cbcc89b8f-rgpnk"]
Oct 30 21:28:55.447225 ip-10-0-142-4 kubenswrapper[4060]: W1030 21:28:55.447190    4060 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66c4d221_6627_4e5f_abba_6b49050d6eba.slice/crio-6ece4cb4417c87d8cbebebd34a8887e35dd72dfd78267861acc040820ab24ab9 WatchSource:0}: Error finding container 6ece4cb4417c87d8cbebebd34a8887e35dd72dfd78267861acc040820ab24ab9: Status 404 returned error can't find the container with id 6ece4cb4417c87d8cbebebd34a8887e35dd72dfd78267861acc040820ab24ab9
Oct 30 21:28:56.136601 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:28:56.136565    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-rgpnk" event={"ID":"66c4d221-6627-4e5f-abba-6b49050d6eba","Type":"ContainerStarted","Data":"ab6d9b603be51ccf9e9b8081becccae38469caf230d4679c682e5379179e4e03"}
Oct 30 21:28:56.136995 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:28:56.136621    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-rgpnk" event={"ID":"66c4d221-6627-4e5f-abba-6b49050d6eba","Type":"ContainerStarted","Data":"6ece4cb4417c87d8cbebebd34a8887e35dd72dfd78267861acc040820ab24ab9"}
Oct 30 21:28:56.136995 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:28:56.136664    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-rgpnk"
Oct 30 21:28:56.253856 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:28:56.253811    4060 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-rgpnk" podStartSLOduration=2.2537976459999998 podStartE2EDuration="2.253797646s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:28:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:28:56.252049735 +0000 UTC m=+3155.009048033" watchObservedRunningTime="2026-10-30 21:28:56.253797646 +0000 UTC m=+3155.010795943"
Oct 30 21:29:03.521036 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:03.521002    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:29:03.521523 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:03.521195    4060 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-collector-0" podUID="a28b6c8f-9b23-4276-960f-0718df7f331d" containerName="otc-container" containerID="cri-o://b409d05bf09e763c31bc1613b7c6216b700b9e42cab870bd98fda62bc69aa1ab" gracePeriod=30
Oct 30 21:29:05.872182 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:05.872161    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:29:05.978770 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:05.978742    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/a28b6c8f-9b23-4276-960f-0718df7f331d-data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/a28b6c8f-9b23-4276-960f-0718df7f331d-data-science-collector-ta-client-cert\") pod \"a28b6c8f-9b23-4276-960f-0718df7f331d\" (UID: \"a28b6c8f-9b23-4276-960f-0718df7f331d\") "
Oct 30 21:29:05.978962 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:05.978784    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a28b6c8f-9b23-4276-960f-0718df7f331d-kube-api-access-j26pj\" (UniqueName: \"kubernetes.io/projected/a28b6c8f-9b23-4276-960f-0718df7f331d-kube-api-access-j26pj\") pod \"a28b6c8f-9b23-4276-960f-0718df7f331d\" (UID: \"a28b6c8f-9b23-4276-960f-0718df7f331d\") "
Oct 30 21:29:05.978962 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:05.978808    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a28b6c8f-9b23-4276-960f-0718df7f331d-otc-internal\" (UniqueName: \"kubernetes.io/configmap/a28b6c8f-9b23-4276-960f-0718df7f331d-otc-internal\") pod \"a28b6c8f-9b23-4276-960f-0718df7f331d\" (UID: \"a28b6c8f-9b23-4276-960f-0718df7f331d\") "
Oct 30 21:29:05.978962 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:05.978840    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/a28b6c8f-9b23-4276-960f-0718df7f331d-otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/a28b6c8f-9b23-4276-960f-0718df7f331d-otlp-tls-certs\") pod \"a28b6c8f-9b23-4276-960f-0718df7f331d\" (UID: \"a28b6c8f-9b23-4276-960f-0718df7f331d\") "
Oct 30 21:29:05.978962 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:05.978860    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/a28b6c8f-9b23-4276-960f-0718df7f331d-tls-certs\" (UniqueName: \"kubernetes.io/secret/a28b6c8f-9b23-4276-960f-0718df7f331d-tls-certs\") pod \"a28b6c8f-9b23-4276-960f-0718df7f331d\" (UID: \"a28b6c8f-9b23-4276-960f-0718df7f331d\") "
Oct 30 21:29:05.978962 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:05.978920    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/a28b6c8f-9b23-4276-960f-0718df7f331d-monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/a28b6c8f-9b23-4276-960f-0718df7f331d-monitoring-tls-certs\") pod \"a28b6c8f-9b23-4276-960f-0718df7f331d\" (UID: \"a28b6c8f-9b23-4276-960f-0718df7f331d\") "
Oct 30 21:29:05.979246 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:05.979211    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a28b6c8f-9b23-4276-960f-0718df7f331d-otc-internal" pod "a28b6c8f-9b23-4276-960f-0718df7f331d" (UID: "a28b6c8f-9b23-4276-960f-0718df7f331d"). InnerVolumeSpecName "otc-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:29:05.981318 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:05.981290    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a28b6c8f-9b23-4276-960f-0718df7f331d-kube-api-access-j26pj" pod "a28b6c8f-9b23-4276-960f-0718df7f331d" (UID: "a28b6c8f-9b23-4276-960f-0718df7f331d"). InnerVolumeSpecName "kube-api-access-j26pj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:29:05.981554 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:05.981529    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a28b6c8f-9b23-4276-960f-0718df7f331d-monitoring-tls-certs" pod "a28b6c8f-9b23-4276-960f-0718df7f331d" (UID: "a28b6c8f-9b23-4276-960f-0718df7f331d"). InnerVolumeSpecName "monitoring-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:29:05.981822 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:05.981796    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a28b6c8f-9b23-4276-960f-0718df7f331d-tls-certs" pod "a28b6c8f-9b23-4276-960f-0718df7f331d" (UID: "a28b6c8f-9b23-4276-960f-0718df7f331d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:29:05.981905 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:05.981855    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a28b6c8f-9b23-4276-960f-0718df7f331d-otlp-tls-certs" pod "a28b6c8f-9b23-4276-960f-0718df7f331d" (UID: "a28b6c8f-9b23-4276-960f-0718df7f331d"). InnerVolumeSpecName "otlp-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:29:05.981905 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:05.981866    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a28b6c8f-9b23-4276-960f-0718df7f331d-data-science-collector-ta-client-cert" pod "a28b6c8f-9b23-4276-960f-0718df7f331d" (UID: "a28b6c8f-9b23-4276-960f-0718df7f331d"). InnerVolumeSpecName "data-science-collector-ta-client-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:29:06.079988 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:06.079952    4060 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/a28b6c8f-9b23-4276-960f-0718df7f331d-data-science-collector-ta-client-cert\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:29:06.079988 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:06.079980    4060 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j26pj\" (UniqueName: \"kubernetes.io/projected/a28b6c8f-9b23-4276-960f-0718df7f331d-kube-api-access-j26pj\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:29:06.079988 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:06.079993    4060 reconciler_common.go:299] "Volume detached for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/a28b6c8f-9b23-4276-960f-0718df7f331d-otc-internal\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:29:06.080295 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:06.080002    4060 reconciler_common.go:299] "Volume detached for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/a28b6c8f-9b23-4276-960f-0718df7f331d-otlp-tls-certs\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:29:06.080295 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:06.080011    4060 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a28b6c8f-9b23-4276-960f-0718df7f331d-tls-certs\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:29:06.080295 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:06.080019    4060 reconciler_common.go:299] "Volume detached for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/a28b6c8f-9b23-4276-960f-0718df7f331d-monitoring-tls-certs\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:29:06.186066 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:06.186030    4060 generic.go:356] "Generic (PLEG): container finished" podID="a28b6c8f-9b23-4276-960f-0718df7f331d" containerID="b409d05bf09e763c31bc1613b7c6216b700b9e42cab870bd98fda62bc69aa1ab" exitCode=0
Oct 30 21:29:06.186254 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:06.186093    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:29:06.186254 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:06.186111    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"a28b6c8f-9b23-4276-960f-0718df7f331d","Type":"ContainerDied","Data":"b409d05bf09e763c31bc1613b7c6216b700b9e42cab870bd98fda62bc69aa1ab"}
Oct 30 21:29:06.186254 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:06.186195    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"a28b6c8f-9b23-4276-960f-0718df7f331d","Type":"ContainerDied","Data":"e4cb54cd4c1f0e6f70ae196a05be84e19e39227bb8ee9d9602203aa3ea57cb16"}
Oct 30 21:29:06.186254 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:06.186222    4060 scope.go:122] "RemoveContainer" containerID="b409d05bf09e763c31bc1613b7c6216b700b9e42cab870bd98fda62bc69aa1ab"
Oct 30 21:29:06.195051 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:06.195036    4060 scope.go:122] "RemoveContainer" containerID="b409d05bf09e763c31bc1613b7c6216b700b9e42cab870bd98fda62bc69aa1ab"
Oct 30 21:29:06.195303 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:29:06.195286    4060 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b409d05bf09e763c31bc1613b7c6216b700b9e42cab870bd98fda62bc69aa1ab\": container with ID starting with b409d05bf09e763c31bc1613b7c6216b700b9e42cab870bd98fda62bc69aa1ab not found: ID does not exist" containerID="b409d05bf09e763c31bc1613b7c6216b700b9e42cab870bd98fda62bc69aa1ab"
Oct 30 21:29:06.195360 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:06.195315    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b409d05bf09e763c31bc1613b7c6216b700b9e42cab870bd98fda62bc69aa1ab"} err="failed to get container status \"b409d05bf09e763c31bc1613b7c6216b700b9e42cab870bd98fda62bc69aa1ab\": rpc error: code = NotFound desc = could not find container \"b409d05bf09e763c31bc1613b7c6216b700b9e42cab870bd98fda62bc69aa1ab\": container with ID starting with b409d05bf09e763c31bc1613b7c6216b700b9e42cab870bd98fda62bc69aa1ab not found: ID does not exist"
Oct 30 21:29:06.355313 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:06.355237    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:29:06.358815 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:06.358788    4060 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:29:06.434233 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:06.434205    4060 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:29:06.434586 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:06.434573    4060 cpu_manager.go:414] "containerMap: removing container" podUID="a28b6c8f-9b23-4276-960f-0718df7f331d" containerName="otc-container"
Oct 30 21:29:06.434648 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:06.434587    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a28b6c8f-9b23-4276-960f-0718df7f331d" containerName="otc-container"
Oct 30 21:29:06.434685 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:06.434662    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="a28b6c8f-9b23-4276-960f-0718df7f331d" containerName="otc-container"
Oct 30 21:29:06.439013 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:06.438994    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:29:06.491707 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:06.491680    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-monitoring-tls\""
Oct 30 21:29:06.491866 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:06.491776    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-a0f9182a\""
Oct 30 21:29:06.491866 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:06.491821    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-ta-client-cert\""
Oct 30 21:29:06.491866 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:06.491831    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-tls\""
Oct 30 21:29:06.491866 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:06.491852    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-dockercfg-mpgx5\""
Oct 30 21:29:06.492026 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:06.491887    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-headless-tls\""
Oct 30 21:29:06.515368 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:06.515343    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:29:06.584128 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:06.584099    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7hr58\" (UniqueName: \"kubernetes.io/projected/4a274dae-fde9-42cc-b24b-f205dc6a9c74-kube-api-access-7hr58\") pod \"data-science-collector-collector-0\" (UID: \"4a274dae-fde9-42cc-b24b-f205dc6a9c74\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:29:06.584293 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:06.584167    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/4a274dae-fde9-42cc-b24b-f205dc6a9c74-otlp-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"4a274dae-fde9-42cc-b24b-f205dc6a9c74\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:29:06.584293 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:06.584237    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/4a274dae-fde9-42cc-b24b-f205dc6a9c74-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-0\" (UID: \"4a274dae-fde9-42cc-b24b-f205dc6a9c74\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:29:06.584293 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:06.584272    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/4a274dae-fde9-42cc-b24b-f205dc6a9c74-otc-internal\") pod \"data-science-collector-collector-0\" (UID: \"4a274dae-fde9-42cc-b24b-f205dc6a9c74\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:29:06.584293 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:06.584292    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/4a274dae-fde9-42cc-b24b-f205dc6a9c74-monitoring-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"4a274dae-fde9-42cc-b24b-f205dc6a9c74\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:29:06.584508 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:06.584309    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4a274dae-fde9-42cc-b24b-f205dc6a9c74-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"4a274dae-fde9-42cc-b24b-f205dc6a9c74\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:29:06.685173 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:06.685101    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/4a274dae-fde9-42cc-b24b-f205dc6a9c74-otc-internal\") pod \"data-science-collector-collector-0\" (UID: \"4a274dae-fde9-42cc-b24b-f205dc6a9c74\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:29:06.685173 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:06.685134    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/4a274dae-fde9-42cc-b24b-f205dc6a9c74-monitoring-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"4a274dae-fde9-42cc-b24b-f205dc6a9c74\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:29:06.685173 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:06.685155    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4a274dae-fde9-42cc-b24b-f205dc6a9c74-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"4a274dae-fde9-42cc-b24b-f205dc6a9c74\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:29:06.685462 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:06.685186    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7hr58\" (UniqueName: \"kubernetes.io/projected/4a274dae-fde9-42cc-b24b-f205dc6a9c74-kube-api-access-7hr58\") pod \"data-science-collector-collector-0\" (UID: \"4a274dae-fde9-42cc-b24b-f205dc6a9c74\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:29:06.685462 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:06.685248    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/4a274dae-fde9-42cc-b24b-f205dc6a9c74-otlp-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"4a274dae-fde9-42cc-b24b-f205dc6a9c74\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:29:06.685462 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:06.685265    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/4a274dae-fde9-42cc-b24b-f205dc6a9c74-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-0\" (UID: \"4a274dae-fde9-42cc-b24b-f205dc6a9c74\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:29:06.685929 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:06.685898    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/4a274dae-fde9-42cc-b24b-f205dc6a9c74-otc-internal\") pod \"data-science-collector-collector-0\" (UID: \"4a274dae-fde9-42cc-b24b-f205dc6a9c74\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:29:06.688332 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:06.688307    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/4a274dae-fde9-42cc-b24b-f205dc6a9c74-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-0\" (UID: \"4a274dae-fde9-42cc-b24b-f205dc6a9c74\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:29:06.688427 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:06.688334    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/4a274dae-fde9-42cc-b24b-f205dc6a9c74-otlp-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"4a274dae-fde9-42cc-b24b-f205dc6a9c74\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:29:06.688427 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:06.688379    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4a274dae-fde9-42cc-b24b-f205dc6a9c74-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"4a274dae-fde9-42cc-b24b-f205dc6a9c74\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:29:06.688698 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:06.688683    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/4a274dae-fde9-42cc-b24b-f205dc6a9c74-monitoring-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"4a274dae-fde9-42cc-b24b-f205dc6a9c74\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:29:06.746851 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:06.746828    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7hr58\" (UniqueName: \"kubernetes.io/projected/4a274dae-fde9-42cc-b24b-f205dc6a9c74-kube-api-access-7hr58\") pod \"data-science-collector-collector-0\" (UID: \"4a274dae-fde9-42cc-b24b-f205dc6a9c74\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:29:06.751595 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:06.751580    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:29:07.123598 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:07.123572    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:29:07.125410 ip-10-0-142-4 kubenswrapper[4060]: W1030 21:29:07.125389    4060 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a274dae_fde9_42cc_b24b_f205dc6a9c74.slice/crio-ccfbd619db53e1b36fa674df92fb363408aeb1689038977f72c5debb4790ec8c WatchSource:0}: Error finding container ccfbd619db53e1b36fa674df92fb363408aeb1689038977f72c5debb4790ec8c: Status 404 returned error can't find the container with id ccfbd619db53e1b36fa674df92fb363408aeb1689038977f72c5debb4790ec8c
Oct 30 21:29:07.127502 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:07.127459    4060 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 21:29:07.127600 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:07.127535    4060 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 21:29:07.143886 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:07.143866    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-rgpnk"
Oct 30 21:29:07.199622 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:07.199596    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"4a274dae-fde9-42cc-b24b-f205dc6a9c74","Type":"ContainerStarted","Data":"935c0221d5b17775d3dc02f442a8b778738058fabd8e1fb0d7eea9c7336be520"}
Oct 30 21:29:07.199736 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:07.199651    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"4a274dae-fde9-42cc-b24b-f205dc6a9c74","Type":"ContainerStarted","Data":"ccfbd619db53e1b36fa674df92fb363408aeb1689038977f72c5debb4790ec8c"}
Oct 30 21:29:07.298179 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:07.298146    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/korrel8r-66d6f7f696-d9zpr"]
Oct 30 21:29:07.298614 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:07.298375    4060 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/korrel8r-66d6f7f696-d9zpr" podUID="ccf3318a-747f-4304-95db-b331f2389d41" containerName="korrel8r" containerID="cri-o://5693dee38ce248fda11358fe086bb9ab898c4eba866caf5464e985cb55862883" gracePeriod=30
Oct 30 21:29:07.381543 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:07.381433    4060 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-collector-0" podStartSLOduration=1.381419067 podStartE2EDuration="1.381419067s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:29:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:29:07.379730171 +0000 UTC m=+3166.136728470" watchObservedRunningTime="2026-10-30 21:29:07.381419067 +0000 UTC m=+3166.138417364"
Oct 30 21:29:07.428306 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:07.428274    4060 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a28b6c8f-9b23-4276-960f-0718df7f331d" path="/var/lib/kubelet/pods/a28b6c8f-9b23-4276-960f-0718df7f331d/volumes"
Oct 30 21:29:07.537635 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:07.537611    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/korrel8r-66d6f7f696-d9zpr"
Oct 30 21:29:07.694159 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:07.694087    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ccf3318a-747f-4304-95db-b331f2389d41-tls\" (UniqueName: \"kubernetes.io/secret/ccf3318a-747f-4304-95db-b331f2389d41-tls\") pod \"ccf3318a-747f-4304-95db-b331f2389d41\" (UID: \"ccf3318a-747f-4304-95db-b331f2389d41\") "
Oct 30 21:29:07.694159 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:07.694136    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ccf3318a-747f-4304-95db-b331f2389d41-config\" (UniqueName: \"kubernetes.io/configmap/ccf3318a-747f-4304-95db-b331f2389d41-config\") pod \"ccf3318a-747f-4304-95db-b331f2389d41\" (UID: \"ccf3318a-747f-4304-95db-b331f2389d41\") "
Oct 30 21:29:07.694385 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:07.694224    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ccf3318a-747f-4304-95db-b331f2389d41-kube-api-access-m8b9r\" (UniqueName: \"kubernetes.io/projected/ccf3318a-747f-4304-95db-b331f2389d41-kube-api-access-m8b9r\") pod \"ccf3318a-747f-4304-95db-b331f2389d41\" (UID: \"ccf3318a-747f-4304-95db-b331f2389d41\") "
Oct 30 21:29:07.694586 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:07.694557    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ccf3318a-747f-4304-95db-b331f2389d41-config" pod "ccf3318a-747f-4304-95db-b331f2389d41" (UID: "ccf3318a-747f-4304-95db-b331f2389d41"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:29:07.696244 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:07.696214    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ccf3318a-747f-4304-95db-b331f2389d41-tls" pod "ccf3318a-747f-4304-95db-b331f2389d41" (UID: "ccf3318a-747f-4304-95db-b331f2389d41"). InnerVolumeSpecName "tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:29:07.696367 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:07.696270    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ccf3318a-747f-4304-95db-b331f2389d41-kube-api-access-m8b9r" pod "ccf3318a-747f-4304-95db-b331f2389d41" (UID: "ccf3318a-747f-4304-95db-b331f2389d41"). InnerVolumeSpecName "kube-api-access-m8b9r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:29:07.795633 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:07.795600    4060 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m8b9r\" (UniqueName: \"kubernetes.io/projected/ccf3318a-747f-4304-95db-b331f2389d41-kube-api-access-m8b9r\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:29:07.795633 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:07.795629    4060 reconciler_common.go:299] "Volume detached for volume \"tls\" (UniqueName: \"kubernetes.io/secret/ccf3318a-747f-4304-95db-b331f2389d41-tls\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:29:07.795633 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:07.795639    4060 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ccf3318a-747f-4304-95db-b331f2389d41-config\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:29:08.205169 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:08.205137    4060 generic.go:356] "Generic (PLEG): container finished" podID="ccf3318a-747f-4304-95db-b331f2389d41" containerID="5693dee38ce248fda11358fe086bb9ab898c4eba866caf5464e985cb55862883" exitCode=0
Oct 30 21:29:08.205587 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:08.205181    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/korrel8r-66d6f7f696-d9zpr"
Oct 30 21:29:08.205587 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:08.205222    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/korrel8r-66d6f7f696-d9zpr" event={"ID":"ccf3318a-747f-4304-95db-b331f2389d41","Type":"ContainerDied","Data":"5693dee38ce248fda11358fe086bb9ab898c4eba866caf5464e985cb55862883"}
Oct 30 21:29:08.205587 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:08.205274    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/korrel8r-66d6f7f696-d9zpr" event={"ID":"ccf3318a-747f-4304-95db-b331f2389d41","Type":"ContainerDied","Data":"cfb42b7f36e8805289a7fe8a14686627203454f477800b71def908b226b29cc5"}
Oct 30 21:29:08.205587 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:08.205296    4060 scope.go:122] "RemoveContainer" containerID="5693dee38ce248fda11358fe086bb9ab898c4eba866caf5464e985cb55862883"
Oct 30 21:29:08.214414 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:08.214399    4060 scope.go:122] "RemoveContainer" containerID="5693dee38ce248fda11358fe086bb9ab898c4eba866caf5464e985cb55862883"
Oct 30 21:29:08.214710 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:29:08.214692    4060 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5693dee38ce248fda11358fe086bb9ab898c4eba866caf5464e985cb55862883\": container with ID starting with 5693dee38ce248fda11358fe086bb9ab898c4eba866caf5464e985cb55862883 not found: ID does not exist" containerID="5693dee38ce248fda11358fe086bb9ab898c4eba866caf5464e985cb55862883"
Oct 30 21:29:08.214763 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:08.214718    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5693dee38ce248fda11358fe086bb9ab898c4eba866caf5464e985cb55862883"} err="failed to get container status \"5693dee38ce248fda11358fe086bb9ab898c4eba866caf5464e985cb55862883\": rpc error: code = NotFound desc = could not find container \"5693dee38ce248fda11358fe086bb9ab898c4eba866caf5464e985cb55862883\": container with ID starting with 5693dee38ce248fda11358fe086bb9ab898c4eba866caf5464e985cb55862883 not found: ID does not exist"
Oct 30 21:29:08.380574 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:08.380544    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/korrel8r-66d6f7f696-d9zpr"]
Oct 30 21:29:08.430128 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:08.430101    4060 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/korrel8r-66d6f7f696-d9zpr"]
Oct 30 21:29:09.432064 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:09.432032    4060 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ccf3318a-747f-4304-95db-b331f2389d41" path="/var/lib/kubelet/pods/ccf3318a-747f-4304-95db-b331f2389d41/volumes"
Oct 30 21:29:12.149368 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:29:12.149336    4060 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v2f4x" containerName="extractor"
Oct 30 21:29:27.720113 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:27.720075    4060 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/korrel8r-66d6f7f696-nc8nk"]
Oct 30 21:29:27.720572 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:27.720408    4060 cpu_manager.go:414] "containerMap: removing container" podUID="ccf3318a-747f-4304-95db-b331f2389d41" containerName="korrel8r"
Oct 30 21:29:27.720572 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:27.720419    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ccf3318a-747f-4304-95db-b331f2389d41" containerName="korrel8r"
Oct 30 21:29:27.720572 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:27.720506    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="ccf3318a-747f-4304-95db-b331f2389d41" containerName="korrel8r"
Oct 30 21:29:27.723508 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:27.723474    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/korrel8r-66d6f7f696-nc8nk"
Oct 30 21:29:27.782910 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:27.782877    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/korrel8r-66d6f7f696-nc8nk"]
Oct 30 21:29:27.854919 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:27.854874    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/28b92edb-fc9c-4ff0-9374-959f013cd6c7-config\") pod \"korrel8r-66d6f7f696-nc8nk\" (UID: \"28b92edb-fc9c-4ff0-9374-959f013cd6c7\") " pod="redhat-ods-monitoring/korrel8r-66d6f7f696-nc8nk"
Oct 30 21:29:27.854919 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:27.854920    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rtbq6\" (UniqueName: \"kubernetes.io/projected/28b92edb-fc9c-4ff0-9374-959f013cd6c7-kube-api-access-rtbq6\") pod \"korrel8r-66d6f7f696-nc8nk\" (UID: \"28b92edb-fc9c-4ff0-9374-959f013cd6c7\") " pod="redhat-ods-monitoring/korrel8r-66d6f7f696-nc8nk"
Oct 30 21:29:27.855129 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:27.855063    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/28b92edb-fc9c-4ff0-9374-959f013cd6c7-tls\") pod \"korrel8r-66d6f7f696-nc8nk\" (UID: \"28b92edb-fc9c-4ff0-9374-959f013cd6c7\") " pod="redhat-ods-monitoring/korrel8r-66d6f7f696-nc8nk"
Oct 30 21:29:27.956323 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:27.956290    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/28b92edb-fc9c-4ff0-9374-959f013cd6c7-config\") pod \"korrel8r-66d6f7f696-nc8nk\" (UID: \"28b92edb-fc9c-4ff0-9374-959f013cd6c7\") " pod="redhat-ods-monitoring/korrel8r-66d6f7f696-nc8nk"
Oct 30 21:29:27.956323 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:27.956324    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rtbq6\" (UniqueName: \"kubernetes.io/projected/28b92edb-fc9c-4ff0-9374-959f013cd6c7-kube-api-access-rtbq6\") pod \"korrel8r-66d6f7f696-nc8nk\" (UID: \"28b92edb-fc9c-4ff0-9374-959f013cd6c7\") " pod="redhat-ods-monitoring/korrel8r-66d6f7f696-nc8nk"
Oct 30 21:29:27.956574 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:27.956370    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/28b92edb-fc9c-4ff0-9374-959f013cd6c7-tls\") pod \"korrel8r-66d6f7f696-nc8nk\" (UID: \"28b92edb-fc9c-4ff0-9374-959f013cd6c7\") " pod="redhat-ods-monitoring/korrel8r-66d6f7f696-nc8nk"
Oct 30 21:29:27.957200 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:27.957180    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/28b92edb-fc9c-4ff0-9374-959f013cd6c7-config\") pod \"korrel8r-66d6f7f696-nc8nk\" (UID: \"28b92edb-fc9c-4ff0-9374-959f013cd6c7\") " pod="redhat-ods-monitoring/korrel8r-66d6f7f696-nc8nk"
Oct 30 21:29:27.958754 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:27.958737    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls\" (UniqueName: \"kubernetes.io/secret/28b92edb-fc9c-4ff0-9374-959f013cd6c7-tls\") pod \"korrel8r-66d6f7f696-nc8nk\" (UID: \"28b92edb-fc9c-4ff0-9374-959f013cd6c7\") " pod="redhat-ods-monitoring/korrel8r-66d6f7f696-nc8nk"
Oct 30 21:29:28.017729 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:28.017666    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rtbq6\" (UniqueName: \"kubernetes.io/projected/28b92edb-fc9c-4ff0-9374-959f013cd6c7-kube-api-access-rtbq6\") pod \"korrel8r-66d6f7f696-nc8nk\" (UID: \"28b92edb-fc9c-4ff0-9374-959f013cd6c7\") " pod="redhat-ods-monitoring/korrel8r-66d6f7f696-nc8nk"
Oct 30 21:29:28.035496 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:28.035475    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/korrel8r-66d6f7f696-nc8nk"
Oct 30 21:29:28.405564 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:28.405539    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/korrel8r-66d6f7f696-nc8nk"]
Oct 30 21:29:28.407778 ip-10-0-142-4 kubenswrapper[4060]: W1030 21:29:28.407746    4060 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28b92edb_fc9c_4ff0_9374_959f013cd6c7.slice/crio-61d5d59f98b7c6018725c6fc409469a5534d254478864465135227d318f87e70 WatchSource:0}: Error finding container 61d5d59f98b7c6018725c6fc409469a5534d254478864465135227d318f87e70: Status 404 returned error can't find the container with id 61d5d59f98b7c6018725c6fc409469a5534d254478864465135227d318f87e70
Oct 30 21:29:29.305669 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:29.305628    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/korrel8r-66d6f7f696-nc8nk" event={"ID":"28b92edb-fc9c-4ff0-9374-959f013cd6c7","Type":"ContainerStarted","Data":"fd1ed1b948446c9a6316697a0bcbd756e0c1f331d78849eb23613613ae7e2b19"}
Oct 30 21:29:29.306044 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:29.305692    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/korrel8r-66d6f7f696-nc8nk" event={"ID":"28b92edb-fc9c-4ff0-9374-959f013cd6c7","Type":"ContainerStarted","Data":"61d5d59f98b7c6018725c6fc409469a5534d254478864465135227d318f87e70"}
Oct 30 21:29:29.306044 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:29.305749    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/korrel8r-66d6f7f696-nc8nk"
Oct 30 21:29:29.422199 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:29.422150    4060 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/korrel8r-66d6f7f696-nc8nk" podStartSLOduration=2.422136679 podStartE2EDuration="2.422136679s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:29:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:29:29.420372548 +0000 UTC m=+3188.177370846" watchObservedRunningTime="2026-10-30 21:29:29.422136679 +0000 UTC m=+3188.179134976"
Oct 30 21:29:37.690725 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:37.690647    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:29:37.691268 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:37.690883    4060 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-collector-0" podUID="4a274dae-fde9-42cc-b24b-f205dc6a9c74" containerName="otc-container" containerID="cri-o://935c0221d5b17775d3dc02f442a8b778738058fabd8e1fb0d7eea9c7336be520" gracePeriod=30
Oct 30 21:29:40.039101 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:40.039074    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:29:40.058249 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:40.058215    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/4a274dae-fde9-42cc-b24b-f205dc6a9c74-otc-internal\" (UniqueName: \"kubernetes.io/configmap/4a274dae-fde9-42cc-b24b-f205dc6a9c74-otc-internal\") pod \"4a274dae-fde9-42cc-b24b-f205dc6a9c74\" (UID: \"4a274dae-fde9-42cc-b24b-f205dc6a9c74\") "
Oct 30 21:29:40.058249 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:40.058258    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/4a274dae-fde9-42cc-b24b-f205dc6a9c74-tls-certs\" (UniqueName: \"kubernetes.io/secret/4a274dae-fde9-42cc-b24b-f205dc6a9c74-tls-certs\") pod \"4a274dae-fde9-42cc-b24b-f205dc6a9c74\" (UID: \"4a274dae-fde9-42cc-b24b-f205dc6a9c74\") "
Oct 30 21:29:40.058422 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:40.058291    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/4a274dae-fde9-42cc-b24b-f205dc6a9c74-monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/4a274dae-fde9-42cc-b24b-f205dc6a9c74-monitoring-tls-certs\") pod \"4a274dae-fde9-42cc-b24b-f205dc6a9c74\" (UID: \"4a274dae-fde9-42cc-b24b-f205dc6a9c74\") "
Oct 30 21:29:40.058422 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:40.058344    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/4a274dae-fde9-42cc-b24b-f205dc6a9c74-otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/4a274dae-fde9-42cc-b24b-f205dc6a9c74-otlp-tls-certs\") pod \"4a274dae-fde9-42cc-b24b-f205dc6a9c74\" (UID: \"4a274dae-fde9-42cc-b24b-f205dc6a9c74\") "
Oct 30 21:29:40.058422 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:40.058374    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4a274dae-fde9-42cc-b24b-f205dc6a9c74-kube-api-access-7hr58\" (UniqueName: \"kubernetes.io/projected/4a274dae-fde9-42cc-b24b-f205dc6a9c74-kube-api-access-7hr58\") pod \"4a274dae-fde9-42cc-b24b-f205dc6a9c74\" (UID: \"4a274dae-fde9-42cc-b24b-f205dc6a9c74\") "
Oct 30 21:29:40.058612 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:40.058421    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/4a274dae-fde9-42cc-b24b-f205dc6a9c74-data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/4a274dae-fde9-42cc-b24b-f205dc6a9c74-data-science-collector-ta-client-cert\") pod \"4a274dae-fde9-42cc-b24b-f205dc6a9c74\" (UID: \"4a274dae-fde9-42cc-b24b-f205dc6a9c74\") "
Oct 30 21:29:40.058682 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:40.058633    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4a274dae-fde9-42cc-b24b-f205dc6a9c74-otc-internal" pod "4a274dae-fde9-42cc-b24b-f205dc6a9c74" (UID: "4a274dae-fde9-42cc-b24b-f205dc6a9c74"). InnerVolumeSpecName "otc-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:29:40.058748 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:40.058732    4060 reconciler_common.go:299] "Volume detached for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/4a274dae-fde9-42cc-b24b-f205dc6a9c74-otc-internal\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:29:40.060583 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:40.060471    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4a274dae-fde9-42cc-b24b-f205dc6a9c74-monitoring-tls-certs" pod "4a274dae-fde9-42cc-b24b-f205dc6a9c74" (UID: "4a274dae-fde9-42cc-b24b-f205dc6a9c74"). InnerVolumeSpecName "monitoring-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:29:40.060583 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:40.060540    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4a274dae-fde9-42cc-b24b-f205dc6a9c74-otlp-tls-certs" pod "4a274dae-fde9-42cc-b24b-f205dc6a9c74" (UID: "4a274dae-fde9-42cc-b24b-f205dc6a9c74"). InnerVolumeSpecName "otlp-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:29:40.060766 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:40.060726    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4a274dae-fde9-42cc-b24b-f205dc6a9c74-tls-certs" pod "4a274dae-fde9-42cc-b24b-f205dc6a9c74" (UID: "4a274dae-fde9-42cc-b24b-f205dc6a9c74"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:29:40.060963 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:40.060944    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4a274dae-fde9-42cc-b24b-f205dc6a9c74-data-science-collector-ta-client-cert" pod "4a274dae-fde9-42cc-b24b-f205dc6a9c74" (UID: "4a274dae-fde9-42cc-b24b-f205dc6a9c74"). InnerVolumeSpecName "data-science-collector-ta-client-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:29:40.061024 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:40.060975    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4a274dae-fde9-42cc-b24b-f205dc6a9c74-kube-api-access-7hr58" pod "4a274dae-fde9-42cc-b24b-f205dc6a9c74" (UID: "4a274dae-fde9-42cc-b24b-f205dc6a9c74"). InnerVolumeSpecName "kube-api-access-7hr58". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:29:40.159430 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:40.159352    4060 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/4a274dae-fde9-42cc-b24b-f205dc6a9c74-data-science-collector-ta-client-cert\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:29:40.159430 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:40.159387    4060 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4a274dae-fde9-42cc-b24b-f205dc6a9c74-tls-certs\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:29:40.159430 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:40.159404    4060 reconciler_common.go:299] "Volume detached for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/4a274dae-fde9-42cc-b24b-f205dc6a9c74-monitoring-tls-certs\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:29:40.159430 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:40.159418    4060 reconciler_common.go:299] "Volume detached for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/4a274dae-fde9-42cc-b24b-f205dc6a9c74-otlp-tls-certs\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:29:40.159706 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:40.159433    4060 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7hr58\" (UniqueName: \"kubernetes.io/projected/4a274dae-fde9-42cc-b24b-f205dc6a9c74-kube-api-access-7hr58\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:29:40.313225 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:40.313198    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/korrel8r-66d6f7f696-nc8nk"
Oct 30 21:29:40.366063 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:40.366036    4060 generic.go:356] "Generic (PLEG): container finished" podID="4a274dae-fde9-42cc-b24b-f205dc6a9c74" containerID="935c0221d5b17775d3dc02f442a8b778738058fabd8e1fb0d7eea9c7336be520" exitCode=0
Oct 30 21:29:40.366233 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:40.366096    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:29:40.366233 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:40.366098    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"4a274dae-fde9-42cc-b24b-f205dc6a9c74","Type":"ContainerDied","Data":"935c0221d5b17775d3dc02f442a8b778738058fabd8e1fb0d7eea9c7336be520"}
Oct 30 21:29:40.366233 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:40.366221    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"4a274dae-fde9-42cc-b24b-f205dc6a9c74","Type":"ContainerDied","Data":"ccfbd619db53e1b36fa674df92fb363408aeb1689038977f72c5debb4790ec8c"}
Oct 30 21:29:40.366357 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:40.366245    4060 scope.go:122] "RemoveContainer" containerID="935c0221d5b17775d3dc02f442a8b778738058fabd8e1fb0d7eea9c7336be520"
Oct 30 21:29:40.375016 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:40.374992    4060 scope.go:122] "RemoveContainer" containerID="935c0221d5b17775d3dc02f442a8b778738058fabd8e1fb0d7eea9c7336be520"
Oct 30 21:29:40.375295 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:29:40.375273    4060 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"935c0221d5b17775d3dc02f442a8b778738058fabd8e1fb0d7eea9c7336be520\": container with ID starting with 935c0221d5b17775d3dc02f442a8b778738058fabd8e1fb0d7eea9c7336be520 not found: ID does not exist" containerID="935c0221d5b17775d3dc02f442a8b778738058fabd8e1fb0d7eea9c7336be520"
Oct 30 21:29:40.375370 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:40.375306    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"935c0221d5b17775d3dc02f442a8b778738058fabd8e1fb0d7eea9c7336be520"} err="failed to get container status \"935c0221d5b17775d3dc02f442a8b778738058fabd8e1fb0d7eea9c7336be520\": rpc error: code = NotFound desc = could not find container \"935c0221d5b17775d3dc02f442a8b778738058fabd8e1fb0d7eea9c7336be520\": container with ID starting with 935c0221d5b17775d3dc02f442a8b778738058fabd8e1fb0d7eea9c7336be520 not found: ID does not exist"
Oct 30 21:29:40.460751 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:40.460718    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/korrel8r-5cbcc89b8f-rgpnk"]
Oct 30 21:29:40.461272 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:40.461016    4060 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-rgpnk" podUID="66c4d221-6627-4e5f-abba-6b49050d6eba" containerName="korrel8r" containerID="cri-o://ab6d9b603be51ccf9e9b8081becccae38469caf230d4679c682e5379179e4e03" gracePeriod=30
Oct 30 21:29:40.541697 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:40.541667    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:29:40.546355 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:40.546328    4060 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:29:40.622237 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:40.622197    4060 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:29:40.622589 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:40.622571    4060 cpu_manager.go:414] "containerMap: removing container" podUID="4a274dae-fde9-42cc-b24b-f205dc6a9c74" containerName="otc-container"
Oct 30 21:29:40.622589 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:40.622587    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4a274dae-fde9-42cc-b24b-f205dc6a9c74" containerName="otc-container"
Oct 30 21:29:40.622756 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:40.622671    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="4a274dae-fde9-42cc-b24b-f205dc6a9c74" containerName="otc-container"
Oct 30 21:29:40.625797 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:40.625777    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:29:40.663793 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:40.663761    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/aaeeb8c4-701f-4be3-9f5f-67dc592bb294-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-0\" (UID: \"aaeeb8c4-701f-4be3-9f5f-67dc592bb294\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:29:40.663964 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:40.663816    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/aaeeb8c4-701f-4be3-9f5f-67dc592bb294-otc-internal\") pod \"data-science-collector-collector-0\" (UID: \"aaeeb8c4-701f-4be3-9f5f-67dc592bb294\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:29:40.663964 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:40.663834    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/aaeeb8c4-701f-4be3-9f5f-67dc592bb294-otlp-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"aaeeb8c4-701f-4be3-9f5f-67dc592bb294\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:29:40.663964 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:40.663861    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/aaeeb8c4-701f-4be3-9f5f-67dc592bb294-monitoring-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"aaeeb8c4-701f-4be3-9f5f-67dc592bb294\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:29:40.663964 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:40.663874    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aaeeb8c4-701f-4be3-9f5f-67dc592bb294-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"aaeeb8c4-701f-4be3-9f5f-67dc592bb294\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:29:40.663964 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:40.663899    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4sd2h\" (UniqueName: \"kubernetes.io/projected/aaeeb8c4-701f-4be3-9f5f-67dc592bb294-kube-api-access-4sd2h\") pod \"data-science-collector-collector-0\" (UID: \"aaeeb8c4-701f-4be3-9f5f-67dc592bb294\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:29:40.678300 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:40.678276    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-6d9d4583\""
Oct 30 21:29:40.678471 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:40.678450    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-ta-client-cert\""
Oct 30 21:29:40.678569 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:40.678451    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-monitoring-tls\""
Oct 30 21:29:40.678569 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:40.678475    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-dockercfg-mpgx5\""
Oct 30 21:29:40.678569 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:40.678451    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-headless-tls\""
Oct 30 21:29:40.678569 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:40.678536    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-tls\""
Oct 30 21:29:40.688416 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:40.688394    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:29:40.700589 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:40.700569    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-rgpnk"
Oct 30 21:29:40.765094 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:40.765014    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/66c4d221-6627-4e5f-abba-6b49050d6eba-kube-api-access-tprx5\" (UniqueName: \"kubernetes.io/projected/66c4d221-6627-4e5f-abba-6b49050d6eba-kube-api-access-tprx5\") pod \"66c4d221-6627-4e5f-abba-6b49050d6eba\" (UID: \"66c4d221-6627-4e5f-abba-6b49050d6eba\") "
Oct 30 21:29:40.765094 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:40.765060    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/66c4d221-6627-4e5f-abba-6b49050d6eba-tls\" (UniqueName: \"kubernetes.io/secret/66c4d221-6627-4e5f-abba-6b49050d6eba-tls\") pod \"66c4d221-6627-4e5f-abba-6b49050d6eba\" (UID: \"66c4d221-6627-4e5f-abba-6b49050d6eba\") "
Oct 30 21:29:40.765094 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:40.765093    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/66c4d221-6627-4e5f-abba-6b49050d6eba-config\" (UniqueName: \"kubernetes.io/configmap/66c4d221-6627-4e5f-abba-6b49050d6eba-config\") pod \"66c4d221-6627-4e5f-abba-6b49050d6eba\" (UID: \"66c4d221-6627-4e5f-abba-6b49050d6eba\") "
Oct 30 21:29:40.765370 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:40.765183    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/aaeeb8c4-701f-4be3-9f5f-67dc592bb294-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-0\" (UID: \"aaeeb8c4-701f-4be3-9f5f-67dc592bb294\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:29:40.765370 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:40.765247    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/aaeeb8c4-701f-4be3-9f5f-67dc592bb294-otc-internal\") pod \"data-science-collector-collector-0\" (UID: \"aaeeb8c4-701f-4be3-9f5f-67dc592bb294\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:29:40.765370 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:40.765276    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/aaeeb8c4-701f-4be3-9f5f-67dc592bb294-otlp-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"aaeeb8c4-701f-4be3-9f5f-67dc592bb294\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:29:40.765370 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:40.765324    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/aaeeb8c4-701f-4be3-9f5f-67dc592bb294-monitoring-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"aaeeb8c4-701f-4be3-9f5f-67dc592bb294\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:29:40.765370 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:40.765345    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aaeeb8c4-701f-4be3-9f5f-67dc592bb294-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"aaeeb8c4-701f-4be3-9f5f-67dc592bb294\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:29:40.765672 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:40.765385    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4sd2h\" (UniqueName: \"kubernetes.io/projected/aaeeb8c4-701f-4be3-9f5f-67dc592bb294-kube-api-access-4sd2h\") pod \"data-science-collector-collector-0\" (UID: \"aaeeb8c4-701f-4be3-9f5f-67dc592bb294\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:29:40.765672 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:40.765642    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/66c4d221-6627-4e5f-abba-6b49050d6eba-config" pod "66c4d221-6627-4e5f-abba-6b49050d6eba" (UID: "66c4d221-6627-4e5f-abba-6b49050d6eba"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:29:40.766083 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:40.766027    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/aaeeb8c4-701f-4be3-9f5f-67dc592bb294-otc-internal\") pod \"data-science-collector-collector-0\" (UID: \"aaeeb8c4-701f-4be3-9f5f-67dc592bb294\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:29:40.767696 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:40.767670    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/66c4d221-6627-4e5f-abba-6b49050d6eba-kube-api-access-tprx5" pod "66c4d221-6627-4e5f-abba-6b49050d6eba" (UID: "66c4d221-6627-4e5f-abba-6b49050d6eba"). InnerVolumeSpecName "kube-api-access-tprx5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:29:40.767910 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:40.767888    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/66c4d221-6627-4e5f-abba-6b49050d6eba-tls" pod "66c4d221-6627-4e5f-abba-6b49050d6eba" (UID: "66c4d221-6627-4e5f-abba-6b49050d6eba"). InnerVolumeSpecName "tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:29:40.768059 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:40.768032    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/aaeeb8c4-701f-4be3-9f5f-67dc592bb294-otlp-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"aaeeb8c4-701f-4be3-9f5f-67dc592bb294\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:29:40.768429 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:40.768406    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aaeeb8c4-701f-4be3-9f5f-67dc592bb294-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"aaeeb8c4-701f-4be3-9f5f-67dc592bb294\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:29:40.768429 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:40.768409    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/aaeeb8c4-701f-4be3-9f5f-67dc592bb294-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-0\" (UID: \"aaeeb8c4-701f-4be3-9f5f-67dc592bb294\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:29:40.768593 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:40.768538    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/aaeeb8c4-701f-4be3-9f5f-67dc592bb294-monitoring-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"aaeeb8c4-701f-4be3-9f5f-67dc592bb294\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:29:40.825838 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:40.825813    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4sd2h\" (UniqueName: \"kubernetes.io/projected/aaeeb8c4-701f-4be3-9f5f-67dc592bb294-kube-api-access-4sd2h\") pod \"data-science-collector-collector-0\" (UID: \"aaeeb8c4-701f-4be3-9f5f-67dc592bb294\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:29:40.866786 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:40.866757    4060 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tprx5\" (UniqueName: \"kubernetes.io/projected/66c4d221-6627-4e5f-abba-6b49050d6eba-kube-api-access-tprx5\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:29:40.866786 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:40.866778    4060 reconciler_common.go:299] "Volume detached for volume \"tls\" (UniqueName: \"kubernetes.io/secret/66c4d221-6627-4e5f-abba-6b49050d6eba-tls\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:29:40.866786 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:40.866790    4060 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/66c4d221-6627-4e5f-abba-6b49050d6eba-config\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:29:40.941633 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:40.941605    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:29:41.313048 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:41.313026    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:29:41.315390 ip-10-0-142-4 kubenswrapper[4060]: W1030 21:29:41.315357    4060 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaaeeb8c4_701f_4be3_9f5f_67dc592bb294.slice/crio-03c725b1a83ef9ab3fc0d04ed7df4b148867016421244e41d2a91573a53a5f21 WatchSource:0}: Error finding container 03c725b1a83ef9ab3fc0d04ed7df4b148867016421244e41d2a91573a53a5f21: Status 404 returned error can't find the container with id 03c725b1a83ef9ab3fc0d04ed7df4b148867016421244e41d2a91573a53a5f21
Oct 30 21:29:41.317459 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:41.317425    4060 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 21:29:41.317594 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:41.317518    4060 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 21:29:41.372558 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:41.372527    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"aaeeb8c4-701f-4be3-9f5f-67dc592bb294","Type":"ContainerStarted","Data":"38159d2e6fa19ad34ce465fba2e9aae975ba115b778d95e546e2bca0b63cc08a"}
Oct 30 21:29:41.372677 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:41.372581    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"aaeeb8c4-701f-4be3-9f5f-67dc592bb294","Type":"ContainerStarted","Data":"03c725b1a83ef9ab3fc0d04ed7df4b148867016421244e41d2a91573a53a5f21"}
Oct 30 21:29:41.373793 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:41.373772    4060 generic.go:356] "Generic (PLEG): container finished" podID="66c4d221-6627-4e5f-abba-6b49050d6eba" containerID="ab6d9b603be51ccf9e9b8081becccae38469caf230d4679c682e5379179e4e03" exitCode=0
Oct 30 21:29:41.373883 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:41.373811    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-rgpnk"
Oct 30 21:29:41.373883 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:41.373850    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-rgpnk" event={"ID":"66c4d221-6627-4e5f-abba-6b49050d6eba","Type":"ContainerDied","Data":"ab6d9b603be51ccf9e9b8081becccae38469caf230d4679c682e5379179e4e03"}
Oct 30 21:29:41.374003 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:41.373895    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-rgpnk" event={"ID":"66c4d221-6627-4e5f-abba-6b49050d6eba","Type":"ContainerDied","Data":"6ece4cb4417c87d8cbebebd34a8887e35dd72dfd78267861acc040820ab24ab9"}
Oct 30 21:29:41.374003 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:41.373919    4060 scope.go:122] "RemoveContainer" containerID="ab6d9b603be51ccf9e9b8081becccae38469caf230d4679c682e5379179e4e03"
Oct 30 21:29:41.382014 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:41.381984    4060 scope.go:122] "RemoveContainer" containerID="ab6d9b603be51ccf9e9b8081becccae38469caf230d4679c682e5379179e4e03"
Oct 30 21:29:41.382292 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:29:41.382271    4060 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ab6d9b603be51ccf9e9b8081becccae38469caf230d4679c682e5379179e4e03\": container with ID starting with ab6d9b603be51ccf9e9b8081becccae38469caf230d4679c682e5379179e4e03 not found: ID does not exist" containerID="ab6d9b603be51ccf9e9b8081becccae38469caf230d4679c682e5379179e4e03"
Oct 30 21:29:41.382398 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:41.382298    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab6d9b603be51ccf9e9b8081becccae38469caf230d4679c682e5379179e4e03"} err="failed to get container status \"ab6d9b603be51ccf9e9b8081becccae38469caf230d4679c682e5379179e4e03\": rpc error: code = NotFound desc = could not find container \"ab6d9b603be51ccf9e9b8081becccae38469caf230d4679c682e5379179e4e03\": container with ID starting with ab6d9b603be51ccf9e9b8081becccae38469caf230d4679c682e5379179e4e03 not found: ID does not exist"
Oct 30 21:29:41.427231 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:41.427198    4060 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="4a274dae-fde9-42cc-b24b-f205dc6a9c74" path="/var/lib/kubelet/pods/4a274dae-fde9-42cc-b24b-f205dc6a9c74/volumes"
Oct 30 21:29:41.491858 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:41.491812    4060 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-collector-0" podStartSLOduration=1.49179485 podStartE2EDuration="1.49179485s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:29:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:29:41.489528937 +0000 UTC m=+3200.246527237" watchObservedRunningTime="2026-10-30 21:29:41.49179485 +0000 UTC m=+3200.248793149"
Oct 30 21:29:41.601537 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:41.601442    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/korrel8r-5cbcc89b8f-rgpnk"]
Oct 30 21:29:41.609526 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:41.609504    4060 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/korrel8r-5cbcc89b8f-rgpnk"]
Oct 30 21:29:42.150856 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:29:42.150823    4060 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v2f4x" containerName="extractor"
Oct 30 21:29:43.426745 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:29:43.426705    4060 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="66c4d221-6627-4e5f-abba-6b49050d6eba" path="/var/lib/kubelet/pods/66c4d221-6627-4e5f-abba-6b49050d6eba/volumes"
Oct 30 21:30:01.187203 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:01.187165    4060 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/korrel8r-5cbcc89b8f-lkvdq"]
Oct 30 21:30:01.187715 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:01.187529    4060 cpu_manager.go:414] "containerMap: removing container" podUID="66c4d221-6627-4e5f-abba-6b49050d6eba" containerName="korrel8r"
Oct 30 21:30:01.187715 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:01.187545    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="66c4d221-6627-4e5f-abba-6b49050d6eba" containerName="korrel8r"
Oct 30 21:30:01.187715 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:01.187632    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="66c4d221-6627-4e5f-abba-6b49050d6eba" containerName="korrel8r"
Oct 30 21:30:01.190708 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:01.190692    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-lkvdq"
Oct 30 21:30:01.234697 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:01.234671    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/cc239be2-6a1b-4b84-a188-5e3232143f91-config\") pod \"korrel8r-5cbcc89b8f-lkvdq\" (UID: \"cc239be2-6a1b-4b84-a188-5e3232143f91\") " pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-lkvdq"
Oct 30 21:30:01.234841 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:01.234708    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cqp5l\" (UniqueName: \"kubernetes.io/projected/cc239be2-6a1b-4b84-a188-5e3232143f91-kube-api-access-cqp5l\") pod \"korrel8r-5cbcc89b8f-lkvdq\" (UID: \"cc239be2-6a1b-4b84-a188-5e3232143f91\") " pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-lkvdq"
Oct 30 21:30:01.234882 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:01.234837    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/cc239be2-6a1b-4b84-a188-5e3232143f91-tls\") pod \"korrel8r-5cbcc89b8f-lkvdq\" (UID: \"cc239be2-6a1b-4b84-a188-5e3232143f91\") " pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-lkvdq"
Oct 30 21:30:01.250298 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:01.250273    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/korrel8r-5cbcc89b8f-lkvdq"]
Oct 30 21:30:01.335336 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:01.335305    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/cc239be2-6a1b-4b84-a188-5e3232143f91-tls\") pod \"korrel8r-5cbcc89b8f-lkvdq\" (UID: \"cc239be2-6a1b-4b84-a188-5e3232143f91\") " pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-lkvdq"
Oct 30 21:30:01.335699 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:01.335376    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/cc239be2-6a1b-4b84-a188-5e3232143f91-config\") pod \"korrel8r-5cbcc89b8f-lkvdq\" (UID: \"cc239be2-6a1b-4b84-a188-5e3232143f91\") " pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-lkvdq"
Oct 30 21:30:01.335699 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:01.335397    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cqp5l\" (UniqueName: \"kubernetes.io/projected/cc239be2-6a1b-4b84-a188-5e3232143f91-kube-api-access-cqp5l\") pod \"korrel8r-5cbcc89b8f-lkvdq\" (UID: \"cc239be2-6a1b-4b84-a188-5e3232143f91\") " pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-lkvdq"
Oct 30 21:30:01.336238 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:01.336219    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/cc239be2-6a1b-4b84-a188-5e3232143f91-config\") pod \"korrel8r-5cbcc89b8f-lkvdq\" (UID: \"cc239be2-6a1b-4b84-a188-5e3232143f91\") " pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-lkvdq"
Oct 30 21:30:01.337938 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:01.337909    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls\" (UniqueName: \"kubernetes.io/secret/cc239be2-6a1b-4b84-a188-5e3232143f91-tls\") pod \"korrel8r-5cbcc89b8f-lkvdq\" (UID: \"cc239be2-6a1b-4b84-a188-5e3232143f91\") " pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-lkvdq"
Oct 30 21:30:01.396713 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:01.396687    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cqp5l\" (UniqueName: \"kubernetes.io/projected/cc239be2-6a1b-4b84-a188-5e3232143f91-kube-api-access-cqp5l\") pod \"korrel8r-5cbcc89b8f-lkvdq\" (UID: \"cc239be2-6a1b-4b84-a188-5e3232143f91\") " pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-lkvdq"
Oct 30 21:30:01.503532 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:01.503484    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-lkvdq"
Oct 30 21:30:01.874350 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:01.874324    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/korrel8r-5cbcc89b8f-lkvdq"]
Oct 30 21:30:01.876642 ip-10-0-142-4 kubenswrapper[4060]: W1030 21:30:01.876611    4060 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc239be2_6a1b_4b84_a188_5e3232143f91.slice/crio-8e0e4ce1906f314a82098aa13aa1a05a11362200a7029d469bc07c2d7f753a5d WatchSource:0}: Error finding container 8e0e4ce1906f314a82098aa13aa1a05a11362200a7029d469bc07c2d7f753a5d: Status 404 returned error can't find the container with id 8e0e4ce1906f314a82098aa13aa1a05a11362200a7029d469bc07c2d7f753a5d
Oct 30 21:30:02.479508 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:02.479464    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-lkvdq" event={"ID":"cc239be2-6a1b-4b84-a188-5e3232143f91","Type":"ContainerStarted","Data":"a2fded693cb817f49f4e123145e0b6dfd21cf485a085e9d685be9ebdcd87164c"}
Oct 30 21:30:02.479921 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:02.479531    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-lkvdq" event={"ID":"cc239be2-6a1b-4b84-a188-5e3232143f91","Type":"ContainerStarted","Data":"8e0e4ce1906f314a82098aa13aa1a05a11362200a7029d469bc07c2d7f753a5d"}
Oct 30 21:30:02.479921 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:02.479574    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-lkvdq"
Oct 30 21:30:02.595511 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:02.595442    4060 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-lkvdq" podStartSLOduration=1.595429684 podStartE2EDuration="1.595429684s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:30:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:30:02.595167714 +0000 UTC m=+3221.352166011" watchObservedRunningTime="2026-10-30 21:30:02.595429684 +0000 UTC m=+3221.352428002"
Oct 30 21:30:10.859262 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:10.859221    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:30:10.859734 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:10.859521    4060 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-collector-0" podUID="aaeeb8c4-701f-4be3-9f5f-67dc592bb294" containerName="otc-container" containerID="cri-o://38159d2e6fa19ad34ce465fba2e9aae975ba115b778d95e546e2bca0b63cc08a" gracePeriod=30
Oct 30 21:30:12.149796 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:30:12.149765    4060 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v2f4x" containerName="extractor"
Oct 30 21:30:13.215256 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:13.215233    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:30:13.339117 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:13.339045    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/aaeeb8c4-701f-4be3-9f5f-67dc592bb294-data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/aaeeb8c4-701f-4be3-9f5f-67dc592bb294-data-science-collector-ta-client-cert\") pod \"aaeeb8c4-701f-4be3-9f5f-67dc592bb294\" (UID: \"aaeeb8c4-701f-4be3-9f5f-67dc592bb294\") "
Oct 30 21:30:13.339263 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:13.339130    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/aaeeb8c4-701f-4be3-9f5f-67dc592bb294-tls-certs\" (UniqueName: \"kubernetes.io/secret/aaeeb8c4-701f-4be3-9f5f-67dc592bb294-tls-certs\") pod \"aaeeb8c4-701f-4be3-9f5f-67dc592bb294\" (UID: \"aaeeb8c4-701f-4be3-9f5f-67dc592bb294\") "
Oct 30 21:30:13.339263 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:13.339202    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/aaeeb8c4-701f-4be3-9f5f-67dc592bb294-kube-api-access-4sd2h\" (UniqueName: \"kubernetes.io/projected/aaeeb8c4-701f-4be3-9f5f-67dc592bb294-kube-api-access-4sd2h\") pod \"aaeeb8c4-701f-4be3-9f5f-67dc592bb294\" (UID: \"aaeeb8c4-701f-4be3-9f5f-67dc592bb294\") "
Oct 30 21:30:13.339263 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:13.339228    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/aaeeb8c4-701f-4be3-9f5f-67dc592bb294-monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/aaeeb8c4-701f-4be3-9f5f-67dc592bb294-monitoring-tls-certs\") pod \"aaeeb8c4-701f-4be3-9f5f-67dc592bb294\" (UID: \"aaeeb8c4-701f-4be3-9f5f-67dc592bb294\") "
Oct 30 21:30:13.339427 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:13.339261    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/aaeeb8c4-701f-4be3-9f5f-67dc592bb294-otc-internal\" (UniqueName: \"kubernetes.io/configmap/aaeeb8c4-701f-4be3-9f5f-67dc592bb294-otc-internal\") pod \"aaeeb8c4-701f-4be3-9f5f-67dc592bb294\" (UID: \"aaeeb8c4-701f-4be3-9f5f-67dc592bb294\") "
Oct 30 21:30:13.339427 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:13.339292    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/aaeeb8c4-701f-4be3-9f5f-67dc592bb294-otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/aaeeb8c4-701f-4be3-9f5f-67dc592bb294-otlp-tls-certs\") pod \"aaeeb8c4-701f-4be3-9f5f-67dc592bb294\" (UID: \"aaeeb8c4-701f-4be3-9f5f-67dc592bb294\") "
Oct 30 21:30:13.340098 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:13.340068    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aaeeb8c4-701f-4be3-9f5f-67dc592bb294-otc-internal" pod "aaeeb8c4-701f-4be3-9f5f-67dc592bb294" (UID: "aaeeb8c4-701f-4be3-9f5f-67dc592bb294"). InnerVolumeSpecName "otc-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:30:13.341954 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:13.341930    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aaeeb8c4-701f-4be3-9f5f-67dc592bb294-monitoring-tls-certs" pod "aaeeb8c4-701f-4be3-9f5f-67dc592bb294" (UID: "aaeeb8c4-701f-4be3-9f5f-67dc592bb294"). InnerVolumeSpecName "monitoring-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:30:13.342093 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:13.341980    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aaeeb8c4-701f-4be3-9f5f-67dc592bb294-data-science-collector-ta-client-cert" pod "aaeeb8c4-701f-4be3-9f5f-67dc592bb294" (UID: "aaeeb8c4-701f-4be3-9f5f-67dc592bb294"). InnerVolumeSpecName "data-science-collector-ta-client-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:30:13.342648 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:13.342625    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aaeeb8c4-701f-4be3-9f5f-67dc592bb294-otlp-tls-certs" pod "aaeeb8c4-701f-4be3-9f5f-67dc592bb294" (UID: "aaeeb8c4-701f-4be3-9f5f-67dc592bb294"). InnerVolumeSpecName "otlp-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:30:13.343116 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:13.343098    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aaeeb8c4-701f-4be3-9f5f-67dc592bb294-tls-certs" pod "aaeeb8c4-701f-4be3-9f5f-67dc592bb294" (UID: "aaeeb8c4-701f-4be3-9f5f-67dc592bb294"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:30:13.343231 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:13.343213    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aaeeb8c4-701f-4be3-9f5f-67dc592bb294-kube-api-access-4sd2h" pod "aaeeb8c4-701f-4be3-9f5f-67dc592bb294" (UID: "aaeeb8c4-701f-4be3-9f5f-67dc592bb294"). InnerVolumeSpecName "kube-api-access-4sd2h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:30:13.439917 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:13.439882    4060 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4sd2h\" (UniqueName: \"kubernetes.io/projected/aaeeb8c4-701f-4be3-9f5f-67dc592bb294-kube-api-access-4sd2h\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:30:13.439917 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:13.439916    4060 reconciler_common.go:299] "Volume detached for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/aaeeb8c4-701f-4be3-9f5f-67dc592bb294-monitoring-tls-certs\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:30:13.439917 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:13.439928    4060 reconciler_common.go:299] "Volume detached for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/aaeeb8c4-701f-4be3-9f5f-67dc592bb294-otc-internal\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:30:13.440130 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:13.439936    4060 reconciler_common.go:299] "Volume detached for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/aaeeb8c4-701f-4be3-9f5f-67dc592bb294-otlp-tls-certs\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:30:13.440130 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:13.439946    4060 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/aaeeb8c4-701f-4be3-9f5f-67dc592bb294-data-science-collector-ta-client-cert\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:30:13.440130 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:13.439955    4060 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aaeeb8c4-701f-4be3-9f5f-67dc592bb294-tls-certs\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:30:13.486220 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:13.486194    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-lkvdq"
Oct 30 21:30:13.533269 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:13.533239    4060 generic.go:356] "Generic (PLEG): container finished" podID="aaeeb8c4-701f-4be3-9f5f-67dc592bb294" containerID="38159d2e6fa19ad34ce465fba2e9aae975ba115b778d95e546e2bca0b63cc08a" exitCode=0
Oct 30 21:30:13.533411 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:13.533287    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:30:13.533411 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:13.533290    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"aaeeb8c4-701f-4be3-9f5f-67dc592bb294","Type":"ContainerDied","Data":"38159d2e6fa19ad34ce465fba2e9aae975ba115b778d95e546e2bca0b63cc08a"}
Oct 30 21:30:13.533522 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:13.533415    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"aaeeb8c4-701f-4be3-9f5f-67dc592bb294","Type":"ContainerDied","Data":"03c725b1a83ef9ab3fc0d04ed7df4b148867016421244e41d2a91573a53a5f21"}
Oct 30 21:30:13.533522 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:13.533445    4060 scope.go:122] "RemoveContainer" containerID="38159d2e6fa19ad34ce465fba2e9aae975ba115b778d95e546e2bca0b63cc08a"
Oct 30 21:30:13.541930 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:13.541915    4060 scope.go:122] "RemoveContainer" containerID="38159d2e6fa19ad34ce465fba2e9aae975ba115b778d95e546e2bca0b63cc08a"
Oct 30 21:30:13.542192 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:30:13.542176    4060 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"38159d2e6fa19ad34ce465fba2e9aae975ba115b778d95e546e2bca0b63cc08a\": container with ID starting with 38159d2e6fa19ad34ce465fba2e9aae975ba115b778d95e546e2bca0b63cc08a not found: ID does not exist" containerID="38159d2e6fa19ad34ce465fba2e9aae975ba115b778d95e546e2bca0b63cc08a"
Oct 30 21:30:13.542237 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:13.542203    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"38159d2e6fa19ad34ce465fba2e9aae975ba115b778d95e546e2bca0b63cc08a"} err="failed to get container status \"38159d2e6fa19ad34ce465fba2e9aae975ba115b778d95e546e2bca0b63cc08a\": rpc error: code = NotFound desc = could not find container \"38159d2e6fa19ad34ce465fba2e9aae975ba115b778d95e546e2bca0b63cc08a\": container with ID starting with 38159d2e6fa19ad34ce465fba2e9aae975ba115b778d95e546e2bca0b63cc08a not found: ID does not exist"
Oct 30 21:30:13.633155 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:13.633085    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/korrel8r-66d6f7f696-nc8nk"]
Oct 30 21:30:13.633300 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:13.633280    4060 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/korrel8r-66d6f7f696-nc8nk" podUID="28b92edb-fc9c-4ff0-9374-959f013cd6c7" containerName="korrel8r" containerID="cri-o://fd1ed1b948446c9a6316697a0bcbd756e0c1f331d78849eb23613613ae7e2b19" gracePeriod=30
Oct 30 21:30:13.713155 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:13.713126    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:30:13.718704 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:13.718678    4060 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:30:13.796237 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:13.796206    4060 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:30:13.796585 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:13.796571    4060 cpu_manager.go:414] "containerMap: removing container" podUID="aaeeb8c4-701f-4be3-9f5f-67dc592bb294" containerName="otc-container"
Oct 30 21:30:13.796637 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:13.796586    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="aaeeb8c4-701f-4be3-9f5f-67dc592bb294" containerName="otc-container"
Oct 30 21:30:13.796677 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:13.796661    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="aaeeb8c4-701f-4be3-9f5f-67dc592bb294" containerName="otc-container"
Oct 30 21:30:13.799671 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:13.799652    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:30:13.852548 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:13.852509    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-a0f9182a\""
Oct 30 21:30:13.852548 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:13.852534    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-monitoring-tls\""
Oct 30 21:30:13.852548 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:13.852534    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-dockercfg-mpgx5\""
Oct 30 21:30:13.852769 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:13.852560    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-ta-client-cert\""
Oct 30 21:30:13.852769 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:13.852567    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-tls\""
Oct 30 21:30:13.852769 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:13.852534    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-headless-tls\""
Oct 30 21:30:13.861461 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:13.861439    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:30:13.878911 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:13.878885    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/korrel8r-66d6f7f696-nc8nk"
Oct 30 21:30:13.944267 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:13.944194    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/28b92edb-fc9c-4ff0-9374-959f013cd6c7-tls\" (UniqueName: \"kubernetes.io/secret/28b92edb-fc9c-4ff0-9374-959f013cd6c7-tls\") pod \"28b92edb-fc9c-4ff0-9374-959f013cd6c7\" (UID: \"28b92edb-fc9c-4ff0-9374-959f013cd6c7\") "
Oct 30 21:30:13.944267 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:13.944234    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/28b92edb-fc9c-4ff0-9374-959f013cd6c7-config\" (UniqueName: \"kubernetes.io/configmap/28b92edb-fc9c-4ff0-9374-959f013cd6c7-config\") pod \"28b92edb-fc9c-4ff0-9374-959f013cd6c7\" (UID: \"28b92edb-fc9c-4ff0-9374-959f013cd6c7\") "
Oct 30 21:30:13.944267 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:13.944263    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/28b92edb-fc9c-4ff0-9374-959f013cd6c7-kube-api-access-rtbq6\" (UniqueName: \"kubernetes.io/projected/28b92edb-fc9c-4ff0-9374-959f013cd6c7-kube-api-access-rtbq6\") pod \"28b92edb-fc9c-4ff0-9374-959f013cd6c7\" (UID: \"28b92edb-fc9c-4ff0-9374-959f013cd6c7\") "
Oct 30 21:30:13.944558 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:13.944389    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/6a0d8240-18ce-47dc-b9ca-aefd497f47c0-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-0\" (UID: \"6a0d8240-18ce-47dc-b9ca-aefd497f47c0\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:30:13.944558 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:13.944418    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/6a0d8240-18ce-47dc-b9ca-aefd497f47c0-otlp-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"6a0d8240-18ce-47dc-b9ca-aefd497f47c0\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:30:13.944667 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:13.944591    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lnhhc\" (UniqueName: \"kubernetes.io/projected/6a0d8240-18ce-47dc-b9ca-aefd497f47c0-kube-api-access-lnhhc\") pod \"data-science-collector-collector-0\" (UID: \"6a0d8240-18ce-47dc-b9ca-aefd497f47c0\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:30:13.944667 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:13.944651    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/28b92edb-fc9c-4ff0-9374-959f013cd6c7-config" pod "28b92edb-fc9c-4ff0-9374-959f013cd6c7" (UID: "28b92edb-fc9c-4ff0-9374-959f013cd6c7"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:30:13.944773 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:13.944663    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/6a0d8240-18ce-47dc-b9ca-aefd497f47c0-monitoring-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"6a0d8240-18ce-47dc-b9ca-aefd497f47c0\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:30:13.944811 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:13.944776    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/6a0d8240-18ce-47dc-b9ca-aefd497f47c0-otc-internal\") pod \"data-science-collector-collector-0\" (UID: \"6a0d8240-18ce-47dc-b9ca-aefd497f47c0\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:30:13.944859 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:13.944811    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6a0d8240-18ce-47dc-b9ca-aefd497f47c0-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"6a0d8240-18ce-47dc-b9ca-aefd497f47c0\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:30:13.944898 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:13.944869    4060 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/28b92edb-fc9c-4ff0-9374-959f013cd6c7-config\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:30:13.946288 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:13.946267    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/28b92edb-fc9c-4ff0-9374-959f013cd6c7-tls" pod "28b92edb-fc9c-4ff0-9374-959f013cd6c7" (UID: "28b92edb-fc9c-4ff0-9374-959f013cd6c7"). InnerVolumeSpecName "tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:30:13.946377 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:13.946363    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/28b92edb-fc9c-4ff0-9374-959f013cd6c7-kube-api-access-rtbq6" pod "28b92edb-fc9c-4ff0-9374-959f013cd6c7" (UID: "28b92edb-fc9c-4ff0-9374-959f013cd6c7"). InnerVolumeSpecName "kube-api-access-rtbq6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:30:14.045460 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:14.045430    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/6a0d8240-18ce-47dc-b9ca-aefd497f47c0-otc-internal\") pod \"data-science-collector-collector-0\" (UID: \"6a0d8240-18ce-47dc-b9ca-aefd497f47c0\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:30:14.045608 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:14.045465    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6a0d8240-18ce-47dc-b9ca-aefd497f47c0-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"6a0d8240-18ce-47dc-b9ca-aefd497f47c0\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:30:14.045608 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:14.045514    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/6a0d8240-18ce-47dc-b9ca-aefd497f47c0-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-0\" (UID: \"6a0d8240-18ce-47dc-b9ca-aefd497f47c0\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:30:14.045757 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:14.045730    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/6a0d8240-18ce-47dc-b9ca-aefd497f47c0-otlp-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"6a0d8240-18ce-47dc-b9ca-aefd497f47c0\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:30:14.045847 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:14.045827    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lnhhc\" (UniqueName: \"kubernetes.io/projected/6a0d8240-18ce-47dc-b9ca-aefd497f47c0-kube-api-access-lnhhc\") pod \"data-science-collector-collector-0\" (UID: \"6a0d8240-18ce-47dc-b9ca-aefd497f47c0\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:30:14.045909 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:14.045874    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/6a0d8240-18ce-47dc-b9ca-aefd497f47c0-monitoring-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"6a0d8240-18ce-47dc-b9ca-aefd497f47c0\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:30:14.045972 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:14.045960    4060 reconciler_common.go:299] "Volume detached for volume \"tls\" (UniqueName: \"kubernetes.io/secret/28b92edb-fc9c-4ff0-9374-959f013cd6c7-tls\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:30:14.046031 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:14.045976    4060 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rtbq6\" (UniqueName: \"kubernetes.io/projected/28b92edb-fc9c-4ff0-9374-959f013cd6c7-kube-api-access-rtbq6\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:30:14.046331 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:14.046306    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/6a0d8240-18ce-47dc-b9ca-aefd497f47c0-otc-internal\") pod \"data-science-collector-collector-0\" (UID: \"6a0d8240-18ce-47dc-b9ca-aefd497f47c0\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:30:14.048050 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:14.048028    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/6a0d8240-18ce-47dc-b9ca-aefd497f47c0-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-0\" (UID: \"6a0d8240-18ce-47dc-b9ca-aefd497f47c0\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:30:14.048185 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:14.048165    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/6a0d8240-18ce-47dc-b9ca-aefd497f47c0-monitoring-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"6a0d8240-18ce-47dc-b9ca-aefd497f47c0\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:30:14.048426 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:14.048404    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/6a0d8240-18ce-47dc-b9ca-aefd497f47c0-otlp-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"6a0d8240-18ce-47dc-b9ca-aefd497f47c0\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:30:14.048465 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:14.048420    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6a0d8240-18ce-47dc-b9ca-aefd497f47c0-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"6a0d8240-18ce-47dc-b9ca-aefd497f47c0\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:30:14.106918 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:14.106885    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lnhhc\" (UniqueName: \"kubernetes.io/projected/6a0d8240-18ce-47dc-b9ca-aefd497f47c0-kube-api-access-lnhhc\") pod \"data-science-collector-collector-0\" (UID: \"6a0d8240-18ce-47dc-b9ca-aefd497f47c0\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:30:14.114679 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:14.114646    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:30:14.491855 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:14.491830    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:30:14.494055 ip-10-0-142-4 kubenswrapper[4060]: W1030 21:30:14.494031    4060 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a0d8240_18ce_47dc_b9ca_aefd497f47c0.slice/crio-d56bfb6d3bb4b23790461d113934ff3f6fa7bad8549df10aeb51dddeba1a21ab WatchSource:0}: Error finding container d56bfb6d3bb4b23790461d113934ff3f6fa7bad8549df10aeb51dddeba1a21ab: Status 404 returned error can't find the container with id d56bfb6d3bb4b23790461d113934ff3f6fa7bad8549df10aeb51dddeba1a21ab
Oct 30 21:30:14.496240 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:14.496211    4060 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 21:30:14.496291 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:14.496266    4060 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 21:30:14.540119 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:14.540096    4060 generic.go:356] "Generic (PLEG): container finished" podID="28b92edb-fc9c-4ff0-9374-959f013cd6c7" containerID="fd1ed1b948446c9a6316697a0bcbd756e0c1f331d78849eb23613613ae7e2b19" exitCode=0
Oct 30 21:30:14.540207 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:14.540147    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/korrel8r-66d6f7f696-nc8nk"
Oct 30 21:30:14.540207 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:14.540186    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/korrel8r-66d6f7f696-nc8nk" event={"ID":"28b92edb-fc9c-4ff0-9374-959f013cd6c7","Type":"ContainerDied","Data":"fd1ed1b948446c9a6316697a0bcbd756e0c1f331d78849eb23613613ae7e2b19"}
Oct 30 21:30:14.540312 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:14.540244    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/korrel8r-66d6f7f696-nc8nk" event={"ID":"28b92edb-fc9c-4ff0-9374-959f013cd6c7","Type":"ContainerDied","Data":"61d5d59f98b7c6018725c6fc409469a5534d254478864465135227d318f87e70"}
Oct 30 21:30:14.540312 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:14.540279    4060 scope.go:122] "RemoveContainer" containerID="fd1ed1b948446c9a6316697a0bcbd756e0c1f331d78849eb23613613ae7e2b19"
Oct 30 21:30:14.541935 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:14.541908    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"6a0d8240-18ce-47dc-b9ca-aefd497f47c0","Type":"ContainerStarted","Data":"d56bfb6d3bb4b23790461d113934ff3f6fa7bad8549df10aeb51dddeba1a21ab"}
Oct 30 21:30:14.549622 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:14.549535    4060 scope.go:122] "RemoveContainer" containerID="fd1ed1b948446c9a6316697a0bcbd756e0c1f331d78849eb23613613ae7e2b19"
Oct 30 21:30:14.550072 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:30:14.550044    4060 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fd1ed1b948446c9a6316697a0bcbd756e0c1f331d78849eb23613613ae7e2b19\": container with ID starting with fd1ed1b948446c9a6316697a0bcbd756e0c1f331d78849eb23613613ae7e2b19 not found: ID does not exist" containerID="fd1ed1b948446c9a6316697a0bcbd756e0c1f331d78849eb23613613ae7e2b19"
Oct 30 21:30:14.550132 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:14.550082    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd1ed1b948446c9a6316697a0bcbd756e0c1f331d78849eb23613613ae7e2b19"} err="failed to get container status \"fd1ed1b948446c9a6316697a0bcbd756e0c1f331d78849eb23613613ae7e2b19\": rpc error: code = NotFound desc = could not find container \"fd1ed1b948446c9a6316697a0bcbd756e0c1f331d78849eb23613613ae7e2b19\": container with ID starting with fd1ed1b948446c9a6316697a0bcbd756e0c1f331d78849eb23613613ae7e2b19 not found: ID does not exist"
Oct 30 21:30:14.705923 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:14.705885    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/korrel8r-66d6f7f696-nc8nk"]
Oct 30 21:30:14.710399 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:14.710373    4060 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/korrel8r-66d6f7f696-nc8nk"]
Oct 30 21:30:15.426263 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:15.426232    4060 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="28b92edb-fc9c-4ff0-9374-959f013cd6c7" path="/var/lib/kubelet/pods/28b92edb-fc9c-4ff0-9374-959f013cd6c7/volumes"
Oct 30 21:30:15.426639 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:15.426626    4060 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="aaeeb8c4-701f-4be3-9f5f-67dc592bb294" path="/var/lib/kubelet/pods/aaeeb8c4-701f-4be3-9f5f-67dc592bb294/volumes"
Oct 30 21:30:15.547921 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:15.547890    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"6a0d8240-18ce-47dc-b9ca-aefd497f47c0","Type":"ContainerStarted","Data":"3b01fd1a1ece09130a8e6effa3b2ad9ba2770be59fa447bfa7057204c31d6d4a"}
Oct 30 21:30:15.665814 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:15.665761    4060 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-collector-0" podStartSLOduration=2.665748173 podStartE2EDuration="2.665748173s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:30:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:30:15.664841409 +0000 UTC m=+3234.421839708" watchObservedRunningTime="2026-10-30 21:30:15.665748173 +0000 UTC m=+3234.422746470"
Oct 30 21:30:24.163871 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:24.163837    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-v6lq2"]
Oct 30 21:30:24.164346 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:24.164030    4060 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-v6lq2" podUID="8c8f231f-5064-498b-bed5-c1d7213283b2" containerName="kube-rbac-proxy" containerID="cri-o://6a065204d5fcc5a29463fcb2eddec21f2ceb736a16d82127fd4a5a0ebdd1909d" gracePeriod=30
Oct 30 21:30:24.336456 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:24.336426    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/korrel8r-5cbcc89b8f-lkvdq"]
Oct 30 21:30:24.336697 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:24.336674    4060 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-lkvdq" podUID="cc239be2-6a1b-4b84-a188-5e3232143f91" containerName="korrel8r" containerID="cri-o://a2fded693cb817f49f4e123145e0b6dfd21cf485a085e9d685be9ebdcd87164c" gracePeriod=30
Oct 30 21:30:24.464695 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:24.464643    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-v6lq2"
Oct 30 21:30:24.571629 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:24.571605    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-lkvdq"
Oct 30 21:30:24.593646 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:24.593608    4060 generic.go:356] "Generic (PLEG): container finished" podID="cc239be2-6a1b-4b84-a188-5e3232143f91" containerID="a2fded693cb817f49f4e123145e0b6dfd21cf485a085e9d685be9ebdcd87164c" exitCode=0
Oct 30 21:30:24.593821 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:24.593668    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-lkvdq"
Oct 30 21:30:24.593821 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:24.593690    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-lkvdq" event={"ID":"cc239be2-6a1b-4b84-a188-5e3232143f91","Type":"ContainerDied","Data":"a2fded693cb817f49f4e123145e0b6dfd21cf485a085e9d685be9ebdcd87164c"}
Oct 30 21:30:24.593821 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:24.593748    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-lkvdq" event={"ID":"cc239be2-6a1b-4b84-a188-5e3232143f91","Type":"ContainerDied","Data":"8e0e4ce1906f314a82098aa13aa1a05a11362200a7029d469bc07c2d7f753a5d"}
Oct 30 21:30:24.593821 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:24.593766    4060 scope.go:122] "RemoveContainer" containerID="a2fded693cb817f49f4e123145e0b6dfd21cf485a085e9d685be9ebdcd87164c"
Oct 30 21:30:24.595162 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:24.595141    4060 generic.go:356] "Generic (PLEG): container finished" podID="8c8f231f-5064-498b-bed5-c1d7213283b2" containerID="6a065204d5fcc5a29463fcb2eddec21f2ceb736a16d82127fd4a5a0ebdd1909d" exitCode=0
Oct 30 21:30:24.595294 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:24.595175    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-v6lq2" event={"ID":"8c8f231f-5064-498b-bed5-c1d7213283b2","Type":"ContainerDied","Data":"6a065204d5fcc5a29463fcb2eddec21f2ceb736a16d82127fd4a5a0ebdd1909d"}
Oct 30 21:30:24.595294 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:24.595191    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-v6lq2"
Oct 30 21:30:24.595294 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:24.595214    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-v6lq2" event={"ID":"8c8f231f-5064-498b-bed5-c1d7213283b2","Type":"ContainerDied","Data":"bc759079e02825a733c79dfab38c4a04a0c89aa5829d6563ae3139ed81b05512"}
Oct 30 21:30:24.603376 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:24.603360    4060 scope.go:122] "RemoveContainer" containerID="a2fded693cb817f49f4e123145e0b6dfd21cf485a085e9d685be9ebdcd87164c"
Oct 30 21:30:24.603770 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:30:24.603745    4060 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a2fded693cb817f49f4e123145e0b6dfd21cf485a085e9d685be9ebdcd87164c\": container with ID starting with a2fded693cb817f49f4e123145e0b6dfd21cf485a085e9d685be9ebdcd87164c not found: ID does not exist" containerID="a2fded693cb817f49f4e123145e0b6dfd21cf485a085e9d685be9ebdcd87164c"
Oct 30 21:30:24.603918 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:24.603885    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a2fded693cb817f49f4e123145e0b6dfd21cf485a085e9d685be9ebdcd87164c"} err="failed to get container status \"a2fded693cb817f49f4e123145e0b6dfd21cf485a085e9d685be9ebdcd87164c\": rpc error: code = NotFound desc = could not find container \"a2fded693cb817f49f4e123145e0b6dfd21cf485a085e9d685be9ebdcd87164c\": container with ID starting with a2fded693cb817f49f4e123145e0b6dfd21cf485a085e9d685be9ebdcd87164c not found: ID does not exist"
Oct 30 21:30:24.603918 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:24.603917    4060 scope.go:122] "RemoveContainer" containerID="6a065204d5fcc5a29463fcb2eddec21f2ceb736a16d82127fd4a5a0ebdd1909d"
Oct 30 21:30:24.613556 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:24.613535    4060 scope.go:122] "RemoveContainer" containerID="6a065204d5fcc5a29463fcb2eddec21f2ceb736a16d82127fd4a5a0ebdd1909d"
Oct 30 21:30:24.613889 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:30:24.613864    4060 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6a065204d5fcc5a29463fcb2eddec21f2ceb736a16d82127fd4a5a0ebdd1909d\": container with ID starting with 6a065204d5fcc5a29463fcb2eddec21f2ceb736a16d82127fd4a5a0ebdd1909d not found: ID does not exist" containerID="6a065204d5fcc5a29463fcb2eddec21f2ceb736a16d82127fd4a5a0ebdd1909d"
Oct 30 21:30:24.613949 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:24.613900    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a065204d5fcc5a29463fcb2eddec21f2ceb736a16d82127fd4a5a0ebdd1909d"} err="failed to get container status \"6a065204d5fcc5a29463fcb2eddec21f2ceb736a16d82127fd4a5a0ebdd1909d\": rpc error: code = NotFound desc = could not find container \"6a065204d5fcc5a29463fcb2eddec21f2ceb736a16d82127fd4a5a0ebdd1909d\": container with ID starting with 6a065204d5fcc5a29463fcb2eddec21f2ceb736a16d82127fd4a5a0ebdd1909d not found: ID does not exist"
Oct 30 21:30:24.645227 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:24.645192    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/8c8f231f-5064-498b-bed5-c1d7213283b2-tls\" (UniqueName: \"kubernetes.io/secret/8c8f231f-5064-498b-bed5-c1d7213283b2-tls\") pod \"8c8f231f-5064-498b-bed5-c1d7213283b2\" (UID: \"8c8f231f-5064-498b-bed5-c1d7213283b2\") "
Oct 30 21:30:24.645404 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:24.645276    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/8c8f231f-5064-498b-bed5-c1d7213283b2-prometheus-ca\" (UniqueName: \"kubernetes.io/configmap/8c8f231f-5064-498b-bed5-c1d7213283b2-prometheus-ca\") pod \"8c8f231f-5064-498b-bed5-c1d7213283b2\" (UID: \"8c8f231f-5064-498b-bed5-c1d7213283b2\") "
Oct 30 21:30:24.645404 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:24.645310    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8c8f231f-5064-498b-bed5-c1d7213283b2-kube-api-access-bkc4k\" (UniqueName: \"kubernetes.io/projected/8c8f231f-5064-498b-bed5-c1d7213283b2-kube-api-access-bkc4k\") pod \"8c8f231f-5064-498b-bed5-c1d7213283b2\" (UID: \"8c8f231f-5064-498b-bed5-c1d7213283b2\") "
Oct 30 21:30:24.645404 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:24.645386    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/8c8f231f-5064-498b-bed5-c1d7213283b2-prometheus-client-cert\" (UniqueName: \"kubernetes.io/secret/8c8f231f-5064-498b-bed5-c1d7213283b2-prometheus-client-cert\") pod \"8c8f231f-5064-498b-bed5-c1d7213283b2\" (UID: \"8c8f231f-5064-498b-bed5-c1d7213283b2\") "
Oct 30 21:30:24.645606 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:24.645433    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/8c8f231f-5064-498b-bed5-c1d7213283b2-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8c8f231f-5064-498b-bed5-c1d7213283b2-kube-rbac-proxy-config\") pod \"8c8f231f-5064-498b-bed5-c1d7213283b2\" (UID: \"8c8f231f-5064-498b-bed5-c1d7213283b2\") "
Oct 30 21:30:24.645734 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:24.645708    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8c8f231f-5064-498b-bed5-c1d7213283b2-prometheus-ca" pod "8c8f231f-5064-498b-bed5-c1d7213283b2" (UID: "8c8f231f-5064-498b-bed5-c1d7213283b2"). InnerVolumeSpecName "prometheus-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:30:24.647530 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:24.647482    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8c8f231f-5064-498b-bed5-c1d7213283b2-prometheus-client-cert" pod "8c8f231f-5064-498b-bed5-c1d7213283b2" (UID: "8c8f231f-5064-498b-bed5-c1d7213283b2"). InnerVolumeSpecName "prometheus-client-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:30:24.647530 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:24.647514    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8c8f231f-5064-498b-bed5-c1d7213283b2-tls" pod "8c8f231f-5064-498b-bed5-c1d7213283b2" (UID: "8c8f231f-5064-498b-bed5-c1d7213283b2"). InnerVolumeSpecName "tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:30:24.647688 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:24.647574    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8c8f231f-5064-498b-bed5-c1d7213283b2-kube-rbac-proxy-config" pod "8c8f231f-5064-498b-bed5-c1d7213283b2" (UID: "8c8f231f-5064-498b-bed5-c1d7213283b2"). InnerVolumeSpecName "kube-rbac-proxy-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:30:24.647788 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:24.647773    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c8f231f-5064-498b-bed5-c1d7213283b2-kube-api-access-bkc4k" pod "8c8f231f-5064-498b-bed5-c1d7213283b2" (UID: "8c8f231f-5064-498b-bed5-c1d7213283b2"). InnerVolumeSpecName "kube-api-access-bkc4k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:30:24.745975 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:24.745945    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/cc239be2-6a1b-4b84-a188-5e3232143f91-kube-api-access-cqp5l\" (UniqueName: \"kubernetes.io/projected/cc239be2-6a1b-4b84-a188-5e3232143f91-kube-api-access-cqp5l\") pod \"cc239be2-6a1b-4b84-a188-5e3232143f91\" (UID: \"cc239be2-6a1b-4b84-a188-5e3232143f91\") "
Oct 30 21:30:24.746184 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:24.746013    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/cc239be2-6a1b-4b84-a188-5e3232143f91-tls\" (UniqueName: \"kubernetes.io/secret/cc239be2-6a1b-4b84-a188-5e3232143f91-tls\") pod \"cc239be2-6a1b-4b84-a188-5e3232143f91\" (UID: \"cc239be2-6a1b-4b84-a188-5e3232143f91\") "
Oct 30 21:30:24.746184 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:24.746079    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/cc239be2-6a1b-4b84-a188-5e3232143f91-config\" (UniqueName: \"kubernetes.io/configmap/cc239be2-6a1b-4b84-a188-5e3232143f91-config\") pod \"cc239be2-6a1b-4b84-a188-5e3232143f91\" (UID: \"cc239be2-6a1b-4b84-a188-5e3232143f91\") "
Oct 30 21:30:24.746367 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:24.746348    4060 reconciler_common.go:299] "Volume detached for volume \"prometheus-client-cert\" (UniqueName: \"kubernetes.io/secret/8c8f231f-5064-498b-bed5-c1d7213283b2-prometheus-client-cert\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:30:24.746427 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:24.746371    4060 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8c8f231f-5064-498b-bed5-c1d7213283b2-kube-rbac-proxy-config\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:30:24.746427 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:24.746386    4060 reconciler_common.go:299] "Volume detached for volume \"tls\" (UniqueName: \"kubernetes.io/secret/8c8f231f-5064-498b-bed5-c1d7213283b2-tls\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:30:24.746427 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:24.746401    4060 reconciler_common.go:299] "Volume detached for volume \"prometheus-ca\" (UniqueName: \"kubernetes.io/configmap/8c8f231f-5064-498b-bed5-c1d7213283b2-prometheus-ca\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:30:24.746427 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:24.746415    4060 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bkc4k\" (UniqueName: \"kubernetes.io/projected/8c8f231f-5064-498b-bed5-c1d7213283b2-kube-api-access-bkc4k\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:30:24.746603 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:24.746548    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cc239be2-6a1b-4b84-a188-5e3232143f91-config" pod "cc239be2-6a1b-4b84-a188-5e3232143f91" (UID: "cc239be2-6a1b-4b84-a188-5e3232143f91"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:30:24.748045 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:24.748028    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cc239be2-6a1b-4b84-a188-5e3232143f91-tls" pod "cc239be2-6a1b-4b84-a188-5e3232143f91" (UID: "cc239be2-6a1b-4b84-a188-5e3232143f91"). InnerVolumeSpecName "tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:30:24.748113 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:24.748094    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc239be2-6a1b-4b84-a188-5e3232143f91-kube-api-access-cqp5l" pod "cc239be2-6a1b-4b84-a188-5e3232143f91" (UID: "cc239be2-6a1b-4b84-a188-5e3232143f91"). InnerVolumeSpecName "kube-api-access-cqp5l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:30:24.847838 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:24.847796    4060 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/cc239be2-6a1b-4b84-a188-5e3232143f91-config\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:30:24.847838 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:24.847833    4060 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cqp5l\" (UniqueName: \"kubernetes.io/projected/cc239be2-6a1b-4b84-a188-5e3232143f91-kube-api-access-cqp5l\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:30:24.847838 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:24.847847    4060 reconciler_common.go:299] "Volume detached for volume \"tls\" (UniqueName: \"kubernetes.io/secret/cc239be2-6a1b-4b84-a188-5e3232143f91-tls\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:30:25.016948 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:25.016862    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/korrel8r-5cbcc89b8f-lkvdq"]
Oct 30 21:30:25.020587 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:25.020554    4060 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/korrel8r-5cbcc89b8f-lkvdq"]
Oct 30 21:30:25.132280 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:25.131782    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-v6lq2"]
Oct 30 21:30:25.132280 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:25.131843    4060 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-v6lq2"]
Oct 30 21:30:25.430083 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:25.429989    4060 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="8c8f231f-5064-498b-bed5-c1d7213283b2" path="/var/lib/kubelet/pods/8c8f231f-5064-498b-bed5-c1d7213283b2/volumes"
Oct 30 21:30:25.430556 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:25.430541    4060 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="cc239be2-6a1b-4b84-a188-5e3232143f91" path="/var/lib/kubelet/pods/cc239be2-6a1b-4b84-a188-5e3232143f91/volumes"
Oct 30 21:30:25.579801 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:25.579766    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"]
Oct 30 21:30:25.580156 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:25.580105    4060 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0" podUID="a43b743c-b9f0-40f9-a02b-b5631f82b41a" containerName="alertmanager" containerID="cri-o://30fc04fb9901bf6e193aecf979c7148c06beb7ea9e367a91193d8a7c8fc4395f" gracePeriod=120
Oct 30 21:30:25.580249 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:25.580131    4060 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0" podUID="a43b743c-b9f0-40f9-a02b-b5631f82b41a" containerName="config-reloader" containerID="cri-o://3f27725038d25b8ce636577cc882134b74a0d08255099dec2e62c2b578b4540b" gracePeriod=120
Oct 30 21:30:25.588873 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:25.588847    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/prometheus-data-science-monitoringstack-1"]
Oct 30 21:30:25.589173 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:25.589144    4060 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1" podUID="790881c5-8eb2-4233-ac15-657f5ae7ccec" containerName="thanos-sidecar" containerID="cri-o://cddc211b2a5eaf6d6493e7a733eec68511533ead37020442bdf26109ed727e2e" gracePeriod=600
Oct 30 21:30:25.589293 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:25.589154    4060 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1" podUID="790881c5-8eb2-4233-ac15-657f5ae7ccec" containerName="config-reloader" containerID="cri-o://3d83d425f164debc2b0cff955dd56d77615fc31e4d2be3e656b31dd938b0829b" gracePeriod=600
Oct 30 21:30:25.589355 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:25.589138    4060 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1" podUID="790881c5-8eb2-4233-ac15-657f5ae7ccec" containerName="prometheus" containerID="cri-o://9e559607c7fe449ff89634190bd1ca5ae9fc08f0860be6fc42f4edc7fd06693d" gracePeriod=600
Oct 30 21:30:26.611115 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:26.611039    4060 generic.go:356] "Generic (PLEG): container finished" podID="a43b743c-b9f0-40f9-a02b-b5631f82b41a" containerID="3f27725038d25b8ce636577cc882134b74a0d08255099dec2e62c2b578b4540b" exitCode=0
Oct 30 21:30:26.611509 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:26.611112    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0" event={"ID":"a43b743c-b9f0-40f9-a02b-b5631f82b41a","Type":"ContainerDied","Data":"3f27725038d25b8ce636577cc882134b74a0d08255099dec2e62c2b578b4540b"}
Oct 30 21:30:26.613267 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:26.613247    4060 generic.go:356] "Generic (PLEG): container finished" podID="790881c5-8eb2-4233-ac15-657f5ae7ccec" containerID="cddc211b2a5eaf6d6493e7a733eec68511533ead37020442bdf26109ed727e2e" exitCode=0
Oct 30 21:30:26.613267 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:26.613262    4060 generic.go:356] "Generic (PLEG): container finished" podID="790881c5-8eb2-4233-ac15-657f5ae7ccec" containerID="3d83d425f164debc2b0cff955dd56d77615fc31e4d2be3e656b31dd938b0829b" exitCode=0
Oct 30 21:30:26.613452 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:26.613294    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1" event={"ID":"790881c5-8eb2-4233-ac15-657f5ae7ccec","Type":"ContainerDied","Data":"cddc211b2a5eaf6d6493e7a733eec68511533ead37020442bdf26109ed727e2e"}
Oct 30 21:30:26.613452 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:26.613341    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1" event={"ID":"790881c5-8eb2-4233-ac15-657f5ae7ccec","Type":"ContainerDied","Data":"3d83d425f164debc2b0cff955dd56d77615fc31e4d2be3e656b31dd938b0829b"}
Oct 30 21:30:27.444291 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:27.444261    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1"
Oct 30 21:30:27.486828 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:27.486791    4060 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0" podUID="a43b743c-b9f0-40f9-a02b-b5631f82b41a" containerName="alertmanager" probeResult="failure" output="Get \"http://10.133.0.115:9093/-/ready\": dial tcp 10.133.0.115:9093: connect: connection refused"
Oct 30 21:30:27.571510 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:27.571408    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/790881c5-8eb2-4233-ac15-657f5ae7ccec-kube-api-access-bw6cp\" (UniqueName: \"kubernetes.io/projected/790881c5-8eb2-4233-ac15-657f5ae7ccec-kube-api-access-bw6cp\") pod \"790881c5-8eb2-4233-ac15-657f5ae7ccec\" (UID: \"790881c5-8eb2-4233-ac15-657f5ae7ccec\") "
Oct 30 21:30:27.571510 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:27.571445    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/790881c5-8eb2-4233-ac15-657f5ae7ccec-web-config\" (UniqueName: \"kubernetes.io/secret/790881c5-8eb2-4233-ac15-657f5ae7ccec-web-config\") pod \"790881c5-8eb2-4233-ac15-657f5ae7ccec\" (UID: \"790881c5-8eb2-4233-ac15-657f5ae7ccec\") "
Oct 30 21:30:27.571732 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:27.571554    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/csi/ebs.csi.aws.com^vol-0913d5896cba88aba\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0913d5896cba88aba\") pod \"790881c5-8eb2-4233-ac15-657f5ae7ccec\" (UID: \"790881c5-8eb2-4233-ac15-657f5ae7ccec\") "
Oct 30 21:30:27.571732 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:27.571590    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/790881c5-8eb2-4233-ac15-657f5ae7ccec-tls-assets\" (UniqueName: \"kubernetes.io/projected/790881c5-8eb2-4233-ac15-657f5ae7ccec-tls-assets\") pod \"790881c5-8eb2-4233-ac15-657f5ae7ccec\" (UID: \"790881c5-8eb2-4233-ac15-657f5ae7ccec\") "
Oct 30 21:30:27.571732 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:27.571611    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/790881c5-8eb2-4233-ac15-657f5ae7ccec-prometheus-data-science-monitoringstack-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/790881c5-8eb2-4233-ac15-657f5ae7ccec-prometheus-data-science-monitoringstack-rulefiles-1\") pod \"790881c5-8eb2-4233-ac15-657f5ae7ccec\" (UID: \"790881c5-8eb2-4233-ac15-657f5ae7ccec\") "
Oct 30 21:30:27.571732 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:27.571638    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/790881c5-8eb2-4233-ac15-657f5ae7ccec-prometheus-data-science-monitoringstack-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/790881c5-8eb2-4233-ac15-657f5ae7ccec-prometheus-data-science-monitoringstack-rulefiles-0\") pod \"790881c5-8eb2-4233-ac15-657f5ae7ccec\" (UID: \"790881c5-8eb2-4233-ac15-657f5ae7ccec\") "
Oct 30 21:30:27.571732 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:27.571690    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/790881c5-8eb2-4233-ac15-657f5ae7ccec-web-config-tls-secret-key-prometheus-operated-tls-f3457c70\" (UniqueName: \"kubernetes.io/secret/790881c5-8eb2-4233-ac15-657f5ae7ccec-web-config-tls-secret-key-prometheus-operated-tls-f3457c70\") pod \"790881c5-8eb2-4233-ac15-657f5ae7ccec\" (UID: \"790881c5-8eb2-4233-ac15-657f5ae7ccec\") "
Oct 30 21:30:27.572032 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:27.571742    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/790881c5-8eb2-4233-ac15-657f5ae7ccec-thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/790881c5-8eb2-4233-ac15-657f5ae7ccec-thanos-prometheus-http-client-file\") pod \"790881c5-8eb2-4233-ac15-657f5ae7ccec\" (UID: \"790881c5-8eb2-4233-ac15-657f5ae7ccec\") "
Oct 30 21:30:27.572032 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:27.571805    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/790881c5-8eb2-4233-ac15-657f5ae7ccec-secret-prometheus-web-tls-ca\" (UniqueName: \"kubernetes.io/secret/790881c5-8eb2-4233-ac15-657f5ae7ccec-secret-prometheus-web-tls-ca\") pod \"790881c5-8eb2-4233-ac15-657f5ae7ccec\" (UID: \"790881c5-8eb2-4233-ac15-657f5ae7ccec\") "
Oct 30 21:30:27.572032 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:27.571883    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/790881c5-8eb2-4233-ac15-657f5ae7ccec-config\" (UniqueName: \"kubernetes.io/secret/790881c5-8eb2-4233-ac15-657f5ae7ccec-config\") pod \"790881c5-8eb2-4233-ac15-657f5ae7ccec\" (UID: \"790881c5-8eb2-4233-ac15-657f5ae7ccec\") "
Oct 30 21:30:27.572032 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:27.571917    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/790881c5-8eb2-4233-ac15-657f5ae7ccec-web-config-tls-secret-cert-prometheus-operated-tls-f3457c70\" (UniqueName: \"kubernetes.io/secret/790881c5-8eb2-4233-ac15-657f5ae7ccec-web-config-tls-secret-cert-prometheus-operated-tls-f3457c70\") pod \"790881c5-8eb2-4233-ac15-657f5ae7ccec\" (UID: \"790881c5-8eb2-4233-ac15-657f5ae7ccec\") "
Oct 30 21:30:27.572032 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:27.571945    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/790881c5-8eb2-4233-ac15-657f5ae7ccec-config-out\" (UniqueName: \"kubernetes.io/empty-dir/790881c5-8eb2-4233-ac15-657f5ae7ccec-config-out\") pod \"790881c5-8eb2-4233-ac15-657f5ae7ccec\" (UID: \"790881c5-8eb2-4233-ac15-657f5ae7ccec\") "
Oct 30 21:30:27.572032 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:27.571985    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/790881c5-8eb2-4233-ac15-657f5ae7ccec-prometheus-data-science-monitoringstack-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/790881c5-8eb2-4233-ac15-657f5ae7ccec-prometheus-data-science-monitoringstack-rulefiles-2\") pod \"790881c5-8eb2-4233-ac15-657f5ae7ccec\" (UID: \"790881c5-8eb2-4233-ac15-657f5ae7ccec\") "
Oct 30 21:30:27.572032 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:27.572001    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/790881c5-8eb2-4233-ac15-657f5ae7ccec-prometheus-data-science-monitoringstack-rulefiles-1" pod "790881c5-8eb2-4233-ac15-657f5ae7ccec" (UID: "790881c5-8eb2-4233-ac15-657f5ae7ccec"). InnerVolumeSpecName "prometheus-data-science-monitoringstack-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:30:27.572721 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:27.572579    4060 reconciler_common.go:299] "Volume detached for volume \"prometheus-data-science-monitoringstack-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/790881c5-8eb2-4233-ac15-657f5ae7ccec-prometheus-data-science-monitoringstack-rulefiles-1\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:30:27.572721 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:27.572667    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/790881c5-8eb2-4233-ac15-657f5ae7ccec-prometheus-data-science-monitoringstack-rulefiles-0" pod "790881c5-8eb2-4233-ac15-657f5ae7ccec" (UID: "790881c5-8eb2-4233-ac15-657f5ae7ccec"). InnerVolumeSpecName "prometheus-data-science-monitoringstack-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:30:27.572946 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:27.572885    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/790881c5-8eb2-4233-ac15-657f5ae7ccec-prometheus-data-science-monitoringstack-rulefiles-2" pod "790881c5-8eb2-4233-ac15-657f5ae7ccec" (UID: "790881c5-8eb2-4233-ac15-657f5ae7ccec"). InnerVolumeSpecName "prometheus-data-science-monitoringstack-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:30:27.574687 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:27.574640    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/790881c5-8eb2-4233-ac15-657f5ae7ccec-kube-api-access-bw6cp" pod "790881c5-8eb2-4233-ac15-657f5ae7ccec" (UID: "790881c5-8eb2-4233-ac15-657f5ae7ccec"). InnerVolumeSpecName "kube-api-access-bw6cp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:30:27.575383 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:27.575362    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/790881c5-8eb2-4233-ac15-657f5ae7ccec-tls-assets" pod "790881c5-8eb2-4233-ac15-657f5ae7ccec" (UID: "790881c5-8eb2-4233-ac15-657f5ae7ccec"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:30:27.576131 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:27.576078    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/790881c5-8eb2-4233-ac15-657f5ae7ccec-web-config-tls-secret-cert-prometheus-operated-tls-f3457c70" pod "790881c5-8eb2-4233-ac15-657f5ae7ccec" (UID: "790881c5-8eb2-4233-ac15-657f5ae7ccec"). InnerVolumeSpecName "web-config-tls-secret-cert-prometheus-operated-tls-f3457c70". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:30:27.576254 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:27.576229    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/790881c5-8eb2-4233-ac15-657f5ae7ccec-secret-prometheus-web-tls-ca" pod "790881c5-8eb2-4233-ac15-657f5ae7ccec" (UID: "790881c5-8eb2-4233-ac15-657f5ae7ccec"). InnerVolumeSpecName "secret-prometheus-web-tls-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:30:27.576556 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:27.576510    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/790881c5-8eb2-4233-ac15-657f5ae7ccec-web-config-tls-secret-key-prometheus-operated-tls-f3457c70" pod "790881c5-8eb2-4233-ac15-657f5ae7ccec" (UID: "790881c5-8eb2-4233-ac15-657f5ae7ccec"). InnerVolumeSpecName "web-config-tls-secret-key-prometheus-operated-tls-f3457c70". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:30:27.576556 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:27.576521    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/790881c5-8eb2-4233-ac15-657f5ae7ccec-config-out" pod "790881c5-8eb2-4233-ac15-657f5ae7ccec" (UID: "790881c5-8eb2-4233-ac15-657f5ae7ccec"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:30:27.576847 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:27.576817    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/790881c5-8eb2-4233-ac15-657f5ae7ccec-config" pod "790881c5-8eb2-4233-ac15-657f5ae7ccec" (UID: "790881c5-8eb2-4233-ac15-657f5ae7ccec"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:30:27.576896 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:27.576881    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/790881c5-8eb2-4233-ac15-657f5ae7ccec-thanos-prometheus-http-client-file" pod "790881c5-8eb2-4233-ac15-657f5ae7ccec" (UID: "790881c5-8eb2-4233-ac15-657f5ae7ccec"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:30:27.578351 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:27.578330    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/csi/ebs.csi.aws.com^vol-0913d5896cba88aba" pod "790881c5-8eb2-4233-ac15-657f5ae7ccec" (UID: "790881c5-8eb2-4233-ac15-657f5ae7ccec"). InnerVolumeSpecName "pvc-fb65aa63-2762-435b-a8ef-8892b9ffe1f6". PluginName "kubernetes.io/csi", VolumeGIDValue ""
Oct 30 21:30:27.586940 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:27.586918    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/790881c5-8eb2-4233-ac15-657f5ae7ccec-web-config" pod "790881c5-8eb2-4233-ac15-657f5ae7ccec" (UID: "790881c5-8eb2-4233-ac15-657f5ae7ccec"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:30:27.620251 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:27.620219    4060 generic.go:356] "Generic (PLEG): container finished" podID="790881c5-8eb2-4233-ac15-657f5ae7ccec" containerID="9e559607c7fe449ff89634190bd1ca5ae9fc08f0860be6fc42f4edc7fd06693d" exitCode=0
Oct 30 21:30:27.620686 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:27.620263    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1" event={"ID":"790881c5-8eb2-4233-ac15-657f5ae7ccec","Type":"ContainerDied","Data":"9e559607c7fe449ff89634190bd1ca5ae9fc08f0860be6fc42f4edc7fd06693d"}
Oct 30 21:30:27.620686 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:27.620288    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1"
Oct 30 21:30:27.620686 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:27.620318    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1" event={"ID":"790881c5-8eb2-4233-ac15-657f5ae7ccec","Type":"ContainerDied","Data":"27cb6d0c36ebe97fd0f36521d716e09be4e079107ca029c20ad110cd3a58f9ce"}
Oct 30 21:30:27.620686 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:27.620354    4060 scope.go:122] "RemoveContainer" containerID="cddc211b2a5eaf6d6493e7a733eec68511533ead37020442bdf26109ed727e2e"
Oct 30 21:30:27.629894 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:27.629876    4060 scope.go:122] "RemoveContainer" containerID="3d83d425f164debc2b0cff955dd56d77615fc31e4d2be3e656b31dd938b0829b"
Oct 30 21:30:27.638105 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:27.638082    4060 scope.go:122] "RemoveContainer" containerID="9e559607c7fe449ff89634190bd1ca5ae9fc08f0860be6fc42f4edc7fd06693d"
Oct 30 21:30:27.646050 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:27.646033    4060 scope.go:122] "RemoveContainer" containerID="3644d766fd95bcc8b8cca90d5975c116d954535eba6afe0f02255dc747e02bdf"
Oct 30 21:30:27.653986 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:27.653967    4060 scope.go:122] "RemoveContainer" containerID="cddc211b2a5eaf6d6493e7a733eec68511533ead37020442bdf26109ed727e2e"
Oct 30 21:30:27.654268 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:30:27.654243    4060 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cddc211b2a5eaf6d6493e7a733eec68511533ead37020442bdf26109ed727e2e\": container with ID starting with cddc211b2a5eaf6d6493e7a733eec68511533ead37020442bdf26109ed727e2e not found: ID does not exist" containerID="cddc211b2a5eaf6d6493e7a733eec68511533ead37020442bdf26109ed727e2e"
Oct 30 21:30:27.654309 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:27.654278    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cddc211b2a5eaf6d6493e7a733eec68511533ead37020442bdf26109ed727e2e"} err="failed to get container status \"cddc211b2a5eaf6d6493e7a733eec68511533ead37020442bdf26109ed727e2e\": rpc error: code = NotFound desc = could not find container \"cddc211b2a5eaf6d6493e7a733eec68511533ead37020442bdf26109ed727e2e\": container with ID starting with cddc211b2a5eaf6d6493e7a733eec68511533ead37020442bdf26109ed727e2e not found: ID does not exist"
Oct 30 21:30:27.654309 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:27.654299    4060 scope.go:122] "RemoveContainer" containerID="3d83d425f164debc2b0cff955dd56d77615fc31e4d2be3e656b31dd938b0829b"
Oct 30 21:30:27.654578 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:30:27.654560    4060 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3d83d425f164debc2b0cff955dd56d77615fc31e4d2be3e656b31dd938b0829b\": container with ID starting with 3d83d425f164debc2b0cff955dd56d77615fc31e4d2be3e656b31dd938b0829b not found: ID does not exist" containerID="3d83d425f164debc2b0cff955dd56d77615fc31e4d2be3e656b31dd938b0829b"
Oct 30 21:30:27.654644 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:27.654583    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d83d425f164debc2b0cff955dd56d77615fc31e4d2be3e656b31dd938b0829b"} err="failed to get container status \"3d83d425f164debc2b0cff955dd56d77615fc31e4d2be3e656b31dd938b0829b\": rpc error: code = NotFound desc = could not find container \"3d83d425f164debc2b0cff955dd56d77615fc31e4d2be3e656b31dd938b0829b\": container with ID starting with 3d83d425f164debc2b0cff955dd56d77615fc31e4d2be3e656b31dd938b0829b not found: ID does not exist"
Oct 30 21:30:27.654644 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:27.654597    4060 scope.go:122] "RemoveContainer" containerID="9e559607c7fe449ff89634190bd1ca5ae9fc08f0860be6fc42f4edc7fd06693d"
Oct 30 21:30:27.654835 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:30:27.654815    4060 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9e559607c7fe449ff89634190bd1ca5ae9fc08f0860be6fc42f4edc7fd06693d\": container with ID starting with 9e559607c7fe449ff89634190bd1ca5ae9fc08f0860be6fc42f4edc7fd06693d not found: ID does not exist" containerID="9e559607c7fe449ff89634190bd1ca5ae9fc08f0860be6fc42f4edc7fd06693d"
Oct 30 21:30:27.654878 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:27.654843    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9e559607c7fe449ff89634190bd1ca5ae9fc08f0860be6fc42f4edc7fd06693d"} err="failed to get container status \"9e559607c7fe449ff89634190bd1ca5ae9fc08f0860be6fc42f4edc7fd06693d\": rpc error: code = NotFound desc = could not find container \"9e559607c7fe449ff89634190bd1ca5ae9fc08f0860be6fc42f4edc7fd06693d\": container with ID starting with 9e559607c7fe449ff89634190bd1ca5ae9fc08f0860be6fc42f4edc7fd06693d not found: ID does not exist"
Oct 30 21:30:27.654878 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:27.654858    4060 scope.go:122] "RemoveContainer" containerID="3644d766fd95bcc8b8cca90d5975c116d954535eba6afe0f02255dc747e02bdf"
Oct 30 21:30:27.655106 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:30:27.655090    4060 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3644d766fd95bcc8b8cca90d5975c116d954535eba6afe0f02255dc747e02bdf\": container with ID starting with 3644d766fd95bcc8b8cca90d5975c116d954535eba6afe0f02255dc747e02bdf not found: ID does not exist" containerID="3644d766fd95bcc8b8cca90d5975c116d954535eba6afe0f02255dc747e02bdf"
Oct 30 21:30:27.655155 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:27.655108    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3644d766fd95bcc8b8cca90d5975c116d954535eba6afe0f02255dc747e02bdf"} err="failed to get container status \"3644d766fd95bcc8b8cca90d5975c116d954535eba6afe0f02255dc747e02bdf\": rpc error: code = NotFound desc = could not find container \"3644d766fd95bcc8b8cca90d5975c116d954535eba6afe0f02255dc747e02bdf\": container with ID starting with 3644d766fd95bcc8b8cca90d5975c116d954535eba6afe0f02255dc747e02bdf not found: ID does not exist"
Oct 30 21:30:27.673049 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:27.673022    4060 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/790881c5-8eb2-4233-ac15-657f5ae7ccec-thanos-prometheus-http-client-file\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:30:27.673049 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:27.673047    4060 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-web-tls-ca\" (UniqueName: \"kubernetes.io/secret/790881c5-8eb2-4233-ac15-657f5ae7ccec-secret-prometheus-web-tls-ca\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:30:27.673342 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:27.673058    4060 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/790881c5-8eb2-4233-ac15-657f5ae7ccec-config\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:30:27.673342 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:27.673069    4060 reconciler_common.go:299] "Volume detached for volume \"web-config-tls-secret-cert-prometheus-operated-tls-f3457c70\" (UniqueName: \"kubernetes.io/secret/790881c5-8eb2-4233-ac15-657f5ae7ccec-web-config-tls-secret-cert-prometheus-operated-tls-f3457c70\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:30:27.673342 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:27.673078    4060 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/790881c5-8eb2-4233-ac15-657f5ae7ccec-config-out\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:30:27.673342 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:27.673087    4060 reconciler_common.go:299] "Volume detached for volume \"prometheus-data-science-monitoringstack-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/790881c5-8eb2-4233-ac15-657f5ae7ccec-prometheus-data-science-monitoringstack-rulefiles-2\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:30:27.673342 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:27.673097    4060 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bw6cp\" (UniqueName: \"kubernetes.io/projected/790881c5-8eb2-4233-ac15-657f5ae7ccec-kube-api-access-bw6cp\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:30:27.673342 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:27.673105    4060 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/790881c5-8eb2-4233-ac15-657f5ae7ccec-web-config\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:30:27.673342 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:27.673137    4060 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"pvc-fb65aa63-2762-435b-a8ef-8892b9ffe1f6\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0913d5896cba88aba\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" "
Oct 30 21:30:27.673342 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:27.673150    4060 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/790881c5-8eb2-4233-ac15-657f5ae7ccec-tls-assets\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:30:27.673342 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:27.673159    4060 reconciler_common.go:299] "Volume detached for volume \"prometheus-data-science-monitoringstack-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/790881c5-8eb2-4233-ac15-657f5ae7ccec-prometheus-data-science-monitoringstack-rulefiles-0\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:30:27.673342 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:27.673170    4060 reconciler_common.go:299] "Volume detached for volume \"web-config-tls-secret-key-prometheus-operated-tls-f3457c70\" (UniqueName: \"kubernetes.io/secret/790881c5-8eb2-4233-ac15-657f5ae7ccec-web-config-tls-secret-key-prometheus-operated-tls-f3457c70\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:30:27.685378 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:27.685355    4060 operation_generator.go:893] UnmountDevice succeeded for volume "pvc-fb65aa63-2762-435b-a8ef-8892b9ffe1f6" (UniqueName: "kubernetes.io/csi/ebs.csi.aws.com^vol-0913d5896cba88aba") on node "ip-10-0-142-4.us-west-1.compute.internal"
Oct 30 21:30:27.773873 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:27.773831    4060 reconciler_common.go:299] "Volume detached for volume \"pvc-fb65aa63-2762-435b-a8ef-8892b9ffe1f6\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0913d5896cba88aba\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"csi-dbc62499abb3d22ac96b5aeec76b56804a0f706240b990b24aaa3954301809a6\""
Oct 30 21:30:27.790635 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:27.790596    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/prometheus-data-science-monitoringstack-1"]
Oct 30 21:30:27.796885 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:27.796857    4060 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/prometheus-data-science-monitoringstack-1"]
Oct 30 21:30:27.944383 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:27.944299    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:30:27.944596 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:27.944570    4060 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-collector-0" podUID="6a0d8240-18ce-47dc-b9ca-aefd497f47c0" containerName="otc-container" containerID="cri-o://3b01fd1a1ece09130a8e6effa3b2ad9ba2770be59fa447bfa7057204c31d6d4a" gracePeriod=30
Oct 30 21:30:28.184656 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:28.184631    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:30:28.379541 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:28.379506    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/6a0d8240-18ce-47dc-b9ca-aefd497f47c0-data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/6a0d8240-18ce-47dc-b9ca-aefd497f47c0-data-science-collector-ta-client-cert\") pod \"6a0d8240-18ce-47dc-b9ca-aefd497f47c0\" (UID: \"6a0d8240-18ce-47dc-b9ca-aefd497f47c0\") "
Oct 30 21:30:28.379541 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:28.379545    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/6a0d8240-18ce-47dc-b9ca-aefd497f47c0-monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/6a0d8240-18ce-47dc-b9ca-aefd497f47c0-monitoring-tls-certs\") pod \"6a0d8240-18ce-47dc-b9ca-aefd497f47c0\" (UID: \"6a0d8240-18ce-47dc-b9ca-aefd497f47c0\") "
Oct 30 21:30:28.379792 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:28.379600    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/6a0d8240-18ce-47dc-b9ca-aefd497f47c0-tls-certs\" (UniqueName: \"kubernetes.io/secret/6a0d8240-18ce-47dc-b9ca-aefd497f47c0-tls-certs\") pod \"6a0d8240-18ce-47dc-b9ca-aefd497f47c0\" (UID: \"6a0d8240-18ce-47dc-b9ca-aefd497f47c0\") "
Oct 30 21:30:28.379792 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:28.379652    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/6a0d8240-18ce-47dc-b9ca-aefd497f47c0-otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/6a0d8240-18ce-47dc-b9ca-aefd497f47c0-otlp-tls-certs\") pod \"6a0d8240-18ce-47dc-b9ca-aefd497f47c0\" (UID: \"6a0d8240-18ce-47dc-b9ca-aefd497f47c0\") "
Oct 30 21:30:28.379792 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:28.379721    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6a0d8240-18ce-47dc-b9ca-aefd497f47c0-kube-api-access-lnhhc\" (UniqueName: \"kubernetes.io/projected/6a0d8240-18ce-47dc-b9ca-aefd497f47c0-kube-api-access-lnhhc\") pod \"6a0d8240-18ce-47dc-b9ca-aefd497f47c0\" (UID: \"6a0d8240-18ce-47dc-b9ca-aefd497f47c0\") "
Oct 30 21:30:28.379792 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:28.379744    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/6a0d8240-18ce-47dc-b9ca-aefd497f47c0-otc-internal\" (UniqueName: \"kubernetes.io/configmap/6a0d8240-18ce-47dc-b9ca-aefd497f47c0-otc-internal\") pod \"6a0d8240-18ce-47dc-b9ca-aefd497f47c0\" (UID: \"6a0d8240-18ce-47dc-b9ca-aefd497f47c0\") "
Oct 30 21:30:28.380322 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:28.380274    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6a0d8240-18ce-47dc-b9ca-aefd497f47c0-otc-internal" pod "6a0d8240-18ce-47dc-b9ca-aefd497f47c0" (UID: "6a0d8240-18ce-47dc-b9ca-aefd497f47c0"). InnerVolumeSpecName "otc-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:30:28.382357 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:28.382309    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6a0d8240-18ce-47dc-b9ca-aefd497f47c0-data-science-collector-ta-client-cert" pod "6a0d8240-18ce-47dc-b9ca-aefd497f47c0" (UID: "6a0d8240-18ce-47dc-b9ca-aefd497f47c0"). InnerVolumeSpecName "data-science-collector-ta-client-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:30:28.382857 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:28.382822    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6a0d8240-18ce-47dc-b9ca-aefd497f47c0-tls-certs" pod "6a0d8240-18ce-47dc-b9ca-aefd497f47c0" (UID: "6a0d8240-18ce-47dc-b9ca-aefd497f47c0"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:30:28.383074 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:28.382995    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6a0d8240-18ce-47dc-b9ca-aefd497f47c0-otlp-tls-certs" pod "6a0d8240-18ce-47dc-b9ca-aefd497f47c0" (UID: "6a0d8240-18ce-47dc-b9ca-aefd497f47c0"). InnerVolumeSpecName "otlp-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:30:28.383144 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:28.383113    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6a0d8240-18ce-47dc-b9ca-aefd497f47c0-monitoring-tls-certs" pod "6a0d8240-18ce-47dc-b9ca-aefd497f47c0" (UID: "6a0d8240-18ce-47dc-b9ca-aefd497f47c0"). InnerVolumeSpecName "monitoring-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:30:28.383735 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:28.383714    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6a0d8240-18ce-47dc-b9ca-aefd497f47c0-kube-api-access-lnhhc" pod "6a0d8240-18ce-47dc-b9ca-aefd497f47c0" (UID: "6a0d8240-18ce-47dc-b9ca-aefd497f47c0"). InnerVolumeSpecName "kube-api-access-lnhhc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:30:28.480949 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:28.480910    4060 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6a0d8240-18ce-47dc-b9ca-aefd497f47c0-tls-certs\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:30:28.480949 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:28.480951    4060 reconciler_common.go:299] "Volume detached for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/6a0d8240-18ce-47dc-b9ca-aefd497f47c0-otlp-tls-certs\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:30:28.481133 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:28.480971    4060 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lnhhc\" (UniqueName: \"kubernetes.io/projected/6a0d8240-18ce-47dc-b9ca-aefd497f47c0-kube-api-access-lnhhc\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:30:28.481133 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:28.480986    4060 reconciler_common.go:299] "Volume detached for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/6a0d8240-18ce-47dc-b9ca-aefd497f47c0-otc-internal\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:30:28.481133 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:28.481002    4060 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/6a0d8240-18ce-47dc-b9ca-aefd497f47c0-data-science-collector-ta-client-cert\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:30:28.481133 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:28.481016    4060 reconciler_common.go:299] "Volume detached for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/6a0d8240-18ce-47dc-b9ca-aefd497f47c0-monitoring-tls-certs\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:30:28.627658 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:28.627567    4060 generic.go:356] "Generic (PLEG): container finished" podID="6a0d8240-18ce-47dc-b9ca-aefd497f47c0" containerID="3b01fd1a1ece09130a8e6effa3b2ad9ba2770be59fa447bfa7057204c31d6d4a" exitCode=0
Oct 30 21:30:28.627658 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:28.627614    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:30:28.627658 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:28.627644    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"6a0d8240-18ce-47dc-b9ca-aefd497f47c0","Type":"ContainerDied","Data":"3b01fd1a1ece09130a8e6effa3b2ad9ba2770be59fa447bfa7057204c31d6d4a"}
Oct 30 21:30:28.628143 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:28.627696    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"6a0d8240-18ce-47dc-b9ca-aefd497f47c0","Type":"ContainerDied","Data":"d56bfb6d3bb4b23790461d113934ff3f6fa7bad8549df10aeb51dddeba1a21ab"}
Oct 30 21:30:28.628143 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:28.627718    4060 scope.go:122] "RemoveContainer" containerID="3b01fd1a1ece09130a8e6effa3b2ad9ba2770be59fa447bfa7057204c31d6d4a"
Oct 30 21:30:28.637015 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:28.636995    4060 scope.go:122] "RemoveContainer" containerID="3b01fd1a1ece09130a8e6effa3b2ad9ba2770be59fa447bfa7057204c31d6d4a"
Oct 30 21:30:28.637265 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:30:28.637245    4060 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3b01fd1a1ece09130a8e6effa3b2ad9ba2770be59fa447bfa7057204c31d6d4a\": container with ID starting with 3b01fd1a1ece09130a8e6effa3b2ad9ba2770be59fa447bfa7057204c31d6d4a not found: ID does not exist" containerID="3b01fd1a1ece09130a8e6effa3b2ad9ba2770be59fa447bfa7057204c31d6d4a"
Oct 30 21:30:28.637326 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:28.637278    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b01fd1a1ece09130a8e6effa3b2ad9ba2770be59fa447bfa7057204c31d6d4a"} err="failed to get container status \"3b01fd1a1ece09130a8e6effa3b2ad9ba2770be59fa447bfa7057204c31d6d4a\": rpc error: code = NotFound desc = could not find container \"3b01fd1a1ece09130a8e6effa3b2ad9ba2770be59fa447bfa7057204c31d6d4a\": container with ID starting with 3b01fd1a1ece09130a8e6effa3b2ad9ba2770be59fa447bfa7057204c31d6d4a not found: ID does not exist"
Oct 30 21:30:28.796184 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:28.796151    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:30:28.800189 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:28.800161    4060 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:30:29.431307 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:29.431273    4060 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="6a0d8240-18ce-47dc-b9ca-aefd497f47c0" path="/var/lib/kubelet/pods/6a0d8240-18ce-47dc-b9ca-aefd497f47c0/volumes"
Oct 30 21:30:29.431740 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:29.431726    4060 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="790881c5-8eb2-4233-ac15-657f5ae7ccec" path="/var/lib/kubelet/pods/790881c5-8eb2-4233-ac15-657f5ae7ccec/volumes"
Oct 30 21:30:32.486988 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:32.486951    4060 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0" podUID="a43b743c-b9f0-40f9-a02b-b5631f82b41a" containerName="alertmanager" probeResult="failure" output="Get \"http://10.133.0.115:9093/-/ready\": dial tcp 10.133.0.115:9093: connect: connection refused"
Oct 30 21:30:35.828658 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:35.828634    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:30:35.835734 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:35.835714    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a43b743c-b9f0-40f9-a02b-b5631f82b41a-alertmanager-data-science-monitoringstack-db\" (UniqueName: \"kubernetes.io/empty-dir/a43b743c-b9f0-40f9-a02b-b5631f82b41a-alertmanager-data-science-monitoringstack-db\") pod \"a43b743c-b9f0-40f9-a02b-b5631f82b41a\" (UID: \"a43b743c-b9f0-40f9-a02b-b5631f82b41a\") "
Oct 30 21:30:35.835806 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:35.835757    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/a43b743c-b9f0-40f9-a02b-b5631f82b41a-config-volume\" (UniqueName: \"kubernetes.io/secret/a43b743c-b9f0-40f9-a02b-b5631f82b41a-config-volume\") pod \"a43b743c-b9f0-40f9-a02b-b5631f82b41a\" (UID: \"a43b743c-b9f0-40f9-a02b-b5631f82b41a\") "
Oct 30 21:30:35.835806 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:35.835789    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a43b743c-b9f0-40f9-a02b-b5631f82b41a-tls-assets\" (UniqueName: \"kubernetes.io/projected/a43b743c-b9f0-40f9-a02b-b5631f82b41a-tls-assets\") pod \"a43b743c-b9f0-40f9-a02b-b5631f82b41a\" (UID: \"a43b743c-b9f0-40f9-a02b-b5631f82b41a\") "
Oct 30 21:30:35.835911 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:35.835805    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/a43b743c-b9f0-40f9-a02b-b5631f82b41a-web-config\" (UniqueName: \"kubernetes.io/secret/a43b743c-b9f0-40f9-a02b-b5631f82b41a-web-config\") pod \"a43b743c-b9f0-40f9-a02b-b5631f82b41a\" (UID: \"a43b743c-b9f0-40f9-a02b-b5631f82b41a\") "
Oct 30 21:30:35.835911 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:35.835840    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a43b743c-b9f0-40f9-a02b-b5631f82b41a-kube-api-access-5g9rb\" (UniqueName: \"kubernetes.io/projected/a43b743c-b9f0-40f9-a02b-b5631f82b41a-kube-api-access-5g9rb\") pod \"a43b743c-b9f0-40f9-a02b-b5631f82b41a\" (UID: \"a43b743c-b9f0-40f9-a02b-b5631f82b41a\") "
Oct 30 21:30:35.835911 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:35.835866    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/a43b743c-b9f0-40f9-a02b-b5631f82b41a-cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a43b743c-b9f0-40f9-a02b-b5631f82b41a-cluster-tls-config\") pod \"a43b743c-b9f0-40f9-a02b-b5631f82b41a\" (UID: \"a43b743c-b9f0-40f9-a02b-b5631f82b41a\") "
Oct 30 21:30:35.836063 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:35.836030    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a43b743c-b9f0-40f9-a02b-b5631f82b41a-alertmanager-data-science-monitoringstack-db" pod "a43b743c-b9f0-40f9-a02b-b5631f82b41a" (UID: "a43b743c-b9f0-40f9-a02b-b5631f82b41a"). InnerVolumeSpecName "alertmanager-data-science-monitoringstack-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:30:35.838014 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:35.837984    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a43b743c-b9f0-40f9-a02b-b5631f82b41a-config-volume" pod "a43b743c-b9f0-40f9-a02b-b5631f82b41a" (UID: "a43b743c-b9f0-40f9-a02b-b5631f82b41a"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:30:35.838116 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:35.838063    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a43b743c-b9f0-40f9-a02b-b5631f82b41a-kube-api-access-5g9rb" pod "a43b743c-b9f0-40f9-a02b-b5631f82b41a" (UID: "a43b743c-b9f0-40f9-a02b-b5631f82b41a"). InnerVolumeSpecName "kube-api-access-5g9rb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:30:35.838290 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:35.838272    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a43b743c-b9f0-40f9-a02b-b5631f82b41a-tls-assets" pod "a43b743c-b9f0-40f9-a02b-b5631f82b41a" (UID: "a43b743c-b9f0-40f9-a02b-b5631f82b41a"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:30:35.841601 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:35.841548    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a43b743c-b9f0-40f9-a02b-b5631f82b41a-cluster-tls-config" pod "a43b743c-b9f0-40f9-a02b-b5631f82b41a" (UID: "a43b743c-b9f0-40f9-a02b-b5631f82b41a"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:30:35.847691 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:35.847621    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a43b743c-b9f0-40f9-a02b-b5631f82b41a-web-config" pod "a43b743c-b9f0-40f9-a02b-b5631f82b41a" (UID: "a43b743c-b9f0-40f9-a02b-b5631f82b41a"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:30:35.936748 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:35.936718    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a43b743c-b9f0-40f9-a02b-b5631f82b41a-config-out\" (UniqueName: \"kubernetes.io/empty-dir/a43b743c-b9f0-40f9-a02b-b5631f82b41a-config-out\") pod \"a43b743c-b9f0-40f9-a02b-b5631f82b41a\" (UID: \"a43b743c-b9f0-40f9-a02b-b5631f82b41a\") "
Oct 30 21:30:35.936972 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:35.936956    4060 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a43b743c-b9f0-40f9-a02b-b5631f82b41a-tls-assets\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:30:35.937049 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:35.936981    4060 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a43b743c-b9f0-40f9-a02b-b5631f82b41a-web-config\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:30:35.937049 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:35.936998    4060 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5g9rb\" (UniqueName: \"kubernetes.io/projected/a43b743c-b9f0-40f9-a02b-b5631f82b41a-kube-api-access-5g9rb\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:30:35.937049 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:35.937014    4060 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a43b743c-b9f0-40f9-a02b-b5631f82b41a-cluster-tls-config\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:30:35.937049 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:35.937029    4060 reconciler_common.go:299] "Volume detached for volume \"alertmanager-data-science-monitoringstack-db\" (UniqueName: \"kubernetes.io/empty-dir/a43b743c-b9f0-40f9-a02b-b5631f82b41a-alertmanager-data-science-monitoringstack-db\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:30:35.937049 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:35.937046    4060 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a43b743c-b9f0-40f9-a02b-b5631f82b41a-config-volume\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:30:35.938677 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:35.938651    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a43b743c-b9f0-40f9-a02b-b5631f82b41a-config-out" pod "a43b743c-b9f0-40f9-a02b-b5631f82b41a" (UID: "a43b743c-b9f0-40f9-a02b-b5631f82b41a"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:30:36.037890 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:36.037853    4060 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a43b743c-b9f0-40f9-a02b-b5631f82b41a-config-out\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:30:36.666456 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:36.666426    4060 generic.go:356] "Generic (PLEG): container finished" podID="a43b743c-b9f0-40f9-a02b-b5631f82b41a" containerID="30fc04fb9901bf6e193aecf979c7148c06beb7ea9e367a91193d8a7c8fc4395f" exitCode=0
Oct 30 21:30:36.666616 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:36.666484    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:30:36.666616 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:36.666528    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0" event={"ID":"a43b743c-b9f0-40f9-a02b-b5631f82b41a","Type":"ContainerDied","Data":"30fc04fb9901bf6e193aecf979c7148c06beb7ea9e367a91193d8a7c8fc4395f"}
Oct 30 21:30:36.666616 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:36.666604    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0" event={"ID":"a43b743c-b9f0-40f9-a02b-b5631f82b41a","Type":"ContainerDied","Data":"20cfe73f1aeb3c5a7b219f7dab9a2bb97457772cb9f210f7aad585aa316e27ef"}
Oct 30 21:30:36.666728 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:36.666642    4060 scope.go:122] "RemoveContainer" containerID="3f27725038d25b8ce636577cc882134b74a0d08255099dec2e62c2b578b4540b"
Oct 30 21:30:36.675949 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:36.675932    4060 scope.go:122] "RemoveContainer" containerID="30fc04fb9901bf6e193aecf979c7148c06beb7ea9e367a91193d8a7c8fc4395f"
Oct 30 21:30:36.684440 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:36.684424    4060 scope.go:122] "RemoveContainer" containerID="9d8f9a2912e1b943ab6df1f5f05c75aae0dbc6bf5983f1073e2cf248b7931309"
Oct 30 21:30:36.691532 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:36.691509    4060 scope.go:122] "RemoveContainer" containerID="3f27725038d25b8ce636577cc882134b74a0d08255099dec2e62c2b578b4540b"
Oct 30 21:30:36.691810 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:30:36.691788    4060 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3f27725038d25b8ce636577cc882134b74a0d08255099dec2e62c2b578b4540b\": container with ID starting with 3f27725038d25b8ce636577cc882134b74a0d08255099dec2e62c2b578b4540b not found: ID does not exist" containerID="3f27725038d25b8ce636577cc882134b74a0d08255099dec2e62c2b578b4540b"
Oct 30 21:30:36.691866 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:36.691819    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f27725038d25b8ce636577cc882134b74a0d08255099dec2e62c2b578b4540b"} err="failed to get container status \"3f27725038d25b8ce636577cc882134b74a0d08255099dec2e62c2b578b4540b\": rpc error: code = NotFound desc = could not find container \"3f27725038d25b8ce636577cc882134b74a0d08255099dec2e62c2b578b4540b\": container with ID starting with 3f27725038d25b8ce636577cc882134b74a0d08255099dec2e62c2b578b4540b not found: ID does not exist"
Oct 30 21:30:36.691866 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:36.691837    4060 scope.go:122] "RemoveContainer" containerID="30fc04fb9901bf6e193aecf979c7148c06beb7ea9e367a91193d8a7c8fc4395f"
Oct 30 21:30:36.692070 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:30:36.692054    4060 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"30fc04fb9901bf6e193aecf979c7148c06beb7ea9e367a91193d8a7c8fc4395f\": container with ID starting with 30fc04fb9901bf6e193aecf979c7148c06beb7ea9e367a91193d8a7c8fc4395f not found: ID does not exist" containerID="30fc04fb9901bf6e193aecf979c7148c06beb7ea9e367a91193d8a7c8fc4395f"
Oct 30 21:30:36.692109 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:36.692077    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30fc04fb9901bf6e193aecf979c7148c06beb7ea9e367a91193d8a7c8fc4395f"} err="failed to get container status \"30fc04fb9901bf6e193aecf979c7148c06beb7ea9e367a91193d8a7c8fc4395f\": rpc error: code = NotFound desc = could not find container \"30fc04fb9901bf6e193aecf979c7148c06beb7ea9e367a91193d8a7c8fc4395f\": container with ID starting with 30fc04fb9901bf6e193aecf979c7148c06beb7ea9e367a91193d8a7c8fc4395f not found: ID does not exist"
Oct 30 21:30:36.692109 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:36.692092    4060 scope.go:122] "RemoveContainer" containerID="9d8f9a2912e1b943ab6df1f5f05c75aae0dbc6bf5983f1073e2cf248b7931309"
Oct 30 21:30:36.692338 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:30:36.692320    4060 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9d8f9a2912e1b943ab6df1f5f05c75aae0dbc6bf5983f1073e2cf248b7931309\": container with ID starting with 9d8f9a2912e1b943ab6df1f5f05c75aae0dbc6bf5983f1073e2cf248b7931309 not found: ID does not exist" containerID="9d8f9a2912e1b943ab6df1f5f05c75aae0dbc6bf5983f1073e2cf248b7931309"
Oct 30 21:30:36.692392 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:36.692343    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d8f9a2912e1b943ab6df1f5f05c75aae0dbc6bf5983f1073e2cf248b7931309"} err="failed to get container status \"9d8f9a2912e1b943ab6df1f5f05c75aae0dbc6bf5983f1073e2cf248b7931309\": rpc error: code = NotFound desc = could not find container \"9d8f9a2912e1b943ab6df1f5f05c75aae0dbc6bf5983f1073e2cf248b7931309\": container with ID starting with 9d8f9a2912e1b943ab6df1f5f05c75aae0dbc6bf5983f1073e2cf248b7931309 not found: ID does not exist"
Oct 30 21:30:36.884855 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:36.884759    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"]
Oct 30 21:30:36.934401 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:36.934361    4060 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"]
Oct 30 21:30:37.429407 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:37.429373    4060 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a43b743c-b9f0-40f9-a02b-b5631f82b41a" path="/var/lib/kubelet/pods/a43b743c-b9f0-40f9-a02b-b5631f82b41a/volumes"
Oct 30 21:30:42.149529 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:30:42.149475    4060 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v2f4x" containerName="extractor"
Oct 30 21:30:44.104125 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:44.104090    4060 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-smmxr"]
Oct 30 21:30:44.104546 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:44.104369    4060 cpu_manager.go:414] "containerMap: removing container" podUID="790881c5-8eb2-4233-ac15-657f5ae7ccec" containerName="config-reloader"
Oct 30 21:30:44.104546 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:44.104380    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="790881c5-8eb2-4233-ac15-657f5ae7ccec" containerName="config-reloader"
Oct 30 21:30:44.104546 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:44.104389    4060 cpu_manager.go:414] "containerMap: removing container" podUID="790881c5-8eb2-4233-ac15-657f5ae7ccec" containerName="thanos-sidecar"
Oct 30 21:30:44.104546 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:44.104395    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="790881c5-8eb2-4233-ac15-657f5ae7ccec" containerName="thanos-sidecar"
Oct 30 21:30:44.104546 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:44.104405    4060 cpu_manager.go:414] "containerMap: removing container" podUID="cc239be2-6a1b-4b84-a188-5e3232143f91" containerName="korrel8r"
Oct 30 21:30:44.104546 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:44.104410    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="cc239be2-6a1b-4b84-a188-5e3232143f91" containerName="korrel8r"
Oct 30 21:30:44.104546 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:44.104418    4060 cpu_manager.go:414] "containerMap: removing container" podUID="28b92edb-fc9c-4ff0-9374-959f013cd6c7" containerName="korrel8r"
Oct 30 21:30:44.104546 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:44.104423    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="28b92edb-fc9c-4ff0-9374-959f013cd6c7" containerName="korrel8r"
Oct 30 21:30:44.104546 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:44.104433    4060 cpu_manager.go:414] "containerMap: removing container" podUID="a43b743c-b9f0-40f9-a02b-b5631f82b41a" containerName="config-reloader"
Oct 30 21:30:44.104546 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:44.104438    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a43b743c-b9f0-40f9-a02b-b5631f82b41a" containerName="config-reloader"
Oct 30 21:30:44.104546 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:44.104443    4060 cpu_manager.go:414] "containerMap: removing container" podUID="790881c5-8eb2-4233-ac15-657f5ae7ccec" containerName="prometheus"
Oct 30 21:30:44.104546 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:44.104448    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="790881c5-8eb2-4233-ac15-657f5ae7ccec" containerName="prometheus"
Oct 30 21:30:44.104546 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:44.104457    4060 cpu_manager.go:414] "containerMap: removing container" podUID="790881c5-8eb2-4233-ac15-657f5ae7ccec" containerName="init-config-reloader"
Oct 30 21:30:44.104546 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:44.104461    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="790881c5-8eb2-4233-ac15-657f5ae7ccec" containerName="init-config-reloader"
Oct 30 21:30:44.104546 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:44.104472    4060 cpu_manager.go:414] "containerMap: removing container" podUID="6a0d8240-18ce-47dc-b9ca-aefd497f47c0" containerName="otc-container"
Oct 30 21:30:44.104546 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:44.104476    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6a0d8240-18ce-47dc-b9ca-aefd497f47c0" containerName="otc-container"
Oct 30 21:30:44.104546 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:44.104484    4060 cpu_manager.go:414] "containerMap: removing container" podUID="a43b743c-b9f0-40f9-a02b-b5631f82b41a" containerName="alertmanager"
Oct 30 21:30:44.104546 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:44.104503    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a43b743c-b9f0-40f9-a02b-b5631f82b41a" containerName="alertmanager"
Oct 30 21:30:44.104546 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:44.104509    4060 cpu_manager.go:414] "containerMap: removing container" podUID="8c8f231f-5064-498b-bed5-c1d7213283b2" containerName="kube-rbac-proxy"
Oct 30 21:30:44.104546 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:44.104514    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8c8f231f-5064-498b-bed5-c1d7213283b2" containerName="kube-rbac-proxy"
Oct 30 21:30:44.104546 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:44.104522    4060 cpu_manager.go:414] "containerMap: removing container" podUID="a43b743c-b9f0-40f9-a02b-b5631f82b41a" containerName="init-config-reloader"
Oct 30 21:30:44.104546 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:44.104527    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a43b743c-b9f0-40f9-a02b-b5631f82b41a" containerName="init-config-reloader"
Oct 30 21:30:44.105192 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:44.104570    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="6a0d8240-18ce-47dc-b9ca-aefd497f47c0" containerName="otc-container"
Oct 30 21:30:44.105192 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:44.104578    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="a43b743c-b9f0-40f9-a02b-b5631f82b41a" containerName="alertmanager"
Oct 30 21:30:44.105192 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:44.104584    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="8c8f231f-5064-498b-bed5-c1d7213283b2" containerName="kube-rbac-proxy"
Oct 30 21:30:44.105192 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:44.104590    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="790881c5-8eb2-4233-ac15-657f5ae7ccec" containerName="config-reloader"
Oct 30 21:30:44.105192 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:44.104595    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="790881c5-8eb2-4233-ac15-657f5ae7ccec" containerName="thanos-sidecar"
Oct 30 21:30:44.105192 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:44.104600    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="cc239be2-6a1b-4b84-a188-5e3232143f91" containerName="korrel8r"
Oct 30 21:30:44.105192 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:44.104605    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="28b92edb-fc9c-4ff0-9374-959f013cd6c7" containerName="korrel8r"
Oct 30 21:30:44.105192 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:44.104613    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="a43b743c-b9f0-40f9-a02b-b5631f82b41a" containerName="config-reloader"
Oct 30 21:30:44.105192 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:44.104619    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="790881c5-8eb2-4233-ac15-657f5ae7ccec" containerName="prometheus"
Oct 30 21:30:44.109110 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:44.109092    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-smmxr"
Oct 30 21:30:44.162605 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:44.162573    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"kube-root-ca.crt\""
Oct 30 21:30:44.162605 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:44.162600    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"openshift-service-ca.crt\""
Oct 30 21:30:44.197320 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:44.197290    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/81ed591c-3ac0-43d7-bf5f-2e938d2f2c95-tls\") pod \"data-science-prometheus-cluster-proxy-545f759f7c-smmxr\" (UID: \"81ed591c-3ac0-43d7-bf5f-2e938d2f2c95\") " pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-smmxr"
Oct 30 21:30:44.197479 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:44.197328    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-ca\" (UniqueName: \"kubernetes.io/configmap/81ed591c-3ac0-43d7-bf5f-2e938d2f2c95-prometheus-ca\") pod \"data-science-prometheus-cluster-proxy-545f759f7c-smmxr\" (UID: \"81ed591c-3ac0-43d7-bf5f-2e938d2f2c95\") " pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-smmxr"
Oct 30 21:30:44.197479 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:44.197397    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jsjbb\" (UniqueName: \"kubernetes.io/projected/81ed591c-3ac0-43d7-bf5f-2e938d2f2c95-kube-api-access-jsjbb\") pod \"data-science-prometheus-cluster-proxy-545f759f7c-smmxr\" (UID: \"81ed591c-3ac0-43d7-bf5f-2e938d2f2c95\") " pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-smmxr"
Oct 30 21:30:44.197479 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:44.197462    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/81ed591c-3ac0-43d7-bf5f-2e938d2f2c95-kube-rbac-proxy-config\") pod \"data-science-prometheus-cluster-proxy-545f759f7c-smmxr\" (UID: \"81ed591c-3ac0-43d7-bf5f-2e938d2f2c95\") " pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-smmxr"
Oct 30 21:30:44.197622 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:44.197502    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-client-cert\" (UniqueName: \"kubernetes.io/secret/81ed591c-3ac0-43d7-bf5f-2e938d2f2c95-prometheus-client-cert\") pod \"data-science-prometheus-cluster-proxy-545f759f7c-smmxr\" (UID: \"81ed591c-3ac0-43d7-bf5f-2e938d2f2c95\") " pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-smmxr"
Oct 30 21:30:44.211991 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:44.211968    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"prometheus-web-tls-ca\""
Oct 30 21:30:44.212136 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:44.212046    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-prometheus-cluster-proxy-kube-rbac-proxy\""
Oct 30 21:30:44.212136 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:44.212110    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"prometheus-operated-tls\""
Oct 30 21:30:44.212268 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:44.212136    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-prometheus-cluster-proxy-dockercfg-9pjkh\""
Oct 30 21:30:44.212268 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:44.212232    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-prometheus-cluster-proxy-tls\""
Oct 30 21:30:44.213710 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:44.213691    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-smmxr"]
Oct 30 21:30:44.297910 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:44.297881    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jsjbb\" (UniqueName: \"kubernetes.io/projected/81ed591c-3ac0-43d7-bf5f-2e938d2f2c95-kube-api-access-jsjbb\") pod \"data-science-prometheus-cluster-proxy-545f759f7c-smmxr\" (UID: \"81ed591c-3ac0-43d7-bf5f-2e938d2f2c95\") " pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-smmxr"
Oct 30 21:30:44.298073 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:44.297917    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/81ed591c-3ac0-43d7-bf5f-2e938d2f2c95-kube-rbac-proxy-config\") pod \"data-science-prometheus-cluster-proxy-545f759f7c-smmxr\" (UID: \"81ed591c-3ac0-43d7-bf5f-2e938d2f2c95\") " pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-smmxr"
Oct 30 21:30:44.298073 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:44.297942    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-client-cert\" (UniqueName: \"kubernetes.io/secret/81ed591c-3ac0-43d7-bf5f-2e938d2f2c95-prometheus-client-cert\") pod \"data-science-prometheus-cluster-proxy-545f759f7c-smmxr\" (UID: \"81ed591c-3ac0-43d7-bf5f-2e938d2f2c95\") " pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-smmxr"
Oct 30 21:30:44.298073 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:44.298002    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/81ed591c-3ac0-43d7-bf5f-2e938d2f2c95-tls\") pod \"data-science-prometheus-cluster-proxy-545f759f7c-smmxr\" (UID: \"81ed591c-3ac0-43d7-bf5f-2e938d2f2c95\") " pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-smmxr"
Oct 30 21:30:44.298073 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:44.298027    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-ca\" (UniqueName: \"kubernetes.io/configmap/81ed591c-3ac0-43d7-bf5f-2e938d2f2c95-prometheus-ca\") pod \"data-science-prometheus-cluster-proxy-545f759f7c-smmxr\" (UID: \"81ed591c-3ac0-43d7-bf5f-2e938d2f2c95\") " pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-smmxr"
Oct 30 21:30:44.298798 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:44.298772    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-ca\" (UniqueName: \"kubernetes.io/configmap/81ed591c-3ac0-43d7-bf5f-2e938d2f2c95-prometheus-ca\") pod \"data-science-prometheus-cluster-proxy-545f759f7c-smmxr\" (UID: \"81ed591c-3ac0-43d7-bf5f-2e938d2f2c95\") " pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-smmxr"
Oct 30 21:30:44.300646 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:44.300619    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls\" (UniqueName: \"kubernetes.io/secret/81ed591c-3ac0-43d7-bf5f-2e938d2f2c95-tls\") pod \"data-science-prometheus-cluster-proxy-545f759f7c-smmxr\" (UID: \"81ed591c-3ac0-43d7-bf5f-2e938d2f2c95\") " pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-smmxr"
Oct 30 21:30:44.300920 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:44.300900    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/81ed591c-3ac0-43d7-bf5f-2e938d2f2c95-kube-rbac-proxy-config\") pod \"data-science-prometheus-cluster-proxy-545f759f7c-smmxr\" (UID: \"81ed591c-3ac0-43d7-bf5f-2e938d2f2c95\") " pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-smmxr"
Oct 30 21:30:44.300968 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:44.300954    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-client-cert\" (UniqueName: \"kubernetes.io/secret/81ed591c-3ac0-43d7-bf5f-2e938d2f2c95-prometheus-client-cert\") pod \"data-science-prometheus-cluster-proxy-545f759f7c-smmxr\" (UID: \"81ed591c-3ac0-43d7-bf5f-2e938d2f2c95\") " pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-smmxr"
Oct 30 21:30:44.360353 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:44.360294    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jsjbb\" (UniqueName: \"kubernetes.io/projected/81ed591c-3ac0-43d7-bf5f-2e938d2f2c95-kube-api-access-jsjbb\") pod \"data-science-prometheus-cluster-proxy-545f759f7c-smmxr\" (UID: \"81ed591c-3ac0-43d7-bf5f-2e938d2f2c95\") " pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-smmxr"
Oct 30 21:30:44.421186 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:44.421153    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-smmxr"
Oct 30 21:30:44.451522 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:44.451483    4060 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/korrel8r-5cbcc89b8f-6m8qc"]
Oct 30 21:30:44.455771 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:44.455750    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-6m8qc"
Oct 30 21:30:44.511483 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:44.511172    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"korrel8r-config\""
Oct 30 21:30:44.511483 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:44.511345    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"korrel8r-tls\""
Oct 30 21:30:44.511711 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:44.511678    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"korrel8r-dockercfg-vx7c8\""
Oct 30 21:30:44.518972 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:44.518944    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/korrel8r-5cbcc89b8f-6m8qc"]
Oct 30 21:30:44.601608 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:44.601582    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dp4lz\" (UniqueName: \"kubernetes.io/projected/c5db122f-0c8d-45d5-9b8f-c2fb2aed1b38-kube-api-access-dp4lz\") pod \"korrel8r-5cbcc89b8f-6m8qc\" (UID: \"c5db122f-0c8d-45d5-9b8f-c2fb2aed1b38\") " pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-6m8qc"
Oct 30 21:30:44.601752 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:44.601633    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c5db122f-0c8d-45d5-9b8f-c2fb2aed1b38-config\") pod \"korrel8r-5cbcc89b8f-6m8qc\" (UID: \"c5db122f-0c8d-45d5-9b8f-c2fb2aed1b38\") " pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-6m8qc"
Oct 30 21:30:44.601798 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:44.601758    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/c5db122f-0c8d-45d5-9b8f-c2fb2aed1b38-tls\") pod \"korrel8r-5cbcc89b8f-6m8qc\" (UID: \"c5db122f-0c8d-45d5-9b8f-c2fb2aed1b38\") " pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-6m8qc"
Oct 30 21:30:44.702146 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:44.702118    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c5db122f-0c8d-45d5-9b8f-c2fb2aed1b38-config\") pod \"korrel8r-5cbcc89b8f-6m8qc\" (UID: \"c5db122f-0c8d-45d5-9b8f-c2fb2aed1b38\") " pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-6m8qc"
Oct 30 21:30:44.702304 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:44.702176    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/c5db122f-0c8d-45d5-9b8f-c2fb2aed1b38-tls\") pod \"korrel8r-5cbcc89b8f-6m8qc\" (UID: \"c5db122f-0c8d-45d5-9b8f-c2fb2aed1b38\") " pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-6m8qc"
Oct 30 21:30:44.702304 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:44.702220    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dp4lz\" (UniqueName: \"kubernetes.io/projected/c5db122f-0c8d-45d5-9b8f-c2fb2aed1b38-kube-api-access-dp4lz\") pod \"korrel8r-5cbcc89b8f-6m8qc\" (UID: \"c5db122f-0c8d-45d5-9b8f-c2fb2aed1b38\") " pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-6m8qc"
Oct 30 21:30:44.702976 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:44.702951    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c5db122f-0c8d-45d5-9b8f-c2fb2aed1b38-config\") pod \"korrel8r-5cbcc89b8f-6m8qc\" (UID: \"c5db122f-0c8d-45d5-9b8f-c2fb2aed1b38\") " pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-6m8qc"
Oct 30 21:30:44.704834 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:44.704810    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls\" (UniqueName: \"kubernetes.io/secret/c5db122f-0c8d-45d5-9b8f-c2fb2aed1b38-tls\") pod \"korrel8r-5cbcc89b8f-6m8qc\" (UID: \"c5db122f-0c8d-45d5-9b8f-c2fb2aed1b38\") " pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-6m8qc"
Oct 30 21:30:44.762800 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:44.762778    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dp4lz\" (UniqueName: \"kubernetes.io/projected/c5db122f-0c8d-45d5-9b8f-c2fb2aed1b38-kube-api-access-dp4lz\") pod \"korrel8r-5cbcc89b8f-6m8qc\" (UID: \"c5db122f-0c8d-45d5-9b8f-c2fb2aed1b38\") " pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-6m8qc"
Oct 30 21:30:44.770605 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:44.770588    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-6m8qc"
Oct 30 21:30:44.791589 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:44.791563    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-smmxr"]
Oct 30 21:30:44.794213 ip-10-0-142-4 kubenswrapper[4060]: W1030 21:30:44.794191    4060 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81ed591c_3ac0_43d7_bf5f_2e938d2f2c95.slice/crio-b4e8e7ff05f2048cd18c5ef3b9011e7006187d1b65243056cc67a20be0887b55 WatchSource:0}: Error finding container b4e8e7ff05f2048cd18c5ef3b9011e7006187d1b65243056cc67a20be0887b55: Status 404 returned error can't find the container with id b4e8e7ff05f2048cd18c5ef3b9011e7006187d1b65243056cc67a20be0887b55
Oct 30 21:30:45.142394 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:45.142364    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/korrel8r-5cbcc89b8f-6m8qc"]
Oct 30 21:30:45.144780 ip-10-0-142-4 kubenswrapper[4060]: W1030 21:30:45.144755    4060 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5db122f_0c8d_45d5_9b8f_c2fb2aed1b38.slice/crio-30b666965cc0b6560f4bd72d7a8e9ba11854590c1169634494d0409acef7e0b0 WatchSource:0}: Error finding container 30b666965cc0b6560f4bd72d7a8e9ba11854590c1169634494d0409acef7e0b0: Status 404 returned error can't find the container with id 30b666965cc0b6560f4bd72d7a8e9ba11854590c1169634494d0409acef7e0b0
Oct 30 21:30:45.713012 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:45.712979    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-6m8qc" event={"ID":"c5db122f-0c8d-45d5-9b8f-c2fb2aed1b38","Type":"ContainerStarted","Data":"26206c2bb2143dc2de61015131ebd279557a52430c19dae1159e82c28473248d"}
Oct 30 21:30:45.713210 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:45.713115    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-6m8qc"
Oct 30 21:30:45.713210 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:45.713158    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-6m8qc" event={"ID":"c5db122f-0c8d-45d5-9b8f-c2fb2aed1b38","Type":"ContainerStarted","Data":"30b666965cc0b6560f4bd72d7a8e9ba11854590c1169634494d0409acef7e0b0"}
Oct 30 21:30:45.714662 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:45.714634    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-smmxr" event={"ID":"81ed591c-3ac0-43d7-bf5f-2e938d2f2c95","Type":"ContainerStarted","Data":"8198f211946b8e84b933a0c95e239a3f57b3d96c8897cbc72f07b09bc747add0"}
Oct 30 21:30:45.714786 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:45.714677    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-smmxr" event={"ID":"81ed591c-3ac0-43d7-bf5f-2e938d2f2c95","Type":"ContainerStarted","Data":"b4e8e7ff05f2048cd18c5ef3b9011e7006187d1b65243056cc67a20be0887b55"}
Oct 30 21:30:45.714786 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:45.714727    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-smmxr"
Oct 30 21:30:45.829888 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:45.829824    4060 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-6m8qc" podStartSLOduration=1.8298107350000001 podStartE2EDuration="1.829810735s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:30:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:30:45.828780294 +0000 UTC m=+3264.585778595" watchObservedRunningTime="2026-10-30 21:30:45.829810735 +0000 UTC m=+3264.586809095"
Oct 30 21:30:45.949915 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:45.949869    4060 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-smmxr" podStartSLOduration=1.949854838 podStartE2EDuration="1.949854838s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:30:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:30:45.948857791 +0000 UTC m=+3264.705856090" watchObservedRunningTime="2026-10-30 21:30:45.949854838 +0000 UTC m=+3264.706853136"
Oct 30 21:30:48.933018 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:48.932987    4060 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:30:48.936962 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:48.936946    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:30:48.993965 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:48.993933    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-a0f9182a\""
Oct 30 21:30:49.028830 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:49.028803    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/11671523-dec4-4e05-8be7-84efdd770121-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"11671523-dec4-4e05-8be7-84efdd770121\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:30:49.028971 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:49.028846    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/11671523-dec4-4e05-8be7-84efdd770121-otc-internal\") pod \"data-science-collector-collector-0\" (UID: \"11671523-dec4-4e05-8be7-84efdd770121\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:30:49.028971 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:49.028869    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/11671523-dec4-4e05-8be7-84efdd770121-otlp-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"11671523-dec4-4e05-8be7-84efdd770121\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:30:49.028971 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:49.028929    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sd2bb\" (UniqueName: \"kubernetes.io/projected/11671523-dec4-4e05-8be7-84efdd770121-kube-api-access-sd2bb\") pod \"data-science-collector-collector-0\" (UID: \"11671523-dec4-4e05-8be7-84efdd770121\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:30:49.029084 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:49.028972    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/11671523-dec4-4e05-8be7-84efdd770121-monitoring-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"11671523-dec4-4e05-8be7-84efdd770121\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:30:49.029084 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:49.029042    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/11671523-dec4-4e05-8be7-84efdd770121-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-0\" (UID: \"11671523-dec4-4e05-8be7-84efdd770121\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:30:49.040857 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:49.040832    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-ta-client-cert\""
Oct 30 21:30:49.041191 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:49.041175    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-monitoring-tls\""
Oct 30 21:30:49.041427 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:49.041413    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-tls\""
Oct 30 21:30:49.041612 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:49.041599    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-headless-tls\""
Oct 30 21:30:49.045137 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:49.045113    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-dockercfg-9267g\""
Oct 30 21:30:49.049001 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:49.048976    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:30:49.129537 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:49.129508    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/11671523-dec4-4e05-8be7-84efdd770121-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-0\" (UID: \"11671523-dec4-4e05-8be7-84efdd770121\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:30:49.129694 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:49.129628    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/11671523-dec4-4e05-8be7-84efdd770121-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"11671523-dec4-4e05-8be7-84efdd770121\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:30:49.129694 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:49.129659    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/11671523-dec4-4e05-8be7-84efdd770121-otc-internal\") pod \"data-science-collector-collector-0\" (UID: \"11671523-dec4-4e05-8be7-84efdd770121\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:30:49.129694 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:49.129674    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/11671523-dec4-4e05-8be7-84efdd770121-otlp-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"11671523-dec4-4e05-8be7-84efdd770121\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:30:49.129694 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:49.129693    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sd2bb\" (UniqueName: \"kubernetes.io/projected/11671523-dec4-4e05-8be7-84efdd770121-kube-api-access-sd2bb\") pod \"data-science-collector-collector-0\" (UID: \"11671523-dec4-4e05-8be7-84efdd770121\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:30:49.129922 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:49.129717    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/11671523-dec4-4e05-8be7-84efdd770121-monitoring-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"11671523-dec4-4e05-8be7-84efdd770121\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:30:49.129922 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:30:49.129811    4060 secret.go:189] Couldn't get secret redhat-ods-monitoring/data-science-collector-collector-headless-tls: secret "data-science-collector-collector-headless-tls" not found
Oct 30 21:30:49.129922 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:30:49.129889    4060 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/11671523-dec4-4e05-8be7-84efdd770121-otlp-tls-certs podName:11671523-dec4-4e05-8be7-84efdd770121 nodeName:}" failed. No retries permitted until 2026-10-30 21:30:49.629867803 +0000 UTC m=+3268.386866086 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "otlp-tls-certs" (UniqueName: "kubernetes.io/secret/11671523-dec4-4e05-8be7-84efdd770121-otlp-tls-certs") pod "data-science-collector-collector-0" (UID: "11671523-dec4-4e05-8be7-84efdd770121") : secret "data-science-collector-collector-headless-tls" not found
Oct 30 21:30:49.130381 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:49.130355    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/11671523-dec4-4e05-8be7-84efdd770121-otc-internal\") pod \"data-science-collector-collector-0\" (UID: \"11671523-dec4-4e05-8be7-84efdd770121\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:30:49.131950 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:49.131927    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/11671523-dec4-4e05-8be7-84efdd770121-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-0\" (UID: \"11671523-dec4-4e05-8be7-84efdd770121\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:30:49.132050 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:49.131974    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/11671523-dec4-4e05-8be7-84efdd770121-monitoring-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"11671523-dec4-4e05-8be7-84efdd770121\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:30:49.132107 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:49.132043    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/11671523-dec4-4e05-8be7-84efdd770121-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"11671523-dec4-4e05-8be7-84efdd770121\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:30:49.190745 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:49.190677    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sd2bb\" (UniqueName: \"kubernetes.io/projected/11671523-dec4-4e05-8be7-84efdd770121-kube-api-access-sd2bb\") pod \"data-science-collector-collector-0\" (UID: \"11671523-dec4-4e05-8be7-84efdd770121\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:30:49.633206 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:49.633161    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/11671523-dec4-4e05-8be7-84efdd770121-otlp-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"11671523-dec4-4e05-8be7-84efdd770121\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:30:49.635631 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:49.635610    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/11671523-dec4-4e05-8be7-84efdd770121-otlp-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"11671523-dec4-4e05-8be7-84efdd770121\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:30:49.851980 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:49.851944    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:30:50.226146 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:50.225986    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:30:50.228565 ip-10-0-142-4 kubenswrapper[4060]: W1030 21:30:50.228539    4060 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11671523_dec4_4e05_8be7_84efdd770121.slice/crio-81731b5a7114ae349db413397d2a388fc1a7042217a220adf595899f6fbaf1f3 WatchSource:0}: Error finding container 81731b5a7114ae349db413397d2a388fc1a7042217a220adf595899f6fbaf1f3: Status 404 returned error can't find the container with id 81731b5a7114ae349db413397d2a388fc1a7042217a220adf595899f6fbaf1f3
Oct 30 21:30:50.230646 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:50.230607    4060 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 21:30:50.230717 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:50.230684    4060 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 21:30:50.739524 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:50.739475    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"11671523-dec4-4e05-8be7-84efdd770121","Type":"ContainerStarted","Data":"ae5c1ea43938dbf7d1b9a9690df1b36a5ef83f2190e5f8a0b79af7c16ac03885"}
Oct 30 21:30:50.739692 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:50.739541    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"11671523-dec4-4e05-8be7-84efdd770121","Type":"ContainerStarted","Data":"81731b5a7114ae349db413397d2a388fc1a7042217a220adf595899f6fbaf1f3"}
Oct 30 21:30:50.858609 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:50.858559    4060 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-collector-0" podStartSLOduration=2.8585434 podStartE2EDuration="2.8585434s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:30:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:30:50.856698614 +0000 UTC m=+3269.613696913" watchObservedRunningTime="2026-10-30 21:30:50.8585434 +0000 UTC m=+3269.615541696"
Oct 30 21:30:51.722100 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:51.722072    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-smmxr"
Oct 30 21:30:56.722130 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:30:56.722101    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-6m8qc"
Oct 30 21:31:02.532841 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:31:02.532808    4060 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"]
Oct 30 21:31:02.541631 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:31:02.541600    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:31:02.597328 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:31:02.597301    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"alertmanager-data-science-monitoringstack-web-config\""
Oct 30 21:31:02.597513 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:31:02.597344    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"alertmanager-data-science-monitoringstack-generated\""
Oct 30 21:31:02.597513 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:31:02.597353    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"alertmanager-data-science-monitoringstack-cluster-tls-config\""
Oct 30 21:31:02.597513 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:31:02.597374    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"alertmanager-data-science-monitoringstack-tls-assets-0\""
Oct 30 21:31:02.625152 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:31:02.625126    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/07114265-e487-4b7d-ab67-51bf6e4e73ef-web-config\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"07114265-e487-4b7d-ab67-51bf6e4e73ef\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:31:02.625274 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:31:02.625160    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-data-science-monitoringstack-db\" (UniqueName: \"kubernetes.io/empty-dir/07114265-e487-4b7d-ab67-51bf6e4e73ef-alertmanager-data-science-monitoringstack-db\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"07114265-e487-4b7d-ab67-51bf6e4e73ef\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:31:02.625274 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:31:02.625191    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-59ckb\" (UniqueName: \"kubernetes.io/projected/07114265-e487-4b7d-ab67-51bf6e4e73ef-kube-api-access-59ckb\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"07114265-e487-4b7d-ab67-51bf6e4e73ef\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:31:02.625350 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:31:02.625295    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/07114265-e487-4b7d-ab67-51bf6e4e73ef-cluster-tls-config\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"07114265-e487-4b7d-ab67-51bf6e4e73ef\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:31:02.625350 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:31:02.625324    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/07114265-e487-4b7d-ab67-51bf6e4e73ef-tls-assets\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"07114265-e487-4b7d-ab67-51bf6e4e73ef\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:31:02.625350 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:31:02.625346    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/07114265-e487-4b7d-ab67-51bf6e4e73ef-config-out\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"07114265-e487-4b7d-ab67-51bf6e4e73ef\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:31:02.625519 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:31:02.625395    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/07114265-e487-4b7d-ab67-51bf6e4e73ef-config-volume\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"07114265-e487-4b7d-ab67-51bf6e4e73ef\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:31:02.644089 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:31:02.644022    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-monitoringstack-alertmanager-dockercfg-2l2zd\""
Oct 30 21:31:02.645760 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:31:02.645740    4060 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"]
Oct 30 21:31:02.649302 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:31:02.649285    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"]
Oct 30 21:31:02.649387 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:31:02.649382    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:31:02.697196 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:31:02.697166    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"]
Oct 30 21:31:02.703843 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:31:02.703811    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"prometheus-data-science-monitoringstack-rulefiles-0\""
Oct 30 21:31:02.708071 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:31:02.708050    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"prometheus-data-science-monitoringstack-rulefiles-2\""
Oct 30 21:31:02.708071 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:31:02.708070    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"prometheus-data-science-monitoringstack-rulefiles-1\""
Oct 30 21:31:02.708973 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:31:02.708954    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"prometheus-data-science-monitoringstack-tls-assets-0\""
Oct 30 21:31:02.709095 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:31:02.709081    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"prometheus-web-tls-ca\""
Oct 30 21:31:02.709154 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:31:02.709094    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"prometheus-data-science-monitoringstack-web-config\""
Oct 30 21:31:02.709154 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:31:02.709097    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"prometheus-data-science-monitoringstack-thanos-prometheus-http-client-file\""
Oct 30 21:31:02.709222 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:31:02.709156    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-monitoringstack-prometheus-dockercfg-jq9nq\""
Oct 30 21:31:02.709222 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:31:02.709202    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"prometheus-data-science-monitoringstack\""
Oct 30 21:31:02.726854 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:31:02.726832    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-59ckb\" (UniqueName: \"kubernetes.io/projected/07114265-e487-4b7d-ab67-51bf6e4e73ef-kube-api-access-59ckb\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"07114265-e487-4b7d-ab67-51bf6e4e73ef\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:31:02.727012 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:31:02.726884    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/07114265-e487-4b7d-ab67-51bf6e4e73ef-cluster-tls-config\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"07114265-e487-4b7d-ab67-51bf6e4e73ef\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:31:02.727012 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:31:02.726924    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/07114265-e487-4b7d-ab67-51bf6e4e73ef-tls-assets\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"07114265-e487-4b7d-ab67-51bf6e4e73ef\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:31:02.727012 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:31:02.726957    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/07114265-e487-4b7d-ab67-51bf6e4e73ef-config-out\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"07114265-e487-4b7d-ab67-51bf6e4e73ef\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:31:02.727193 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:31:02.727035    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/07114265-e487-4b7d-ab67-51bf6e4e73ef-config-volume\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"07114265-e487-4b7d-ab67-51bf6e4e73ef\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:31:02.727193 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:31:02.727123    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/07114265-e487-4b7d-ab67-51bf6e4e73ef-web-config\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"07114265-e487-4b7d-ab67-51bf6e4e73ef\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:31:02.727303 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:31:02.727198    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-data-science-monitoringstack-db\" (UniqueName: \"kubernetes.io/empty-dir/07114265-e487-4b7d-ab67-51bf6e4e73ef-alertmanager-data-science-monitoringstack-db\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"07114265-e487-4b7d-ab67-51bf6e4e73ef\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:31:02.727637 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:31:02.727609    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-data-science-monitoringstack-db\" (UniqueName: \"kubernetes.io/empty-dir/07114265-e487-4b7d-ab67-51bf6e4e73ef-alertmanager-data-science-monitoringstack-db\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"07114265-e487-4b7d-ab67-51bf6e4e73ef\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:31:02.729443 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:31:02.729415    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/07114265-e487-4b7d-ab67-51bf6e4e73ef-config-out\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"07114265-e487-4b7d-ab67-51bf6e4e73ef\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:31:02.729635 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:31:02.729583    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/07114265-e487-4b7d-ab67-51bf6e4e73ef-tls-assets\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"07114265-e487-4b7d-ab67-51bf6e4e73ef\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:31:02.729936 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:31:02.729914    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/07114265-e487-4b7d-ab67-51bf6e4e73ef-web-config\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"07114265-e487-4b7d-ab67-51bf6e4e73ef\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:31:02.729936 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:31:02.729930    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/07114265-e487-4b7d-ab67-51bf6e4e73ef-cluster-tls-config\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"07114265-e487-4b7d-ab67-51bf6e4e73ef\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:31:02.730187 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:31:02.730167    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/07114265-e487-4b7d-ab67-51bf6e4e73ef-config-volume\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"07114265-e487-4b7d-ab67-51bf6e4e73ef\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:31:02.789009 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:31:02.788946    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-59ckb\" (UniqueName: \"kubernetes.io/projected/07114265-e487-4b7d-ab67-51bf6e4e73ef-kube-api-access-59ckb\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"07114265-e487-4b7d-ab67-51bf6e4e73ef\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:31:02.827810 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:31:02.827779    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config-tls-secret-cert-prometheus-operated-tls-f3457c70\" (UniqueName: \"kubernetes.io/secret/4213733c-9bbb-412c-9b3e-8895e16de905-web-config-tls-secret-cert-prometheus-operated-tls-f3457c70\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"4213733c-9bbb-412c-9b3e-8895e16de905\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:31:02.827810 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:31:02.827813    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m8lg9\" (UniqueName: \"kubernetes.io/projected/4213733c-9bbb-412c-9b3e-8895e16de905-kube-api-access-m8lg9\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"4213733c-9bbb-412c-9b3e-8895e16de905\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:31:02.827995 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:31:02.827843    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-data-science-monitoringstack-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4213733c-9bbb-412c-9b3e-8895e16de905-prometheus-data-science-monitoringstack-rulefiles-2\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"4213733c-9bbb-412c-9b3e-8895e16de905\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:31:02.827995 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:31:02.827971    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config-tls-secret-key-prometheus-operated-tls-f3457c70\" (UniqueName: \"kubernetes.io/secret/4213733c-9bbb-412c-9b3e-8895e16de905-web-config-tls-secret-key-prometheus-operated-tls-f3457c70\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"4213733c-9bbb-412c-9b3e-8895e16de905\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:31:02.828072 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:31:02.828005    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-web-tls-ca\" (UniqueName: \"kubernetes.io/secret/4213733c-9bbb-412c-9b3e-8895e16de905-secret-prometheus-web-tls-ca\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"4213733c-9bbb-412c-9b3e-8895e16de905\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:31:02.828072 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:31:02.828031    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/4213733c-9bbb-412c-9b3e-8895e16de905-config\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"4213733c-9bbb-412c-9b3e-8895e16de905\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:31:02.828072 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:31:02.828055    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4213733c-9bbb-412c-9b3e-8895e16de905-thanos-prometheus-http-client-file\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"4213733c-9bbb-412c-9b3e-8895e16de905\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:31:02.828194 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:31:02.828173    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4213733c-9bbb-412c-9b3e-8895e16de905-config-out\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"4213733c-9bbb-412c-9b3e-8895e16de905\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:31:02.828237 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:31:02.828203    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4213733c-9bbb-412c-9b3e-8895e16de905-web-config\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"4213733c-9bbb-412c-9b3e-8895e16de905\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:31:02.828274 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:31:02.828237    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4213733c-9bbb-412c-9b3e-8895e16de905-tls-assets\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"4213733c-9bbb-412c-9b3e-8895e16de905\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:31:02.828316 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:31:02.828281    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-data-science-monitoringstack-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4213733c-9bbb-412c-9b3e-8895e16de905-prometheus-data-science-monitoringstack-rulefiles-0\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"4213733c-9bbb-412c-9b3e-8895e16de905\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:31:02.828351 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:31:02.828317    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-data-science-monitoringstack-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4213733c-9bbb-412c-9b3e-8895e16de905-prometheus-data-science-monitoringstack-rulefiles-1\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"4213733c-9bbb-412c-9b3e-8895e16de905\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:31:02.857909 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:31:02.857888    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:31:02.929423 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:31:02.929386    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-data-science-monitoringstack-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4213733c-9bbb-412c-9b3e-8895e16de905-prometheus-data-science-monitoringstack-rulefiles-2\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"4213733c-9bbb-412c-9b3e-8895e16de905\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:31:02.929653 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:31:02.929454    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config-tls-secret-key-prometheus-operated-tls-f3457c70\" (UniqueName: \"kubernetes.io/secret/4213733c-9bbb-412c-9b3e-8895e16de905-web-config-tls-secret-key-prometheus-operated-tls-f3457c70\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"4213733c-9bbb-412c-9b3e-8895e16de905\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:31:02.929653 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:31:02.929487    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-web-tls-ca\" (UniqueName: \"kubernetes.io/secret/4213733c-9bbb-412c-9b3e-8895e16de905-secret-prometheus-web-tls-ca\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"4213733c-9bbb-412c-9b3e-8895e16de905\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:31:02.929653 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:31:02.929550    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/4213733c-9bbb-412c-9b3e-8895e16de905-config\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"4213733c-9bbb-412c-9b3e-8895e16de905\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:31:02.929653 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:31:02.929587    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4213733c-9bbb-412c-9b3e-8895e16de905-thanos-prometheus-http-client-file\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"4213733c-9bbb-412c-9b3e-8895e16de905\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:31:02.929653 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:31:02.929637    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4213733c-9bbb-412c-9b3e-8895e16de905-config-out\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"4213733c-9bbb-412c-9b3e-8895e16de905\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:31:02.930127 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:31:02.929660    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4213733c-9bbb-412c-9b3e-8895e16de905-web-config\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"4213733c-9bbb-412c-9b3e-8895e16de905\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:31:02.930127 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:31:02.929689    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4213733c-9bbb-412c-9b3e-8895e16de905-tls-assets\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"4213733c-9bbb-412c-9b3e-8895e16de905\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:31:02.930127 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:31:02.929722    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-data-science-monitoringstack-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4213733c-9bbb-412c-9b3e-8895e16de905-prometheus-data-science-monitoringstack-rulefiles-0\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"4213733c-9bbb-412c-9b3e-8895e16de905\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:31:02.930127 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:31:02.929756    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-data-science-monitoringstack-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4213733c-9bbb-412c-9b3e-8895e16de905-prometheus-data-science-monitoringstack-rulefiles-1\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"4213733c-9bbb-412c-9b3e-8895e16de905\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:31:02.930127 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:31:02.929807    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config-tls-secret-cert-prometheus-operated-tls-f3457c70\" (UniqueName: \"kubernetes.io/secret/4213733c-9bbb-412c-9b3e-8895e16de905-web-config-tls-secret-cert-prometheus-operated-tls-f3457c70\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"4213733c-9bbb-412c-9b3e-8895e16de905\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:31:02.930127 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:31:02.929843    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m8lg9\" (UniqueName: \"kubernetes.io/projected/4213733c-9bbb-412c-9b3e-8895e16de905-kube-api-access-m8lg9\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"4213733c-9bbb-412c-9b3e-8895e16de905\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:31:02.930127 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:31:02.930104    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-data-science-monitoringstack-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4213733c-9bbb-412c-9b3e-8895e16de905-prometheus-data-science-monitoringstack-rulefiles-2\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"4213733c-9bbb-412c-9b3e-8895e16de905\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:31:02.931322 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:31:02.931210    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-data-science-monitoringstack-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4213733c-9bbb-412c-9b3e-8895e16de905-prometheus-data-science-monitoringstack-rulefiles-0\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"4213733c-9bbb-412c-9b3e-8895e16de905\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:31:02.931559 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:31:02.931479    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-data-science-monitoringstack-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4213733c-9bbb-412c-9b3e-8895e16de905-prometheus-data-science-monitoringstack-rulefiles-1\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"4213733c-9bbb-412c-9b3e-8895e16de905\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:31:02.933660 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:31:02.933638    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-web-tls-ca\" (UniqueName: \"kubernetes.io/secret/4213733c-9bbb-412c-9b3e-8895e16de905-secret-prometheus-web-tls-ca\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"4213733c-9bbb-412c-9b3e-8895e16de905\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:31:02.933749 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:31:02.933671    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config-tls-secret-cert-prometheus-operated-tls-f3457c70\" (UniqueName: \"kubernetes.io/secret/4213733c-9bbb-412c-9b3e-8895e16de905-web-config-tls-secret-cert-prometheus-operated-tls-f3457c70\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"4213733c-9bbb-412c-9b3e-8895e16de905\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:31:02.933749 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:31:02.933718    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4213733c-9bbb-412c-9b3e-8895e16de905-config-out\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"4213733c-9bbb-412c-9b3e-8895e16de905\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:31:02.934123 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:31:02.934097    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4213733c-9bbb-412c-9b3e-8895e16de905-web-config\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"4213733c-9bbb-412c-9b3e-8895e16de905\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:31:02.934229 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:31:02.934172    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4213733c-9bbb-412c-9b3e-8895e16de905-tls-assets\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"4213733c-9bbb-412c-9b3e-8895e16de905\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:31:02.934301 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:31:02.934285    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4213733c-9bbb-412c-9b3e-8895e16de905-thanos-prometheus-http-client-file\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"4213733c-9bbb-412c-9b3e-8895e16de905\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:31:02.935567 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:31:02.935541    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/4213733c-9bbb-412c-9b3e-8895e16de905-config\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"4213733c-9bbb-412c-9b3e-8895e16de905\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:31:02.935783 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:31:02.935762    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config-tls-secret-key-prometheus-operated-tls-f3457c70\" (UniqueName: \"kubernetes.io/secret/4213733c-9bbb-412c-9b3e-8895e16de905-web-config-tls-secret-key-prometheus-operated-tls-f3457c70\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"4213733c-9bbb-412c-9b3e-8895e16de905\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:31:02.992938 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:31:02.992908    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m8lg9\" (UniqueName: \"kubernetes.io/projected/4213733c-9bbb-412c-9b3e-8895e16de905-kube-api-access-m8lg9\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"4213733c-9bbb-412c-9b3e-8895e16de905\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:31:03.285692 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:31:03.285664    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"]
Oct 30 21:31:03.287117 ip-10-0-142-4 kubenswrapper[4060]: W1030 21:31:03.287091    4060 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07114265_e487_4b7d_ab67_51bf6e4e73ef.slice/crio-5c87e5e8e1b4eef20821542aecd79810e61d738704dd9dfa6d748b83e40a563d WatchSource:0}: Error finding container 5c87e5e8e1b4eef20821542aecd79810e61d738704dd9dfa6d748b83e40a563d: Status 404 returned error can't find the container with id 5c87e5e8e1b4eef20821542aecd79810e61d738704dd9dfa6d748b83e40a563d
Oct 30 21:31:03.806760 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:31:03.806730    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0" event={"ID":"07114265-e487-4b7d-ab67-51bf6e4e73ef","Type":"ContainerStarted","Data":"44a49637b4c3b3e85bbb7ddf6ad8eb1885f6de1b944a234c835d6df6f046d523"}
Oct 30 21:31:03.807125 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:31:03.806791    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0" event={"ID":"07114265-e487-4b7d-ab67-51bf6e4e73ef","Type":"ContainerStarted","Data":"5c87e5e8e1b4eef20821542aecd79810e61d738704dd9dfa6d748b83e40a563d"}
Oct 30 21:31:05.149356 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:31:05.149317    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-e73afc79-aa37-49a0-8744-633c03cad1f4\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a155a55c1ce0e65b\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"4213733c-9bbb-412c-9b3e-8895e16de905\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:31:05.253632 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:31:05.253604    4060 operation_generator.go:1464] "Controller attach succeeded for volume \"pvc-e73afc79-aa37-49a0-8744-633c03cad1f4\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a155a55c1ce0e65b\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"4213733c-9bbb-412c-9b3e-8895e16de905\") device path: \"\"" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:31:05.350592 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:31:05.350556    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"pvc-e73afc79-aa37-49a0-8744-633c03cad1f4\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a155a55c1ce0e65b\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"4213733c-9bbb-412c-9b3e-8895e16de905\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:31:05.350769 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:31:05.350681    4060 operation_generator.go:515] "MountVolume.WaitForAttach entering for volume \"pvc-e73afc79-aa37-49a0-8744-633c03cad1f4\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a155a55c1ce0e65b\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"4213733c-9bbb-412c-9b3e-8895e16de905\") DevicePath \"\"" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:31:05.402376 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:31:05.402304    4060 operation_generator.go:525] "MountVolume.WaitForAttach succeeded for volume \"pvc-e73afc79-aa37-49a0-8744-633c03cad1f4\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a155a55c1ce0e65b\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"4213733c-9bbb-412c-9b3e-8895e16de905\") DevicePath \"csi-7011c01335d2502f76be252f9498c79824668beecf30ee8f6a7191145201ca4c\"" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:31:05.538551 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:31:05.538522    4060 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"pvc-e73afc79-aa37-49a0-8744-633c03cad1f4\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a155a55c1ce0e65b\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"4213733c-9bbb-412c-9b3e-8895e16de905\") device mount path \"/var/lib/kubelet/plugins/kubernetes.io/csi/ebs.csi.aws.com/fb02f91ab75afdcfd8c2ac3eaeb0ba7303c67490d38fe3164f5fc7856f2f1875/globalmount\"" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:31:05.603690 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:31:05.603667    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pvc-e73afc79-aa37-49a0-8744-633c03cad1f4\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a155a55c1ce0e65b\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"4213733c-9bbb-412c-9b3e-8895e16de905\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:31:05.674746 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:31:05.674687    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:31:06.151347 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:31:06.151321    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"]
Oct 30 21:31:06.153558 ip-10-0-142-4 kubenswrapper[4060]: W1030 21:31:06.153530    4060 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4213733c_9bbb_412c_9b3e_8895e16de905.slice/crio-dd24c0a5083ac8a596644bc3caae2ca776f42a54405b64ba39640fb2aa2bcefe WatchSource:0}: Error finding container dd24c0a5083ac8a596644bc3caae2ca776f42a54405b64ba39640fb2aa2bcefe: Status 404 returned error can't find the container with id dd24c0a5083ac8a596644bc3caae2ca776f42a54405b64ba39640fb2aa2bcefe
Oct 30 21:31:06.823818 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:31:06.823725    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0" event={"ID":"4213733c-9bbb-412c-9b3e-8895e16de905","Type":"ContainerStarted","Data":"0f0d66439a4499241af06b0ff80a5b19f3e22444585f504067bf34a7eaff41b2"}
Oct 30 21:31:06.823818 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:31:06.823812    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0" event={"ID":"4213733c-9bbb-412c-9b3e-8895e16de905","Type":"ContainerStarted","Data":"dd24c0a5083ac8a596644bc3caae2ca776f42a54405b64ba39640fb2aa2bcefe"}
Oct 30 21:31:07.829812 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:31:07.829777    4060 generic.go:356] "Generic (PLEG): container finished" podID="07114265-e487-4b7d-ab67-51bf6e4e73ef" containerID="44a49637b4c3b3e85bbb7ddf6ad8eb1885f6de1b944a234c835d6df6f046d523" exitCode=0
Oct 30 21:31:07.830314 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:31:07.829853    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0" event={"ID":"07114265-e487-4b7d-ab67-51bf6e4e73ef","Type":"ContainerDied","Data":"44a49637b4c3b3e85bbb7ddf6ad8eb1885f6de1b944a234c835d6df6f046d523"}
Oct 30 21:31:08.837287 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:31:08.837248    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0" event={"ID":"07114265-e487-4b7d-ab67-51bf6e4e73ef","Type":"ContainerStarted","Data":"2dff92934d68ad92c284983cb371a0185f063b8b66075abae65fac0a77df1247"}
Oct 30 21:31:08.837663 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:31:08.837335    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0" event={"ID":"07114265-e487-4b7d-ab67-51bf6e4e73ef","Type":"ContainerStarted","Data":"37976bcb5de4e27ba833c112249b3cbb2088f85a096561f08ef037a4ce11f21e"}
Oct 30 21:31:08.837663 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:31:08.837548    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:31:08.961319 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:31:08.961262    4060 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0" podStartSLOduration=3.475586628 podStartE2EDuration="6.9612436s" totalImagesPullingTime="0s" totalInitContainerRuntime="3.485656972s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:31:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:31:08.960455301 +0000 UTC m=+3287.717453593" watchObservedRunningTime="2026-10-30 21:31:08.9612436 +0000 UTC m=+3287.718241900"
Oct 30 21:31:10.848546 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:31:10.848482    4060 generic.go:356] "Generic (PLEG): container finished" podID="4213733c-9bbb-412c-9b3e-8895e16de905" containerID="0f0d66439a4499241af06b0ff80a5b19f3e22444585f504067bf34a7eaff41b2" exitCode=0
Oct 30 21:31:10.848946 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:31:10.848566    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0" event={"ID":"4213733c-9bbb-412c-9b3e-8895e16de905","Type":"ContainerDied","Data":"0f0d66439a4499241af06b0ff80a5b19f3e22444585f504067bf34a7eaff41b2"}
Oct 30 21:31:11.857086 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:31:11.857051    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0" event={"ID":"4213733c-9bbb-412c-9b3e-8895e16de905","Type":"ContainerStarted","Data":"6c4551b5edf57d0e04691df355a977621fb43fd89e1e2d8c7967ecca7e5a303b"}
Oct 30 21:31:11.857459 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:31:11.857121    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0" event={"ID":"4213733c-9bbb-412c-9b3e-8895e16de905","Type":"ContainerStarted","Data":"ff43d71d75c7ce7071e6cea25144232e926501b294bd0b73fad256a64313e39a"}
Oct 30 21:31:11.857459 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:31:11.857149    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0" event={"ID":"4213733c-9bbb-412c-9b3e-8895e16de905","Type":"ContainerStarted","Data":"742faa8c8caeaf9c14d57efe83cfa29b0725f1f6803eade90ae303ef9e072dfa"}
Oct 30 21:31:11.987087 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:31:11.987031    4060 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0" podStartSLOduration=6.502633131 podStartE2EDuration="9.987015168s" totalImagesPullingTime="0s" totalInitContainerRuntime="3.484382037s" isStatefulPod=true podCreationTimestamp="2026-10-30 21:31:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:31:11.985664047 +0000 UTC m=+3290.742662344" watchObservedRunningTime="2026-10-30 21:31:11.987015168 +0000 UTC m=+3290.744013465"
Oct 30 21:31:12.150274 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:31:12.150188    4060 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v2f4x" containerName="extractor"
Oct 30 21:31:14.843743 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:31:14.843709    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:31:15.675261 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:31:15.675214    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:31:20.675014 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:31:20.674973    4060 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:31:20.680289 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:31:20.680265    4060 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:31:20.904058 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:31:20.904030    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:31:42.151157 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:31:42.151121    4060 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v2f4x" containerName="extractor"
Oct 30 21:32:12.151624 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:32:12.151585    4060 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v2f4x" containerName="extractor"
Oct 30 21:32:42.091653 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:42.091575    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-smmxr"]
Oct 30 21:32:42.092112 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:42.091798    4060 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-smmxr" podUID="81ed591c-3ac0-43d7-bf5f-2e938d2f2c95" containerName="kube-rbac-proxy" containerID="cri-o://8198f211946b8e84b933a0c95e239a3f57b3d96c8897cbc72f07b09bc747add0" gracePeriod=30
Oct 30 21:32:42.156144 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:32:42.156115    4060 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v2f4x" containerName="extractor"
Oct 30 21:32:42.281754 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:42.281718    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/korrel8r-5cbcc89b8f-6m8qc"]
Oct 30 21:32:42.281981 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:42.281954    4060 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-6m8qc" podUID="c5db122f-0c8d-45d5-9b8f-c2fb2aed1b38" containerName="korrel8r" containerID="cri-o://26206c2bb2143dc2de61015131ebd279557a52430c19dae1159e82c28473248d" gracePeriod=30
Oct 30 21:32:42.286552 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:42.286518    4060 generic.go:356] "Generic (PLEG): container finished" podID="81ed591c-3ac0-43d7-bf5f-2e938d2f2c95" containerID="8198f211946b8e84b933a0c95e239a3f57b3d96c8897cbc72f07b09bc747add0" exitCode=0
Oct 30 21:32:42.286713 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:42.286593    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-smmxr" event={"ID":"81ed591c-3ac0-43d7-bf5f-2e938d2f2c95","Type":"ContainerDied","Data":"8198f211946b8e84b933a0c95e239a3f57b3d96c8897cbc72f07b09bc747add0"}
Oct 30 21:32:42.410928 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:42.410892    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-smmxr"
Oct 30 21:32:42.501644 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:42.501614    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/81ed591c-3ac0-43d7-bf5f-2e938d2f2c95-tls\" (UniqueName: \"kubernetes.io/secret/81ed591c-3ac0-43d7-bf5f-2e938d2f2c95-tls\") pod \"81ed591c-3ac0-43d7-bf5f-2e938d2f2c95\" (UID: \"81ed591c-3ac0-43d7-bf5f-2e938d2f2c95\") "
Oct 30 21:32:42.501850 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:42.501673    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/81ed591c-3ac0-43d7-bf5f-2e938d2f2c95-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/81ed591c-3ac0-43d7-bf5f-2e938d2f2c95-kube-rbac-proxy-config\") pod \"81ed591c-3ac0-43d7-bf5f-2e938d2f2c95\" (UID: \"81ed591c-3ac0-43d7-bf5f-2e938d2f2c95\") "
Oct 30 21:32:42.501850 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:42.501777    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/81ed591c-3ac0-43d7-bf5f-2e938d2f2c95-kube-api-access-jsjbb\" (UniqueName: \"kubernetes.io/projected/81ed591c-3ac0-43d7-bf5f-2e938d2f2c95-kube-api-access-jsjbb\") pod \"81ed591c-3ac0-43d7-bf5f-2e938d2f2c95\" (UID: \"81ed591c-3ac0-43d7-bf5f-2e938d2f2c95\") "
Oct 30 21:32:42.501850 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:42.501812    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/81ed591c-3ac0-43d7-bf5f-2e938d2f2c95-prometheus-ca\" (UniqueName: \"kubernetes.io/configmap/81ed591c-3ac0-43d7-bf5f-2e938d2f2c95-prometheus-ca\") pod \"81ed591c-3ac0-43d7-bf5f-2e938d2f2c95\" (UID: \"81ed591c-3ac0-43d7-bf5f-2e938d2f2c95\") "
Oct 30 21:32:42.502030 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:42.501878    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/81ed591c-3ac0-43d7-bf5f-2e938d2f2c95-prometheus-client-cert\" (UniqueName: \"kubernetes.io/secret/81ed591c-3ac0-43d7-bf5f-2e938d2f2c95-prometheus-client-cert\") pod \"81ed591c-3ac0-43d7-bf5f-2e938d2f2c95\" (UID: \"81ed591c-3ac0-43d7-bf5f-2e938d2f2c95\") "
Oct 30 21:32:42.502294 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:42.502260    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/81ed591c-3ac0-43d7-bf5f-2e938d2f2c95-prometheus-ca" pod "81ed591c-3ac0-43d7-bf5f-2e938d2f2c95" (UID: "81ed591c-3ac0-43d7-bf5f-2e938d2f2c95"). InnerVolumeSpecName "prometheus-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:32:42.504024 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:42.503998    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/81ed591c-3ac0-43d7-bf5f-2e938d2f2c95-tls" pod "81ed591c-3ac0-43d7-bf5f-2e938d2f2c95" (UID: "81ed591c-3ac0-43d7-bf5f-2e938d2f2c95"). InnerVolumeSpecName "tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:32:42.504311 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:42.504288    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/81ed591c-3ac0-43d7-bf5f-2e938d2f2c95-prometheus-client-cert" pod "81ed591c-3ac0-43d7-bf5f-2e938d2f2c95" (UID: "81ed591c-3ac0-43d7-bf5f-2e938d2f2c95"). InnerVolumeSpecName "prometheus-client-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:32:42.504399 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:42.504350    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/81ed591c-3ac0-43d7-bf5f-2e938d2f2c95-kube-rbac-proxy-config" pod "81ed591c-3ac0-43d7-bf5f-2e938d2f2c95" (UID: "81ed591c-3ac0-43d7-bf5f-2e938d2f2c95"). InnerVolumeSpecName "kube-rbac-proxy-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:32:42.504399 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:42.504365    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/81ed591c-3ac0-43d7-bf5f-2e938d2f2c95-kube-api-access-jsjbb" pod "81ed591c-3ac0-43d7-bf5f-2e938d2f2c95" (UID: "81ed591c-3ac0-43d7-bf5f-2e938d2f2c95"). InnerVolumeSpecName "kube-api-access-jsjbb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:32:42.517469 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:42.517448    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-6m8qc"
Oct 30 21:32:42.602805 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:42.602733    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/c5db122f-0c8d-45d5-9b8f-c2fb2aed1b38-tls\" (UniqueName: \"kubernetes.io/secret/c5db122f-0c8d-45d5-9b8f-c2fb2aed1b38-tls\") pod \"c5db122f-0c8d-45d5-9b8f-c2fb2aed1b38\" (UID: \"c5db122f-0c8d-45d5-9b8f-c2fb2aed1b38\") "
Oct 30 21:32:42.602957 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:42.602867    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c5db122f-0c8d-45d5-9b8f-c2fb2aed1b38-config\" (UniqueName: \"kubernetes.io/configmap/c5db122f-0c8d-45d5-9b8f-c2fb2aed1b38-config\") pod \"c5db122f-0c8d-45d5-9b8f-c2fb2aed1b38\" (UID: \"c5db122f-0c8d-45d5-9b8f-c2fb2aed1b38\") "
Oct 30 21:32:42.602957 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:42.602908    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c5db122f-0c8d-45d5-9b8f-c2fb2aed1b38-kube-api-access-dp4lz\" (UniqueName: \"kubernetes.io/projected/c5db122f-0c8d-45d5-9b8f-c2fb2aed1b38-kube-api-access-dp4lz\") pod \"c5db122f-0c8d-45d5-9b8f-c2fb2aed1b38\" (UID: \"c5db122f-0c8d-45d5-9b8f-c2fb2aed1b38\") "
Oct 30 21:32:42.603239 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:42.603216    4060 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/81ed591c-3ac0-43d7-bf5f-2e938d2f2c95-kube-rbac-proxy-config\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:32:42.603239 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:42.603241    4060 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jsjbb\" (UniqueName: \"kubernetes.io/projected/81ed591c-3ac0-43d7-bf5f-2e938d2f2c95-kube-api-access-jsjbb\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:32:42.603392 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:42.603256    4060 reconciler_common.go:299] "Volume detached for volume \"prometheus-ca\" (UniqueName: \"kubernetes.io/configmap/81ed591c-3ac0-43d7-bf5f-2e938d2f2c95-prometheus-ca\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:32:42.603392 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:42.603270    4060 reconciler_common.go:299] "Volume detached for volume \"prometheus-client-cert\" (UniqueName: \"kubernetes.io/secret/81ed591c-3ac0-43d7-bf5f-2e938d2f2c95-prometheus-client-cert\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:32:42.603392 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:42.603285    4060 reconciler_common.go:299] "Volume detached for volume \"tls\" (UniqueName: \"kubernetes.io/secret/81ed591c-3ac0-43d7-bf5f-2e938d2f2c95-tls\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:32:42.603392 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:42.603281    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c5db122f-0c8d-45d5-9b8f-c2fb2aed1b38-config" pod "c5db122f-0c8d-45d5-9b8f-c2fb2aed1b38" (UID: "c5db122f-0c8d-45d5-9b8f-c2fb2aed1b38"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:32:42.604647 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:42.604627    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c5db122f-0c8d-45d5-9b8f-c2fb2aed1b38-tls" pod "c5db122f-0c8d-45d5-9b8f-c2fb2aed1b38" (UID: "c5db122f-0c8d-45d5-9b8f-c2fb2aed1b38"). InnerVolumeSpecName "tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:32:42.604833 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:42.604811    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c5db122f-0c8d-45d5-9b8f-c2fb2aed1b38-kube-api-access-dp4lz" pod "c5db122f-0c8d-45d5-9b8f-c2fb2aed1b38" (UID: "c5db122f-0c8d-45d5-9b8f-c2fb2aed1b38"). InnerVolumeSpecName "kube-api-access-dp4lz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:32:42.704345 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:42.704315    4060 reconciler_common.go:299] "Volume detached for volume \"tls\" (UniqueName: \"kubernetes.io/secret/c5db122f-0c8d-45d5-9b8f-c2fb2aed1b38-tls\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:32:42.704345 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:42.704340    4060 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c5db122f-0c8d-45d5-9b8f-c2fb2aed1b38-config\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:32:42.704345 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:42.704350    4060 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dp4lz\" (UniqueName: \"kubernetes.io/projected/c5db122f-0c8d-45d5-9b8f-c2fb2aed1b38-kube-api-access-dp4lz\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:32:43.293313 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:43.293277    4060 generic.go:356] "Generic (PLEG): container finished" podID="c5db122f-0c8d-45d5-9b8f-c2fb2aed1b38" containerID="26206c2bb2143dc2de61015131ebd279557a52430c19dae1159e82c28473248d" exitCode=0
Oct 30 21:32:43.293781 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:43.293334    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-6m8qc"
Oct 30 21:32:43.293781 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:43.293356    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-6m8qc" event={"ID":"c5db122f-0c8d-45d5-9b8f-c2fb2aed1b38","Type":"ContainerDied","Data":"26206c2bb2143dc2de61015131ebd279557a52430c19dae1159e82c28473248d"}
Oct 30 21:32:43.293781 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:43.293418    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-6m8qc" event={"ID":"c5db122f-0c8d-45d5-9b8f-c2fb2aed1b38","Type":"ContainerDied","Data":"30b666965cc0b6560f4bd72d7a8e9ba11854590c1169634494d0409acef7e0b0"}
Oct 30 21:32:43.293781 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:43.293452    4060 scope.go:122] "RemoveContainer" containerID="26206c2bb2143dc2de61015131ebd279557a52430c19dae1159e82c28473248d"
Oct 30 21:32:43.294940 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:43.294828    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-smmxr" event={"ID":"81ed591c-3ac0-43d7-bf5f-2e938d2f2c95","Type":"ContainerDied","Data":"b4e8e7ff05f2048cd18c5ef3b9011e7006187d1b65243056cc67a20be0887b55"}
Oct 30 21:32:43.294940 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:43.294839    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-smmxr"
Oct 30 21:32:43.302736 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:43.302608    4060 scope.go:122] "RemoveContainer" containerID="26206c2bb2143dc2de61015131ebd279557a52430c19dae1159e82c28473248d"
Oct 30 21:32:43.302965 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:32:43.302944    4060 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"26206c2bb2143dc2de61015131ebd279557a52430c19dae1159e82c28473248d\": container with ID starting with 26206c2bb2143dc2de61015131ebd279557a52430c19dae1159e82c28473248d not found: ID does not exist" containerID="26206c2bb2143dc2de61015131ebd279557a52430c19dae1159e82c28473248d"
Oct 30 21:32:43.303021 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:43.302974    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"26206c2bb2143dc2de61015131ebd279557a52430c19dae1159e82c28473248d"} err="failed to get container status \"26206c2bb2143dc2de61015131ebd279557a52430c19dae1159e82c28473248d\": rpc error: code = NotFound desc = could not find container \"26206c2bb2143dc2de61015131ebd279557a52430c19dae1159e82c28473248d\": container with ID starting with 26206c2bb2143dc2de61015131ebd279557a52430c19dae1159e82c28473248d not found: ID does not exist"
Oct 30 21:32:43.303021 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:43.302992    4060 scope.go:122] "RemoveContainer" containerID="8198f211946b8e84b933a0c95e239a3f57b3d96c8897cbc72f07b09bc747add0"
Oct 30 21:32:43.466711 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:43.466677    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-smmxr"]
Oct 30 21:32:43.498633 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:43.498602    4060 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-smmxr"]
Oct 30 21:32:43.505056 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:43.505028    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"]
Oct 30 21:32:43.505296 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:43.505269    4060 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0" podUID="07114265-e487-4b7d-ab67-51bf6e4e73ef" containerName="alertmanager" containerID="cri-o://37976bcb5de4e27ba833c112249b3cbb2088f85a096561f08ef037a4ce11f21e" gracePeriod=120
Oct 30 21:32:43.505393 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:43.505358    4060 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0" podUID="07114265-e487-4b7d-ab67-51bf6e4e73ef" containerName="config-reloader" containerID="cri-o://2dff92934d68ad92c284983cb371a0185f063b8b66075abae65fac0a77df1247" gracePeriod=120
Oct 30 21:32:43.516399 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:43.516372    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"]
Oct 30 21:32:43.516675 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:43.516652    4060 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0" podUID="4213733c-9bbb-412c-9b3e-8895e16de905" containerName="thanos-sidecar" containerID="cri-o://6c4551b5edf57d0e04691df355a977621fb43fd89e1e2d8c7967ecca7e5a303b" gracePeriod=600
Oct 30 21:32:43.516774 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:43.516654    4060 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0" podUID="4213733c-9bbb-412c-9b3e-8895e16de905" containerName="config-reloader" containerID="cri-o://ff43d71d75c7ce7071e6cea25144232e926501b294bd0b73fad256a64313e39a" gracePeriod=600
Oct 30 21:32:43.516822 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:43.516654    4060 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0" podUID="4213733c-9bbb-412c-9b3e-8895e16de905" containerName="prometheus" containerID="cri-o://742faa8c8caeaf9c14d57efe83cfa29b0725f1f6803eade90ae303ef9e072dfa" gracePeriod=600
Oct 30 21:32:43.599467 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:43.599432    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/korrel8r-5cbcc89b8f-6m8qc"]
Oct 30 21:32:43.607535 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:43.607505    4060 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/korrel8r-5cbcc89b8f-6m8qc"]
Oct 30 21:32:44.147932 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:44.147905    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:32:44.258956 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:44.258932    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:32:44.301927 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:44.301897    4060 generic.go:356] "Generic (PLEG): container finished" podID="4213733c-9bbb-412c-9b3e-8895e16de905" containerID="6c4551b5edf57d0e04691df355a977621fb43fd89e1e2d8c7967ecca7e5a303b" exitCode=0
Oct 30 21:32:44.301927 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:44.301919    4060 generic.go:356] "Generic (PLEG): container finished" podID="4213733c-9bbb-412c-9b3e-8895e16de905" containerID="ff43d71d75c7ce7071e6cea25144232e926501b294bd0b73fad256a64313e39a" exitCode=0
Oct 30 21:32:44.301927 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:44.301925    4060 generic.go:356] "Generic (PLEG): container finished" podID="4213733c-9bbb-412c-9b3e-8895e16de905" containerID="742faa8c8caeaf9c14d57efe83cfa29b0725f1f6803eade90ae303ef9e072dfa" exitCode=0
Oct 30 21:32:44.302541 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:44.301971    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:32:44.302541 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:44.301976    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0" event={"ID":"4213733c-9bbb-412c-9b3e-8895e16de905","Type":"ContainerDied","Data":"6c4551b5edf57d0e04691df355a977621fb43fd89e1e2d8c7967ecca7e5a303b"}
Oct 30 21:32:44.302541 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:44.302039    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0" event={"ID":"4213733c-9bbb-412c-9b3e-8895e16de905","Type":"ContainerDied","Data":"ff43d71d75c7ce7071e6cea25144232e926501b294bd0b73fad256a64313e39a"}
Oct 30 21:32:44.302541 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:44.302071    4060 scope.go:122] "RemoveContainer" containerID="6c4551b5edf57d0e04691df355a977621fb43fd89e1e2d8c7967ecca7e5a303b"
Oct 30 21:32:44.302541 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:44.302074    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0" event={"ID":"4213733c-9bbb-412c-9b3e-8895e16de905","Type":"ContainerDied","Data":"742faa8c8caeaf9c14d57efe83cfa29b0725f1f6803eade90ae303ef9e072dfa"}
Oct 30 21:32:44.302541 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:44.302207    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0" event={"ID":"4213733c-9bbb-412c-9b3e-8895e16de905","Type":"ContainerDied","Data":"dd24c0a5083ac8a596644bc3caae2ca776f42a54405b64ba39640fb2aa2bcefe"}
Oct 30 21:32:44.305778 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:44.305755    4060 generic.go:356] "Generic (PLEG): container finished" podID="07114265-e487-4b7d-ab67-51bf6e4e73ef" containerID="2dff92934d68ad92c284983cb371a0185f063b8b66075abae65fac0a77df1247" exitCode=0
Oct 30 21:32:44.305778 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:44.305776    4060 generic.go:356] "Generic (PLEG): container finished" podID="07114265-e487-4b7d-ab67-51bf6e4e73ef" containerID="37976bcb5de4e27ba833c112249b3cbb2088f85a096561f08ef037a4ce11f21e" exitCode=0
Oct 30 21:32:44.305917 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:44.305806    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0" event={"ID":"07114265-e487-4b7d-ab67-51bf6e4e73ef","Type":"ContainerDied","Data":"2dff92934d68ad92c284983cb371a0185f063b8b66075abae65fac0a77df1247"}
Oct 30 21:32:44.305917 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:44.305819    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:32:44.305917 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:44.305852    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0" event={"ID":"07114265-e487-4b7d-ab67-51bf6e4e73ef","Type":"ContainerDied","Data":"37976bcb5de4e27ba833c112249b3cbb2088f85a096561f08ef037a4ce11f21e"}
Oct 30 21:32:44.305917 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:44.305882    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0" event={"ID":"07114265-e487-4b7d-ab67-51bf6e4e73ef","Type":"ContainerDied","Data":"5c87e5e8e1b4eef20821542aecd79810e61d738704dd9dfa6d748b83e40a563d"}
Oct 30 21:32:44.310446 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:44.310429    4060 scope.go:122] "RemoveContainer" containerID="ff43d71d75c7ce7071e6cea25144232e926501b294bd0b73fad256a64313e39a"
Oct 30 21:32:44.318414 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:44.318395    4060 scope.go:122] "RemoveContainer" containerID="742faa8c8caeaf9c14d57efe83cfa29b0725f1f6803eade90ae303ef9e072dfa"
Oct 30 21:32:44.321564 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:44.321546    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/07114265-e487-4b7d-ab67-51bf6e4e73ef-config-volume\" (UniqueName: \"kubernetes.io/secret/07114265-e487-4b7d-ab67-51bf6e4e73ef-config-volume\") pod \"07114265-e487-4b7d-ab67-51bf6e4e73ef\" (UID: \"07114265-e487-4b7d-ab67-51bf6e4e73ef\") "
Oct 30 21:32:44.321660 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:44.321589    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/07114265-e487-4b7d-ab67-51bf6e4e73ef-config-out\" (UniqueName: \"kubernetes.io/empty-dir/07114265-e487-4b7d-ab67-51bf6e4e73ef-config-out\") pod \"07114265-e487-4b7d-ab67-51bf6e4e73ef\" (UID: \"07114265-e487-4b7d-ab67-51bf6e4e73ef\") "
Oct 30 21:32:44.321660 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:44.321623    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/07114265-e487-4b7d-ab67-51bf6e4e73ef-cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/07114265-e487-4b7d-ab67-51bf6e4e73ef-cluster-tls-config\") pod \"07114265-e487-4b7d-ab67-51bf6e4e73ef\" (UID: \"07114265-e487-4b7d-ab67-51bf6e4e73ef\") "
Oct 30 21:32:44.321660 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:44.321655    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/07114265-e487-4b7d-ab67-51bf6e4e73ef-kube-api-access-59ckb\" (UniqueName: \"kubernetes.io/projected/07114265-e487-4b7d-ab67-51bf6e4e73ef-kube-api-access-59ckb\") pod \"07114265-e487-4b7d-ab67-51bf6e4e73ef\" (UID: \"07114265-e487-4b7d-ab67-51bf6e4e73ef\") "
Oct 30 21:32:44.321827 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:44.321713    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/07114265-e487-4b7d-ab67-51bf6e4e73ef-tls-assets\" (UniqueName: \"kubernetes.io/projected/07114265-e487-4b7d-ab67-51bf6e4e73ef-tls-assets\") pod \"07114265-e487-4b7d-ab67-51bf6e4e73ef\" (UID: \"07114265-e487-4b7d-ab67-51bf6e4e73ef\") "
Oct 30 21:32:44.321827 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:44.321752    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/07114265-e487-4b7d-ab67-51bf6e4e73ef-alertmanager-data-science-monitoringstack-db\" (UniqueName: \"kubernetes.io/empty-dir/07114265-e487-4b7d-ab67-51bf6e4e73ef-alertmanager-data-science-monitoringstack-db\") pod \"07114265-e487-4b7d-ab67-51bf6e4e73ef\" (UID: \"07114265-e487-4b7d-ab67-51bf6e4e73ef\") "
Oct 30 21:32:44.321827 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:44.321804    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/07114265-e487-4b7d-ab67-51bf6e4e73ef-web-config\" (UniqueName: \"kubernetes.io/secret/07114265-e487-4b7d-ab67-51bf6e4e73ef-web-config\") pod \"07114265-e487-4b7d-ab67-51bf6e4e73ef\" (UID: \"07114265-e487-4b7d-ab67-51bf6e4e73ef\") "
Oct 30 21:32:44.322266 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:44.322221    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07114265-e487-4b7d-ab67-51bf6e4e73ef-alertmanager-data-science-monitoringstack-db" pod "07114265-e487-4b7d-ab67-51bf6e4e73ef" (UID: "07114265-e487-4b7d-ab67-51bf6e4e73ef"). InnerVolumeSpecName "alertmanager-data-science-monitoringstack-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:32:44.325242 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:44.324400    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/07114265-e487-4b7d-ab67-51bf6e4e73ef-config-volume" pod "07114265-e487-4b7d-ab67-51bf6e4e73ef" (UID: "07114265-e487-4b7d-ab67-51bf6e4e73ef"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:32:44.325242 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:44.324693    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/07114265-e487-4b7d-ab67-51bf6e4e73ef-tls-assets" pod "07114265-e487-4b7d-ab67-51bf6e4e73ef" (UID: "07114265-e487-4b7d-ab67-51bf6e4e73ef"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:32:44.325242 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:44.325213    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/07114265-e487-4b7d-ab67-51bf6e4e73ef-kube-api-access-59ckb" pod "07114265-e487-4b7d-ab67-51bf6e4e73ef" (UID: "07114265-e487-4b7d-ab67-51bf6e4e73ef"). InnerVolumeSpecName "kube-api-access-59ckb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:32:44.325910 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:44.325884    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07114265-e487-4b7d-ab67-51bf6e4e73ef-config-out" pod "07114265-e487-4b7d-ab67-51bf6e4e73ef" (UID: "07114265-e487-4b7d-ab67-51bf6e4e73ef"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:32:44.328427 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:44.328407    4060 scope.go:122] "RemoveContainer" containerID="0f0d66439a4499241af06b0ff80a5b19f3e22444585f504067bf34a7eaff41b2"
Oct 30 21:32:44.329297 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:44.329278    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/07114265-e487-4b7d-ab67-51bf6e4e73ef-cluster-tls-config" pod "07114265-e487-4b7d-ab67-51bf6e4e73ef" (UID: "07114265-e487-4b7d-ab67-51bf6e4e73ef"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:32:44.336325 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:44.336305    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/07114265-e487-4b7d-ab67-51bf6e4e73ef-web-config" pod "07114265-e487-4b7d-ab67-51bf6e4e73ef" (UID: "07114265-e487-4b7d-ab67-51bf6e4e73ef"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:32:44.344854 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:44.344830    4060 scope.go:122] "RemoveContainer" containerID="6c4551b5edf57d0e04691df355a977621fb43fd89e1e2d8c7967ecca7e5a303b"
Oct 30 21:32:44.345113 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:32:44.345090    4060 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6c4551b5edf57d0e04691df355a977621fb43fd89e1e2d8c7967ecca7e5a303b\": container with ID starting with 6c4551b5edf57d0e04691df355a977621fb43fd89e1e2d8c7967ecca7e5a303b not found: ID does not exist" containerID="6c4551b5edf57d0e04691df355a977621fb43fd89e1e2d8c7967ecca7e5a303b"
Oct 30 21:32:44.345186 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:44.345126    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c4551b5edf57d0e04691df355a977621fb43fd89e1e2d8c7967ecca7e5a303b"} err="failed to get container status \"6c4551b5edf57d0e04691df355a977621fb43fd89e1e2d8c7967ecca7e5a303b\": rpc error: code = NotFound desc = could not find container \"6c4551b5edf57d0e04691df355a977621fb43fd89e1e2d8c7967ecca7e5a303b\": container with ID starting with 6c4551b5edf57d0e04691df355a977621fb43fd89e1e2d8c7967ecca7e5a303b not found: ID does not exist"
Oct 30 21:32:44.345186 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:44.345166    4060 scope.go:122] "RemoveContainer" containerID="ff43d71d75c7ce7071e6cea25144232e926501b294bd0b73fad256a64313e39a"
Oct 30 21:32:44.345467 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:32:44.345447    4060 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ff43d71d75c7ce7071e6cea25144232e926501b294bd0b73fad256a64313e39a\": container with ID starting with ff43d71d75c7ce7071e6cea25144232e926501b294bd0b73fad256a64313e39a not found: ID does not exist" containerID="ff43d71d75c7ce7071e6cea25144232e926501b294bd0b73fad256a64313e39a"
Oct 30 21:32:44.345545 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:44.345474    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ff43d71d75c7ce7071e6cea25144232e926501b294bd0b73fad256a64313e39a"} err="failed to get container status \"ff43d71d75c7ce7071e6cea25144232e926501b294bd0b73fad256a64313e39a\": rpc error: code = NotFound desc = could not find container \"ff43d71d75c7ce7071e6cea25144232e926501b294bd0b73fad256a64313e39a\": container with ID starting with ff43d71d75c7ce7071e6cea25144232e926501b294bd0b73fad256a64313e39a not found: ID does not exist"
Oct 30 21:32:44.345545 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:44.345505    4060 scope.go:122] "RemoveContainer" containerID="742faa8c8caeaf9c14d57efe83cfa29b0725f1f6803eade90ae303ef9e072dfa"
Oct 30 21:32:44.345722 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:32:44.345706    4060 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"742faa8c8caeaf9c14d57efe83cfa29b0725f1f6803eade90ae303ef9e072dfa\": container with ID starting with 742faa8c8caeaf9c14d57efe83cfa29b0725f1f6803eade90ae303ef9e072dfa not found: ID does not exist" containerID="742faa8c8caeaf9c14d57efe83cfa29b0725f1f6803eade90ae303ef9e072dfa"
Oct 30 21:32:44.345762 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:44.345727    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"742faa8c8caeaf9c14d57efe83cfa29b0725f1f6803eade90ae303ef9e072dfa"} err="failed to get container status \"742faa8c8caeaf9c14d57efe83cfa29b0725f1f6803eade90ae303ef9e072dfa\": rpc error: code = NotFound desc = could not find container \"742faa8c8caeaf9c14d57efe83cfa29b0725f1f6803eade90ae303ef9e072dfa\": container with ID starting with 742faa8c8caeaf9c14d57efe83cfa29b0725f1f6803eade90ae303ef9e072dfa not found: ID does not exist"
Oct 30 21:32:44.345762 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:44.345742    4060 scope.go:122] "RemoveContainer" containerID="0f0d66439a4499241af06b0ff80a5b19f3e22444585f504067bf34a7eaff41b2"
Oct 30 21:32:44.345974 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:32:44.345956    4060 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0f0d66439a4499241af06b0ff80a5b19f3e22444585f504067bf34a7eaff41b2\": container with ID starting with 0f0d66439a4499241af06b0ff80a5b19f3e22444585f504067bf34a7eaff41b2 not found: ID does not exist" containerID="0f0d66439a4499241af06b0ff80a5b19f3e22444585f504067bf34a7eaff41b2"
Oct 30 21:32:44.346042 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:44.345984    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f0d66439a4499241af06b0ff80a5b19f3e22444585f504067bf34a7eaff41b2"} err="failed to get container status \"0f0d66439a4499241af06b0ff80a5b19f3e22444585f504067bf34a7eaff41b2\": rpc error: code = NotFound desc = could not find container \"0f0d66439a4499241af06b0ff80a5b19f3e22444585f504067bf34a7eaff41b2\": container with ID starting with 0f0d66439a4499241af06b0ff80a5b19f3e22444585f504067bf34a7eaff41b2 not found: ID does not exist"
Oct 30 21:32:44.346042 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:44.346005    4060 scope.go:122] "RemoveContainer" containerID="6c4551b5edf57d0e04691df355a977621fb43fd89e1e2d8c7967ecca7e5a303b"
Oct 30 21:32:44.346215 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:44.346198    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c4551b5edf57d0e04691df355a977621fb43fd89e1e2d8c7967ecca7e5a303b"} err="failed to get container status \"6c4551b5edf57d0e04691df355a977621fb43fd89e1e2d8c7967ecca7e5a303b\": rpc error: code = NotFound desc = could not find container \"6c4551b5edf57d0e04691df355a977621fb43fd89e1e2d8c7967ecca7e5a303b\": container with ID starting with 6c4551b5edf57d0e04691df355a977621fb43fd89e1e2d8c7967ecca7e5a303b not found: ID does not exist"
Oct 30 21:32:44.346254 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:44.346215    4060 scope.go:122] "RemoveContainer" containerID="ff43d71d75c7ce7071e6cea25144232e926501b294bd0b73fad256a64313e39a"
Oct 30 21:32:44.346404 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:44.346389    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ff43d71d75c7ce7071e6cea25144232e926501b294bd0b73fad256a64313e39a"} err="failed to get container status \"ff43d71d75c7ce7071e6cea25144232e926501b294bd0b73fad256a64313e39a\": rpc error: code = NotFound desc = could not find container \"ff43d71d75c7ce7071e6cea25144232e926501b294bd0b73fad256a64313e39a\": container with ID starting with ff43d71d75c7ce7071e6cea25144232e926501b294bd0b73fad256a64313e39a not found: ID does not exist"
Oct 30 21:32:44.346460 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:44.346404    4060 scope.go:122] "RemoveContainer" containerID="742faa8c8caeaf9c14d57efe83cfa29b0725f1f6803eade90ae303ef9e072dfa"
Oct 30 21:32:44.346620 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:44.346602    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"742faa8c8caeaf9c14d57efe83cfa29b0725f1f6803eade90ae303ef9e072dfa"} err="failed to get container status \"742faa8c8caeaf9c14d57efe83cfa29b0725f1f6803eade90ae303ef9e072dfa\": rpc error: code = NotFound desc = could not find container \"742faa8c8caeaf9c14d57efe83cfa29b0725f1f6803eade90ae303ef9e072dfa\": container with ID starting with 742faa8c8caeaf9c14d57efe83cfa29b0725f1f6803eade90ae303ef9e072dfa not found: ID does not exist"
Oct 30 21:32:44.346676 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:44.346621    4060 scope.go:122] "RemoveContainer" containerID="0f0d66439a4499241af06b0ff80a5b19f3e22444585f504067bf34a7eaff41b2"
Oct 30 21:32:44.346810 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:44.346793    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f0d66439a4499241af06b0ff80a5b19f3e22444585f504067bf34a7eaff41b2"} err="failed to get container status \"0f0d66439a4499241af06b0ff80a5b19f3e22444585f504067bf34a7eaff41b2\": rpc error: code = NotFound desc = could not find container \"0f0d66439a4499241af06b0ff80a5b19f3e22444585f504067bf34a7eaff41b2\": container with ID starting with 0f0d66439a4499241af06b0ff80a5b19f3e22444585f504067bf34a7eaff41b2 not found: ID does not exist"
Oct 30 21:32:44.346864 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:44.346810    4060 scope.go:122] "RemoveContainer" containerID="6c4551b5edf57d0e04691df355a977621fb43fd89e1e2d8c7967ecca7e5a303b"
Oct 30 21:32:44.346980 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:44.346962    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c4551b5edf57d0e04691df355a977621fb43fd89e1e2d8c7967ecca7e5a303b"} err="failed to get container status \"6c4551b5edf57d0e04691df355a977621fb43fd89e1e2d8c7967ecca7e5a303b\": rpc error: code = NotFound desc = could not find container \"6c4551b5edf57d0e04691df355a977621fb43fd89e1e2d8c7967ecca7e5a303b\": container with ID starting with 6c4551b5edf57d0e04691df355a977621fb43fd89e1e2d8c7967ecca7e5a303b not found: ID does not exist"
Oct 30 21:32:44.347040 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:44.346981    4060 scope.go:122] "RemoveContainer" containerID="ff43d71d75c7ce7071e6cea25144232e926501b294bd0b73fad256a64313e39a"
Oct 30 21:32:44.347196 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:44.347174    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ff43d71d75c7ce7071e6cea25144232e926501b294bd0b73fad256a64313e39a"} err="failed to get container status \"ff43d71d75c7ce7071e6cea25144232e926501b294bd0b73fad256a64313e39a\": rpc error: code = NotFound desc = could not find container \"ff43d71d75c7ce7071e6cea25144232e926501b294bd0b73fad256a64313e39a\": container with ID starting with ff43d71d75c7ce7071e6cea25144232e926501b294bd0b73fad256a64313e39a not found: ID does not exist"
Oct 30 21:32:44.347238 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:44.347196    4060 scope.go:122] "RemoveContainer" containerID="742faa8c8caeaf9c14d57efe83cfa29b0725f1f6803eade90ae303ef9e072dfa"
Oct 30 21:32:44.347399 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:44.347381    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"742faa8c8caeaf9c14d57efe83cfa29b0725f1f6803eade90ae303ef9e072dfa"} err="failed to get container status \"742faa8c8caeaf9c14d57efe83cfa29b0725f1f6803eade90ae303ef9e072dfa\": rpc error: code = NotFound desc = could not find container \"742faa8c8caeaf9c14d57efe83cfa29b0725f1f6803eade90ae303ef9e072dfa\": container with ID starting with 742faa8c8caeaf9c14d57efe83cfa29b0725f1f6803eade90ae303ef9e072dfa not found: ID does not exist"
Oct 30 21:32:44.347441 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:44.347399    4060 scope.go:122] "RemoveContainer" containerID="0f0d66439a4499241af06b0ff80a5b19f3e22444585f504067bf34a7eaff41b2"
Oct 30 21:32:44.347608 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:44.347589    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f0d66439a4499241af06b0ff80a5b19f3e22444585f504067bf34a7eaff41b2"} err="failed to get container status \"0f0d66439a4499241af06b0ff80a5b19f3e22444585f504067bf34a7eaff41b2\": rpc error: code = NotFound desc = could not find container \"0f0d66439a4499241af06b0ff80a5b19f3e22444585f504067bf34a7eaff41b2\": container with ID starting with 0f0d66439a4499241af06b0ff80a5b19f3e22444585f504067bf34a7eaff41b2 not found: ID does not exist"
Oct 30 21:32:44.347691 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:44.347609    4060 scope.go:122] "RemoveContainer" containerID="2dff92934d68ad92c284983cb371a0185f063b8b66075abae65fac0a77df1247"
Oct 30 21:32:44.355076 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:44.355060    4060 scope.go:122] "RemoveContainer" containerID="37976bcb5de4e27ba833c112249b3cbb2088f85a096561f08ef037a4ce11f21e"
Oct 30 21:32:44.362478 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:44.362463    4060 scope.go:122] "RemoveContainer" containerID="44a49637b4c3b3e85bbb7ddf6ad8eb1885f6de1b944a234c835d6df6f046d523"
Oct 30 21:32:44.369519 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:44.369504    4060 scope.go:122] "RemoveContainer" containerID="2dff92934d68ad92c284983cb371a0185f063b8b66075abae65fac0a77df1247"
Oct 30 21:32:44.369790 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:32:44.369770    4060 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2dff92934d68ad92c284983cb371a0185f063b8b66075abae65fac0a77df1247\": container with ID starting with 2dff92934d68ad92c284983cb371a0185f063b8b66075abae65fac0a77df1247 not found: ID does not exist" containerID="2dff92934d68ad92c284983cb371a0185f063b8b66075abae65fac0a77df1247"
Oct 30 21:32:44.369878 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:44.369797    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2dff92934d68ad92c284983cb371a0185f063b8b66075abae65fac0a77df1247"} err="failed to get container status \"2dff92934d68ad92c284983cb371a0185f063b8b66075abae65fac0a77df1247\": rpc error: code = NotFound desc = could not find container \"2dff92934d68ad92c284983cb371a0185f063b8b66075abae65fac0a77df1247\": container with ID starting with 2dff92934d68ad92c284983cb371a0185f063b8b66075abae65fac0a77df1247 not found: ID does not exist"
Oct 30 21:32:44.369878 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:44.369813    4060 scope.go:122] "RemoveContainer" containerID="37976bcb5de4e27ba833c112249b3cbb2088f85a096561f08ef037a4ce11f21e"
Oct 30 21:32:44.370047 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:32:44.370026    4060 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"37976bcb5de4e27ba833c112249b3cbb2088f85a096561f08ef037a4ce11f21e\": container with ID starting with 37976bcb5de4e27ba833c112249b3cbb2088f85a096561f08ef037a4ce11f21e not found: ID does not exist" containerID="37976bcb5de4e27ba833c112249b3cbb2088f85a096561f08ef037a4ce11f21e"
Oct 30 21:32:44.370108 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:44.370054    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"37976bcb5de4e27ba833c112249b3cbb2088f85a096561f08ef037a4ce11f21e"} err="failed to get container status \"37976bcb5de4e27ba833c112249b3cbb2088f85a096561f08ef037a4ce11f21e\": rpc error: code = NotFound desc = could not find container \"37976bcb5de4e27ba833c112249b3cbb2088f85a096561f08ef037a4ce11f21e\": container with ID starting with 37976bcb5de4e27ba833c112249b3cbb2088f85a096561f08ef037a4ce11f21e not found: ID does not exist"
Oct 30 21:32:44.370108 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:44.370075    4060 scope.go:122] "RemoveContainer" containerID="44a49637b4c3b3e85bbb7ddf6ad8eb1885f6de1b944a234c835d6df6f046d523"
Oct 30 21:32:44.370336 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:32:44.370318    4060 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"44a49637b4c3b3e85bbb7ddf6ad8eb1885f6de1b944a234c835d6df6f046d523\": container with ID starting with 44a49637b4c3b3e85bbb7ddf6ad8eb1885f6de1b944a234c835d6df6f046d523 not found: ID does not exist" containerID="44a49637b4c3b3e85bbb7ddf6ad8eb1885f6de1b944a234c835d6df6f046d523"
Oct 30 21:32:44.370374 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:44.370341    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"44a49637b4c3b3e85bbb7ddf6ad8eb1885f6de1b944a234c835d6df6f046d523"} err="failed to get container status \"44a49637b4c3b3e85bbb7ddf6ad8eb1885f6de1b944a234c835d6df6f046d523\": rpc error: code = NotFound desc = could not find container \"44a49637b4c3b3e85bbb7ddf6ad8eb1885f6de1b944a234c835d6df6f046d523\": container with ID starting with 44a49637b4c3b3e85bbb7ddf6ad8eb1885f6de1b944a234c835d6df6f046d523 not found: ID does not exist"
Oct 30 21:32:44.370374 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:44.370358    4060 scope.go:122] "RemoveContainer" containerID="2dff92934d68ad92c284983cb371a0185f063b8b66075abae65fac0a77df1247"
Oct 30 21:32:44.370591 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:44.370572    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2dff92934d68ad92c284983cb371a0185f063b8b66075abae65fac0a77df1247"} err="failed to get container status \"2dff92934d68ad92c284983cb371a0185f063b8b66075abae65fac0a77df1247\": rpc error: code = NotFound desc = could not find container \"2dff92934d68ad92c284983cb371a0185f063b8b66075abae65fac0a77df1247\": container with ID starting with 2dff92934d68ad92c284983cb371a0185f063b8b66075abae65fac0a77df1247 not found: ID does not exist"
Oct 30 21:32:44.370591 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:44.370590    4060 scope.go:122] "RemoveContainer" containerID="37976bcb5de4e27ba833c112249b3cbb2088f85a096561f08ef037a4ce11f21e"
Oct 30 21:32:44.370826 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:44.370811    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"37976bcb5de4e27ba833c112249b3cbb2088f85a096561f08ef037a4ce11f21e"} err="failed to get container status \"37976bcb5de4e27ba833c112249b3cbb2088f85a096561f08ef037a4ce11f21e\": rpc error: code = NotFound desc = could not find container \"37976bcb5de4e27ba833c112249b3cbb2088f85a096561f08ef037a4ce11f21e\": container with ID starting with 37976bcb5de4e27ba833c112249b3cbb2088f85a096561f08ef037a4ce11f21e not found: ID does not exist"
Oct 30 21:32:44.370881 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:44.370825    4060 scope.go:122] "RemoveContainer" containerID="44a49637b4c3b3e85bbb7ddf6ad8eb1885f6de1b944a234c835d6df6f046d523"
Oct 30 21:32:44.371027 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:44.371003    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"44a49637b4c3b3e85bbb7ddf6ad8eb1885f6de1b944a234c835d6df6f046d523"} err="failed to get container status \"44a49637b4c3b3e85bbb7ddf6ad8eb1885f6de1b944a234c835d6df6f046d523\": rpc error: code = NotFound desc = could not find container \"44a49637b4c3b3e85bbb7ddf6ad8eb1885f6de1b944a234c835d6df6f046d523\": container with ID starting with 44a49637b4c3b3e85bbb7ddf6ad8eb1885f6de1b944a234c835d6df6f046d523 not found: ID does not exist"
Oct 30 21:32:44.422220 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:44.422193    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/4213733c-9bbb-412c-9b3e-8895e16de905-thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4213733c-9bbb-412c-9b3e-8895e16de905-thanos-prometheus-http-client-file\") pod \"4213733c-9bbb-412c-9b3e-8895e16de905\" (UID: \"4213733c-9bbb-412c-9b3e-8895e16de905\") "
Oct 30 21:32:44.422404 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:44.422227    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/4213733c-9bbb-412c-9b3e-8895e16de905-web-config\" (UniqueName: \"kubernetes.io/secret/4213733c-9bbb-412c-9b3e-8895e16de905-web-config\") pod \"4213733c-9bbb-412c-9b3e-8895e16de905\" (UID: \"4213733c-9bbb-412c-9b3e-8895e16de905\") "
Oct 30 21:32:44.422404 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:44.422251    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4213733c-9bbb-412c-9b3e-8895e16de905-tls-assets\" (UniqueName: \"kubernetes.io/projected/4213733c-9bbb-412c-9b3e-8895e16de905-tls-assets\") pod \"4213733c-9bbb-412c-9b3e-8895e16de905\" (UID: \"4213733c-9bbb-412c-9b3e-8895e16de905\") "
Oct 30 21:32:44.422404 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:44.422273    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/4213733c-9bbb-412c-9b3e-8895e16de905-prometheus-data-science-monitoringstack-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4213733c-9bbb-412c-9b3e-8895e16de905-prometheus-data-science-monitoringstack-rulefiles-2\") pod \"4213733c-9bbb-412c-9b3e-8895e16de905\" (UID: \"4213733c-9bbb-412c-9b3e-8895e16de905\") "
Oct 30 21:32:44.422404 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:44.422310    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/4213733c-9bbb-412c-9b3e-8895e16de905-web-config-tls-secret-key-prometheus-operated-tls-f3457c70\" (UniqueName: \"kubernetes.io/secret/4213733c-9bbb-412c-9b3e-8895e16de905-web-config-tls-secret-key-prometheus-operated-tls-f3457c70\") pod \"4213733c-9bbb-412c-9b3e-8895e16de905\" (UID: \"4213733c-9bbb-412c-9b3e-8895e16de905\") "
Oct 30 21:32:44.422404 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:44.422334    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/4213733c-9bbb-412c-9b3e-8895e16de905-secret-prometheus-web-tls-ca\" (UniqueName: \"kubernetes.io/secret/4213733c-9bbb-412c-9b3e-8895e16de905-secret-prometheus-web-tls-ca\") pod \"4213733c-9bbb-412c-9b3e-8895e16de905\" (UID: \"4213733c-9bbb-412c-9b3e-8895e16de905\") "
Oct 30 21:32:44.422404 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:44.422390    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/4213733c-9bbb-412c-9b3e-8895e16de905-prometheus-data-science-monitoringstack-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4213733c-9bbb-412c-9b3e-8895e16de905-prometheus-data-science-monitoringstack-rulefiles-0\") pod \"4213733c-9bbb-412c-9b3e-8895e16de905\" (UID: \"4213733c-9bbb-412c-9b3e-8895e16de905\") "
Oct 30 21:32:44.422831 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:44.422412    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/4213733c-9bbb-412c-9b3e-8895e16de905-prometheus-data-science-monitoringstack-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4213733c-9bbb-412c-9b3e-8895e16de905-prometheus-data-science-monitoringstack-rulefiles-1\") pod \"4213733c-9bbb-412c-9b3e-8895e16de905\" (UID: \"4213733c-9bbb-412c-9b3e-8895e16de905\") "
Oct 30 21:32:44.422831 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:44.422445    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/4213733c-9bbb-412c-9b3e-8895e16de905-web-config-tls-secret-cert-prometheus-operated-tls-f3457c70\" (UniqueName: \"kubernetes.io/secret/4213733c-9bbb-412c-9b3e-8895e16de905-web-config-tls-secret-cert-prometheus-operated-tls-f3457c70\") pod \"4213733c-9bbb-412c-9b3e-8895e16de905\" (UID: \"4213733c-9bbb-412c-9b3e-8895e16de905\") "
Oct 30 21:32:44.422831 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:44.422466    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4213733c-9bbb-412c-9b3e-8895e16de905-kube-api-access-m8lg9\" (UniqueName: \"kubernetes.io/projected/4213733c-9bbb-412c-9b3e-8895e16de905-kube-api-access-m8lg9\") pod \"4213733c-9bbb-412c-9b3e-8895e16de905\" (UID: \"4213733c-9bbb-412c-9b3e-8895e16de905\") "
Oct 30 21:32:44.422831 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:44.422503    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/4213733c-9bbb-412c-9b3e-8895e16de905-config\" (UniqueName: \"kubernetes.io/secret/4213733c-9bbb-412c-9b3e-8895e16de905-config\") pod \"4213733c-9bbb-412c-9b3e-8895e16de905\" (UID: \"4213733c-9bbb-412c-9b3e-8895e16de905\") "
Oct 30 21:32:44.422831 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:44.422602    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a155a55c1ce0e65b\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a155a55c1ce0e65b\") pod \"4213733c-9bbb-412c-9b3e-8895e16de905\" (UID: \"4213733c-9bbb-412c-9b3e-8895e16de905\") "
Oct 30 21:32:44.422831 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:44.422641    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4213733c-9bbb-412c-9b3e-8895e16de905-config-out\" (UniqueName: \"kubernetes.io/empty-dir/4213733c-9bbb-412c-9b3e-8895e16de905-config-out\") pod \"4213733c-9bbb-412c-9b3e-8895e16de905\" (UID: \"4213733c-9bbb-412c-9b3e-8895e16de905\") "
Oct 30 21:32:44.423172 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:44.422870    4060 reconciler_common.go:299] "Volume detached for volume \"alertmanager-data-science-monitoringstack-db\" (UniqueName: \"kubernetes.io/empty-dir/07114265-e487-4b7d-ab67-51bf6e4e73ef-alertmanager-data-science-monitoringstack-db\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:32:44.423172 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:44.422889    4060 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/07114265-e487-4b7d-ab67-51bf6e4e73ef-web-config\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:32:44.423172 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:44.422905    4060 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/07114265-e487-4b7d-ab67-51bf6e4e73ef-config-volume\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:32:44.423172 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:44.422925    4060 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/07114265-e487-4b7d-ab67-51bf6e4e73ef-config-out\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:32:44.423172 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:44.422944    4060 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/07114265-e487-4b7d-ab67-51bf6e4e73ef-cluster-tls-config\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:32:44.423172 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:44.422963    4060 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-59ckb\" (UniqueName: \"kubernetes.io/projected/07114265-e487-4b7d-ab67-51bf6e4e73ef-kube-api-access-59ckb\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:32:44.423172 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:44.422976    4060 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/07114265-e487-4b7d-ab67-51bf6e4e73ef-tls-assets\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:32:44.423542 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:44.423353    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4213733c-9bbb-412c-9b3e-8895e16de905-prometheus-data-science-monitoringstack-rulefiles-2" pod "4213733c-9bbb-412c-9b3e-8895e16de905" (UID: "4213733c-9bbb-412c-9b3e-8895e16de905"). InnerVolumeSpecName "prometheus-data-science-monitoringstack-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:32:44.424550 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:44.423851    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4213733c-9bbb-412c-9b3e-8895e16de905-prometheus-data-science-monitoringstack-rulefiles-0" pod "4213733c-9bbb-412c-9b3e-8895e16de905" (UID: "4213733c-9bbb-412c-9b3e-8895e16de905"). InnerVolumeSpecName "prometheus-data-science-monitoringstack-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:32:44.424550 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:44.424197    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4213733c-9bbb-412c-9b3e-8895e16de905-prometheus-data-science-monitoringstack-rulefiles-1" pod "4213733c-9bbb-412c-9b3e-8895e16de905" (UID: "4213733c-9bbb-412c-9b3e-8895e16de905"). InnerVolumeSpecName "prometheus-data-science-monitoringstack-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:32:44.425062 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:44.425036    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4213733c-9bbb-412c-9b3e-8895e16de905-tls-assets" pod "4213733c-9bbb-412c-9b3e-8895e16de905" (UID: "4213733c-9bbb-412c-9b3e-8895e16de905"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:32:44.426320 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:44.426295    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4213733c-9bbb-412c-9b3e-8895e16de905-secret-prometheus-web-tls-ca" pod "4213733c-9bbb-412c-9b3e-8895e16de905" (UID: "4213733c-9bbb-412c-9b3e-8895e16de905"). InnerVolumeSpecName "secret-prometheus-web-tls-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:32:44.427419 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:44.427382    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4213733c-9bbb-412c-9b3e-8895e16de905-config-out" pod "4213733c-9bbb-412c-9b3e-8895e16de905" (UID: "4213733c-9bbb-412c-9b3e-8895e16de905"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:32:44.427752 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:44.427724    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4213733c-9bbb-412c-9b3e-8895e16de905-config" pod "4213733c-9bbb-412c-9b3e-8895e16de905" (UID: "4213733c-9bbb-412c-9b3e-8895e16de905"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:32:44.428359 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:44.428208    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4213733c-9bbb-412c-9b3e-8895e16de905-web-config-tls-secret-cert-prometheus-operated-tls-f3457c70" pod "4213733c-9bbb-412c-9b3e-8895e16de905" (UID: "4213733c-9bbb-412c-9b3e-8895e16de905"). InnerVolumeSpecName "web-config-tls-secret-cert-prometheus-operated-tls-f3457c70". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:32:44.428483 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:44.428458    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4213733c-9bbb-412c-9b3e-8895e16de905-kube-api-access-m8lg9" pod "4213733c-9bbb-412c-9b3e-8895e16de905" (UID: "4213733c-9bbb-412c-9b3e-8895e16de905"). InnerVolumeSpecName "kube-api-access-m8lg9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:32:44.428932 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:44.428890    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4213733c-9bbb-412c-9b3e-8895e16de905-thanos-prometheus-http-client-file" pod "4213733c-9bbb-412c-9b3e-8895e16de905" (UID: "4213733c-9bbb-412c-9b3e-8895e16de905"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:32:44.428932 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:44.428926    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4213733c-9bbb-412c-9b3e-8895e16de905-web-config-tls-secret-key-prometheus-operated-tls-f3457c70" pod "4213733c-9bbb-412c-9b3e-8895e16de905" (UID: "4213733c-9bbb-412c-9b3e-8895e16de905"). InnerVolumeSpecName "web-config-tls-secret-key-prometheus-operated-tls-f3457c70". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:32:44.430677 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:44.430658    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/csi/ebs.csi.aws.com^vol-0a155a55c1ce0e65b" pod "4213733c-9bbb-412c-9b3e-8895e16de905" (UID: "4213733c-9bbb-412c-9b3e-8895e16de905"). InnerVolumeSpecName "pvc-e73afc79-aa37-49a0-8744-633c03cad1f4". PluginName "kubernetes.io/csi", VolumeGIDValue ""
Oct 30 21:32:44.438685 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:44.438660    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4213733c-9bbb-412c-9b3e-8895e16de905-web-config" pod "4213733c-9bbb-412c-9b3e-8895e16de905" (UID: "4213733c-9bbb-412c-9b3e-8895e16de905"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:32:44.524418 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:44.524320    4060 reconciler_common.go:299] "Volume detached for volume \"prometheus-data-science-monitoringstack-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4213733c-9bbb-412c-9b3e-8895e16de905-prometheus-data-science-monitoringstack-rulefiles-0\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:32:44.524418 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:44.524354    4060 reconciler_common.go:299] "Volume detached for volume \"prometheus-data-science-monitoringstack-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4213733c-9bbb-412c-9b3e-8895e16de905-prometheus-data-science-monitoringstack-rulefiles-1\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:32:44.524418 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:44.524369    4060 reconciler_common.go:299] "Volume detached for volume \"web-config-tls-secret-cert-prometheus-operated-tls-f3457c70\" (UniqueName: \"kubernetes.io/secret/4213733c-9bbb-412c-9b3e-8895e16de905-web-config-tls-secret-cert-prometheus-operated-tls-f3457c70\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:32:44.524418 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:44.524383    4060 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m8lg9\" (UniqueName: \"kubernetes.io/projected/4213733c-9bbb-412c-9b3e-8895e16de905-kube-api-access-m8lg9\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:32:44.524418 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:44.524396    4060 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/4213733c-9bbb-412c-9b3e-8895e16de905-config\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:32:44.524745 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:44.524427    4060 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"pvc-e73afc79-aa37-49a0-8744-633c03cad1f4\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a155a55c1ce0e65b\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" "
Oct 30 21:32:44.524745 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:44.524442    4060 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4213733c-9bbb-412c-9b3e-8895e16de905-config-out\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:32:44.524745 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:44.524454    4060 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4213733c-9bbb-412c-9b3e-8895e16de905-thanos-prometheus-http-client-file\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:32:44.524745 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:44.524467    4060 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4213733c-9bbb-412c-9b3e-8895e16de905-web-config\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:32:44.524745 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:44.524479    4060 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4213733c-9bbb-412c-9b3e-8895e16de905-tls-assets\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:32:44.524745 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:44.524505    4060 reconciler_common.go:299] "Volume detached for volume \"prometheus-data-science-monitoringstack-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4213733c-9bbb-412c-9b3e-8895e16de905-prometheus-data-science-monitoringstack-rulefiles-2\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:32:44.524745 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:44.524521    4060 reconciler_common.go:299] "Volume detached for volume \"web-config-tls-secret-key-prometheus-operated-tls-f3457c70\" (UniqueName: \"kubernetes.io/secret/4213733c-9bbb-412c-9b3e-8895e16de905-web-config-tls-secret-key-prometheus-operated-tls-f3457c70\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:32:44.524745 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:44.524536    4060 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-web-tls-ca\" (UniqueName: \"kubernetes.io/secret/4213733c-9bbb-412c-9b3e-8895e16de905-secret-prometheus-web-tls-ca\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:32:44.536153 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:44.536133    4060 operation_generator.go:893] UnmountDevice succeeded for volume "pvc-e73afc79-aa37-49a0-8744-633c03cad1f4" (UniqueName: "kubernetes.io/csi/ebs.csi.aws.com^vol-0a155a55c1ce0e65b") on node "ip-10-0-142-4.us-west-1.compute.internal"
Oct 30 21:32:44.625465 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:44.625434    4060 reconciler_common.go:299] "Volume detached for volume \"pvc-e73afc79-aa37-49a0-8744-633c03cad1f4\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a155a55c1ce0e65b\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"csi-7011c01335d2502f76be252f9498c79824668beecf30ee8f6a7191145201ca4c\""
Oct 30 21:32:44.728080 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:44.728039    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"]
Oct 30 21:32:44.733063 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:44.733034    4060 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"]
Oct 30 21:32:44.845783 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:44.845693    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"]
Oct 30 21:32:44.852107 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:44.852078    4060 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"]
Oct 30 21:32:45.427635 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:45.427555    4060 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="07114265-e487-4b7d-ab67-51bf6e4e73ef" path="/var/lib/kubelet/pods/07114265-e487-4b7d-ab67-51bf6e4e73ef/volumes"
Oct 30 21:32:45.428083 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:45.428069    4060 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="4213733c-9bbb-412c-9b3e-8895e16de905" path="/var/lib/kubelet/pods/4213733c-9bbb-412c-9b3e-8895e16de905/volumes"
Oct 30 21:32:45.428825 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:45.428811    4060 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="81ed591c-3ac0-43d7-bf5f-2e938d2f2c95" path="/var/lib/kubelet/pods/81ed591c-3ac0-43d7-bf5f-2e938d2f2c95/volumes"
Oct 30 21:32:45.429154 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:45.429143    4060 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c5db122f-0c8d-45d5-9b8f-c2fb2aed1b38" path="/var/lib/kubelet/pods/c5db122f-0c8d-45d5-9b8f-c2fb2aed1b38/volumes"
Oct 30 21:32:45.790090 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:45.790053    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:32:45.790335 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:45.790305    4060 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-collector-0" podUID="11671523-dec4-4e05-8be7-84efdd770121" containerName="otc-container" containerID="cri-o://ae5c1ea43938dbf7d1b9a9690df1b36a5ef83f2190e5f8a0b79af7c16ac03885" gracePeriod=30
Oct 30 21:32:46.042177 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:46.042121    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:32:46.139887 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:46.139851    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/11671523-dec4-4e05-8be7-84efdd770121-tls-certs\" (UniqueName: \"kubernetes.io/secret/11671523-dec4-4e05-8be7-84efdd770121-tls-certs\") pod \"11671523-dec4-4e05-8be7-84efdd770121\" (UID: \"11671523-dec4-4e05-8be7-84efdd770121\") "
Oct 30 21:32:46.139887 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:46.139890    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/11671523-dec4-4e05-8be7-84efdd770121-monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/11671523-dec4-4e05-8be7-84efdd770121-monitoring-tls-certs\") pod \"11671523-dec4-4e05-8be7-84efdd770121\" (UID: \"11671523-dec4-4e05-8be7-84efdd770121\") "
Oct 30 21:32:46.140133 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:46.139945    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/11671523-dec4-4e05-8be7-84efdd770121-otc-internal\" (UniqueName: \"kubernetes.io/configmap/11671523-dec4-4e05-8be7-84efdd770121-otc-internal\") pod \"11671523-dec4-4e05-8be7-84efdd770121\" (UID: \"11671523-dec4-4e05-8be7-84efdd770121\") "
Oct 30 21:32:46.140133 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:46.139970    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/11671523-dec4-4e05-8be7-84efdd770121-otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/11671523-dec4-4e05-8be7-84efdd770121-otlp-tls-certs\") pod \"11671523-dec4-4e05-8be7-84efdd770121\" (UID: \"11671523-dec4-4e05-8be7-84efdd770121\") "
Oct 30 21:32:46.140133 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:46.140003    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/11671523-dec4-4e05-8be7-84efdd770121-kube-api-access-sd2bb\" (UniqueName: \"kubernetes.io/projected/11671523-dec4-4e05-8be7-84efdd770121-kube-api-access-sd2bb\") pod \"11671523-dec4-4e05-8be7-84efdd770121\" (UID: \"11671523-dec4-4e05-8be7-84efdd770121\") "
Oct 30 21:32:46.140133 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:46.140047    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/11671523-dec4-4e05-8be7-84efdd770121-data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/11671523-dec4-4e05-8be7-84efdd770121-data-science-collector-ta-client-cert\") pod \"11671523-dec4-4e05-8be7-84efdd770121\" (UID: \"11671523-dec4-4e05-8be7-84efdd770121\") "
Oct 30 21:32:46.140475 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:46.140440    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/11671523-dec4-4e05-8be7-84efdd770121-otc-internal" pod "11671523-dec4-4e05-8be7-84efdd770121" (UID: "11671523-dec4-4e05-8be7-84efdd770121"). InnerVolumeSpecName "otc-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:32:46.142128 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:46.142094    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/11671523-dec4-4e05-8be7-84efdd770121-monitoring-tls-certs" pod "11671523-dec4-4e05-8be7-84efdd770121" (UID: "11671523-dec4-4e05-8be7-84efdd770121"). InnerVolumeSpecName "monitoring-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:32:46.142699 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:46.142677    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/11671523-dec4-4e05-8be7-84efdd770121-otlp-tls-certs" pod "11671523-dec4-4e05-8be7-84efdd770121" (UID: "11671523-dec4-4e05-8be7-84efdd770121"). InnerVolumeSpecName "otlp-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:32:46.142788 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:46.142694    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/11671523-dec4-4e05-8be7-84efdd770121-data-science-collector-ta-client-cert" pod "11671523-dec4-4e05-8be7-84efdd770121" (UID: "11671523-dec4-4e05-8be7-84efdd770121"). InnerVolumeSpecName "data-science-collector-ta-client-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:32:46.142788 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:46.142708    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/11671523-dec4-4e05-8be7-84efdd770121-tls-certs" pod "11671523-dec4-4e05-8be7-84efdd770121" (UID: "11671523-dec4-4e05-8be7-84efdd770121"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:32:46.142788 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:46.142676    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/11671523-dec4-4e05-8be7-84efdd770121-kube-api-access-sd2bb" pod "11671523-dec4-4e05-8be7-84efdd770121" (UID: "11671523-dec4-4e05-8be7-84efdd770121"). InnerVolumeSpecName "kube-api-access-sd2bb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:32:46.241309 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:46.241274    4060 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/11671523-dec4-4e05-8be7-84efdd770121-tls-certs\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:32:46.241309 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:46.241313    4060 reconciler_common.go:299] "Volume detached for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/11671523-dec4-4e05-8be7-84efdd770121-monitoring-tls-certs\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:32:46.241530 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:46.241329    4060 reconciler_common.go:299] "Volume detached for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/11671523-dec4-4e05-8be7-84efdd770121-otc-internal\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:32:46.241530 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:46.241342    4060 reconciler_common.go:299] "Volume detached for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/11671523-dec4-4e05-8be7-84efdd770121-otlp-tls-certs\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:32:46.241530 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:46.241359    4060 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sd2bb\" (UniqueName: \"kubernetes.io/projected/11671523-dec4-4e05-8be7-84efdd770121-kube-api-access-sd2bb\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:32:46.241530 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:46.241375    4060 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/11671523-dec4-4e05-8be7-84efdd770121-data-science-collector-ta-client-cert\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:32:46.319030 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:46.318955    4060 generic.go:356] "Generic (PLEG): container finished" podID="11671523-dec4-4e05-8be7-84efdd770121" containerID="ae5c1ea43938dbf7d1b9a9690df1b36a5ef83f2190e5f8a0b79af7c16ac03885" exitCode=0
Oct 30 21:32:46.319030 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:46.319003    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:32:46.319261 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:46.319043    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"11671523-dec4-4e05-8be7-84efdd770121","Type":"ContainerDied","Data":"ae5c1ea43938dbf7d1b9a9690df1b36a5ef83f2190e5f8a0b79af7c16ac03885"}
Oct 30 21:32:46.319261 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:46.319104    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"11671523-dec4-4e05-8be7-84efdd770121","Type":"ContainerDied","Data":"81731b5a7114ae349db413397d2a388fc1a7042217a220adf595899f6fbaf1f3"}
Oct 30 21:32:46.319261 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:46.319135    4060 scope.go:122] "RemoveContainer" containerID="ae5c1ea43938dbf7d1b9a9690df1b36a5ef83f2190e5f8a0b79af7c16ac03885"
Oct 30 21:32:46.328008 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:46.327988    4060 scope.go:122] "RemoveContainer" containerID="ae5c1ea43938dbf7d1b9a9690df1b36a5ef83f2190e5f8a0b79af7c16ac03885"
Oct 30 21:32:46.328250 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:32:46.328233    4060 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ae5c1ea43938dbf7d1b9a9690df1b36a5ef83f2190e5f8a0b79af7c16ac03885\": container with ID starting with ae5c1ea43938dbf7d1b9a9690df1b36a5ef83f2190e5f8a0b79af7c16ac03885 not found: ID does not exist" containerID="ae5c1ea43938dbf7d1b9a9690df1b36a5ef83f2190e5f8a0b79af7c16ac03885"
Oct 30 21:32:46.328297 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:46.328258    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ae5c1ea43938dbf7d1b9a9690df1b36a5ef83f2190e5f8a0b79af7c16ac03885"} err="failed to get container status \"ae5c1ea43938dbf7d1b9a9690df1b36a5ef83f2190e5f8a0b79af7c16ac03885\": rpc error: code = NotFound desc = could not find container \"ae5c1ea43938dbf7d1b9a9690df1b36a5ef83f2190e5f8a0b79af7c16ac03885\": container with ID starting with ae5c1ea43938dbf7d1b9a9690df1b36a5ef83f2190e5f8a0b79af7c16ac03885 not found: ID does not exist"
Oct 30 21:32:46.485395 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:46.485359    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:32:46.494159 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:46.494135    4060 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:32:47.427010 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:32:47.426972    4060 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="11671523-dec4-4e05-8be7-84efdd770121" path="/var/lib/kubelet/pods/11671523-dec4-4e05-8be7-84efdd770121/volumes"
Oct 30 21:33:12.150272 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:33:12.150235    4060 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v2f4x" containerName="extractor"
Oct 30 21:33:13.135429 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:33:13.135395    4060 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-usage-logs-lokistack-querier-8577fdf8bc-lpwhh"]
Oct 30 21:33:13.135697 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:33:13.135685    4060 cpu_manager.go:414] "containerMap: removing container" podUID="07114265-e487-4b7d-ab67-51bf6e4e73ef" containerName="config-reloader"
Oct 30 21:33:13.135745 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:33:13.135698    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="07114265-e487-4b7d-ab67-51bf6e4e73ef" containerName="config-reloader"
Oct 30 21:33:13.135745 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:33:13.135709    4060 cpu_manager.go:414] "containerMap: removing container" podUID="4213733c-9bbb-412c-9b3e-8895e16de905" containerName="init-config-reloader"
Oct 30 21:33:13.135745 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:33:13.135714    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4213733c-9bbb-412c-9b3e-8895e16de905" containerName="init-config-reloader"
Oct 30 21:33:13.135745 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:33:13.135724    4060 cpu_manager.go:414] "containerMap: removing container" podUID="11671523-dec4-4e05-8be7-84efdd770121" containerName="otc-container"
Oct 30 21:33:13.135745 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:33:13.135730    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="11671523-dec4-4e05-8be7-84efdd770121" containerName="otc-container"
Oct 30 21:33:13.135745 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:33:13.135745    4060 cpu_manager.go:414] "containerMap: removing container" podUID="4213733c-9bbb-412c-9b3e-8895e16de905" containerName="prometheus"
Oct 30 21:33:13.135973 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:33:13.135750    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4213733c-9bbb-412c-9b3e-8895e16de905" containerName="prometheus"
Oct 30 21:33:13.135973 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:33:13.135756    4060 cpu_manager.go:414] "containerMap: removing container" podUID="4213733c-9bbb-412c-9b3e-8895e16de905" containerName="config-reloader"
Oct 30 21:33:13.135973 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:33:13.135760    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4213733c-9bbb-412c-9b3e-8895e16de905" containerName="config-reloader"
Oct 30 21:33:13.135973 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:33:13.135765    4060 cpu_manager.go:414] "containerMap: removing container" podUID="4213733c-9bbb-412c-9b3e-8895e16de905" containerName="thanos-sidecar"
Oct 30 21:33:13.135973 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:33:13.135769    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4213733c-9bbb-412c-9b3e-8895e16de905" containerName="thanos-sidecar"
Oct 30 21:33:13.135973 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:33:13.135776    4060 cpu_manager.go:414] "containerMap: removing container" podUID="07114265-e487-4b7d-ab67-51bf6e4e73ef" containerName="init-config-reloader"
Oct 30 21:33:13.135973 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:33:13.135781    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="07114265-e487-4b7d-ab67-51bf6e4e73ef" containerName="init-config-reloader"
Oct 30 21:33:13.135973 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:33:13.135788    4060 cpu_manager.go:414] "containerMap: removing container" podUID="c5db122f-0c8d-45d5-9b8f-c2fb2aed1b38" containerName="korrel8r"
Oct 30 21:33:13.135973 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:33:13.135792    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c5db122f-0c8d-45d5-9b8f-c2fb2aed1b38" containerName="korrel8r"
Oct 30 21:33:13.135973 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:33:13.135798    4060 cpu_manager.go:414] "containerMap: removing container" podUID="81ed591c-3ac0-43d7-bf5f-2e938d2f2c95" containerName="kube-rbac-proxy"
Oct 30 21:33:13.135973 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:33:13.135802    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="81ed591c-3ac0-43d7-bf5f-2e938d2f2c95" containerName="kube-rbac-proxy"
Oct 30 21:33:13.135973 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:33:13.135808    4060 cpu_manager.go:414] "containerMap: removing container" podUID="07114265-e487-4b7d-ab67-51bf6e4e73ef" containerName="alertmanager"
Oct 30 21:33:13.135973 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:33:13.135812    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="07114265-e487-4b7d-ab67-51bf6e4e73ef" containerName="alertmanager"
Oct 30 21:33:13.135973 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:33:13.135856    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="c5db122f-0c8d-45d5-9b8f-c2fb2aed1b38" containerName="korrel8r"
Oct 30 21:33:13.135973 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:33:13.135864    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="81ed591c-3ac0-43d7-bf5f-2e938d2f2c95" containerName="kube-rbac-proxy"
Oct 30 21:33:13.135973 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:33:13.135870    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="07114265-e487-4b7d-ab67-51bf6e4e73ef" containerName="alertmanager"
Oct 30 21:33:13.135973 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:33:13.135876    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="07114265-e487-4b7d-ab67-51bf6e4e73ef" containerName="config-reloader"
Oct 30 21:33:13.135973 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:33:13.135882    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="11671523-dec4-4e05-8be7-84efdd770121" containerName="otc-container"
Oct 30 21:33:13.135973 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:33:13.135889    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="4213733c-9bbb-412c-9b3e-8895e16de905" containerName="prometheus"
Oct 30 21:33:13.135973 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:33:13.135896    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="4213733c-9bbb-412c-9b3e-8895e16de905" containerName="config-reloader"
Oct 30 21:33:13.135973 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:33:13.135901    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="4213733c-9bbb-412c-9b3e-8895e16de905" containerName="thanos-sidecar"
Oct 30 21:33:13.138704 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:33:13.138689    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-querier-8577fdf8bc-lpwhh"
Oct 30 21:33:13.191306 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:33:13.191275    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"kube-root-ca.crt\""
Oct 30 21:33:13.210283 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:33:13.210259    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"openshift-service-ca.crt\""
Oct 30 21:33:13.228766 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:33:13.228733    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-usage-logs-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5949fcaa-2a50-4232-82bb-1c6f24b49df5-data-science-usage-logs-lokistack-ca-bundle\") pod \"data-science-usage-logs-lokistack-querier-8577fdf8bc-lpwhh\" (UID: \"5949fcaa-2a50-4232-82bb-1c6f24b49df5\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-querier-8577fdf8bc-lpwhh"
Oct 30 21:33:13.228766 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:33:13.228766    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rpbpc\" (UniqueName: \"kubernetes.io/projected/5949fcaa-2a50-4232-82bb-1c6f24b49df5-kube-api-access-rpbpc\") pod \"data-science-usage-logs-lokistack-querier-8577fdf8bc-lpwhh\" (UID: \"5949fcaa-2a50-4232-82bb-1c6f24b49df5\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-querier-8577fdf8bc-lpwhh"
Oct 30 21:33:13.228957 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:33:13.228791    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-usage-logs-lokistack-querier-grpc\" (UniqueName: \"kubernetes.io/secret/5949fcaa-2a50-4232-82bb-1c6f24b49df5-data-science-usage-logs-lokistack-querier-grpc\") pod \"data-science-usage-logs-lokistack-querier-8577fdf8bc-lpwhh\" (UID: \"5949fcaa-2a50-4232-82bb-1c6f24b49df5\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-querier-8577fdf8bc-lpwhh"
Oct 30 21:33:13.228957 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:33:13.228903    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-usage-logs-lokistack-querier-http\" (UniqueName: \"kubernetes.io/secret/5949fcaa-2a50-4232-82bb-1c6f24b49df5-data-science-usage-logs-lokistack-querier-http\") pod \"data-science-usage-logs-lokistack-querier-8577fdf8bc-lpwhh\" (UID: \"5949fcaa-2a50-4232-82bb-1c6f24b49df5\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-querier-8577fdf8bc-lpwhh"
Oct 30 21:33:13.228957 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:33:13.228941    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5949fcaa-2a50-4232-82bb-1c6f24b49df5-config\") pod \"data-science-usage-logs-lokistack-querier-8577fdf8bc-lpwhh\" (UID: \"5949fcaa-2a50-4232-82bb-1c6f24b49df5\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-querier-8577fdf8bc-lpwhh"
Oct 30 21:33:13.229064 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:33:13.229005    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-usage-logs-loki-secret\" (UniqueName: \"kubernetes.io/secret/5949fcaa-2a50-4232-82bb-1c6f24b49df5-test-usage-logs-loki-secret\") pod \"data-science-usage-logs-lokistack-querier-8577fdf8bc-lpwhh\" (UID: \"5949fcaa-2a50-4232-82bb-1c6f24b49df5\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-querier-8577fdf8bc-lpwhh"
Oct 30 21:33:13.240364 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:33:13.240337    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-usage-logs-lokistack-ca-bundle\""
Oct 30 21:33:13.240456 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:33:13.240364    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"test-usage-logs-loki-secret\""
Oct 30 21:33:13.240456 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:33:13.240398    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-usage-logs-lokistack-querier-grpc\""
Oct 30 21:33:13.240456 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:33:13.240410    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-usage-logs-lokistack-config\""
Oct 30 21:33:13.240602 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:33:13.240485    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-usage-logs-lokistack-querier-http\""
Oct 30 21:33:13.240688 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:33:13.240674    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-usage-logs-lokistack-dockercfg-g2x6b\""
Oct 30 21:33:13.242430 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:33:13.242415    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-usage-logs-lokistack-querier-8577fdf8bc-lpwhh"]
Oct 30 21:33:13.329909 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:33:13.329880    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-usage-logs-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5949fcaa-2a50-4232-82bb-1c6f24b49df5-data-science-usage-logs-lokistack-ca-bundle\") pod \"data-science-usage-logs-lokistack-querier-8577fdf8bc-lpwhh\" (UID: \"5949fcaa-2a50-4232-82bb-1c6f24b49df5\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-querier-8577fdf8bc-lpwhh"
Oct 30 21:33:13.330080 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:33:13.329913    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rpbpc\" (UniqueName: \"kubernetes.io/projected/5949fcaa-2a50-4232-82bb-1c6f24b49df5-kube-api-access-rpbpc\") pod \"data-science-usage-logs-lokistack-querier-8577fdf8bc-lpwhh\" (UID: \"5949fcaa-2a50-4232-82bb-1c6f24b49df5\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-querier-8577fdf8bc-lpwhh"
Oct 30 21:33:13.330080 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:33:13.329949    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-usage-logs-lokistack-querier-grpc\" (UniqueName: \"kubernetes.io/secret/5949fcaa-2a50-4232-82bb-1c6f24b49df5-data-science-usage-logs-lokistack-querier-grpc\") pod \"data-science-usage-logs-lokistack-querier-8577fdf8bc-lpwhh\" (UID: \"5949fcaa-2a50-4232-82bb-1c6f24b49df5\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-querier-8577fdf8bc-lpwhh"
Oct 30 21:33:13.330080 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:33:13.329982    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-usage-logs-lokistack-querier-http\" (UniqueName: \"kubernetes.io/secret/5949fcaa-2a50-4232-82bb-1c6f24b49df5-data-science-usage-logs-lokistack-querier-http\") pod \"data-science-usage-logs-lokistack-querier-8577fdf8bc-lpwhh\" (UID: \"5949fcaa-2a50-4232-82bb-1c6f24b49df5\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-querier-8577fdf8bc-lpwhh"
Oct 30 21:33:13.330080 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:33:13.330013    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5949fcaa-2a50-4232-82bb-1c6f24b49df5-config\") pod \"data-science-usage-logs-lokistack-querier-8577fdf8bc-lpwhh\" (UID: \"5949fcaa-2a50-4232-82bb-1c6f24b49df5\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-querier-8577fdf8bc-lpwhh"
Oct 30 21:33:13.330080 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:33:13.330070    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"test-usage-logs-loki-secret\" (UniqueName: \"kubernetes.io/secret/5949fcaa-2a50-4232-82bb-1c6f24b49df5-test-usage-logs-loki-secret\") pod \"data-science-usage-logs-lokistack-querier-8577fdf8bc-lpwhh\" (UID: \"5949fcaa-2a50-4232-82bb-1c6f24b49df5\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-querier-8577fdf8bc-lpwhh"
Oct 30 21:33:13.330743 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:33:13.330721    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-usage-logs-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5949fcaa-2a50-4232-82bb-1c6f24b49df5-data-science-usage-logs-lokistack-ca-bundle\") pod \"data-science-usage-logs-lokistack-querier-8577fdf8bc-lpwhh\" (UID: \"5949fcaa-2a50-4232-82bb-1c6f24b49df5\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-querier-8577fdf8bc-lpwhh"
Oct 30 21:33:13.330877 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:33:13.330861    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5949fcaa-2a50-4232-82bb-1c6f24b49df5-config\") pod \"data-science-usage-logs-lokistack-querier-8577fdf8bc-lpwhh\" (UID: \"5949fcaa-2a50-4232-82bb-1c6f24b49df5\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-querier-8577fdf8bc-lpwhh"
Oct 30 21:33:13.332953 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:33:13.332926    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-usage-logs-loki-secret\" (UniqueName: \"kubernetes.io/secret/5949fcaa-2a50-4232-82bb-1c6f24b49df5-test-usage-logs-loki-secret\") pod \"data-science-usage-logs-lokistack-querier-8577fdf8bc-lpwhh\" (UID: \"5949fcaa-2a50-4232-82bb-1c6f24b49df5\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-querier-8577fdf8bc-lpwhh"
Oct 30 21:33:13.333080 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:33:13.333060    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-usage-logs-lokistack-querier-http\" (UniqueName: \"kubernetes.io/secret/5949fcaa-2a50-4232-82bb-1c6f24b49df5-data-science-usage-logs-lokistack-querier-http\") pod \"data-science-usage-logs-lokistack-querier-8577fdf8bc-lpwhh\" (UID: \"5949fcaa-2a50-4232-82bb-1c6f24b49df5\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-querier-8577fdf8bc-lpwhh"
Oct 30 21:33:13.333123 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:33:13.333093    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-usage-logs-lokistack-querier-grpc\" (UniqueName: \"kubernetes.io/secret/5949fcaa-2a50-4232-82bb-1c6f24b49df5-data-science-usage-logs-lokistack-querier-grpc\") pod \"data-science-usage-logs-lokistack-querier-8577fdf8bc-lpwhh\" (UID: \"5949fcaa-2a50-4232-82bb-1c6f24b49df5\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-querier-8577fdf8bc-lpwhh"
Oct 30 21:33:13.392388 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:33:13.392329    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rpbpc\" (UniqueName: \"kubernetes.io/projected/5949fcaa-2a50-4232-82bb-1c6f24b49df5-kube-api-access-rpbpc\") pod \"data-science-usage-logs-lokistack-querier-8577fdf8bc-lpwhh\" (UID: \"5949fcaa-2a50-4232-82bb-1c6f24b49df5\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-querier-8577fdf8bc-lpwhh"
Oct 30 21:33:13.450144 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:33:13.450113    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-querier-8577fdf8bc-lpwhh"
Oct 30 21:33:13.546328 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:33:13.546300    4060 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-usage-logs-lokistack-query-frontend-7d747cfbbjlwg2"]
Oct 30 21:33:13.549707 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:33:13.549691    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-query-frontend-7d747cfbbjlwg2"
Oct 30 21:33:13.602320 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:33:13.602288    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-usage-logs-lokistack-query-frontend-grpc\""
Oct 30 21:33:13.602320 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:33:13.602299    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-usage-logs-lokistack-query-frontend-http\""
Oct 30 21:33:13.610548 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:33:13.610520    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-usage-logs-lokistack-query-frontend-7d747cfbbjlwg2"]
Oct 30 21:33:13.632365 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:33:13.632336    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6a63680e-1743-4af7-be13-0add069de2da-config\") pod \"data-science-usage-logs-lokistack-query-frontend-7d747cfbbjlwg2\" (UID: \"6a63680e-1743-4af7-be13-0add069de2da\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-query-frontend-7d747cfbbjlwg2"
Oct 30 21:33:13.632365 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:33:13.632368    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-usage-logs-lokistack-query-frontend-grpc\" (UniqueName: \"kubernetes.io/secret/6a63680e-1743-4af7-be13-0add069de2da-data-science-usage-logs-lokistack-query-frontend-grpc\") pod \"data-science-usage-logs-lokistack-query-frontend-7d747cfbbjlwg2\" (UID: \"6a63680e-1743-4af7-be13-0add069de2da\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-query-frontend-7d747cfbbjlwg2"
Oct 30 21:33:13.632579 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:33:13.632390    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-khgfv\" (UniqueName: \"kubernetes.io/projected/6a63680e-1743-4af7-be13-0add069de2da-kube-api-access-khgfv\") pod \"data-science-usage-logs-lokistack-query-frontend-7d747cfbbjlwg2\" (UID: \"6a63680e-1743-4af7-be13-0add069de2da\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-query-frontend-7d747cfbbjlwg2"
Oct 30 21:33:13.632579 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:33:13.632545    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-usage-logs-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a63680e-1743-4af7-be13-0add069de2da-data-science-usage-logs-lokistack-ca-bundle\") pod \"data-science-usage-logs-lokistack-query-frontend-7d747cfbbjlwg2\" (UID: \"6a63680e-1743-4af7-be13-0add069de2da\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-query-frontend-7d747cfbbjlwg2"
Oct 30 21:33:13.632655 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:33:13.632587    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-usage-logs-lokistack-query-frontend-http\" (UniqueName: \"kubernetes.io/secret/6a63680e-1743-4af7-be13-0add069de2da-data-science-usage-logs-lokistack-query-frontend-http\") pod \"data-science-usage-logs-lokistack-query-frontend-7d747cfbbjlwg2\" (UID: \"6a63680e-1743-4af7-be13-0add069de2da\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-query-frontend-7d747cfbbjlwg2"
Oct 30 21:33:13.733210 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:33:13.733166    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6a63680e-1743-4af7-be13-0add069de2da-config\") pod \"data-science-usage-logs-lokistack-query-frontend-7d747cfbbjlwg2\" (UID: \"6a63680e-1743-4af7-be13-0add069de2da\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-query-frontend-7d747cfbbjlwg2"
Oct 30 21:33:13.733210 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:33:13.733204    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-usage-logs-lokistack-query-frontend-grpc\" (UniqueName: \"kubernetes.io/secret/6a63680e-1743-4af7-be13-0add069de2da-data-science-usage-logs-lokistack-query-frontend-grpc\") pod \"data-science-usage-logs-lokistack-query-frontend-7d747cfbbjlwg2\" (UID: \"6a63680e-1743-4af7-be13-0add069de2da\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-query-frontend-7d747cfbbjlwg2"
Oct 30 21:33:13.733456 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:33:13.733239    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-khgfv\" (UniqueName: \"kubernetes.io/projected/6a63680e-1743-4af7-be13-0add069de2da-kube-api-access-khgfv\") pod \"data-science-usage-logs-lokistack-query-frontend-7d747cfbbjlwg2\" (UID: \"6a63680e-1743-4af7-be13-0add069de2da\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-query-frontend-7d747cfbbjlwg2"
Oct 30 21:33:13.733456 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:33:13.733275    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-usage-logs-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a63680e-1743-4af7-be13-0add069de2da-data-science-usage-logs-lokistack-ca-bundle\") pod \"data-science-usage-logs-lokistack-query-frontend-7d747cfbbjlwg2\" (UID: \"6a63680e-1743-4af7-be13-0add069de2da\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-query-frontend-7d747cfbbjlwg2"
Oct 30 21:33:13.733456 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:33:13.733307    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-usage-logs-lokistack-query-frontend-http\" (UniqueName: \"kubernetes.io/secret/6a63680e-1743-4af7-be13-0add069de2da-data-science-usage-logs-lokistack-query-frontend-http\") pod \"data-science-usage-logs-lokistack-query-frontend-7d747cfbbjlwg2\" (UID: \"6a63680e-1743-4af7-be13-0add069de2da\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-query-frontend-7d747cfbbjlwg2"
Oct 30 21:33:13.734039 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:33:13.734004    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-usage-logs-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a63680e-1743-4af7-be13-0add069de2da-data-science-usage-logs-lokistack-ca-bundle\") pod \"data-science-usage-logs-lokistack-query-frontend-7d747cfbbjlwg2\" (UID: \"6a63680e-1743-4af7-be13-0add069de2da\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-query-frontend-7d747cfbbjlwg2"
Oct 30 21:33:13.734039 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:33:13.734022    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6a63680e-1743-4af7-be13-0add069de2da-config\") pod \"data-science-usage-logs-lokistack-query-frontend-7d747cfbbjlwg2\" (UID: \"6a63680e-1743-4af7-be13-0add069de2da\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-query-frontend-7d747cfbbjlwg2"
Oct 30 21:33:13.735637 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:33:13.735618    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-usage-logs-lokistack-query-frontend-grpc\" (UniqueName: \"kubernetes.io/secret/6a63680e-1743-4af7-be13-0add069de2da-data-science-usage-logs-lokistack-query-frontend-grpc\") pod \"data-science-usage-logs-lokistack-query-frontend-7d747cfbbjlwg2\" (UID: \"6a63680e-1743-4af7-be13-0add069de2da\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-query-frontend-7d747cfbbjlwg2"
Oct 30 21:33:13.735720 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:33:13.735706    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-usage-logs-lokistack-query-frontend-http\" (UniqueName: \"kubernetes.io/secret/6a63680e-1743-4af7-be13-0add069de2da-data-science-usage-logs-lokistack-query-frontend-http\") pod \"data-science-usage-logs-lokistack-query-frontend-7d747cfbbjlwg2\" (UID: \"6a63680e-1743-4af7-be13-0add069de2da\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-query-frontend-7d747cfbbjlwg2"
Oct 30 21:33:13.795504 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:33:13.795470    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-khgfv\" (UniqueName: \"kubernetes.io/projected/6a63680e-1743-4af7-be13-0add069de2da-kube-api-access-khgfv\") pod \"data-science-usage-logs-lokistack-query-frontend-7d747cfbbjlwg2\" (UID: \"6a63680e-1743-4af7-be13-0add069de2da\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-query-frontend-7d747cfbbjlwg2"
Oct 30 21:33:13.826575 ip-10-0-142-4 kubenswrapper[4060]: W1030 21:33:13.826534    4060 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5949fcaa_2a50_4232_82bb_1c6f24b49df5.slice/crio-e72bc9a221aa8a808f6f2b83c2d4c108a64ddccf6042da5986232d3ef113c456 WatchSource:0}: Error finding container e72bc9a221aa8a808f6f2b83c2d4c108a64ddccf6042da5986232d3ef113c456: Status 404 returned error can't find the container with id e72bc9a221aa8a808f6f2b83c2d4c108a64ddccf6042da5986232d3ef113c456
Oct 30 21:33:13.829171 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:33:13.829152    4060 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 21:33:13.861515 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:33:13.861472    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-query-frontend-7d747cfbbjlwg2"
Oct 30 21:33:13.937202 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:33:13.937172    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-usage-logs-lokistack-querier-8577fdf8bc-lpwhh"]
Oct 30 21:33:14.237324 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:33:14.237298    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-usage-logs-lokistack-query-frontend-7d747cfbbjlwg2"]
Oct 30 21:33:14.239863 ip-10-0-142-4 kubenswrapper[4060]: W1030 21:33:14.239836    4060 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6a63680e_1743_4af7_be13_0add069de2da.slice/crio-0762eda7ae8fda4ab4cb13cb18b7b70651c34588175e032adbcea6790a38c3c2 WatchSource:0}: Error finding container 0762eda7ae8fda4ab4cb13cb18b7b70651c34588175e032adbcea6790a38c3c2: Status 404 returned error can't find the container with id 0762eda7ae8fda4ab4cb13cb18b7b70651c34588175e032adbcea6790a38c3c2
Oct 30 21:33:14.460534 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:33:14.460481    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-query-frontend-7d747cfbbjlwg2" event={"ID":"6a63680e-1743-4af7-be13-0add069de2da","Type":"ContainerStarted","Data":"0762eda7ae8fda4ab4cb13cb18b7b70651c34588175e032adbcea6790a38c3c2"}
Oct 30 21:33:14.461641 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:33:14.461608    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-querier-8577fdf8bc-lpwhh" event={"ID":"5949fcaa-2a50-4232-82bb-1c6f24b49df5","Type":"ContainerStarted","Data":"e72bc9a221aa8a808f6f2b83c2d4c108a64ddccf6042da5986232d3ef113c456"}
Oct 30 21:33:19.494012 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:33:19.493912    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-querier-8577fdf8bc-lpwhh" event={"ID":"5949fcaa-2a50-4232-82bb-1c6f24b49df5","Type":"ContainerStarted","Data":"1e9eb0608f12b11a3f83418e486af59c55742ed9c30d33a14e360368fe1a67ae"}
Oct 30 21:33:19.494012 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:33:19.493969    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-querier-8577fdf8bc-lpwhh"
Oct 30 21:33:19.495542 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:33:19.495514    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-query-frontend-7d747cfbbjlwg2" event={"ID":"6a63680e-1743-4af7-be13-0add069de2da","Type":"ContainerStarted","Data":"aef89c096cca8c2e9bda76b081c2ce9d7e60e9580b6f4bd6476a6ea227cb450a"}
Oct 30 21:33:19.495671 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:33:19.495592    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-query-frontend-7d747cfbbjlwg2"
Oct 30 21:33:19.612571 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:33:19.612518    4060 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-querier-8577fdf8bc-lpwhh" podStartSLOduration=1.467539726 podStartE2EDuration="6.612505461s" totalImagesPullingTime="5.144965735s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:33:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:33:19.611594299 +0000 UTC m=+3418.368592597" watchObservedRunningTime="2026-10-30 21:33:19.612505461 +0000 UTC m=+3418.369503753"
Oct 30 21:33:19.729627 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:33:19.729567    4060 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-query-frontend-7d747cfbbjlwg2" podStartSLOduration=1.7404487199999998 podStartE2EDuration="6.729551488s" totalImagesPullingTime="4.989102768s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:33:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:33:19.728282049 +0000 UTC m=+3418.485280347" watchObservedRunningTime="2026-10-30 21:33:19.729551488 +0000 UTC m=+3418.486549787"
Oct 30 21:33:40.505917 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:33:40.505889    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-query-frontend-7d747cfbbjlwg2"
Oct 30 21:33:40.506835 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:33:40.506362    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-querier-8577fdf8bc-lpwhh"
Oct 30 21:33:42.151884 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:33:42.151852    4060 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v2f4x" containerName="extractor"
Oct 30 21:34:12.152392 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:34:12.152308    4060 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v2f4x" containerName="extractor"
Oct 30 21:34:42.150484 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:34:42.150451    4060 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v2f4x" containerName="extractor"
Oct 30 21:35:01.934182 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:01.934149    4060 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-usage-logs-collector-5b8b69c67b-fmf8b"]
Oct 30 21:35:01.937598 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:01.937581    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-usage-logs-collector-5b8b69c67b-fmf8b"
Oct 30 21:35:02.041207 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:02.041173    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-usage-logs-collector-headless-tls\""
Oct 30 21:35:02.041934 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:02.041909    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-usage-logs-collector-dockercfg-2lrnh\""
Oct 30 21:35:02.042074 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:02.041953    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-usage-logs-collector-9d8884b6\""
Oct 30 21:35:02.044200 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:02.044178    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-usage-logs-collector-5b8b69c67b-fmf8b"]
Oct 30 21:35:02.117821 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:02.117790    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/f2028e44-80fc-4aeb-ac1b-7f89397921a0-otlp-tls-certs\") pod \"data-science-usage-logs-collector-5b8b69c67b-fmf8b\" (UID: \"f2028e44-80fc-4aeb-ac1b-7f89397921a0\") " pod="redhat-ods-monitoring/data-science-usage-logs-collector-5b8b69c67b-fmf8b"
Oct 30 21:35:02.117992 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:02.117849    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-44bdd\" (UniqueName: \"kubernetes.io/projected/f2028e44-80fc-4aeb-ac1b-7f89397921a0-kube-api-access-44bdd\") pod \"data-science-usage-logs-collector-5b8b69c67b-fmf8b\" (UID: \"f2028e44-80fc-4aeb-ac1b-7f89397921a0\") " pod="redhat-ods-monitoring/data-science-usage-logs-collector-5b8b69c67b-fmf8b"
Oct 30 21:35:02.117992 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:02.117952    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/f2028e44-80fc-4aeb-ac1b-7f89397921a0-otc-internal\") pod \"data-science-usage-logs-collector-5b8b69c67b-fmf8b\" (UID: \"f2028e44-80fc-4aeb-ac1b-7f89397921a0\") " pod="redhat-ods-monitoring/data-science-usage-logs-collector-5b8b69c67b-fmf8b"
Oct 30 21:35:02.218660 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:02.218629    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/f2028e44-80fc-4aeb-ac1b-7f89397921a0-otlp-tls-certs\") pod \"data-science-usage-logs-collector-5b8b69c67b-fmf8b\" (UID: \"f2028e44-80fc-4aeb-ac1b-7f89397921a0\") " pod="redhat-ods-monitoring/data-science-usage-logs-collector-5b8b69c67b-fmf8b"
Oct 30 21:35:02.218837 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:02.218689    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-44bdd\" (UniqueName: \"kubernetes.io/projected/f2028e44-80fc-4aeb-ac1b-7f89397921a0-kube-api-access-44bdd\") pod \"data-science-usage-logs-collector-5b8b69c67b-fmf8b\" (UID: \"f2028e44-80fc-4aeb-ac1b-7f89397921a0\") " pod="redhat-ods-monitoring/data-science-usage-logs-collector-5b8b69c67b-fmf8b"
Oct 30 21:35:02.218837 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:02.218731    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/f2028e44-80fc-4aeb-ac1b-7f89397921a0-otc-internal\") pod \"data-science-usage-logs-collector-5b8b69c67b-fmf8b\" (UID: \"f2028e44-80fc-4aeb-ac1b-7f89397921a0\") " pod="redhat-ods-monitoring/data-science-usage-logs-collector-5b8b69c67b-fmf8b"
Oct 30 21:35:02.219552 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:02.219522    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/f2028e44-80fc-4aeb-ac1b-7f89397921a0-otc-internal\") pod \"data-science-usage-logs-collector-5b8b69c67b-fmf8b\" (UID: \"f2028e44-80fc-4aeb-ac1b-7f89397921a0\") " pod="redhat-ods-monitoring/data-science-usage-logs-collector-5b8b69c67b-fmf8b"
Oct 30 21:35:02.221174 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:02.221149    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/f2028e44-80fc-4aeb-ac1b-7f89397921a0-otlp-tls-certs\") pod \"data-science-usage-logs-collector-5b8b69c67b-fmf8b\" (UID: \"f2028e44-80fc-4aeb-ac1b-7f89397921a0\") " pod="redhat-ods-monitoring/data-science-usage-logs-collector-5b8b69c67b-fmf8b"
Oct 30 21:35:02.279883 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:02.279854    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-44bdd\" (UniqueName: \"kubernetes.io/projected/f2028e44-80fc-4aeb-ac1b-7f89397921a0-kube-api-access-44bdd\") pod \"data-science-usage-logs-collector-5b8b69c67b-fmf8b\" (UID: \"f2028e44-80fc-4aeb-ac1b-7f89397921a0\") " pod="redhat-ods-monitoring/data-science-usage-logs-collector-5b8b69c67b-fmf8b"
Oct 30 21:35:02.549669 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:02.549586    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-usage-logs-collector-5b8b69c67b-fmf8b"
Oct 30 21:35:02.922518 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:02.922446    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-usage-logs-collector-5b8b69c67b-fmf8b"]
Oct 30 21:35:02.924786 ip-10-0-142-4 kubenswrapper[4060]: W1030 21:35:02.924758    4060 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2028e44_80fc_4aeb_ac1b_7f89397921a0.slice/crio-21e91a2d69ad7d57de966cbc025423c6d7fb0449718ff2ae9fc494e902e42f3e WatchSource:0}: Error finding container 21e91a2d69ad7d57de966cbc025423c6d7fb0449718ff2ae9fc494e902e42f3e: Status 404 returned error can't find the container with id 21e91a2d69ad7d57de966cbc025423c6d7fb0449718ff2ae9fc494e902e42f3e
Oct 30 21:35:02.926867 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:02.926821    4060 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 21:35:02.926960 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:02.926902    4060 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 21:35:02.960708 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:02.960683    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-usage-logs-collector-5b8b69c67b-fmf8b" event={"ID":"f2028e44-80fc-4aeb-ac1b-7f89397921a0","Type":"ContainerStarted","Data":"21e91a2d69ad7d57de966cbc025423c6d7fb0449718ff2ae9fc494e902e42f3e"}
Oct 30 21:35:03.966838 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:03.966797    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-usage-logs-collector-5b8b69c67b-fmf8b" event={"ID":"f2028e44-80fc-4aeb-ac1b-7f89397921a0","Type":"ContainerStarted","Data":"efe83c3e9900975efd575e96d1c3130bd6fb8c265523acd81d09280933fe528d"}
Oct 30 21:35:04.083879 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:04.083828    4060 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-usage-logs-collector-5b8b69c67b-fmf8b" podStartSLOduration=3.083813285 podStartE2EDuration="3.083813285s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:35:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:35:04.082796851 +0000 UTC m=+3522.839795150" watchObservedRunningTime="2026-10-30 21:35:04.083813285 +0000 UTC m=+3522.840811649"
Oct 30 21:35:09.050192 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:09.050150    4060 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/korrel8r-5f5775896-txcbx"]
Oct 30 21:35:09.053751 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:09.053730    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/korrel8r-5f5775896-txcbx"
Oct 30 21:35:09.081619 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:09.081588    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8v9mt\" (UniqueName: \"kubernetes.io/projected/68daa60a-11ed-41f4-9bb2-544035c6da0a-kube-api-access-8v9mt\") pod \"korrel8r-5f5775896-txcbx\" (UID: \"68daa60a-11ed-41f4-9bb2-544035c6da0a\") " pod="redhat-ods-monitoring/korrel8r-5f5775896-txcbx"
Oct 30 21:35:09.081775 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:09.081646    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/68daa60a-11ed-41f4-9bb2-544035c6da0a-config\") pod \"korrel8r-5f5775896-txcbx\" (UID: \"68daa60a-11ed-41f4-9bb2-544035c6da0a\") " pod="redhat-ods-monitoring/korrel8r-5f5775896-txcbx"
Oct 30 21:35:09.081775 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:09.081671    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/68daa60a-11ed-41f4-9bb2-544035c6da0a-tls\") pod \"korrel8r-5f5775896-txcbx\" (UID: \"68daa60a-11ed-41f4-9bb2-544035c6da0a\") " pod="redhat-ods-monitoring/korrel8r-5f5775896-txcbx"
Oct 30 21:35:09.155754 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:09.155726    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"korrel8r-dockercfg-pspv4\""
Oct 30 21:35:09.155967 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:09.155760    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"korrel8r-tls\""
Oct 30 21:35:09.155967 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:09.155762    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"korrel8r-config\""
Oct 30 21:35:09.157749 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:09.157722    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/korrel8r-5f5775896-txcbx"]
Oct 30 21:35:09.182276 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:09.182242    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8v9mt\" (UniqueName: \"kubernetes.io/projected/68daa60a-11ed-41f4-9bb2-544035c6da0a-kube-api-access-8v9mt\") pod \"korrel8r-5f5775896-txcbx\" (UID: \"68daa60a-11ed-41f4-9bb2-544035c6da0a\") " pod="redhat-ods-monitoring/korrel8r-5f5775896-txcbx"
Oct 30 21:35:09.182413 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:09.182308    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/68daa60a-11ed-41f4-9bb2-544035c6da0a-config\") pod \"korrel8r-5f5775896-txcbx\" (UID: \"68daa60a-11ed-41f4-9bb2-544035c6da0a\") " pod="redhat-ods-monitoring/korrel8r-5f5775896-txcbx"
Oct 30 21:35:09.182413 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:09.182348    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/68daa60a-11ed-41f4-9bb2-544035c6da0a-tls\") pod \"korrel8r-5f5775896-txcbx\" (UID: \"68daa60a-11ed-41f4-9bb2-544035c6da0a\") " pod="redhat-ods-monitoring/korrel8r-5f5775896-txcbx"
Oct 30 21:35:09.183110 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:09.183088    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/68daa60a-11ed-41f4-9bb2-544035c6da0a-config\") pod \"korrel8r-5f5775896-txcbx\" (UID: \"68daa60a-11ed-41f4-9bb2-544035c6da0a\") " pod="redhat-ods-monitoring/korrel8r-5f5775896-txcbx"
Oct 30 21:35:09.184787 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:09.184766    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls\" (UniqueName: \"kubernetes.io/secret/68daa60a-11ed-41f4-9bb2-544035c6da0a-tls\") pod \"korrel8r-5f5775896-txcbx\" (UID: \"68daa60a-11ed-41f4-9bb2-544035c6da0a\") " pod="redhat-ods-monitoring/korrel8r-5f5775896-txcbx"
Oct 30 21:35:09.243361 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:09.243330    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8v9mt\" (UniqueName: \"kubernetes.io/projected/68daa60a-11ed-41f4-9bb2-544035c6da0a-kube-api-access-8v9mt\") pod \"korrel8r-5f5775896-txcbx\" (UID: \"68daa60a-11ed-41f4-9bb2-544035c6da0a\") " pod="redhat-ods-monitoring/korrel8r-5f5775896-txcbx"
Oct 30 21:35:09.366336 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:09.366249    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/korrel8r-5f5775896-txcbx"
Oct 30 21:35:09.741928 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:09.741906    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/korrel8r-5f5775896-txcbx"]
Oct 30 21:35:09.744278 ip-10-0-142-4 kubenswrapper[4060]: W1030 21:35:09.744247    4060 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68daa60a_11ed_41f4_9bb2_544035c6da0a.slice/crio-d657b1ff9752c9b96e21a5c0933d880a56e887b0742f127ac9fd770377311dd0 WatchSource:0}: Error finding container d657b1ff9752c9b96e21a5c0933d880a56e887b0742f127ac9fd770377311dd0: Status 404 returned error can't find the container with id d657b1ff9752c9b96e21a5c0933d880a56e887b0742f127ac9fd770377311dd0
Oct 30 21:35:09.996919 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:09.996841    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/korrel8r-5f5775896-txcbx" event={"ID":"68daa60a-11ed-41f4-9bb2-544035c6da0a","Type":"ContainerStarted","Data":"b235bf16384045ac0920abaf11496f3b0244d7ca5a3a0a71c15ce3fd9ab1fdeb"}
Oct 30 21:35:09.996919 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:09.996893    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/korrel8r-5f5775896-txcbx" event={"ID":"68daa60a-11ed-41f4-9bb2-544035c6da0a","Type":"ContainerStarted","Data":"d657b1ff9752c9b96e21a5c0933d880a56e887b0742f127ac9fd770377311dd0"}
Oct 30 21:35:09.997113 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:09.996977    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/korrel8r-5f5775896-txcbx"
Oct 30 21:35:10.115010 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:10.114941    4060 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/korrel8r-5f5775896-txcbx" podStartSLOduration=1.114925881 podStartE2EDuration="1.114925881s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:35:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:35:10.112803663 +0000 UTC m=+3528.869801960" watchObservedRunningTime="2026-10-30 21:35:10.114925881 +0000 UTC m=+3528.871924181"
Oct 30 21:35:11.174563 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:11.174529    4060 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-usage-logs-collector-58dc4d7b85-g26pv"]
Oct 30 21:35:11.177750 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:11.177734    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-usage-logs-collector-58dc4d7b85-g26pv"
Oct 30 21:35:11.197653 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:11.197626    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/19e1274f-6858-4cd0-b4ac-8dd274b77c2f-otc-internal\") pod \"data-science-usage-logs-collector-58dc4d7b85-g26pv\" (UID: \"19e1274f-6858-4cd0-b4ac-8dd274b77c2f\") " pod="redhat-ods-monitoring/data-science-usage-logs-collector-58dc4d7b85-g26pv"
Oct 30 21:35:11.197776 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:11.197664    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9z69f\" (UniqueName: \"kubernetes.io/projected/19e1274f-6858-4cd0-b4ac-8dd274b77c2f-kube-api-access-9z69f\") pod \"data-science-usage-logs-collector-58dc4d7b85-g26pv\" (UID: \"19e1274f-6858-4cd0-b4ac-8dd274b77c2f\") " pod="redhat-ods-monitoring/data-science-usage-logs-collector-58dc4d7b85-g26pv"
Oct 30 21:35:11.197776 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:11.197737    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/19e1274f-6858-4cd0-b4ac-8dd274b77c2f-otlp-tls-certs\") pod \"data-science-usage-logs-collector-58dc4d7b85-g26pv\" (UID: \"19e1274f-6858-4cd0-b4ac-8dd274b77c2f\") " pod="redhat-ods-monitoring/data-science-usage-logs-collector-58dc4d7b85-g26pv"
Oct 30 21:35:11.251647 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:11.251615    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-usage-logs-collector-58dc4d7b85-g26pv"]
Oct 30 21:35:11.298728 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:11.298680    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/19e1274f-6858-4cd0-b4ac-8dd274b77c2f-otlp-tls-certs\") pod \"data-science-usage-logs-collector-58dc4d7b85-g26pv\" (UID: \"19e1274f-6858-4cd0-b4ac-8dd274b77c2f\") " pod="redhat-ods-monitoring/data-science-usage-logs-collector-58dc4d7b85-g26pv"
Oct 30 21:35:11.298917 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:11.298833    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/19e1274f-6858-4cd0-b4ac-8dd274b77c2f-otc-internal\") pod \"data-science-usage-logs-collector-58dc4d7b85-g26pv\" (UID: \"19e1274f-6858-4cd0-b4ac-8dd274b77c2f\") " pod="redhat-ods-monitoring/data-science-usage-logs-collector-58dc4d7b85-g26pv"
Oct 30 21:35:11.298917 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:11.298870    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9z69f\" (UniqueName: \"kubernetes.io/projected/19e1274f-6858-4cd0-b4ac-8dd274b77c2f-kube-api-access-9z69f\") pod \"data-science-usage-logs-collector-58dc4d7b85-g26pv\" (UID: \"19e1274f-6858-4cd0-b4ac-8dd274b77c2f\") " pod="redhat-ods-monitoring/data-science-usage-logs-collector-58dc4d7b85-g26pv"
Oct 30 21:35:11.299480 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:11.299459    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/19e1274f-6858-4cd0-b4ac-8dd274b77c2f-otc-internal\") pod \"data-science-usage-logs-collector-58dc4d7b85-g26pv\" (UID: \"19e1274f-6858-4cd0-b4ac-8dd274b77c2f\") " pod="redhat-ods-monitoring/data-science-usage-logs-collector-58dc4d7b85-g26pv"
Oct 30 21:35:11.301197 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:11.301178    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/19e1274f-6858-4cd0-b4ac-8dd274b77c2f-otlp-tls-certs\") pod \"data-science-usage-logs-collector-58dc4d7b85-g26pv\" (UID: \"19e1274f-6858-4cd0-b4ac-8dd274b77c2f\") " pod="redhat-ods-monitoring/data-science-usage-logs-collector-58dc4d7b85-g26pv"
Oct 30 21:35:11.360084 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:11.360058    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9z69f\" (UniqueName: \"kubernetes.io/projected/19e1274f-6858-4cd0-b4ac-8dd274b77c2f-kube-api-access-9z69f\") pod \"data-science-usage-logs-collector-58dc4d7b85-g26pv\" (UID: \"19e1274f-6858-4cd0-b4ac-8dd274b77c2f\") " pod="redhat-ods-monitoring/data-science-usage-logs-collector-58dc4d7b85-g26pv"
Oct 30 21:35:11.489961 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:11.489925    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-usage-logs-collector-58dc4d7b85-g26pv"
Oct 30 21:35:11.862769 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:11.862744    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-usage-logs-collector-58dc4d7b85-g26pv"]
Oct 30 21:35:11.864696 ip-10-0-142-4 kubenswrapper[4060]: W1030 21:35:11.864664    4060 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19e1274f_6858_4cd0_b4ac_8dd274b77c2f.slice/crio-4c7803b001a099fe12780deeff553579a728ea94502446ec3c2854141fbf1da5 WatchSource:0}: Error finding container 4c7803b001a099fe12780deeff553579a728ea94502446ec3c2854141fbf1da5: Status 404 returned error can't find the container with id 4c7803b001a099fe12780deeff553579a728ea94502446ec3c2854141fbf1da5
Oct 30 21:35:11.867060 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:11.867021    4060 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 21:35:11.867145 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:11.867095    4060 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 21:35:12.008881 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:12.008838    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-usage-logs-collector-58dc4d7b85-g26pv" event={"ID":"19e1274f-6858-4cd0-b4ac-8dd274b77c2f","Type":"ContainerStarted","Data":"54f2cc16819f90c9da803746daab9473e70180aea44224b6f1b42fa860ba81b3"}
Oct 30 21:35:12.009083 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:12.008915    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-usage-logs-collector-58dc4d7b85-g26pv" event={"ID":"19e1274f-6858-4cd0-b4ac-8dd274b77c2f","Type":"ContainerStarted","Data":"4c7803b001a099fe12780deeff553579a728ea94502446ec3c2854141fbf1da5"}
Oct 30 21:35:12.129356 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:12.129249    4060 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-usage-logs-collector-58dc4d7b85-g26pv" podStartSLOduration=1.129230973 podStartE2EDuration="1.129230973s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:35:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:35:12.127916882 +0000 UTC m=+3530.884915179" watchObservedRunningTime="2026-10-30 21:35:12.129230973 +0000 UTC m=+3530.886229272"
Oct 30 21:35:12.155532 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:35:12.154472    4060 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v2f4x" containerName="extractor"
Oct 30 21:35:12.162811 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:12.162782    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-usage-logs-collector-5b8b69c67b-fmf8b"]
Oct 30 21:35:12.163049 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:12.163026    4060 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-usage-logs-collector-5b8b69c67b-fmf8b" podUID="f2028e44-80fc-4aeb-ac1b-7f89397921a0" containerName="otc-container" containerID="cri-o://efe83c3e9900975efd575e96d1c3130bd6fb8c265523acd81d09280933fe528d" gracePeriod=30
Oct 30 21:35:12.420211 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:12.420175    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-usage-logs-collector-5b8b69c67b-fmf8b"
Oct 30 21:35:12.506817 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:12.506783    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/f2028e44-80fc-4aeb-ac1b-7f89397921a0-otc-internal\" (UniqueName: \"kubernetes.io/configmap/f2028e44-80fc-4aeb-ac1b-7f89397921a0-otc-internal\") pod \"f2028e44-80fc-4aeb-ac1b-7f89397921a0\" (UID: \"f2028e44-80fc-4aeb-ac1b-7f89397921a0\") "
Oct 30 21:35:12.507190 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:12.507160    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f2028e44-80fc-4aeb-ac1b-7f89397921a0-otc-internal" pod "f2028e44-80fc-4aeb-ac1b-7f89397921a0" (UID: "f2028e44-80fc-4aeb-ac1b-7f89397921a0"). InnerVolumeSpecName "otc-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:35:12.571697 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:12.571661    4060 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-lokistack-distributor-b854ccfb4-xw9h9"]
Oct 30 21:35:12.572004 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:12.571991    4060 cpu_manager.go:414] "containerMap: removing container" podUID="f2028e44-80fc-4aeb-ac1b-7f89397921a0" containerName="otc-container"
Oct 30 21:35:12.572071 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:12.572005    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f2028e44-80fc-4aeb-ac1b-7f89397921a0" containerName="otc-container"
Oct 30 21:35:12.572109 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:12.572084    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="f2028e44-80fc-4aeb-ac1b-7f89397921a0" containerName="otc-container"
Oct 30 21:35:12.575135 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:12.575118    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-lokistack-distributor-b854ccfb4-xw9h9"
Oct 30 21:35:12.607831 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:12.607801    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/f2028e44-80fc-4aeb-ac1b-7f89397921a0-otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/f2028e44-80fc-4aeb-ac1b-7f89397921a0-otlp-tls-certs\") pod \"f2028e44-80fc-4aeb-ac1b-7f89397921a0\" (UID: \"f2028e44-80fc-4aeb-ac1b-7f89397921a0\") "
Oct 30 21:35:12.607831 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:12.607836    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f2028e44-80fc-4aeb-ac1b-7f89397921a0-kube-api-access-44bdd\" (UniqueName: \"kubernetes.io/projected/f2028e44-80fc-4aeb-ac1b-7f89397921a0-kube-api-access-44bdd\") pod \"f2028e44-80fc-4aeb-ac1b-7f89397921a0\" (UID: \"f2028e44-80fc-4aeb-ac1b-7f89397921a0\") "
Oct 30 21:35:12.608057 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:12.607925    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-lokistack-distributor-http\" (UniqueName: \"kubernetes.io/secret/f99f91ba-56d3-43f3-8256-b0e32d702e43-data-science-lokistack-distributor-http\") pod \"data-science-lokistack-distributor-b854ccfb4-xw9h9\" (UID: \"f99f91ba-56d3-43f3-8256-b0e32d702e43\") " pod="redhat-ods-monitoring/data-science-lokistack-distributor-b854ccfb4-xw9h9"
Oct 30 21:35:12.608057 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:12.607950    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f99f91ba-56d3-43f3-8256-b0e32d702e43-config\") pod \"data-science-lokistack-distributor-b854ccfb4-xw9h9\" (UID: \"f99f91ba-56d3-43f3-8256-b0e32d702e43\") " pod="redhat-ods-monitoring/data-science-lokistack-distributor-b854ccfb4-xw9h9"
Oct 30 21:35:12.608057 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:12.608001    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-flqnr\" (UniqueName: \"kubernetes.io/projected/f99f91ba-56d3-43f3-8256-b0e32d702e43-kube-api-access-flqnr\") pod \"data-science-lokistack-distributor-b854ccfb4-xw9h9\" (UID: \"f99f91ba-56d3-43f3-8256-b0e32d702e43\") " pod="redhat-ods-monitoring/data-science-lokistack-distributor-b854ccfb4-xw9h9"
Oct 30 21:35:12.608246 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:12.608125    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-lokistack-distributor-grpc\" (UniqueName: \"kubernetes.io/secret/f99f91ba-56d3-43f3-8256-b0e32d702e43-data-science-lokistack-distributor-grpc\") pod \"data-science-lokistack-distributor-b854ccfb4-xw9h9\" (UID: \"f99f91ba-56d3-43f3-8256-b0e32d702e43\") " pod="redhat-ods-monitoring/data-science-lokistack-distributor-b854ccfb4-xw9h9"
Oct 30 21:35:12.608246 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:12.608153    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f99f91ba-56d3-43f3-8256-b0e32d702e43-data-science-lokistack-ca-bundle\") pod \"data-science-lokistack-distributor-b854ccfb4-xw9h9\" (UID: \"f99f91ba-56d3-43f3-8256-b0e32d702e43\") " pod="redhat-ods-monitoring/data-science-lokistack-distributor-b854ccfb4-xw9h9"
Oct 30 21:35:12.608246 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:12.608222    4060 reconciler_common.go:299] "Volume detached for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/f2028e44-80fc-4aeb-ac1b-7f89397921a0-otc-internal\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:35:12.609900 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:12.609863    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f2028e44-80fc-4aeb-ac1b-7f89397921a0-otlp-tls-certs" pod "f2028e44-80fc-4aeb-ac1b-7f89397921a0" (UID: "f2028e44-80fc-4aeb-ac1b-7f89397921a0"). InnerVolumeSpecName "otlp-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:35:12.610036 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:12.609967    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f2028e44-80fc-4aeb-ac1b-7f89397921a0-kube-api-access-44bdd" pod "f2028e44-80fc-4aeb-ac1b-7f89397921a0" (UID: "f2028e44-80fc-4aeb-ac1b-7f89397921a0"). InnerVolumeSpecName "kube-api-access-44bdd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:35:12.627044 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:12.627017    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-lokistack-ca-bundle\""
Oct 30 21:35:12.627480 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:12.627458    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-lokistack-config\""
Oct 30 21:35:12.627622 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:12.627598    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-lokistack-distributor-grpc\""
Oct 30 21:35:12.627683 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:12.627639    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-lokistack-dockercfg-4gxlb\""
Oct 30 21:35:12.627742 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:12.627683    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-lokistack-distributor-http\""
Oct 30 21:35:12.634763 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:12.634736    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-lokistack-distributor-b854ccfb4-xw9h9"]
Oct 30 21:35:12.708882 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:12.708851    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-lokistack-distributor-http\" (UniqueName: \"kubernetes.io/secret/f99f91ba-56d3-43f3-8256-b0e32d702e43-data-science-lokistack-distributor-http\") pod \"data-science-lokistack-distributor-b854ccfb4-xw9h9\" (UID: \"f99f91ba-56d3-43f3-8256-b0e32d702e43\") " pod="redhat-ods-monitoring/data-science-lokistack-distributor-b854ccfb4-xw9h9"
Oct 30 21:35:12.709069 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:12.708887    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f99f91ba-56d3-43f3-8256-b0e32d702e43-config\") pod \"data-science-lokistack-distributor-b854ccfb4-xw9h9\" (UID: \"f99f91ba-56d3-43f3-8256-b0e32d702e43\") " pod="redhat-ods-monitoring/data-science-lokistack-distributor-b854ccfb4-xw9h9"
Oct 30 21:35:12.709069 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:12.708961    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-flqnr\" (UniqueName: \"kubernetes.io/projected/f99f91ba-56d3-43f3-8256-b0e32d702e43-kube-api-access-flqnr\") pod \"data-science-lokistack-distributor-b854ccfb4-xw9h9\" (UID: \"f99f91ba-56d3-43f3-8256-b0e32d702e43\") " pod="redhat-ods-monitoring/data-science-lokistack-distributor-b854ccfb4-xw9h9"
Oct 30 21:35:12.709069 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:12.709004    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-lokistack-distributor-grpc\" (UniqueName: \"kubernetes.io/secret/f99f91ba-56d3-43f3-8256-b0e32d702e43-data-science-lokistack-distributor-grpc\") pod \"data-science-lokistack-distributor-b854ccfb4-xw9h9\" (UID: \"f99f91ba-56d3-43f3-8256-b0e32d702e43\") " pod="redhat-ods-monitoring/data-science-lokistack-distributor-b854ccfb4-xw9h9"
Oct 30 21:35:12.709069 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:12.709030    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f99f91ba-56d3-43f3-8256-b0e32d702e43-data-science-lokistack-ca-bundle\") pod \"data-science-lokistack-distributor-b854ccfb4-xw9h9\" (UID: \"f99f91ba-56d3-43f3-8256-b0e32d702e43\") " pod="redhat-ods-monitoring/data-science-lokistack-distributor-b854ccfb4-xw9h9"
Oct 30 21:35:12.709284 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:12.709118    4060 reconciler_common.go:299] "Volume detached for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/f2028e44-80fc-4aeb-ac1b-7f89397921a0-otlp-tls-certs\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:35:12.709284 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:12.709133    4060 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-44bdd\" (UniqueName: \"kubernetes.io/projected/f2028e44-80fc-4aeb-ac1b-7f89397921a0-kube-api-access-44bdd\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:35:12.709893 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:12.709859    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f99f91ba-56d3-43f3-8256-b0e32d702e43-config\") pod \"data-science-lokistack-distributor-b854ccfb4-xw9h9\" (UID: \"f99f91ba-56d3-43f3-8256-b0e32d702e43\") " pod="redhat-ods-monitoring/data-science-lokistack-distributor-b854ccfb4-xw9h9"
Oct 30 21:35:12.709989 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:12.709903    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f99f91ba-56d3-43f3-8256-b0e32d702e43-data-science-lokistack-ca-bundle\") pod \"data-science-lokistack-distributor-b854ccfb4-xw9h9\" (UID: \"f99f91ba-56d3-43f3-8256-b0e32d702e43\") " pod="redhat-ods-monitoring/data-science-lokistack-distributor-b854ccfb4-xw9h9"
Oct 30 21:35:12.711420 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:12.711397    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-lokistack-distributor-grpc\" (UniqueName: \"kubernetes.io/secret/f99f91ba-56d3-43f3-8256-b0e32d702e43-data-science-lokistack-distributor-grpc\") pod \"data-science-lokistack-distributor-b854ccfb4-xw9h9\" (UID: \"f99f91ba-56d3-43f3-8256-b0e32d702e43\") " pod="redhat-ods-monitoring/data-science-lokistack-distributor-b854ccfb4-xw9h9"
Oct 30 21:35:12.711536 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:12.711464    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-lokistack-distributor-http\" (UniqueName: \"kubernetes.io/secret/f99f91ba-56d3-43f3-8256-b0e32d702e43-data-science-lokistack-distributor-http\") pod \"data-science-lokistack-distributor-b854ccfb4-xw9h9\" (UID: \"f99f91ba-56d3-43f3-8256-b0e32d702e43\") " pod="redhat-ods-monitoring/data-science-lokistack-distributor-b854ccfb4-xw9h9"
Oct 30 21:35:12.769949 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:12.769915    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-flqnr\" (UniqueName: \"kubernetes.io/projected/f99f91ba-56d3-43f3-8256-b0e32d702e43-kube-api-access-flqnr\") pod \"data-science-lokistack-distributor-b854ccfb4-xw9h9\" (UID: \"f99f91ba-56d3-43f3-8256-b0e32d702e43\") " pod="redhat-ods-monitoring/data-science-lokistack-distributor-b854ccfb4-xw9h9"
Oct 30 21:35:12.886166 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:12.886127    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-lokistack-distributor-b854ccfb4-xw9h9"
Oct 30 21:35:13.015230 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:13.015152    4060 generic.go:356] "Generic (PLEG): container finished" podID="f2028e44-80fc-4aeb-ac1b-7f89397921a0" containerID="efe83c3e9900975efd575e96d1c3130bd6fb8c265523acd81d09280933fe528d" exitCode=0
Oct 30 21:35:13.015230 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:13.015197    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-usage-logs-collector-5b8b69c67b-fmf8b"
Oct 30 21:35:13.015414 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:13.015234    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-usage-logs-collector-5b8b69c67b-fmf8b" event={"ID":"f2028e44-80fc-4aeb-ac1b-7f89397921a0","Type":"ContainerDied","Data":"efe83c3e9900975efd575e96d1c3130bd6fb8c265523acd81d09280933fe528d"}
Oct 30 21:35:13.015414 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:13.015280    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-usage-logs-collector-5b8b69c67b-fmf8b" event={"ID":"f2028e44-80fc-4aeb-ac1b-7f89397921a0","Type":"ContainerDied","Data":"21e91a2d69ad7d57de966cbc025423c6d7fb0449718ff2ae9fc494e902e42f3e"}
Oct 30 21:35:13.015414 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:13.015311    4060 scope.go:122] "RemoveContainer" containerID="efe83c3e9900975efd575e96d1c3130bd6fb8c265523acd81d09280933fe528d"
Oct 30 21:35:13.024905 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:13.024889    4060 scope.go:122] "RemoveContainer" containerID="efe83c3e9900975efd575e96d1c3130bd6fb8c265523acd81d09280933fe528d"
Oct 30 21:35:13.025177 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:35:13.025158    4060 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"efe83c3e9900975efd575e96d1c3130bd6fb8c265523acd81d09280933fe528d\": container with ID starting with efe83c3e9900975efd575e96d1c3130bd6fb8c265523acd81d09280933fe528d not found: ID does not exist" containerID="efe83c3e9900975efd575e96d1c3130bd6fb8c265523acd81d09280933fe528d"
Oct 30 21:35:13.025245 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:13.025189    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"efe83c3e9900975efd575e96d1c3130bd6fb8c265523acd81d09280933fe528d"} err="failed to get container status \"efe83c3e9900975efd575e96d1c3130bd6fb8c265523acd81d09280933fe528d\": rpc error: code = NotFound desc = could not find container \"efe83c3e9900975efd575e96d1c3130bd6fb8c265523acd81d09280933fe528d\": container with ID starting with efe83c3e9900975efd575e96d1c3130bd6fb8c265523acd81d09280933fe528d not found: ID does not exist"
Oct 30 21:35:13.180753 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:13.180719    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-usage-logs-collector-5b8b69c67b-fmf8b"]
Oct 30 21:35:13.185158 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:13.185131    4060 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-usage-logs-collector-5b8b69c67b-fmf8b"]
Oct 30 21:35:13.293701 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:13.293678    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-lokistack-distributor-b854ccfb4-xw9h9"]
Oct 30 21:35:13.295581 ip-10-0-142-4 kubenswrapper[4060]: W1030 21:35:13.295552    4060 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf99f91ba_56d3_43f3_8256_b0e32d702e43.slice/crio-ca7469a154df22c136974cff332a86a97e4f6a96b48efa8b58bb29a8374341d4 WatchSource:0}: Error finding container ca7469a154df22c136974cff332a86a97e4f6a96b48efa8b58bb29a8374341d4: Status 404 returned error can't find the container with id ca7469a154df22c136974cff332a86a97e4f6a96b48efa8b58bb29a8374341d4
Oct 30 21:35:13.426600 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:13.426571    4060 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f2028e44-80fc-4aeb-ac1b-7f89397921a0" path="/var/lib/kubelet/pods/f2028e44-80fc-4aeb-ac1b-7f89397921a0/volumes"
Oct 30 21:35:13.466680 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:13.466649    4060 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-lokistack-query-frontend-5cddddc95c-mtdgf"]
Oct 30 21:35:13.470054 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:13.470034    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-lokistack-query-frontend-5cddddc95c-mtdgf"
Oct 30 21:35:13.515070 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:13.515039    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/232ec0c8-fd25-42e5-87ba-a5860d024d55-data-science-lokistack-ca-bundle\") pod \"data-science-lokistack-query-frontend-5cddddc95c-mtdgf\" (UID: \"232ec0c8-fd25-42e5-87ba-a5860d024d55\") " pod="redhat-ods-monitoring/data-science-lokistack-query-frontend-5cddddc95c-mtdgf"
Oct 30 21:35:13.515070 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:13.515077    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/232ec0c8-fd25-42e5-87ba-a5860d024d55-config\") pod \"data-science-lokistack-query-frontend-5cddddc95c-mtdgf\" (UID: \"232ec0c8-fd25-42e5-87ba-a5860d024d55\") " pod="redhat-ods-monitoring/data-science-lokistack-query-frontend-5cddddc95c-mtdgf"
Oct 30 21:35:13.515330 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:13.515106    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-lokistack-query-frontend-http\" (UniqueName: \"kubernetes.io/secret/232ec0c8-fd25-42e5-87ba-a5860d024d55-data-science-lokistack-query-frontend-http\") pod \"data-science-lokistack-query-frontend-5cddddc95c-mtdgf\" (UID: \"232ec0c8-fd25-42e5-87ba-a5860d024d55\") " pod="redhat-ods-monitoring/data-science-lokistack-query-frontend-5cddddc95c-mtdgf"
Oct 30 21:35:13.515330 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:13.515254    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-lokistack-query-frontend-grpc\" (UniqueName: \"kubernetes.io/secret/232ec0c8-fd25-42e5-87ba-a5860d024d55-data-science-lokistack-query-frontend-grpc\") pod \"data-science-lokistack-query-frontend-5cddddc95c-mtdgf\" (UID: \"232ec0c8-fd25-42e5-87ba-a5860d024d55\") " pod="redhat-ods-monitoring/data-science-lokistack-query-frontend-5cddddc95c-mtdgf"
Oct 30 21:35:13.515330 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:13.515280    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kqqw8\" (UniqueName: \"kubernetes.io/projected/232ec0c8-fd25-42e5-87ba-a5860d024d55-kube-api-access-kqqw8\") pod \"data-science-lokistack-query-frontend-5cddddc95c-mtdgf\" (UID: \"232ec0c8-fd25-42e5-87ba-a5860d024d55\") " pod="redhat-ods-monitoring/data-science-lokistack-query-frontend-5cddddc95c-mtdgf"
Oct 30 21:35:13.522551 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:13.522528    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-lokistack-query-frontend-http\""
Oct 30 21:35:13.522706 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:13.522694    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-lokistack-query-frontend-grpc\""
Oct 30 21:35:13.530546 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:13.530517    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-lokistack-query-frontend-5cddddc95c-mtdgf"]
Oct 30 21:35:13.616582 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:13.616475    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/232ec0c8-fd25-42e5-87ba-a5860d024d55-config\") pod \"data-science-lokistack-query-frontend-5cddddc95c-mtdgf\" (UID: \"232ec0c8-fd25-42e5-87ba-a5860d024d55\") " pod="redhat-ods-monitoring/data-science-lokistack-query-frontend-5cddddc95c-mtdgf"
Oct 30 21:35:13.616582 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:13.616543    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-lokistack-query-frontend-http\" (UniqueName: \"kubernetes.io/secret/232ec0c8-fd25-42e5-87ba-a5860d024d55-data-science-lokistack-query-frontend-http\") pod \"data-science-lokistack-query-frontend-5cddddc95c-mtdgf\" (UID: \"232ec0c8-fd25-42e5-87ba-a5860d024d55\") " pod="redhat-ods-monitoring/data-science-lokistack-query-frontend-5cddddc95c-mtdgf"
Oct 30 21:35:13.616813 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:13.616605    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-lokistack-query-frontend-grpc\" (UniqueName: \"kubernetes.io/secret/232ec0c8-fd25-42e5-87ba-a5860d024d55-data-science-lokistack-query-frontend-grpc\") pod \"data-science-lokistack-query-frontend-5cddddc95c-mtdgf\" (UID: \"232ec0c8-fd25-42e5-87ba-a5860d024d55\") " pod="redhat-ods-monitoring/data-science-lokistack-query-frontend-5cddddc95c-mtdgf"
Oct 30 21:35:13.616813 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:13.616623    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kqqw8\" (UniqueName: \"kubernetes.io/projected/232ec0c8-fd25-42e5-87ba-a5860d024d55-kube-api-access-kqqw8\") pod \"data-science-lokistack-query-frontend-5cddddc95c-mtdgf\" (UID: \"232ec0c8-fd25-42e5-87ba-a5860d024d55\") " pod="redhat-ods-monitoring/data-science-lokistack-query-frontend-5cddddc95c-mtdgf"
Oct 30 21:35:13.616813 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:13.616652    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/232ec0c8-fd25-42e5-87ba-a5860d024d55-data-science-lokistack-ca-bundle\") pod \"data-science-lokistack-query-frontend-5cddddc95c-mtdgf\" (UID: \"232ec0c8-fd25-42e5-87ba-a5860d024d55\") " pod="redhat-ods-monitoring/data-science-lokistack-query-frontend-5cddddc95c-mtdgf"
Oct 30 21:35:13.617299 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:13.617267    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/232ec0c8-fd25-42e5-87ba-a5860d024d55-data-science-lokistack-ca-bundle\") pod \"data-science-lokistack-query-frontend-5cddddc95c-mtdgf\" (UID: \"232ec0c8-fd25-42e5-87ba-a5860d024d55\") " pod="redhat-ods-monitoring/data-science-lokistack-query-frontend-5cddddc95c-mtdgf"
Oct 30 21:35:13.617593 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:13.617574    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/232ec0c8-fd25-42e5-87ba-a5860d024d55-config\") pod \"data-science-lokistack-query-frontend-5cddddc95c-mtdgf\" (UID: \"232ec0c8-fd25-42e5-87ba-a5860d024d55\") " pod="redhat-ods-monitoring/data-science-lokistack-query-frontend-5cddddc95c-mtdgf"
Oct 30 21:35:13.619028 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:13.619007    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-lokistack-query-frontend-grpc\" (UniqueName: \"kubernetes.io/secret/232ec0c8-fd25-42e5-87ba-a5860d024d55-data-science-lokistack-query-frontend-grpc\") pod \"data-science-lokistack-query-frontend-5cddddc95c-mtdgf\" (UID: \"232ec0c8-fd25-42e5-87ba-a5860d024d55\") " pod="redhat-ods-monitoring/data-science-lokistack-query-frontend-5cddddc95c-mtdgf"
Oct 30 21:35:13.619127 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:13.619063    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-lokistack-query-frontend-http\" (UniqueName: \"kubernetes.io/secret/232ec0c8-fd25-42e5-87ba-a5860d024d55-data-science-lokistack-query-frontend-http\") pod \"data-science-lokistack-query-frontend-5cddddc95c-mtdgf\" (UID: \"232ec0c8-fd25-42e5-87ba-a5860d024d55\") " pod="redhat-ods-monitoring/data-science-lokistack-query-frontend-5cddddc95c-mtdgf"
Oct 30 21:35:13.677768 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:13.677736    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kqqw8\" (UniqueName: \"kubernetes.io/projected/232ec0c8-fd25-42e5-87ba-a5860d024d55-kube-api-access-kqqw8\") pod \"data-science-lokistack-query-frontend-5cddddc95c-mtdgf\" (UID: \"232ec0c8-fd25-42e5-87ba-a5860d024d55\") " pod="redhat-ods-monitoring/data-science-lokistack-query-frontend-5cddddc95c-mtdgf"
Oct 30 21:35:13.781771 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:13.781736    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-lokistack-query-frontend-5cddddc95c-mtdgf"
Oct 30 21:35:14.022008 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:14.021969    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-lokistack-distributor-b854ccfb4-xw9h9" event={"ID":"f99f91ba-56d3-43f3-8256-b0e32d702e43","Type":"ContainerStarted","Data":"70349b1af2a644b2f769ceba3bf5bd4500624caef35186f16ea983b9c589b42d"}
Oct 30 21:35:14.022196 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:14.022017    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-lokistack-distributor-b854ccfb4-xw9h9" event={"ID":"f99f91ba-56d3-43f3-8256-b0e32d702e43","Type":"ContainerStarted","Data":"ca7469a154df22c136974cff332a86a97e4f6a96b48efa8b58bb29a8374341d4"}
Oct 30 21:35:14.022196 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:14.022099    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-lokistack-distributor-b854ccfb4-xw9h9"
Oct 30 21:35:14.146937 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:14.146883    4060 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-lokistack-distributor-b854ccfb4-xw9h9" podStartSLOduration=2.146865575 podStartE2EDuration="2.146865575s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:35:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:35:14.146549461 +0000 UTC m=+3532.903547759" watchObservedRunningTime="2026-10-30 21:35:14.146865575 +0000 UTC m=+3532.903863871"
Oct 30 21:35:14.155329 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:14.155301    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-lokistack-query-frontend-5cddddc95c-mtdgf"]
Oct 30 21:35:14.193676 ip-10-0-142-4 kubenswrapper[4060]: W1030 21:35:14.193608    4060 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod232ec0c8_fd25_42e5_87ba_a5860d024d55.slice/crio-af0ee5b1cd3a4d46bfe21366f6cce600742b2dd053a0c17efef0416ae07ca90c WatchSource:0}: Error finding container af0ee5b1cd3a4d46bfe21366f6cce600742b2dd053a0c17efef0416ae07ca90c: Status 404 returned error can't find the container with id af0ee5b1cd3a4d46bfe21366f6cce600742b2dd053a0c17efef0416ae07ca90c
Oct 30 21:35:15.028829 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:15.028793    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-lokistack-query-frontend-5cddddc95c-mtdgf" event={"ID":"232ec0c8-fd25-42e5-87ba-a5860d024d55","Type":"ContainerStarted","Data":"e90497f06fa3a47ce39b0338c87c9e37842bbacc9f5c0510eb2cc88a84245412"}
Oct 30 21:35:15.029292 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:15.028836    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-lokistack-query-frontend-5cddddc95c-mtdgf" event={"ID":"232ec0c8-fd25-42e5-87ba-a5860d024d55","Type":"ContainerStarted","Data":"af0ee5b1cd3a4d46bfe21366f6cce600742b2dd053a0c17efef0416ae07ca90c"}
Oct 30 21:35:15.029292 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:15.028998    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-lokistack-query-frontend-5cddddc95c-mtdgf"
Oct 30 21:35:15.145874 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:15.145829    4060 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-lokistack-query-frontend-5cddddc95c-mtdgf" podStartSLOduration=2.145814573 podStartE2EDuration="2.145814573s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:35:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:35:15.14501817 +0000 UTC m=+3533.902016465" watchObservedRunningTime="2026-10-30 21:35:15.145814573 +0000 UTC m=+3533.902812869"
Oct 30 21:35:17.232538 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:17.232502    4060 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-logging/data-science-cluster-log-forwarder-55fzw"]
Oct 30 21:35:17.235987 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:17.235972    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-logging/data-science-cluster-log-forwarder-55fzw"
Oct 30 21:35:17.246767 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:17.246742    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics\" (UniqueName: \"kubernetes.io/secret/42e634cc-318c-4d38-892d-933d68c2db39-metrics\") pod \"data-science-cluster-log-forwarder-55fzw\" (UID: \"42e634cc-318c-4d38-892d-933d68c2db39\") " pod="openshift-logging/data-science-cluster-log-forwarder-55fzw"
Oct 30 21:35:17.246899 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:17.246771    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"varlogpods\" (UniqueName: \"kubernetes.io/host-path/42e634cc-318c-4d38-892d-933d68c2db39-varlogpods\") pod \"data-science-cluster-log-forwarder-55fzw\" (UID: \"42e634cc-318c-4d38-892d-933d68c2db39\") " pod="openshift-logging/data-science-cluster-log-forwarder-55fzw"
Oct 30 21:35:17.246899 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:17.246854    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sa-token\" (UniqueName: \"kubernetes.io/projected/42e634cc-318c-4d38-892d-933d68c2db39-sa-token\") pod \"data-science-cluster-log-forwarder-55fzw\" (UID: \"42e634cc-318c-4d38-892d-933d68c2db39\") " pod="openshift-logging/data-science-cluster-log-forwarder-55fzw"
Oct 30 21:35:17.247046 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:17.246917    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/42e634cc-318c-4d38-892d-933d68c2db39-trusted-ca\") pod \"data-science-cluster-log-forwarder-55fzw\" (UID: \"42e634cc-318c-4d38-892d-933d68c2db39\") " pod="openshift-logging/data-science-cluster-log-forwarder-55fzw"
Oct 30 21:35:17.247046 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:17.246937    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-openshift-service-cacrt\" (UniqueName: \"kubernetes.io/configmap/42e634cc-318c-4d38-892d-933d68c2db39-config-openshift-service-cacrt\") pod \"data-science-cluster-log-forwarder-55fzw\" (UID: \"42e634cc-318c-4d38-892d-933d68c2db39\") " pod="openshift-logging/data-science-cluster-log-forwarder-55fzw"
Oct 30 21:35:17.247145 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:17.247049    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"datadir\" (UniqueName: \"kubernetes.io/host-path/42e634cc-318c-4d38-892d-933d68c2db39-datadir\") pod \"data-science-cluster-log-forwarder-55fzw\" (UID: \"42e634cc-318c-4d38-892d-933d68c2db39\") " pod="openshift-logging/data-science-cluster-log-forwarder-55fzw"
Oct 30 21:35:17.247145 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:17.247071    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-cluster-log-forwarder-collector-token\" (UniqueName: \"kubernetes.io/secret/42e634cc-318c-4d38-892d-933d68c2db39-data-science-cluster-log-forwarder-collector-token\") pod \"data-science-cluster-log-forwarder-55fzw\" (UID: \"42e634cc-318c-4d38-892d-933d68c2db39\") " pod="openshift-logging/data-science-cluster-log-forwarder-55fzw"
Oct 30 21:35:17.247145 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:17.247093    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/42e634cc-318c-4d38-892d-933d68c2db39-tmp\") pod \"data-science-cluster-log-forwarder-55fzw\" (UID: \"42e634cc-318c-4d38-892d-933d68c2db39\") " pod="openshift-logging/data-science-cluster-log-forwarder-55fzw"
Oct 30 21:35:17.247296 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:17.247146    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"entrypoint\" (UniqueName: \"kubernetes.io/configmap/42e634cc-318c-4d38-892d-933d68c2db39-entrypoint\") pod \"data-science-cluster-log-forwarder-55fzw\" (UID: \"42e634cc-318c-4d38-892d-933d68c2db39\") " pod="openshift-logging/data-science-cluster-log-forwarder-55fzw"
Oct 30 21:35:17.247296 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:17.247185    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/42e634cc-318c-4d38-892d-933d68c2db39-config\") pod \"data-science-cluster-log-forwarder-55fzw\" (UID: \"42e634cc-318c-4d38-892d-933d68c2db39\") " pod="openshift-logging/data-science-cluster-log-forwarder-55fzw"
Oct 30 21:35:17.247296 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:17.247202    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tw9hh\" (UniqueName: \"kubernetes.io/projected/42e634cc-318c-4d38-892d-933d68c2db39-kube-api-access-tw9hh\") pod \"data-science-cluster-log-forwarder-55fzw\" (UID: \"42e634cc-318c-4d38-892d-933d68c2db39\") " pod="openshift-logging/data-science-cluster-log-forwarder-55fzw"
Oct 30 21:35:17.288418 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:17.288386    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-logging\"/\"data-science-cluster-log-forwarder-metrics\""
Oct 30 21:35:17.337863 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:17.337833    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-logging\"/\"openshift-service-ca.crt\""
Oct 30 21:35:17.337863 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:17.337835    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-logging\"/\"data-science-cluster-log-forwarder-collector-token\""
Oct 30 21:35:17.338088 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:17.337878    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-logging\"/\"kube-root-ca.crt\""
Oct 30 21:35:17.347905 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:17.347872    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics\" (UniqueName: \"kubernetes.io/secret/42e634cc-318c-4d38-892d-933d68c2db39-metrics\") pod \"data-science-cluster-log-forwarder-55fzw\" (UID: \"42e634cc-318c-4d38-892d-933d68c2db39\") " pod="openshift-logging/data-science-cluster-log-forwarder-55fzw"
Oct 30 21:35:17.347905 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:17.347903    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"varlogpods\" (UniqueName: \"kubernetes.io/host-path/42e634cc-318c-4d38-892d-933d68c2db39-varlogpods\") pod \"data-science-cluster-log-forwarder-55fzw\" (UID: \"42e634cc-318c-4d38-892d-933d68c2db39\") " pod="openshift-logging/data-science-cluster-log-forwarder-55fzw"
Oct 30 21:35:17.348104 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:17.347943    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sa-token\" (UniqueName: \"kubernetes.io/projected/42e634cc-318c-4d38-892d-933d68c2db39-sa-token\") pod \"data-science-cluster-log-forwarder-55fzw\" (UID: \"42e634cc-318c-4d38-892d-933d68c2db39\") " pod="openshift-logging/data-science-cluster-log-forwarder-55fzw"
Oct 30 21:35:17.348104 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:17.347966    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/42e634cc-318c-4d38-892d-933d68c2db39-trusted-ca\") pod \"data-science-cluster-log-forwarder-55fzw\" (UID: \"42e634cc-318c-4d38-892d-933d68c2db39\") " pod="openshift-logging/data-science-cluster-log-forwarder-55fzw"
Oct 30 21:35:17.348104 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:17.347993    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-openshift-service-cacrt\" (UniqueName: \"kubernetes.io/configmap/42e634cc-318c-4d38-892d-933d68c2db39-config-openshift-service-cacrt\") pod \"data-science-cluster-log-forwarder-55fzw\" (UID: \"42e634cc-318c-4d38-892d-933d68c2db39\") " pod="openshift-logging/data-science-cluster-log-forwarder-55fzw"
Oct 30 21:35:17.348104 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:17.347998    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"varlogpods\" (UniqueName: \"kubernetes.io/host-path/42e634cc-318c-4d38-892d-933d68c2db39-varlogpods\") pod \"data-science-cluster-log-forwarder-55fzw\" (UID: \"42e634cc-318c-4d38-892d-933d68c2db39\") " pod="openshift-logging/data-science-cluster-log-forwarder-55fzw"
Oct 30 21:35:17.348104 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:35:17.348019    4060 secret.go:189] Couldn't get secret openshift-logging/data-science-cluster-log-forwarder-metrics: secret "data-science-cluster-log-forwarder-metrics" not found
Oct 30 21:35:17.348104 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:17.348068    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"datadir\" (UniqueName: \"kubernetes.io/host-path/42e634cc-318c-4d38-892d-933d68c2db39-datadir\") pod \"data-science-cluster-log-forwarder-55fzw\" (UID: \"42e634cc-318c-4d38-892d-933d68c2db39\") " pod="openshift-logging/data-science-cluster-log-forwarder-55fzw"
Oct 30 21:35:17.348104 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:35:17.348078    4060 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42e634cc-318c-4d38-892d-933d68c2db39-metrics podName:42e634cc-318c-4d38-892d-933d68c2db39 nodeName:}" failed. No retries permitted until 2026-10-30 21:35:17.848061626 +0000 UTC m=+3536.605059916 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics" (UniqueName: "kubernetes.io/secret/42e634cc-318c-4d38-892d-933d68c2db39-metrics") pod "data-science-cluster-log-forwarder-55fzw" (UID: "42e634cc-318c-4d38-892d-933d68c2db39") : secret "data-science-cluster-log-forwarder-metrics" not found
Oct 30 21:35:17.348478 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:17.348107    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-cluster-log-forwarder-collector-token\" (UniqueName: \"kubernetes.io/secret/42e634cc-318c-4d38-892d-933d68c2db39-data-science-cluster-log-forwarder-collector-token\") pod \"data-science-cluster-log-forwarder-55fzw\" (UID: \"42e634cc-318c-4d38-892d-933d68c2db39\") " pod="openshift-logging/data-science-cluster-log-forwarder-55fzw"
Oct 30 21:35:17.348478 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:17.348139    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/42e634cc-318c-4d38-892d-933d68c2db39-tmp\") pod \"data-science-cluster-log-forwarder-55fzw\" (UID: \"42e634cc-318c-4d38-892d-933d68c2db39\") " pod="openshift-logging/data-science-cluster-log-forwarder-55fzw"
Oct 30 21:35:17.348478 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:17.348111    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"datadir\" (UniqueName: \"kubernetes.io/host-path/42e634cc-318c-4d38-892d-933d68c2db39-datadir\") pod \"data-science-cluster-log-forwarder-55fzw\" (UID: \"42e634cc-318c-4d38-892d-933d68c2db39\") " pod="openshift-logging/data-science-cluster-log-forwarder-55fzw"
Oct 30 21:35:17.348478 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:17.348163    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"entrypoint\" (UniqueName: \"kubernetes.io/configmap/42e634cc-318c-4d38-892d-933d68c2db39-entrypoint\") pod \"data-science-cluster-log-forwarder-55fzw\" (UID: \"42e634cc-318c-4d38-892d-933d68c2db39\") " pod="openshift-logging/data-science-cluster-log-forwarder-55fzw"
Oct 30 21:35:17.348478 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:17.348229    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/42e634cc-318c-4d38-892d-933d68c2db39-config\") pod \"data-science-cluster-log-forwarder-55fzw\" (UID: \"42e634cc-318c-4d38-892d-933d68c2db39\") " pod="openshift-logging/data-science-cluster-log-forwarder-55fzw"
Oct 30 21:35:17.348478 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:17.348260    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tw9hh\" (UniqueName: \"kubernetes.io/projected/42e634cc-318c-4d38-892d-933d68c2db39-kube-api-access-tw9hh\") pod \"data-science-cluster-log-forwarder-55fzw\" (UID: \"42e634cc-318c-4d38-892d-933d68c2db39\") " pod="openshift-logging/data-science-cluster-log-forwarder-55fzw"
Oct 30 21:35:17.348737 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:17.348605    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-openshift-service-cacrt\" (UniqueName: \"kubernetes.io/configmap/42e634cc-318c-4d38-892d-933d68c2db39-config-openshift-service-cacrt\") pod \"data-science-cluster-log-forwarder-55fzw\" (UID: \"42e634cc-318c-4d38-892d-933d68c2db39\") " pod="openshift-logging/data-science-cluster-log-forwarder-55fzw"
Oct 30 21:35:17.350337 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:17.350320    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/42e634cc-318c-4d38-892d-933d68c2db39-tmp\") pod \"data-science-cluster-log-forwarder-55fzw\" (UID: \"42e634cc-318c-4d38-892d-933d68c2db39\") " pod="openshift-logging/data-science-cluster-log-forwarder-55fzw"
Oct 30 21:35:17.350406 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:17.350388    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-cluster-log-forwarder-collector-token\" (UniqueName: \"kubernetes.io/secret/42e634cc-318c-4d38-892d-933d68c2db39-data-science-cluster-log-forwarder-collector-token\") pod \"data-science-cluster-log-forwarder-55fzw\" (UID: \"42e634cc-318c-4d38-892d-933d68c2db39\") " pod="openshift-logging/data-science-cluster-log-forwarder-55fzw"
Oct 30 21:35:17.486718 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:17.486635    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-logging\"/\"data-science-cluster-log-forwarder-config\""
Oct 30 21:35:17.486718 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:17.486668    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-logging\"/\"data-science-cluster-log-forwarder-trustbundle\""
Oct 30 21:35:17.487486 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:17.487468    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-logging\"/\"data-science-cluster-log-forwarder-collector-dockercfg-hh4ns\""
Oct 30 21:35:17.488763 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:17.488739    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"entrypoint\" (UniqueName: \"kubernetes.io/configmap/42e634cc-318c-4d38-892d-933d68c2db39-entrypoint\") pod \"data-science-cluster-log-forwarder-55fzw\" (UID: \"42e634cc-318c-4d38-892d-933d68c2db39\") " pod="openshift-logging/data-science-cluster-log-forwarder-55fzw"
Oct 30 21:35:17.488901 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:17.488773    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/42e634cc-318c-4d38-892d-933d68c2db39-trusted-ca\") pod \"data-science-cluster-log-forwarder-55fzw\" (UID: \"42e634cc-318c-4d38-892d-933d68c2db39\") " pod="openshift-logging/data-science-cluster-log-forwarder-55fzw"
Oct 30 21:35:17.488965 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:17.488923    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/42e634cc-318c-4d38-892d-933d68c2db39-config\") pod \"data-science-cluster-log-forwarder-55fzw\" (UID: \"42e634cc-318c-4d38-892d-933d68c2db39\") " pod="openshift-logging/data-science-cluster-log-forwarder-55fzw"
Oct 30 21:35:17.489577 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:17.489555    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-logging/data-science-cluster-log-forwarder-55fzw"]
Oct 30 21:35:17.489980 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:17.489963    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sa-token\" (UniqueName: \"kubernetes.io/projected/42e634cc-318c-4d38-892d-933d68c2db39-sa-token\") pod \"data-science-cluster-log-forwarder-55fzw\" (UID: \"42e634cc-318c-4d38-892d-933d68c2db39\") " pod="openshift-logging/data-science-cluster-log-forwarder-55fzw"
Oct 30 21:35:17.490124 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:17.490104    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tw9hh\" (UniqueName: \"kubernetes.io/projected/42e634cc-318c-4d38-892d-933d68c2db39-kube-api-access-tw9hh\") pod \"data-science-cluster-log-forwarder-55fzw\" (UID: \"42e634cc-318c-4d38-892d-933d68c2db39\") " pod="openshift-logging/data-science-cluster-log-forwarder-55fzw"
Oct 30 21:35:17.852867 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:17.852782    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics\" (UniqueName: \"kubernetes.io/secret/42e634cc-318c-4d38-892d-933d68c2db39-metrics\") pod \"data-science-cluster-log-forwarder-55fzw\" (UID: \"42e634cc-318c-4d38-892d-933d68c2db39\") " pod="openshift-logging/data-science-cluster-log-forwarder-55fzw"
Oct 30 21:35:17.855073 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:17.855043    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics\" (UniqueName: \"kubernetes.io/secret/42e634cc-318c-4d38-892d-933d68c2db39-metrics\") pod \"data-science-cluster-log-forwarder-55fzw\" (UID: \"42e634cc-318c-4d38-892d-933d68c2db39\") " pod="openshift-logging/data-science-cluster-log-forwarder-55fzw"
Oct 30 21:35:18.148856 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:18.148777    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-logging/data-science-cluster-log-forwarder-55fzw"
Oct 30 21:35:18.236843 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:18.236811    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-logging/data-science-cluster-log-forwarder-55fzw"]
Oct 30 21:35:18.575690 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:18.575665    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-logging/data-science-cluster-log-forwarder-55fzw"]
Oct 30 21:35:18.577048 ip-10-0-142-4 kubenswrapper[4060]: W1030 21:35:18.577025    4060 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42e634cc_318c_4d38_892d_933d68c2db39.slice/crio-be6263536343920ffe3d85e74f3e5a5996a491805650c7df5e1d489d100c3182 WatchSource:0}: Error finding container be6263536343920ffe3d85e74f3e5a5996a491805650c7df5e1d489d100c3182: Status 404 returned error can't find the container with id be6263536343920ffe3d85e74f3e5a5996a491805650c7df5e1d489d100c3182
Oct 30 21:35:19.049441 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:19.049407    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-logging/data-science-cluster-log-forwarder-55fzw" event={"ID":"42e634cc-318c-4d38-892d-933d68c2db39","Type":"ContainerStarted","Data":"be6263536343920ffe3d85e74f3e5a5996a491805650c7df5e1d489d100c3182"}
Oct 30 21:35:21.004685 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:21.004650    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/korrel8r-5f5775896-txcbx"
Oct 30 21:35:25.079948 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:25.079905    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-logging/data-science-cluster-log-forwarder-55fzw" event={"ID":"42e634cc-318c-4d38-892d-933d68c2db39","Type":"ContainerStarted","Data":"22c1ac05f8da0febbd6c1aa4aff8588e274d2878e168e0346d9e06abd83da68e"}
Oct 30 21:35:25.080412 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:25.079996    4060 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-logging/data-science-cluster-log-forwarder-55fzw" podUID="42e634cc-318c-4d38-892d-933d68c2db39" containerName="collector" containerID="cri-o://22c1ac05f8da0febbd6c1aa4aff8588e274d2878e168e0346d9e06abd83da68e" gracePeriod=10
Oct 30 21:35:25.253987 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:25.253930    4060 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-logging/data-science-cluster-log-forwarder-55fzw" podStartSLOduration=2.80753536 podStartE2EDuration="8.253915488s" totalImagesPullingTime="5.446380128s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 21:35:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:35:25.251124861 +0000 UTC m=+3544.008123171" watchObservedRunningTime="2026-10-30 21:35:25.253915488 +0000 UTC m=+3544.010913808"
Oct 30 21:35:25.332604 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:25.332541    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-logging/data-science-cluster-log-forwarder-55fzw"
Oct 30 21:35:25.422313 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:25.422286    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/42e634cc-318c-4d38-892d-933d68c2db39-trusted-ca\" (UniqueName: \"kubernetes.io/configmap/42e634cc-318c-4d38-892d-933d68c2db39-trusted-ca\") pod \"42e634cc-318c-4d38-892d-933d68c2db39\" (UID: \"42e634cc-318c-4d38-892d-933d68c2db39\") "
Oct 30 21:35:25.422523 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:25.422330    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/42e634cc-318c-4d38-892d-933d68c2db39-kube-api-access-tw9hh\" (UniqueName: \"kubernetes.io/projected/42e634cc-318c-4d38-892d-933d68c2db39-kube-api-access-tw9hh\") pod \"42e634cc-318c-4d38-892d-933d68c2db39\" (UID: \"42e634cc-318c-4d38-892d-933d68c2db39\") "
Oct 30 21:35:25.422523 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:25.422369    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/42e634cc-318c-4d38-892d-933d68c2db39-sa-token\" (UniqueName: \"kubernetes.io/projected/42e634cc-318c-4d38-892d-933d68c2db39-sa-token\") pod \"42e634cc-318c-4d38-892d-933d68c2db39\" (UID: \"42e634cc-318c-4d38-892d-933d68c2db39\") "
Oct 30 21:35:25.422523 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:25.422405    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/42e634cc-318c-4d38-892d-933d68c2db39-entrypoint\" (UniqueName: \"kubernetes.io/configmap/42e634cc-318c-4d38-892d-933d68c2db39-entrypoint\") pod \"42e634cc-318c-4d38-892d-933d68c2db39\" (UID: \"42e634cc-318c-4d38-892d-933d68c2db39\") "
Oct 30 21:35:25.422523 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:25.422444    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/host-path/42e634cc-318c-4d38-892d-933d68c2db39-datadir\" (UniqueName: \"kubernetes.io/host-path/42e634cc-318c-4d38-892d-933d68c2db39-datadir\") pod \"42e634cc-318c-4d38-892d-933d68c2db39\" (UID: \"42e634cc-318c-4d38-892d-933d68c2db39\") "
Oct 30 21:35:25.422523 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:25.422485    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/42e634cc-318c-4d38-892d-933d68c2db39-tmp\" (UniqueName: \"kubernetes.io/empty-dir/42e634cc-318c-4d38-892d-933d68c2db39-tmp\") pod \"42e634cc-318c-4d38-892d-933d68c2db39\" (UID: \"42e634cc-318c-4d38-892d-933d68c2db39\") "
Oct 30 21:35:25.422814 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:25.422541    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/host-path/42e634cc-318c-4d38-892d-933d68c2db39-varlogpods\" (UniqueName: \"kubernetes.io/host-path/42e634cc-318c-4d38-892d-933d68c2db39-varlogpods\") pod \"42e634cc-318c-4d38-892d-933d68c2db39\" (UID: \"42e634cc-318c-4d38-892d-933d68c2db39\") "
Oct 30 21:35:25.422814 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:25.422540    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/42e634cc-318c-4d38-892d-933d68c2db39-datadir" pod "42e634cc-318c-4d38-892d-933d68c2db39" (UID: "42e634cc-318c-4d38-892d-933d68c2db39"). InnerVolumeSpecName "datadir". PluginName "kubernetes.io/host-path", VolumeGIDValue ""
Oct 30 21:35:25.422814 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:25.422581    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/42e634cc-318c-4d38-892d-933d68c2db39-config-openshift-service-cacrt\" (UniqueName: \"kubernetes.io/configmap/42e634cc-318c-4d38-892d-933d68c2db39-config-openshift-service-cacrt\") pod \"42e634cc-318c-4d38-892d-933d68c2db39\" (UID: \"42e634cc-318c-4d38-892d-933d68c2db39\") "
Oct 30 21:35:25.422814 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:25.422622    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/42e634cc-318c-4d38-892d-933d68c2db39-metrics\" (UniqueName: \"kubernetes.io/secret/42e634cc-318c-4d38-892d-933d68c2db39-metrics\") pod \"42e634cc-318c-4d38-892d-933d68c2db39\" (UID: \"42e634cc-318c-4d38-892d-933d68c2db39\") "
Oct 30 21:35:25.422814 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:25.422661    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/42e634cc-318c-4d38-892d-933d68c2db39-data-science-cluster-log-forwarder-collector-token\" (UniqueName: \"kubernetes.io/secret/42e634cc-318c-4d38-892d-933d68c2db39-data-science-cluster-log-forwarder-collector-token\") pod \"42e634cc-318c-4d38-892d-933d68c2db39\" (UID: \"42e634cc-318c-4d38-892d-933d68c2db39\") "
Oct 30 21:35:25.422814 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:25.422706    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/42e634cc-318c-4d38-892d-933d68c2db39-config\" (UniqueName: \"kubernetes.io/configmap/42e634cc-318c-4d38-892d-933d68c2db39-config\") pod \"42e634cc-318c-4d38-892d-933d68c2db39\" (UID: \"42e634cc-318c-4d38-892d-933d68c2db39\") "
Oct 30 21:35:25.422814 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:25.422747    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/42e634cc-318c-4d38-892d-933d68c2db39-trusted-ca" pod "42e634cc-318c-4d38-892d-933d68c2db39" (UID: "42e634cc-318c-4d38-892d-933d68c2db39"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:35:25.423187 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:25.422885    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/42e634cc-318c-4d38-892d-933d68c2db39-varlogpods" pod "42e634cc-318c-4d38-892d-933d68c2db39" (UID: "42e634cc-318c-4d38-892d-933d68c2db39"). InnerVolumeSpecName "varlogpods". PluginName "kubernetes.io/host-path", VolumeGIDValue ""
Oct 30 21:35:25.423187 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:25.423056    4060 reconciler_common.go:299] "Volume detached for volume \"datadir\" (UniqueName: \"kubernetes.io/host-path/42e634cc-318c-4d38-892d-933d68c2db39-datadir\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:35:25.423187 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:25.423075    4060 reconciler_common.go:299] "Volume detached for volume \"varlogpods\" (UniqueName: \"kubernetes.io/host-path/42e634cc-318c-4d38-892d-933d68c2db39-varlogpods\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:35:25.423187 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:25.423089    4060 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/42e634cc-318c-4d38-892d-933d68c2db39-trusted-ca\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:35:25.423187 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:25.423132    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/42e634cc-318c-4d38-892d-933d68c2db39-config-openshift-service-cacrt" pod "42e634cc-318c-4d38-892d-933d68c2db39" (UID: "42e634cc-318c-4d38-892d-933d68c2db39"). InnerVolumeSpecName "config-openshift-service-cacrt". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:35:25.423442 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:25.423261    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/42e634cc-318c-4d38-892d-933d68c2db39-config" pod "42e634cc-318c-4d38-892d-933d68c2db39" (UID: "42e634cc-318c-4d38-892d-933d68c2db39"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:35:25.424909 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:25.424866    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/42e634cc-318c-4d38-892d-933d68c2db39-sa-token" pod "42e634cc-318c-4d38-892d-933d68c2db39" (UID: "42e634cc-318c-4d38-892d-933d68c2db39"). InnerVolumeSpecName "sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:35:25.425264 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:25.425232    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/42e634cc-318c-4d38-892d-933d68c2db39-kube-api-access-tw9hh" pod "42e634cc-318c-4d38-892d-933d68c2db39" (UID: "42e634cc-318c-4d38-892d-933d68c2db39"). InnerVolumeSpecName "kube-api-access-tw9hh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:35:25.425525 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:25.425479    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/42e634cc-318c-4d38-892d-933d68c2db39-metrics" pod "42e634cc-318c-4d38-892d-933d68c2db39" (UID: "42e634cc-318c-4d38-892d-933d68c2db39"). InnerVolumeSpecName "metrics". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:35:25.425648 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:25.425534    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/42e634cc-318c-4d38-892d-933d68c2db39-data-science-cluster-log-forwarder-collector-token" pod "42e634cc-318c-4d38-892d-933d68c2db39" (UID: "42e634cc-318c-4d38-892d-933d68c2db39"). InnerVolumeSpecName "data-science-cluster-log-forwarder-collector-token". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:35:25.426226 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:25.426207    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/42e634cc-318c-4d38-892d-933d68c2db39-tmp" pod "42e634cc-318c-4d38-892d-933d68c2db39" (UID: "42e634cc-318c-4d38-892d-933d68c2db39"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:35:25.427851 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:25.427832    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/42e634cc-318c-4d38-892d-933d68c2db39-entrypoint" pod "42e634cc-318c-4d38-892d-933d68c2db39" (UID: "42e634cc-318c-4d38-892d-933d68c2db39"). InnerVolumeSpecName "entrypoint". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:35:25.523939 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:25.523898    4060 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/42e634cc-318c-4d38-892d-933d68c2db39-tmp\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:35:25.524109 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:25.523950    4060 reconciler_common.go:299] "Volume detached for volume \"config-openshift-service-cacrt\" (UniqueName: \"kubernetes.io/configmap/42e634cc-318c-4d38-892d-933d68c2db39-config-openshift-service-cacrt\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:35:25.524109 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:25.523967    4060 reconciler_common.go:299] "Volume detached for volume \"metrics\" (UniqueName: \"kubernetes.io/secret/42e634cc-318c-4d38-892d-933d68c2db39-metrics\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:35:25.524109 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:25.523981    4060 reconciler_common.go:299] "Volume detached for volume \"data-science-cluster-log-forwarder-collector-token\" (UniqueName: \"kubernetes.io/secret/42e634cc-318c-4d38-892d-933d68c2db39-data-science-cluster-log-forwarder-collector-token\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:35:25.524248 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:25.524153    4060 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/42e634cc-318c-4d38-892d-933d68c2db39-config\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:35:25.524248 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:25.524186    4060 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tw9hh\" (UniqueName: \"kubernetes.io/projected/42e634cc-318c-4d38-892d-933d68c2db39-kube-api-access-tw9hh\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:35:25.524248 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:25.524208    4060 reconciler_common.go:299] "Volume detached for volume \"sa-token\" (UniqueName: \"kubernetes.io/projected/42e634cc-318c-4d38-892d-933d68c2db39-sa-token\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:35:25.524248 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:25.524221    4060 reconciler_common.go:299] "Volume detached for volume \"entrypoint\" (UniqueName: \"kubernetes.io/configmap/42e634cc-318c-4d38-892d-933d68c2db39-entrypoint\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:35:25.535112 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:25.535080    4060 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-logging/data-science-cluster-log-forwarder-kkhdh"]
Oct 30 21:35:25.535419 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:25.535405    4060 cpu_manager.go:414] "containerMap: removing container" podUID="42e634cc-318c-4d38-892d-933d68c2db39" containerName="collector"
Oct 30 21:35:25.535459 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:25.535421    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="42e634cc-318c-4d38-892d-933d68c2db39" containerName="collector"
Oct 30 21:35:25.535515 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:25.535501    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="42e634cc-318c-4d38-892d-933d68c2db39" containerName="collector"
Oct 30 21:35:25.539480 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:25.539465    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-logging/data-science-cluster-log-forwarder-kkhdh"
Oct 30 21:35:25.604766 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:25.604686    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-logging/data-science-cluster-log-forwarder-kkhdh"]
Oct 30 21:35:25.625525 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:25.625486    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sa-token\" (UniqueName: \"kubernetes.io/projected/39ca921b-4dd1-4948-b603-cdf6ee28e011-sa-token\") pod \"data-science-cluster-log-forwarder-kkhdh\" (UID: \"39ca921b-4dd1-4948-b603-cdf6ee28e011\") " pod="openshift-logging/data-science-cluster-log-forwarder-kkhdh"
Oct 30 21:35:25.625525 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:25.625536    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"varlogpods\" (UniqueName: \"kubernetes.io/host-path/39ca921b-4dd1-4948-b603-cdf6ee28e011-varlogpods\") pod \"data-science-cluster-log-forwarder-kkhdh\" (UID: \"39ca921b-4dd1-4948-b603-cdf6ee28e011\") " pod="openshift-logging/data-science-cluster-log-forwarder-kkhdh"
Oct 30 21:35:25.625756 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:25.625562    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-openshift-service-cacrt\" (UniqueName: \"kubernetes.io/configmap/39ca921b-4dd1-4948-b603-cdf6ee28e011-config-openshift-service-cacrt\") pod \"data-science-cluster-log-forwarder-kkhdh\" (UID: \"39ca921b-4dd1-4948-b603-cdf6ee28e011\") " pod="openshift-logging/data-science-cluster-log-forwarder-kkhdh"
Oct 30 21:35:25.625756 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:25.625651    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/39ca921b-4dd1-4948-b603-cdf6ee28e011-config\") pod \"data-science-cluster-log-forwarder-kkhdh\" (UID: \"39ca921b-4dd1-4948-b603-cdf6ee28e011\") " pod="openshift-logging/data-science-cluster-log-forwarder-kkhdh"
Oct 30 21:35:25.625867 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:25.625769    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-cluster-log-forwarder-collector-token\" (UniqueName: \"kubernetes.io/secret/39ca921b-4dd1-4948-b603-cdf6ee28e011-data-science-cluster-log-forwarder-collector-token\") pod \"data-science-cluster-log-forwarder-kkhdh\" (UID: \"39ca921b-4dd1-4948-b603-cdf6ee28e011\") " pod="openshift-logging/data-science-cluster-log-forwarder-kkhdh"
Oct 30 21:35:25.625867 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:25.625810    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics\" (UniqueName: \"kubernetes.io/secret/39ca921b-4dd1-4948-b603-cdf6ee28e011-metrics\") pod \"data-science-cluster-log-forwarder-kkhdh\" (UID: \"39ca921b-4dd1-4948-b603-cdf6ee28e011\") " pod="openshift-logging/data-science-cluster-log-forwarder-kkhdh"
Oct 30 21:35:25.625867 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:25.625839    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"datadir\" (UniqueName: \"kubernetes.io/host-path/39ca921b-4dd1-4948-b603-cdf6ee28e011-datadir\") pod \"data-science-cluster-log-forwarder-kkhdh\" (UID: \"39ca921b-4dd1-4948-b603-cdf6ee28e011\") " pod="openshift-logging/data-science-cluster-log-forwarder-kkhdh"
Oct 30 21:35:25.626010 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:25.625868    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2bgtw\" (UniqueName: \"kubernetes.io/projected/39ca921b-4dd1-4948-b603-cdf6ee28e011-kube-api-access-2bgtw\") pod \"data-science-cluster-log-forwarder-kkhdh\" (UID: \"39ca921b-4dd1-4948-b603-cdf6ee28e011\") " pod="openshift-logging/data-science-cluster-log-forwarder-kkhdh"
Oct 30 21:35:25.626010 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:25.625943    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"entrypoint\" (UniqueName: \"kubernetes.io/configmap/39ca921b-4dd1-4948-b603-cdf6ee28e011-entrypoint\") pod \"data-science-cluster-log-forwarder-kkhdh\" (UID: \"39ca921b-4dd1-4948-b603-cdf6ee28e011\") " pod="openshift-logging/data-science-cluster-log-forwarder-kkhdh"
Oct 30 21:35:25.626010 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:25.626000    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/39ca921b-4dd1-4948-b603-cdf6ee28e011-tmp\") pod \"data-science-cluster-log-forwarder-kkhdh\" (UID: \"39ca921b-4dd1-4948-b603-cdf6ee28e011\") " pod="openshift-logging/data-science-cluster-log-forwarder-kkhdh"
Oct 30 21:35:25.626099 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:25.626048    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/39ca921b-4dd1-4948-b603-cdf6ee28e011-trusted-ca\") pod \"data-science-cluster-log-forwarder-kkhdh\" (UID: \"39ca921b-4dd1-4948-b603-cdf6ee28e011\") " pod="openshift-logging/data-science-cluster-log-forwarder-kkhdh"
Oct 30 21:35:25.726803 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:25.726766    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sa-token\" (UniqueName: \"kubernetes.io/projected/39ca921b-4dd1-4948-b603-cdf6ee28e011-sa-token\") pod \"data-science-cluster-log-forwarder-kkhdh\" (UID: \"39ca921b-4dd1-4948-b603-cdf6ee28e011\") " pod="openshift-logging/data-science-cluster-log-forwarder-kkhdh"
Oct 30 21:35:25.726803 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:25.726807    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"varlogpods\" (UniqueName: \"kubernetes.io/host-path/39ca921b-4dd1-4948-b603-cdf6ee28e011-varlogpods\") pod \"data-science-cluster-log-forwarder-kkhdh\" (UID: \"39ca921b-4dd1-4948-b603-cdf6ee28e011\") " pod="openshift-logging/data-science-cluster-log-forwarder-kkhdh"
Oct 30 21:35:25.727060 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:25.726826    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-openshift-service-cacrt\" (UniqueName: \"kubernetes.io/configmap/39ca921b-4dd1-4948-b603-cdf6ee28e011-config-openshift-service-cacrt\") pod \"data-science-cluster-log-forwarder-kkhdh\" (UID: \"39ca921b-4dd1-4948-b603-cdf6ee28e011\") " pod="openshift-logging/data-science-cluster-log-forwarder-kkhdh"
Oct 30 21:35:25.727060 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:25.726894    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"varlogpods\" (UniqueName: \"kubernetes.io/host-path/39ca921b-4dd1-4948-b603-cdf6ee28e011-varlogpods\") pod \"data-science-cluster-log-forwarder-kkhdh\" (UID: \"39ca921b-4dd1-4948-b603-cdf6ee28e011\") " pod="openshift-logging/data-science-cluster-log-forwarder-kkhdh"
Oct 30 21:35:25.727060 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:25.726978    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/39ca921b-4dd1-4948-b603-cdf6ee28e011-config\") pod \"data-science-cluster-log-forwarder-kkhdh\" (UID: \"39ca921b-4dd1-4948-b603-cdf6ee28e011\") " pod="openshift-logging/data-science-cluster-log-forwarder-kkhdh"
Oct 30 21:35:25.727060 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:25.727042    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-cluster-log-forwarder-collector-token\" (UniqueName: \"kubernetes.io/secret/39ca921b-4dd1-4948-b603-cdf6ee28e011-data-science-cluster-log-forwarder-collector-token\") pod \"data-science-cluster-log-forwarder-kkhdh\" (UID: \"39ca921b-4dd1-4948-b603-cdf6ee28e011\") " pod="openshift-logging/data-science-cluster-log-forwarder-kkhdh"
Oct 30 21:35:25.727293 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:25.727075    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics\" (UniqueName: \"kubernetes.io/secret/39ca921b-4dd1-4948-b603-cdf6ee28e011-metrics\") pod \"data-science-cluster-log-forwarder-kkhdh\" (UID: \"39ca921b-4dd1-4948-b603-cdf6ee28e011\") " pod="openshift-logging/data-science-cluster-log-forwarder-kkhdh"
Oct 30 21:35:25.727293 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:25.727104    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"datadir\" (UniqueName: \"kubernetes.io/host-path/39ca921b-4dd1-4948-b603-cdf6ee28e011-datadir\") pod \"data-science-cluster-log-forwarder-kkhdh\" (UID: \"39ca921b-4dd1-4948-b603-cdf6ee28e011\") " pod="openshift-logging/data-science-cluster-log-forwarder-kkhdh"
Oct 30 21:35:25.727293 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:25.727136    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2bgtw\" (UniqueName: \"kubernetes.io/projected/39ca921b-4dd1-4948-b603-cdf6ee28e011-kube-api-access-2bgtw\") pod \"data-science-cluster-log-forwarder-kkhdh\" (UID: \"39ca921b-4dd1-4948-b603-cdf6ee28e011\") " pod="openshift-logging/data-science-cluster-log-forwarder-kkhdh"
Oct 30 21:35:25.727293 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:25.727163    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"entrypoint\" (UniqueName: \"kubernetes.io/configmap/39ca921b-4dd1-4948-b603-cdf6ee28e011-entrypoint\") pod \"data-science-cluster-log-forwarder-kkhdh\" (UID: \"39ca921b-4dd1-4948-b603-cdf6ee28e011\") " pod="openshift-logging/data-science-cluster-log-forwarder-kkhdh"
Oct 30 21:35:25.727293 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:25.727205    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/39ca921b-4dd1-4948-b603-cdf6ee28e011-tmp\") pod \"data-science-cluster-log-forwarder-kkhdh\" (UID: \"39ca921b-4dd1-4948-b603-cdf6ee28e011\") " pod="openshift-logging/data-science-cluster-log-forwarder-kkhdh"
Oct 30 21:35:25.727293 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:25.727220    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"datadir\" (UniqueName: \"kubernetes.io/host-path/39ca921b-4dd1-4948-b603-cdf6ee28e011-datadir\") pod \"data-science-cluster-log-forwarder-kkhdh\" (UID: \"39ca921b-4dd1-4948-b603-cdf6ee28e011\") " pod="openshift-logging/data-science-cluster-log-forwarder-kkhdh"
Oct 30 21:35:25.727293 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:25.727276    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/39ca921b-4dd1-4948-b603-cdf6ee28e011-trusted-ca\") pod \"data-science-cluster-log-forwarder-kkhdh\" (UID: \"39ca921b-4dd1-4948-b603-cdf6ee28e011\") " pod="openshift-logging/data-science-cluster-log-forwarder-kkhdh"
Oct 30 21:35:25.727661 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:25.727543    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-openshift-service-cacrt\" (UniqueName: \"kubernetes.io/configmap/39ca921b-4dd1-4948-b603-cdf6ee28e011-config-openshift-service-cacrt\") pod \"data-science-cluster-log-forwarder-kkhdh\" (UID: \"39ca921b-4dd1-4948-b603-cdf6ee28e011\") " pod="openshift-logging/data-science-cluster-log-forwarder-kkhdh"
Oct 30 21:35:25.727752 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:25.727732    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/39ca921b-4dd1-4948-b603-cdf6ee28e011-config\") pod \"data-science-cluster-log-forwarder-kkhdh\" (UID: \"39ca921b-4dd1-4948-b603-cdf6ee28e011\") " pod="openshift-logging/data-science-cluster-log-forwarder-kkhdh"
Oct 30 21:35:25.728002 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:25.727976    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"entrypoint\" (UniqueName: \"kubernetes.io/configmap/39ca921b-4dd1-4948-b603-cdf6ee28e011-entrypoint\") pod \"data-science-cluster-log-forwarder-kkhdh\" (UID: \"39ca921b-4dd1-4948-b603-cdf6ee28e011\") " pod="openshift-logging/data-science-cluster-log-forwarder-kkhdh"
Oct 30 21:35:25.728096 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:25.728044    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/39ca921b-4dd1-4948-b603-cdf6ee28e011-trusted-ca\") pod \"data-science-cluster-log-forwarder-kkhdh\" (UID: \"39ca921b-4dd1-4948-b603-cdf6ee28e011\") " pod="openshift-logging/data-science-cluster-log-forwarder-kkhdh"
Oct 30 21:35:25.729570 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:25.729550    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/39ca921b-4dd1-4948-b603-cdf6ee28e011-tmp\") pod \"data-science-cluster-log-forwarder-kkhdh\" (UID: \"39ca921b-4dd1-4948-b603-cdf6ee28e011\") " pod="openshift-logging/data-science-cluster-log-forwarder-kkhdh"
Oct 30 21:35:25.729659 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:25.729573    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics\" (UniqueName: \"kubernetes.io/secret/39ca921b-4dd1-4948-b603-cdf6ee28e011-metrics\") pod \"data-science-cluster-log-forwarder-kkhdh\" (UID: \"39ca921b-4dd1-4948-b603-cdf6ee28e011\") " pod="openshift-logging/data-science-cluster-log-forwarder-kkhdh"
Oct 30 21:35:25.729710 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:25.729694    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-cluster-log-forwarder-collector-token\" (UniqueName: \"kubernetes.io/secret/39ca921b-4dd1-4948-b603-cdf6ee28e011-data-science-cluster-log-forwarder-collector-token\") pod \"data-science-cluster-log-forwarder-kkhdh\" (UID: \"39ca921b-4dd1-4948-b603-cdf6ee28e011\") " pod="openshift-logging/data-science-cluster-log-forwarder-kkhdh"
Oct 30 21:35:25.787814 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:25.787783    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sa-token\" (UniqueName: \"kubernetes.io/projected/39ca921b-4dd1-4948-b603-cdf6ee28e011-sa-token\") pod \"data-science-cluster-log-forwarder-kkhdh\" (UID: \"39ca921b-4dd1-4948-b603-cdf6ee28e011\") " pod="openshift-logging/data-science-cluster-log-forwarder-kkhdh"
Oct 30 21:35:25.787960 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:25.787833    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2bgtw\" (UniqueName: \"kubernetes.io/projected/39ca921b-4dd1-4948-b603-cdf6ee28e011-kube-api-access-2bgtw\") pod \"data-science-cluster-log-forwarder-kkhdh\" (UID: \"39ca921b-4dd1-4948-b603-cdf6ee28e011\") " pod="openshift-logging/data-science-cluster-log-forwarder-kkhdh"
Oct 30 21:35:25.851942 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:25.851909    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-logging/data-science-cluster-log-forwarder-kkhdh"
Oct 30 21:35:26.085365 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:26.085327    4060 generic.go:356] "Generic (PLEG): container finished" podID="42e634cc-318c-4d38-892d-933d68c2db39" containerID="22c1ac05f8da0febbd6c1aa4aff8588e274d2878e168e0346d9e06abd83da68e" exitCode=0
Oct 30 21:35:26.085807 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:26.085381    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-logging/data-science-cluster-log-forwarder-55fzw"
Oct 30 21:35:26.085807 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:26.085405    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-logging/data-science-cluster-log-forwarder-55fzw" event={"ID":"42e634cc-318c-4d38-892d-933d68c2db39","Type":"ContainerDied","Data":"22c1ac05f8da0febbd6c1aa4aff8588e274d2878e168e0346d9e06abd83da68e"}
Oct 30 21:35:26.085807 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:26.085455    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-logging/data-science-cluster-log-forwarder-55fzw" event={"ID":"42e634cc-318c-4d38-892d-933d68c2db39","Type":"ContainerDied","Data":"be6263536343920ffe3d85e74f3e5a5996a491805650c7df5e1d489d100c3182"}
Oct 30 21:35:26.085807 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:26.085476    4060 scope.go:122] "RemoveContainer" containerID="22c1ac05f8da0febbd6c1aa4aff8588e274d2878e168e0346d9e06abd83da68e"
Oct 30 21:35:26.094383 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:26.094368    4060 scope.go:122] "RemoveContainer" containerID="22c1ac05f8da0febbd6c1aa4aff8588e274d2878e168e0346d9e06abd83da68e"
Oct 30 21:35:26.094663 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:35:26.094644    4060 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"22c1ac05f8da0febbd6c1aa4aff8588e274d2878e168e0346d9e06abd83da68e\": container with ID starting with 22c1ac05f8da0febbd6c1aa4aff8588e274d2878e168e0346d9e06abd83da68e not found: ID does not exist" containerID="22c1ac05f8da0febbd6c1aa4aff8588e274d2878e168e0346d9e06abd83da68e"
Oct 30 21:35:26.094743 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:26.094671    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"22c1ac05f8da0febbd6c1aa4aff8588e274d2878e168e0346d9e06abd83da68e"} err="failed to get container status \"22c1ac05f8da0febbd6c1aa4aff8588e274d2878e168e0346d9e06abd83da68e\": rpc error: code = NotFound desc = could not find container \"22c1ac05f8da0febbd6c1aa4aff8588e274d2878e168e0346d9e06abd83da68e\": container with ID starting with 22c1ac05f8da0febbd6c1aa4aff8588e274d2878e168e0346d9e06abd83da68e not found: ID does not exist"
Oct 30 21:35:26.249533 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:26.249481    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-logging/data-science-cluster-log-forwarder-55fzw"]
Oct 30 21:35:26.298971 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:26.298918    4060 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-logging/data-science-cluster-log-forwarder-55fzw"]
Oct 30 21:35:26.303551 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:26.302096    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-logging/data-science-cluster-log-forwarder-kkhdh"]
Oct 30 21:35:26.310049 ip-10-0-142-4 kubenswrapper[4060]: W1030 21:35:26.310020    4060 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39ca921b_4dd1_4948_b603_cdf6ee28e011.slice/crio-5a63f496815346fdb0098e52e50920b65b6bb718f7a9eebc6d8e077c92b35b3b WatchSource:0}: Error finding container 5a63f496815346fdb0098e52e50920b65b6bb718f7a9eebc6d8e077c92b35b3b: Status 404 returned error can't find the container with id 5a63f496815346fdb0098e52e50920b65b6bb718f7a9eebc6d8e077c92b35b3b
Oct 30 21:35:27.092155 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:27.092119    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-logging/data-science-cluster-log-forwarder-kkhdh" event={"ID":"39ca921b-4dd1-4948-b603-cdf6ee28e011","Type":"ContainerStarted","Data":"0874bc72eec98c08cad19d0dc3a9f59c7c5aed2f285a71fa9be0e5b54b859042"}
Oct 30 21:35:27.092596 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:27.092200    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-logging/data-science-cluster-log-forwarder-kkhdh" event={"ID":"39ca921b-4dd1-4948-b603-cdf6ee28e011","Type":"ContainerStarted","Data":"5a63f496815346fdb0098e52e50920b65b6bb718f7a9eebc6d8e077c92b35b3b"}
Oct 30 21:35:27.220013 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:27.219965    4060 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-logging/data-science-cluster-log-forwarder-kkhdh" podStartSLOduration=2.219950178 podStartE2EDuration="2.219950178s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 21:35:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:35:27.217839553 +0000 UTC m=+3545.974837850" watchObservedRunningTime="2026-10-30 21:35:27.219950178 +0000 UTC m=+3545.976948475"
Oct 30 21:35:27.427060 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:27.426979    4060 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="42e634cc-318c-4d38-892d-933d68c2db39" path="/var/lib/kubelet/pods/42e634cc-318c-4d38-892d-933d68c2db39/volumes"
Oct 30 21:35:35.034870 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:35.034789    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-lokistack-distributor-b854ccfb4-xw9h9"
Oct 30 21:35:36.039970 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:35:36.039942    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-lokistack-query-frontend-5cddddc95c-mtdgf"
Oct 30 21:35:42.150793 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:35:42.150756    4060 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v2f4x" containerName="extractor"
Oct 30 21:36:12.151079 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:36:12.151038    4060 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v2f4x" containerName="extractor"
Oct 30 21:36:42.150732 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:36:42.150696    4060 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v2f4x" containerName="extractor"
Oct 30 21:36:48.266475 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:48.266435    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/korrel8r-5f5775896-txcbx"]
Oct 30 21:36:48.267221 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:48.266690    4060 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/korrel8r-5f5775896-txcbx" podUID="68daa60a-11ed-41f4-9bb2-544035c6da0a" containerName="korrel8r" containerID="cri-o://b235bf16384045ac0920abaf11496f3b0244d7ca5a3a0a71c15ce3fd9ab1fdeb" gracePeriod=30
Oct 30 21:36:48.472858 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:48.472819    4060 generic.go:356] "Generic (PLEG): container finished" podID="68daa60a-11ed-41f4-9bb2-544035c6da0a" containerID="b235bf16384045ac0920abaf11496f3b0244d7ca5a3a0a71c15ce3fd9ab1fdeb" exitCode=0
Oct 30 21:36:48.473039 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:48.472896    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/korrel8r-5f5775896-txcbx" event={"ID":"68daa60a-11ed-41f4-9bb2-544035c6da0a","Type":"ContainerDied","Data":"b235bf16384045ac0920abaf11496f3b0244d7ca5a3a0a71c15ce3fd9ab1fdeb"}
Oct 30 21:36:48.539071 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:36:48.538747    4060 secret.go:189] Couldn't get secret redhat-ods-monitoring/data-science-lokistack-distributor-http: secret "data-science-lokistack-distributor-http" not found
Oct 30 21:36:48.539071 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:36:48.538844    4060 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f99f91ba-56d3-43f3-8256-b0e32d702e43-data-science-lokistack-distributor-http podName:f99f91ba-56d3-43f3-8256-b0e32d702e43 nodeName:}" failed. No retries permitted until 2026-10-30 21:36:49.038821561 +0000 UTC m=+3627.795819843 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "data-science-lokistack-distributor-http" (UniqueName: "kubernetes.io/secret/f99f91ba-56d3-43f3-8256-b0e32d702e43-data-science-lokistack-distributor-http") pod "data-science-lokistack-distributor-b854ccfb4-xw9h9" (UID: "f99f91ba-56d3-43f3-8256-b0e32d702e43") : secret "data-science-lokistack-distributor-http" not found
Oct 30 21:36:48.539071 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:36:48.539035    4060 secret.go:189] Couldn't get secret redhat-ods-monitoring/data-science-lokistack-distributor-grpc: secret "data-science-lokistack-distributor-grpc" not found
Oct 30 21:36:48.539355 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:36:48.539098    4060 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f99f91ba-56d3-43f3-8256-b0e32d702e43-data-science-lokistack-distributor-grpc podName:f99f91ba-56d3-43f3-8256-b0e32d702e43 nodeName:}" failed. No retries permitted until 2026-10-30 21:36:49.039079485 +0000 UTC m=+3627.796077775 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "data-science-lokistack-distributor-grpc" (UniqueName: "kubernetes.io/secret/f99f91ba-56d3-43f3-8256-b0e32d702e43-data-science-lokistack-distributor-grpc") pod "data-science-lokistack-distributor-b854ccfb4-xw9h9" (UID: "f99f91ba-56d3-43f3-8256-b0e32d702e43") : secret "data-science-lokistack-distributor-grpc" not found
Oct 30 21:36:48.548903 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:48.548868    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/korrel8r-5f5775896-txcbx"
Oct 30 21:36:48.740751 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:48.740720    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/68daa60a-11ed-41f4-9bb2-544035c6da0a-kube-api-access-8v9mt\" (UniqueName: \"kubernetes.io/projected/68daa60a-11ed-41f4-9bb2-544035c6da0a-kube-api-access-8v9mt\") pod \"68daa60a-11ed-41f4-9bb2-544035c6da0a\" (UID: \"68daa60a-11ed-41f4-9bb2-544035c6da0a\") "
Oct 30 21:36:48.740940 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:48.740805    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/68daa60a-11ed-41f4-9bb2-544035c6da0a-config\" (UniqueName: \"kubernetes.io/configmap/68daa60a-11ed-41f4-9bb2-544035c6da0a-config\") pod \"68daa60a-11ed-41f4-9bb2-544035c6da0a\" (UID: \"68daa60a-11ed-41f4-9bb2-544035c6da0a\") "
Oct 30 21:36:48.740940 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:48.740890    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/68daa60a-11ed-41f4-9bb2-544035c6da0a-tls\" (UniqueName: \"kubernetes.io/secret/68daa60a-11ed-41f4-9bb2-544035c6da0a-tls\") pod \"68daa60a-11ed-41f4-9bb2-544035c6da0a\" (UID: \"68daa60a-11ed-41f4-9bb2-544035c6da0a\") "
Oct 30 21:36:48.741279 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:48.741249    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/68daa60a-11ed-41f4-9bb2-544035c6da0a-config" pod "68daa60a-11ed-41f4-9bb2-544035c6da0a" (UID: "68daa60a-11ed-41f4-9bb2-544035c6da0a"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:36:48.743136 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:48.743115    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/68daa60a-11ed-41f4-9bb2-544035c6da0a-kube-api-access-8v9mt" pod "68daa60a-11ed-41f4-9bb2-544035c6da0a" (UID: "68daa60a-11ed-41f4-9bb2-544035c6da0a"). InnerVolumeSpecName "kube-api-access-8v9mt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:36:48.743315 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:48.743299    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/68daa60a-11ed-41f4-9bb2-544035c6da0a-tls" pod "68daa60a-11ed-41f4-9bb2-544035c6da0a" (UID: "68daa60a-11ed-41f4-9bb2-544035c6da0a"). InnerVolumeSpecName "tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:36:48.769346 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:48.769316    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-lokistack-distributor-b854ccfb4-xw9h9"]
Oct 30 21:36:48.769534 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:48.769510    4060 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-lokistack-distributor-b854ccfb4-xw9h9" podUID="f99f91ba-56d3-43f3-8256-b0e32d702e43" containerName="loki-distributor" containerID="cri-o://70349b1af2a644b2f769ceba3bf5bd4500624caef35186f16ea983b9c589b42d" gracePeriod=30
Oct 30 21:36:48.771463 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:48.771436    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-lokistack-query-frontend-5cddddc95c-mtdgf"]
Oct 30 21:36:48.771632 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:48.771610    4060 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-lokistack-query-frontend-5cddddc95c-mtdgf" podUID="232ec0c8-fd25-42e5-87ba-a5860d024d55" containerName="loki-query-frontend" containerID="cri-o://e90497f06fa3a47ce39b0338c87c9e37842bbacc9f5c0510eb2cc88a84245412" gracePeriod=30
Oct 30 21:36:48.842276 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:48.842241    4060 reconciler_common.go:299] "Volume detached for volume \"tls\" (UniqueName: \"kubernetes.io/secret/68daa60a-11ed-41f4-9bb2-544035c6da0a-tls\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:36:48.842276 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:48.842272    4060 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8v9mt\" (UniqueName: \"kubernetes.io/projected/68daa60a-11ed-41f4-9bb2-544035c6da0a-kube-api-access-8v9mt\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:36:48.842468 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:48.842285    4060 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/68daa60a-11ed-41f4-9bb2-544035c6da0a-config\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:36:49.009763 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:49.009738    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-lokistack-query-frontend-5cddddc95c-mtdgf"
Oct 30 21:36:49.044017 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:36:49.043952    4060 secret.go:189] Couldn't get secret redhat-ods-monitoring/data-science-lokistack-distributor-http: secret "data-science-lokistack-distributor-http" not found
Oct 30 21:36:49.044017 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:36:49.044014    4060 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f99f91ba-56d3-43f3-8256-b0e32d702e43-data-science-lokistack-distributor-http podName:f99f91ba-56d3-43f3-8256-b0e32d702e43 nodeName:}" failed. No retries permitted until 2026-10-30 21:36:50.044000628 +0000 UTC m=+3628.800998905 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "data-science-lokistack-distributor-http" (UniqueName: "kubernetes.io/secret/f99f91ba-56d3-43f3-8256-b0e32d702e43-data-science-lokistack-distributor-http") pod "data-science-lokistack-distributor-b854ccfb4-xw9h9" (UID: "f99f91ba-56d3-43f3-8256-b0e32d702e43") : secret "data-science-lokistack-distributor-http" not found
Oct 30 21:36:49.044199 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:36:49.043953    4060 secret.go:189] Couldn't get secret redhat-ods-monitoring/data-science-lokistack-distributor-grpc: secret "data-science-lokistack-distributor-grpc" not found
Oct 30 21:36:49.044199 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:36:49.044105    4060 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f99f91ba-56d3-43f3-8256-b0e32d702e43-data-science-lokistack-distributor-grpc podName:f99f91ba-56d3-43f3-8256-b0e32d702e43 nodeName:}" failed. No retries permitted until 2026-10-30 21:36:50.044088982 +0000 UTC m=+3628.801087266 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "data-science-lokistack-distributor-grpc" (UniqueName: "kubernetes.io/secret/f99f91ba-56d3-43f3-8256-b0e32d702e43-data-science-lokistack-distributor-grpc") pod "data-science-lokistack-distributor-b854ccfb4-xw9h9" (UID: "f99f91ba-56d3-43f3-8256-b0e32d702e43") : secret "data-science-lokistack-distributor-grpc" not found
Oct 30 21:36:49.144789 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:49.144757    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/232ec0c8-fd25-42e5-87ba-a5860d024d55-data-science-lokistack-query-frontend-grpc\" (UniqueName: \"kubernetes.io/secret/232ec0c8-fd25-42e5-87ba-a5860d024d55-data-science-lokistack-query-frontend-grpc\") pod \"232ec0c8-fd25-42e5-87ba-a5860d024d55\" (UID: \"232ec0c8-fd25-42e5-87ba-a5860d024d55\") "
Oct 30 21:36:49.144976 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:49.144842    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/232ec0c8-fd25-42e5-87ba-a5860d024d55-data-science-lokistack-query-frontend-http\" (UniqueName: \"kubernetes.io/secret/232ec0c8-fd25-42e5-87ba-a5860d024d55-data-science-lokistack-query-frontend-http\") pod \"232ec0c8-fd25-42e5-87ba-a5860d024d55\" (UID: \"232ec0c8-fd25-42e5-87ba-a5860d024d55\") "
Oct 30 21:36:49.144976 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:49.144900    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/232ec0c8-fd25-42e5-87ba-a5860d024d55-config\" (UniqueName: \"kubernetes.io/configmap/232ec0c8-fd25-42e5-87ba-a5860d024d55-config\") pod \"232ec0c8-fd25-42e5-87ba-a5860d024d55\" (UID: \"232ec0c8-fd25-42e5-87ba-a5860d024d55\") "
Oct 30 21:36:49.144976 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:49.144940    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/232ec0c8-fd25-42e5-87ba-a5860d024d55-data-science-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/232ec0c8-fd25-42e5-87ba-a5860d024d55-data-science-lokistack-ca-bundle\") pod \"232ec0c8-fd25-42e5-87ba-a5860d024d55\" (UID: \"232ec0c8-fd25-42e5-87ba-a5860d024d55\") "
Oct 30 21:36:49.145147 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:49.144974    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/232ec0c8-fd25-42e5-87ba-a5860d024d55-kube-api-access-kqqw8\" (UniqueName: \"kubernetes.io/projected/232ec0c8-fd25-42e5-87ba-a5860d024d55-kube-api-access-kqqw8\") pod \"232ec0c8-fd25-42e5-87ba-a5860d024d55\" (UID: \"232ec0c8-fd25-42e5-87ba-a5860d024d55\") "
Oct 30 21:36:49.145349 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:49.145312    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/232ec0c8-fd25-42e5-87ba-a5860d024d55-config" pod "232ec0c8-fd25-42e5-87ba-a5860d024d55" (UID: "232ec0c8-fd25-42e5-87ba-a5860d024d55"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:36:49.145681 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:49.145652    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/232ec0c8-fd25-42e5-87ba-a5860d024d55-data-science-lokistack-ca-bundle" pod "232ec0c8-fd25-42e5-87ba-a5860d024d55" (UID: "232ec0c8-fd25-42e5-87ba-a5860d024d55"). InnerVolumeSpecName "data-science-lokistack-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:36:49.147303 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:49.147274    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/232ec0c8-fd25-42e5-87ba-a5860d024d55-data-science-lokistack-query-frontend-http" pod "232ec0c8-fd25-42e5-87ba-a5860d024d55" (UID: "232ec0c8-fd25-42e5-87ba-a5860d024d55"). InnerVolumeSpecName "data-science-lokistack-query-frontend-http". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:36:49.147408 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:49.147335    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/232ec0c8-fd25-42e5-87ba-a5860d024d55-data-science-lokistack-query-frontend-grpc" pod "232ec0c8-fd25-42e5-87ba-a5860d024d55" (UID: "232ec0c8-fd25-42e5-87ba-a5860d024d55"). InnerVolumeSpecName "data-science-lokistack-query-frontend-grpc". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:36:49.147587 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:49.147563    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/232ec0c8-fd25-42e5-87ba-a5860d024d55-kube-api-access-kqqw8" pod "232ec0c8-fd25-42e5-87ba-a5860d024d55" (UID: "232ec0c8-fd25-42e5-87ba-a5860d024d55"). InnerVolumeSpecName "kube-api-access-kqqw8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:36:49.246593 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:49.246552    4060 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/232ec0c8-fd25-42e5-87ba-a5860d024d55-config\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:36:49.246593 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:49.246587    4060 reconciler_common.go:299] "Volume detached for volume \"data-science-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/232ec0c8-fd25-42e5-87ba-a5860d024d55-data-science-lokistack-ca-bundle\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:36:49.246593 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:49.246601    4060 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kqqw8\" (UniqueName: \"kubernetes.io/projected/232ec0c8-fd25-42e5-87ba-a5860d024d55-kube-api-access-kqqw8\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:36:49.246839 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:49.246614    4060 reconciler_common.go:299] "Volume detached for volume \"data-science-lokistack-query-frontend-grpc\" (UniqueName: \"kubernetes.io/secret/232ec0c8-fd25-42e5-87ba-a5860d024d55-data-science-lokistack-query-frontend-grpc\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:36:49.246839 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:49.246627    4060 reconciler_common.go:299] "Volume detached for volume \"data-science-lokistack-query-frontend-http\" (UniqueName: \"kubernetes.io/secret/232ec0c8-fd25-42e5-87ba-a5860d024d55-data-science-lokistack-query-frontend-http\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:36:49.479152 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:49.479127    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/korrel8r-5f5775896-txcbx"
Oct 30 21:36:49.479621 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:49.479154    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/korrel8r-5f5775896-txcbx" event={"ID":"68daa60a-11ed-41f4-9bb2-544035c6da0a","Type":"ContainerDied","Data":"d657b1ff9752c9b96e21a5c0933d880a56e887b0742f127ac9fd770377311dd0"}
Oct 30 21:36:49.479621 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:49.479212    4060 scope.go:122] "RemoveContainer" containerID="b235bf16384045ac0920abaf11496f3b0244d7ca5a3a0a71c15ce3fd9ab1fdeb"
Oct 30 21:36:49.480579 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:49.480463    4060 generic.go:356] "Generic (PLEG): container finished" podID="232ec0c8-fd25-42e5-87ba-a5860d024d55" containerID="e90497f06fa3a47ce39b0338c87c9e37842bbacc9f5c0510eb2cc88a84245412" exitCode=0
Oct 30 21:36:49.480579 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:49.480514    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-lokistack-query-frontend-5cddddc95c-mtdgf"
Oct 30 21:36:49.480579 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:49.480519    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-lokistack-query-frontend-5cddddc95c-mtdgf" event={"ID":"232ec0c8-fd25-42e5-87ba-a5860d024d55","Type":"ContainerDied","Data":"e90497f06fa3a47ce39b0338c87c9e37842bbacc9f5c0510eb2cc88a84245412"}
Oct 30 21:36:49.480579 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:49.480554    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-lokistack-query-frontend-5cddddc95c-mtdgf" event={"ID":"232ec0c8-fd25-42e5-87ba-a5860d024d55","Type":"ContainerDied","Data":"af0ee5b1cd3a4d46bfe21366f6cce600742b2dd053a0c17efef0416ae07ca90c"}
Oct 30 21:36:49.487083 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:49.487061    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-logging/data-science-cluster-log-forwarder-kkhdh"]
Oct 30 21:36:49.487232 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:49.487214    4060 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-logging/data-science-cluster-log-forwarder-kkhdh" podUID="39ca921b-4dd1-4948-b603-cdf6ee28e011" containerName="collector" containerID="cri-o://0874bc72eec98c08cad19d0dc3a9f59c7c5aed2f285a71fa9be0e5b54b859042" gracePeriod=10
Oct 30 21:36:49.488700 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:49.488682    4060 scope.go:122] "RemoveContainer" containerID="e90497f06fa3a47ce39b0338c87c9e37842bbacc9f5c0510eb2cc88a84245412"
Oct 30 21:36:49.496933 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:49.496917    4060 scope.go:122] "RemoveContainer" containerID="e90497f06fa3a47ce39b0338c87c9e37842bbacc9f5c0510eb2cc88a84245412"
Oct 30 21:36:49.497227 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:36:49.497204    4060 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e90497f06fa3a47ce39b0338c87c9e37842bbacc9f5c0510eb2cc88a84245412\": container with ID starting with e90497f06fa3a47ce39b0338c87c9e37842bbacc9f5c0510eb2cc88a84245412 not found: ID does not exist" containerID="e90497f06fa3a47ce39b0338c87c9e37842bbacc9f5c0510eb2cc88a84245412"
Oct 30 21:36:49.497345 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:49.497232    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e90497f06fa3a47ce39b0338c87c9e37842bbacc9f5c0510eb2cc88a84245412"} err="failed to get container status \"e90497f06fa3a47ce39b0338c87c9e37842bbacc9f5c0510eb2cc88a84245412\": rpc error: code = NotFound desc = could not find container \"e90497f06fa3a47ce39b0338c87c9e37842bbacc9f5c0510eb2cc88a84245412\": container with ID starting with e90497f06fa3a47ce39b0338c87c9e37842bbacc9f5c0510eb2cc88a84245412 not found: ID does not exist"
Oct 30 21:36:49.743446 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:49.743425    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-logging/data-science-cluster-log-forwarder-kkhdh"
Oct 30 21:36:49.750636 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:49.750617    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/39ca921b-4dd1-4948-b603-cdf6ee28e011-tmp\" (UniqueName: \"kubernetes.io/empty-dir/39ca921b-4dd1-4948-b603-cdf6ee28e011-tmp\") pod \"39ca921b-4dd1-4948-b603-cdf6ee28e011\" (UID: \"39ca921b-4dd1-4948-b603-cdf6ee28e011\") "
Oct 30 21:36:49.750714 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:49.750667    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/host-path/39ca921b-4dd1-4948-b603-cdf6ee28e011-varlogpods\" (UniqueName: \"kubernetes.io/host-path/39ca921b-4dd1-4948-b603-cdf6ee28e011-varlogpods\") pod \"39ca921b-4dd1-4948-b603-cdf6ee28e011\" (UID: \"39ca921b-4dd1-4948-b603-cdf6ee28e011\") "
Oct 30 21:36:49.750714 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:49.750691    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/39ca921b-4dd1-4948-b603-cdf6ee28e011-kube-api-access-2bgtw\" (UniqueName: \"kubernetes.io/projected/39ca921b-4dd1-4948-b603-cdf6ee28e011-kube-api-access-2bgtw\") pod \"39ca921b-4dd1-4948-b603-cdf6ee28e011\" (UID: \"39ca921b-4dd1-4948-b603-cdf6ee28e011\") "
Oct 30 21:36:49.750714 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:49.750711    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/39ca921b-4dd1-4948-b603-cdf6ee28e011-sa-token\" (UniqueName: \"kubernetes.io/projected/39ca921b-4dd1-4948-b603-cdf6ee28e011-sa-token\") pod \"39ca921b-4dd1-4948-b603-cdf6ee28e011\" (UID: \"39ca921b-4dd1-4948-b603-cdf6ee28e011\") "
Oct 30 21:36:49.750829 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:49.750746    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/39ca921b-4dd1-4948-b603-cdf6ee28e011-config-openshift-service-cacrt\" (UniqueName: \"kubernetes.io/configmap/39ca921b-4dd1-4948-b603-cdf6ee28e011-config-openshift-service-cacrt\") pod \"39ca921b-4dd1-4948-b603-cdf6ee28e011\" (UID: \"39ca921b-4dd1-4948-b603-cdf6ee28e011\") "
Oct 30 21:36:49.750829 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:49.750767    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/39ca921b-4dd1-4948-b603-cdf6ee28e011-varlogpods" pod "39ca921b-4dd1-4948-b603-cdf6ee28e011" (UID: "39ca921b-4dd1-4948-b603-cdf6ee28e011"). InnerVolumeSpecName "varlogpods". PluginName "kubernetes.io/host-path", VolumeGIDValue ""
Oct 30 21:36:49.750829 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:49.750776    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/39ca921b-4dd1-4948-b603-cdf6ee28e011-entrypoint\" (UniqueName: \"kubernetes.io/configmap/39ca921b-4dd1-4948-b603-cdf6ee28e011-entrypoint\") pod \"39ca921b-4dd1-4948-b603-cdf6ee28e011\" (UID: \"39ca921b-4dd1-4948-b603-cdf6ee28e011\") "
Oct 30 21:36:49.751002 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:49.750825    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/39ca921b-4dd1-4948-b603-cdf6ee28e011-config\" (UniqueName: \"kubernetes.io/configmap/39ca921b-4dd1-4948-b603-cdf6ee28e011-config\") pod \"39ca921b-4dd1-4948-b603-cdf6ee28e011\" (UID: \"39ca921b-4dd1-4948-b603-cdf6ee28e011\") "
Oct 30 21:36:49.751002 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:49.750852    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/39ca921b-4dd1-4948-b603-cdf6ee28e011-metrics\" (UniqueName: \"kubernetes.io/secret/39ca921b-4dd1-4948-b603-cdf6ee28e011-metrics\") pod \"39ca921b-4dd1-4948-b603-cdf6ee28e011\" (UID: \"39ca921b-4dd1-4948-b603-cdf6ee28e011\") "
Oct 30 21:36:49.751158 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:49.751137    4060 reconciler_common.go:299] "Volume detached for volume \"varlogpods\" (UniqueName: \"kubernetes.io/host-path/39ca921b-4dd1-4948-b603-cdf6ee28e011-varlogpods\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:36:49.751217 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:49.751168    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/39ca921b-4dd1-4948-b603-cdf6ee28e011-config-openshift-service-cacrt" pod "39ca921b-4dd1-4948-b603-cdf6ee28e011" (UID: "39ca921b-4dd1-4948-b603-cdf6ee28e011"). InnerVolumeSpecName "config-openshift-service-cacrt". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:36:49.751386 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:49.751356    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/39ca921b-4dd1-4948-b603-cdf6ee28e011-config" pod "39ca921b-4dd1-4948-b603-cdf6ee28e011" (UID: "39ca921b-4dd1-4948-b603-cdf6ee28e011"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:36:49.752824 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:49.752799    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/39ca921b-4dd1-4948-b603-cdf6ee28e011-tmp" pod "39ca921b-4dd1-4948-b603-cdf6ee28e011" (UID: "39ca921b-4dd1-4948-b603-cdf6ee28e011"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:36:49.752924 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:49.752881    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/39ca921b-4dd1-4948-b603-cdf6ee28e011-kube-api-access-2bgtw" pod "39ca921b-4dd1-4948-b603-cdf6ee28e011" (UID: "39ca921b-4dd1-4948-b603-cdf6ee28e011"). InnerVolumeSpecName "kube-api-access-2bgtw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:36:49.753154 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:49.753131    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/39ca921b-4dd1-4948-b603-cdf6ee28e011-metrics" pod "39ca921b-4dd1-4948-b603-cdf6ee28e011" (UID: "39ca921b-4dd1-4948-b603-cdf6ee28e011"). InnerVolumeSpecName "metrics". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:36:49.753325 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:49.753306    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/39ca921b-4dd1-4948-b603-cdf6ee28e011-sa-token" pod "39ca921b-4dd1-4948-b603-cdf6ee28e011" (UID: "39ca921b-4dd1-4948-b603-cdf6ee28e011"). InnerVolumeSpecName "sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:36:49.755662 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:49.755636    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/39ca921b-4dd1-4948-b603-cdf6ee28e011-entrypoint" pod "39ca921b-4dd1-4948-b603-cdf6ee28e011" (UID: "39ca921b-4dd1-4948-b603-cdf6ee28e011"). InnerVolumeSpecName "entrypoint". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:36:49.767363 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:49.767341    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-lokistack-query-frontend-5cddddc95c-mtdgf"]
Oct 30 21:36:49.771432 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:49.771408    4060 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-lokistack-query-frontend-5cddddc95c-mtdgf"]
Oct 30 21:36:49.852218 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:49.852182    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/39ca921b-4dd1-4948-b603-cdf6ee28e011-data-science-cluster-log-forwarder-collector-token\" (UniqueName: \"kubernetes.io/secret/39ca921b-4dd1-4948-b603-cdf6ee28e011-data-science-cluster-log-forwarder-collector-token\") pod \"39ca921b-4dd1-4948-b603-cdf6ee28e011\" (UID: \"39ca921b-4dd1-4948-b603-cdf6ee28e011\") "
Oct 30 21:36:49.852387 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:49.852231    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/39ca921b-4dd1-4948-b603-cdf6ee28e011-trusted-ca\" (UniqueName: \"kubernetes.io/configmap/39ca921b-4dd1-4948-b603-cdf6ee28e011-trusted-ca\") pod \"39ca921b-4dd1-4948-b603-cdf6ee28e011\" (UID: \"39ca921b-4dd1-4948-b603-cdf6ee28e011\") "
Oct 30 21:36:49.852387 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:49.852254    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/host-path/39ca921b-4dd1-4948-b603-cdf6ee28e011-datadir\" (UniqueName: \"kubernetes.io/host-path/39ca921b-4dd1-4948-b603-cdf6ee28e011-datadir\") pod \"39ca921b-4dd1-4948-b603-cdf6ee28e011\" (UID: \"39ca921b-4dd1-4948-b603-cdf6ee28e011\") "
Oct 30 21:36:49.852387 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:49.852364    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/39ca921b-4dd1-4948-b603-cdf6ee28e011-datadir" pod "39ca921b-4dd1-4948-b603-cdf6ee28e011" (UID: "39ca921b-4dd1-4948-b603-cdf6ee28e011"). InnerVolumeSpecName "datadir". PluginName "kubernetes.io/host-path", VolumeGIDValue ""
Oct 30 21:36:49.852626 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:49.852454    4060 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/39ca921b-4dd1-4948-b603-cdf6ee28e011-tmp\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:36:49.852626 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:49.852470    4060 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2bgtw\" (UniqueName: \"kubernetes.io/projected/39ca921b-4dd1-4948-b603-cdf6ee28e011-kube-api-access-2bgtw\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:36:49.852626 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:49.852481    4060 reconciler_common.go:299] "Volume detached for volume \"sa-token\" (UniqueName: \"kubernetes.io/projected/39ca921b-4dd1-4948-b603-cdf6ee28e011-sa-token\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:36:49.852626 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:49.852512    4060 reconciler_common.go:299] "Volume detached for volume \"config-openshift-service-cacrt\" (UniqueName: \"kubernetes.io/configmap/39ca921b-4dd1-4948-b603-cdf6ee28e011-config-openshift-service-cacrt\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:36:49.852626 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:49.852521    4060 reconciler_common.go:299] "Volume detached for volume \"entrypoint\" (UniqueName: \"kubernetes.io/configmap/39ca921b-4dd1-4948-b603-cdf6ee28e011-entrypoint\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:36:49.852626 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:49.852533    4060 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/39ca921b-4dd1-4948-b603-cdf6ee28e011-config\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:36:49.852626 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:49.852545    4060 reconciler_common.go:299] "Volume detached for volume \"metrics\" (UniqueName: \"kubernetes.io/secret/39ca921b-4dd1-4948-b603-cdf6ee28e011-metrics\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:36:49.852626 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:49.852552    4060 reconciler_common.go:299] "Volume detached for volume \"datadir\" (UniqueName: \"kubernetes.io/host-path/39ca921b-4dd1-4948-b603-cdf6ee28e011-datadir\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:36:49.852904 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:49.852647    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/39ca921b-4dd1-4948-b603-cdf6ee28e011-trusted-ca" pod "39ca921b-4dd1-4948-b603-cdf6ee28e011" (UID: "39ca921b-4dd1-4948-b603-cdf6ee28e011"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:36:49.854243 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:49.854225    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/39ca921b-4dd1-4948-b603-cdf6ee28e011-data-science-cluster-log-forwarder-collector-token" pod "39ca921b-4dd1-4948-b603-cdf6ee28e011" (UID: "39ca921b-4dd1-4948-b603-cdf6ee28e011"). InnerVolumeSpecName "data-science-cluster-log-forwarder-collector-token". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:36:49.882237 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:49.882208    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/korrel8r-5f5775896-txcbx"]
Oct 30 21:36:49.913365 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:49.913335    4060 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/korrel8r-5f5775896-txcbx"]
Oct 30 21:36:49.953751 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:49.953719    4060 reconciler_common.go:299] "Volume detached for volume \"data-science-cluster-log-forwarder-collector-token\" (UniqueName: \"kubernetes.io/secret/39ca921b-4dd1-4948-b603-cdf6ee28e011-data-science-cluster-log-forwarder-collector-token\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:36:49.953751 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:49.953745    4060 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/39ca921b-4dd1-4948-b603-cdf6ee28e011-trusted-ca\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:36:50.054711 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:36:50.054635    4060 secret.go:189] Couldn't get secret redhat-ods-monitoring/data-science-lokistack-distributor-http: secret "data-science-lokistack-distributor-http" not found
Oct 30 21:36:50.054858 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:36:50.054714    4060 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f99f91ba-56d3-43f3-8256-b0e32d702e43-data-science-lokistack-distributor-http podName:f99f91ba-56d3-43f3-8256-b0e32d702e43 nodeName:}" failed. No retries permitted until 2026-10-30 21:36:52.054701059 +0000 UTC m=+3630.811699348 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "data-science-lokistack-distributor-http" (UniqueName: "kubernetes.io/secret/f99f91ba-56d3-43f3-8256-b0e32d702e43-data-science-lokistack-distributor-http") pod "data-science-lokistack-distributor-b854ccfb4-xw9h9" (UID: "f99f91ba-56d3-43f3-8256-b0e32d702e43") : secret "data-science-lokistack-distributor-http" not found
Oct 30 21:36:50.054858 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:36:50.054643    4060 secret.go:189] Couldn't get secret redhat-ods-monitoring/data-science-lokistack-distributor-grpc: secret "data-science-lokistack-distributor-grpc" not found
Oct 30 21:36:50.054858 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:36:50.054801    4060 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f99f91ba-56d3-43f3-8256-b0e32d702e43-data-science-lokistack-distributor-grpc podName:f99f91ba-56d3-43f3-8256-b0e32d702e43 nodeName:}" failed. No retries permitted until 2026-10-30 21:36:52.054787032 +0000 UTC m=+3630.811785308 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "data-science-lokistack-distributor-grpc" (UniqueName: "kubernetes.io/secret/f99f91ba-56d3-43f3-8256-b0e32d702e43-data-science-lokistack-distributor-grpc") pod "data-science-lokistack-distributor-b854ccfb4-xw9h9" (UID: "f99f91ba-56d3-43f3-8256-b0e32d702e43") : secret "data-science-lokistack-distributor-grpc" not found
Oct 30 21:36:50.109710 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:50.109675    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-usage-logs-collector-58dc4d7b85-g26pv"]
Oct 30 21:36:50.109910 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:50.109889    4060 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-usage-logs-collector-58dc4d7b85-g26pv" podUID="19e1274f-6858-4cd0-b4ac-8dd274b77c2f" containerName="otc-container" containerID="cri-o://54f2cc16819f90c9da803746daab9473e70180aea44224b6f1b42fa860ba81b3" gracePeriod=30
Oct 30 21:36:50.230863 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:50.230833    4060 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-usage-logs-collector-59d48566db-bd2vt"]
Oct 30 21:36:50.231138 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:50.231125    4060 cpu_manager.go:414] "containerMap: removing container" podUID="232ec0c8-fd25-42e5-87ba-a5860d024d55" containerName="loki-query-frontend"
Oct 30 21:36:50.231199 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:50.231139    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="232ec0c8-fd25-42e5-87ba-a5860d024d55" containerName="loki-query-frontend"
Oct 30 21:36:50.231199 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:50.231164    4060 cpu_manager.go:414] "containerMap: removing container" podUID="68daa60a-11ed-41f4-9bb2-544035c6da0a" containerName="korrel8r"
Oct 30 21:36:50.231199 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:50.231169    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="68daa60a-11ed-41f4-9bb2-544035c6da0a" containerName="korrel8r"
Oct 30 21:36:50.231199 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:50.231183    4060 cpu_manager.go:414] "containerMap: removing container" podUID="39ca921b-4dd1-4948-b603-cdf6ee28e011" containerName="collector"
Oct 30 21:36:50.231199 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:50.231189    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="39ca921b-4dd1-4948-b603-cdf6ee28e011" containerName="collector"
Oct 30 21:36:50.231449 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:50.231238    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="68daa60a-11ed-41f4-9bb2-544035c6da0a" containerName="korrel8r"
Oct 30 21:36:50.231449 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:50.231246    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="39ca921b-4dd1-4948-b603-cdf6ee28e011" containerName="collector"
Oct 30 21:36:50.231449 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:50.231254    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="232ec0c8-fd25-42e5-87ba-a5860d024d55" containerName="loki-query-frontend"
Oct 30 21:36:50.234206 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:50.234182    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-usage-logs-collector-59d48566db-bd2vt"
Oct 30 21:36:50.256521 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:50.256480    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/b1aef385-f0ca-4c47-84d1-31dbb42ccff0-otc-internal\") pod \"data-science-usage-logs-collector-59d48566db-bd2vt\" (UID: \"b1aef385-f0ca-4c47-84d1-31dbb42ccff0\") " pod="redhat-ods-monitoring/data-science-usage-logs-collector-59d48566db-bd2vt"
Oct 30 21:36:50.256800 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:50.256752    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/b1aef385-f0ca-4c47-84d1-31dbb42ccff0-otlp-tls-certs\") pod \"data-science-usage-logs-collector-59d48566db-bd2vt\" (UID: \"b1aef385-f0ca-4c47-84d1-31dbb42ccff0\") " pod="redhat-ods-monitoring/data-science-usage-logs-collector-59d48566db-bd2vt"
Oct 30 21:36:50.258207 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:50.256995    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l5h7l\" (UniqueName: \"kubernetes.io/projected/b1aef385-f0ca-4c47-84d1-31dbb42ccff0-kube-api-access-l5h7l\") pod \"data-science-usage-logs-collector-59d48566db-bd2vt\" (UID: \"b1aef385-f0ca-4c47-84d1-31dbb42ccff0\") " pod="redhat-ods-monitoring/data-science-usage-logs-collector-59d48566db-bd2vt"
Oct 30 21:36:50.307885 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:50.307695    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-usage-logs-collector-59d48566db-bd2vt"]
Oct 30 21:36:50.357463 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:50.357428    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/b1aef385-f0ca-4c47-84d1-31dbb42ccff0-otc-internal\") pod \"data-science-usage-logs-collector-59d48566db-bd2vt\" (UID: \"b1aef385-f0ca-4c47-84d1-31dbb42ccff0\") " pod="redhat-ods-monitoring/data-science-usage-logs-collector-59d48566db-bd2vt"
Oct 30 21:36:50.357630 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:50.357474    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/b1aef385-f0ca-4c47-84d1-31dbb42ccff0-otlp-tls-certs\") pod \"data-science-usage-logs-collector-59d48566db-bd2vt\" (UID: \"b1aef385-f0ca-4c47-84d1-31dbb42ccff0\") " pod="redhat-ods-monitoring/data-science-usage-logs-collector-59d48566db-bd2vt"
Oct 30 21:36:50.357630 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:50.357575    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l5h7l\" (UniqueName: \"kubernetes.io/projected/b1aef385-f0ca-4c47-84d1-31dbb42ccff0-kube-api-access-l5h7l\") pod \"data-science-usage-logs-collector-59d48566db-bd2vt\" (UID: \"b1aef385-f0ca-4c47-84d1-31dbb42ccff0\") " pod="redhat-ods-monitoring/data-science-usage-logs-collector-59d48566db-bd2vt"
Oct 30 21:36:50.358633 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:50.358593    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/b1aef385-f0ca-4c47-84d1-31dbb42ccff0-otc-internal\") pod \"data-science-usage-logs-collector-59d48566db-bd2vt\" (UID: \"b1aef385-f0ca-4c47-84d1-31dbb42ccff0\") " pod="redhat-ods-monitoring/data-science-usage-logs-collector-59d48566db-bd2vt"
Oct 30 21:36:50.361701 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:50.361673    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/b1aef385-f0ca-4c47-84d1-31dbb42ccff0-otlp-tls-certs\") pod \"data-science-usage-logs-collector-59d48566db-bd2vt\" (UID: \"b1aef385-f0ca-4c47-84d1-31dbb42ccff0\") " pod="redhat-ods-monitoring/data-science-usage-logs-collector-59d48566db-bd2vt"
Oct 30 21:36:50.378390 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:50.378363    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-usage-logs-collector-58dc4d7b85-g26pv"
Oct 30 21:36:50.418854 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:50.418826    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l5h7l\" (UniqueName: \"kubernetes.io/projected/b1aef385-f0ca-4c47-84d1-31dbb42ccff0-kube-api-access-l5h7l\") pod \"data-science-usage-logs-collector-59d48566db-bd2vt\" (UID: \"b1aef385-f0ca-4c47-84d1-31dbb42ccff0\") " pod="redhat-ods-monitoring/data-science-usage-logs-collector-59d48566db-bd2vt"
Oct 30 21:36:50.486390 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:50.486365    4060 generic.go:356] "Generic (PLEG): container finished" podID="39ca921b-4dd1-4948-b603-cdf6ee28e011" containerID="0874bc72eec98c08cad19d0dc3a9f59c7c5aed2f285a71fa9be0e5b54b859042" exitCode=0
Oct 30 21:36:50.486762 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:50.486403    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-logging/data-science-cluster-log-forwarder-kkhdh" event={"ID":"39ca921b-4dd1-4948-b603-cdf6ee28e011","Type":"ContainerDied","Data":"0874bc72eec98c08cad19d0dc3a9f59c7c5aed2f285a71fa9be0e5b54b859042"}
Oct 30 21:36:50.486762 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:50.486437    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-logging/data-science-cluster-log-forwarder-kkhdh"
Oct 30 21:36:50.486762 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:50.486466    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-logging/data-science-cluster-log-forwarder-kkhdh" event={"ID":"39ca921b-4dd1-4948-b603-cdf6ee28e011","Type":"ContainerDied","Data":"5a63f496815346fdb0098e52e50920b65b6bb718f7a9eebc6d8e077c92b35b3b"}
Oct 30 21:36:50.486762 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:50.486516    4060 scope.go:122] "RemoveContainer" containerID="0874bc72eec98c08cad19d0dc3a9f59c7c5aed2f285a71fa9be0e5b54b859042"
Oct 30 21:36:50.489240 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:50.489214    4060 generic.go:356] "Generic (PLEG): container finished" podID="19e1274f-6858-4cd0-b4ac-8dd274b77c2f" containerID="54f2cc16819f90c9da803746daab9473e70180aea44224b6f1b42fa860ba81b3" exitCode=0
Oct 30 21:36:50.489348 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:50.489258    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-usage-logs-collector-58dc4d7b85-g26pv" event={"ID":"19e1274f-6858-4cd0-b4ac-8dd274b77c2f","Type":"ContainerDied","Data":"54f2cc16819f90c9da803746daab9473e70180aea44224b6f1b42fa860ba81b3"}
Oct 30 21:36:50.489348 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:50.489323    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-usage-logs-collector-58dc4d7b85-g26pv" event={"ID":"19e1274f-6858-4cd0-b4ac-8dd274b77c2f","Type":"ContainerDied","Data":"4c7803b001a099fe12780deeff553579a728ea94502446ec3c2854141fbf1da5"}
Oct 30 21:36:50.489348 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:50.489270    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-usage-logs-collector-58dc4d7b85-g26pv"
Oct 30 21:36:50.496861 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:50.496845    4060 scope.go:122] "RemoveContainer" containerID="0874bc72eec98c08cad19d0dc3a9f59c7c5aed2f285a71fa9be0e5b54b859042"
Oct 30 21:36:50.497145 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:36:50.497118    4060 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0874bc72eec98c08cad19d0dc3a9f59c7c5aed2f285a71fa9be0e5b54b859042\": container with ID starting with 0874bc72eec98c08cad19d0dc3a9f59c7c5aed2f285a71fa9be0e5b54b859042 not found: ID does not exist" containerID="0874bc72eec98c08cad19d0dc3a9f59c7c5aed2f285a71fa9be0e5b54b859042"
Oct 30 21:36:50.498428 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:50.497154    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0874bc72eec98c08cad19d0dc3a9f59c7c5aed2f285a71fa9be0e5b54b859042"} err="failed to get container status \"0874bc72eec98c08cad19d0dc3a9f59c7c5aed2f285a71fa9be0e5b54b859042\": rpc error: code = NotFound desc = could not find container \"0874bc72eec98c08cad19d0dc3a9f59c7c5aed2f285a71fa9be0e5b54b859042\": container with ID starting with 0874bc72eec98c08cad19d0dc3a9f59c7c5aed2f285a71fa9be0e5b54b859042 not found: ID does not exist"
Oct 30 21:36:50.498428 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:50.497177    4060 scope.go:122] "RemoveContainer" containerID="54f2cc16819f90c9da803746daab9473e70180aea44224b6f1b42fa860ba81b3"
Oct 30 21:36:50.508632 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:50.508615    4060 scope.go:122] "RemoveContainer" containerID="54f2cc16819f90c9da803746daab9473e70180aea44224b6f1b42fa860ba81b3"
Oct 30 21:36:50.508933 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:36:50.508909    4060 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"54f2cc16819f90c9da803746daab9473e70180aea44224b6f1b42fa860ba81b3\": container with ID starting with 54f2cc16819f90c9da803746daab9473e70180aea44224b6f1b42fa860ba81b3 not found: ID does not exist" containerID="54f2cc16819f90c9da803746daab9473e70180aea44224b6f1b42fa860ba81b3"
Oct 30 21:36:50.508987 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:50.508941    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"54f2cc16819f90c9da803746daab9473e70180aea44224b6f1b42fa860ba81b3"} err="failed to get container status \"54f2cc16819f90c9da803746daab9473e70180aea44224b6f1b42fa860ba81b3\": rpc error: code = NotFound desc = could not find container \"54f2cc16819f90c9da803746daab9473e70180aea44224b6f1b42fa860ba81b3\": container with ID starting with 54f2cc16819f90c9da803746daab9473e70180aea44224b6f1b42fa860ba81b3 not found: ID does not exist"
Oct 30 21:36:50.549337 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:50.549312    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-usage-logs-collector-59d48566db-bd2vt"
Oct 30 21:36:50.559502 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:50.559472    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/19e1274f-6858-4cd0-b4ac-8dd274b77c2f-otc-internal\" (UniqueName: \"kubernetes.io/configmap/19e1274f-6858-4cd0-b4ac-8dd274b77c2f-otc-internal\") pod \"19e1274f-6858-4cd0-b4ac-8dd274b77c2f\" (UID: \"19e1274f-6858-4cd0-b4ac-8dd274b77c2f\") "
Oct 30 21:36:50.559639 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:50.559622    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/19e1274f-6858-4cd0-b4ac-8dd274b77c2f-otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/19e1274f-6858-4cd0-b4ac-8dd274b77c2f-otlp-tls-certs\") pod \"19e1274f-6858-4cd0-b4ac-8dd274b77c2f\" (UID: \"19e1274f-6858-4cd0-b4ac-8dd274b77c2f\") "
Oct 30 21:36:50.559696 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:50.559669    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/19e1274f-6858-4cd0-b4ac-8dd274b77c2f-kube-api-access-9z69f\" (UniqueName: \"kubernetes.io/projected/19e1274f-6858-4cd0-b4ac-8dd274b77c2f-kube-api-access-9z69f\") pod \"19e1274f-6858-4cd0-b4ac-8dd274b77c2f\" (UID: \"19e1274f-6858-4cd0-b4ac-8dd274b77c2f\") "
Oct 30 21:36:50.559846 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:50.559821    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/19e1274f-6858-4cd0-b4ac-8dd274b77c2f-otc-internal" pod "19e1274f-6858-4cd0-b4ac-8dd274b77c2f" (UID: "19e1274f-6858-4cd0-b4ac-8dd274b77c2f"). InnerVolumeSpecName "otc-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:36:50.559943 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:50.559927    4060 reconciler_common.go:299] "Volume detached for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/19e1274f-6858-4cd0-b4ac-8dd274b77c2f-otc-internal\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:36:50.561621 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:50.561579    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/19e1274f-6858-4cd0-b4ac-8dd274b77c2f-otlp-tls-certs" pod "19e1274f-6858-4cd0-b4ac-8dd274b77c2f" (UID: "19e1274f-6858-4cd0-b4ac-8dd274b77c2f"). InnerVolumeSpecName "otlp-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:36:50.561825 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:50.561803    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/19e1274f-6858-4cd0-b4ac-8dd274b77c2f-kube-api-access-9z69f" pod "19e1274f-6858-4cd0-b4ac-8dd274b77c2f" (UID: "19e1274f-6858-4cd0-b4ac-8dd274b77c2f"). InnerVolumeSpecName "kube-api-access-9z69f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:36:50.660487 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:50.660460    4060 reconciler_common.go:299] "Volume detached for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/19e1274f-6858-4cd0-b4ac-8dd274b77c2f-otlp-tls-certs\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:36:50.660487 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:50.660485    4060 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9z69f\" (UniqueName: \"kubernetes.io/projected/19e1274f-6858-4cd0-b4ac-8dd274b77c2f-kube-api-access-9z69f\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:36:50.715355 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:50.715321    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-logging/data-science-cluster-log-forwarder-kkhdh"]
Oct 30 21:36:50.724806 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:50.724778    4060 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-logging/data-science-cluster-log-forwarder-kkhdh"]
Oct 30 21:36:50.914099 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:50.914021    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-usage-logs-collector-58dc4d7b85-g26pv"]
Oct 30 21:36:50.923438 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:50.923413    4060 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-usage-logs-collector-58dc4d7b85-g26pv"]
Oct 30 21:36:50.928538 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:50.928518    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-usage-logs-collector-59d48566db-bd2vt"]
Oct 30 21:36:50.930755 ip-10-0-142-4 kubenswrapper[4060]: W1030 21:36:50.930733    4060 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1aef385_f0ca_4c47_84d1_31dbb42ccff0.slice/crio-c9406b5076ab14697df46dafae89cdd162b9060b0e567e6391ad8a4e919d5d4c WatchSource:0}: Error finding container c9406b5076ab14697df46dafae89cdd162b9060b0e567e6391ad8a4e919d5d4c: Status 404 returned error can't find the container with id c9406b5076ab14697df46dafae89cdd162b9060b0e567e6391ad8a4e919d5d4c
Oct 30 21:36:50.932848 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:50.932817    4060 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 21:36:50.932915 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:50.932872    4060 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 21:36:51.426510 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:51.426462    4060 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="19e1274f-6858-4cd0-b4ac-8dd274b77c2f" path="/var/lib/kubelet/pods/19e1274f-6858-4cd0-b4ac-8dd274b77c2f/volumes"
Oct 30 21:36:51.426914 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:51.426899    4060 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="232ec0c8-fd25-42e5-87ba-a5860d024d55" path="/var/lib/kubelet/pods/232ec0c8-fd25-42e5-87ba-a5860d024d55/volumes"
Oct 30 21:36:51.427268 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:51.427257    4060 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="39ca921b-4dd1-4948-b603-cdf6ee28e011" path="/var/lib/kubelet/pods/39ca921b-4dd1-4948-b603-cdf6ee28e011/volumes"
Oct 30 21:36:51.427780 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:51.427762    4060 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="68daa60a-11ed-41f4-9bb2-544035c6da0a" path="/var/lib/kubelet/pods/68daa60a-11ed-41f4-9bb2-544035c6da0a/volumes"
Oct 30 21:36:51.498425 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:51.498398    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-usage-logs-collector-59d48566db-bd2vt" event={"ID":"b1aef385-f0ca-4c47-84d1-31dbb42ccff0","Type":"ContainerStarted","Data":"0a652843f94e0fed7209a41cbe36eacff7b1a144a276f80e359aa5d6224b4b26"}
Oct 30 21:36:51.498821 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:51.498450    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-usage-logs-collector-59d48566db-bd2vt" event={"ID":"b1aef385-f0ca-4c47-84d1-31dbb42ccff0","Type":"ContainerStarted","Data":"c9406b5076ab14697df46dafae89cdd162b9060b0e567e6391ad8a4e919d5d4c"}
Oct 30 21:36:51.618826 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:51.618764    4060 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-usage-logs-collector-59d48566db-bd2vt" podStartSLOduration=1.6187431129999998 podStartE2EDuration="1.618743113s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:36:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:36:51.617688904 +0000 UTC m=+3630.374687212" watchObservedRunningTime="2026-10-30 21:36:51.618743113 +0000 UTC m=+3630.375741413"
Oct 30 21:36:51.743418 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:51.743391    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-lokistack-distributor-b854ccfb4-xw9h9"
Oct 30 21:36:51.769261 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:51.769234    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/f99f91ba-56d3-43f3-8256-b0e32d702e43-data-science-lokistack-distributor-grpc\" (UniqueName: \"kubernetes.io/secret/f99f91ba-56d3-43f3-8256-b0e32d702e43-data-science-lokistack-distributor-grpc\") pod \"f99f91ba-56d3-43f3-8256-b0e32d702e43\" (UID: \"f99f91ba-56d3-43f3-8256-b0e32d702e43\") "
Oct 30 21:36:51.769406 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:51.769278    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/f99f91ba-56d3-43f3-8256-b0e32d702e43-data-science-lokistack-distributor-http\" (UniqueName: \"kubernetes.io/secret/f99f91ba-56d3-43f3-8256-b0e32d702e43-data-science-lokistack-distributor-http\") pod \"f99f91ba-56d3-43f3-8256-b0e32d702e43\" (UID: \"f99f91ba-56d3-43f3-8256-b0e32d702e43\") "
Oct 30 21:36:51.769406 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:51.769306    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f99f91ba-56d3-43f3-8256-b0e32d702e43-kube-api-access-flqnr\" (UniqueName: \"kubernetes.io/projected/f99f91ba-56d3-43f3-8256-b0e32d702e43-kube-api-access-flqnr\") pod \"f99f91ba-56d3-43f3-8256-b0e32d702e43\" (UID: \"f99f91ba-56d3-43f3-8256-b0e32d702e43\") "
Oct 30 21:36:51.769406 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:51.769332    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/f99f91ba-56d3-43f3-8256-b0e32d702e43-data-science-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f99f91ba-56d3-43f3-8256-b0e32d702e43-data-science-lokistack-ca-bundle\") pod \"f99f91ba-56d3-43f3-8256-b0e32d702e43\" (UID: \"f99f91ba-56d3-43f3-8256-b0e32d702e43\") "
Oct 30 21:36:51.769406 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:51.769367    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/f99f91ba-56d3-43f3-8256-b0e32d702e43-config\" (UniqueName: \"kubernetes.io/configmap/f99f91ba-56d3-43f3-8256-b0e32d702e43-config\") pod \"f99f91ba-56d3-43f3-8256-b0e32d702e43\" (UID: \"f99f91ba-56d3-43f3-8256-b0e32d702e43\") "
Oct 30 21:36:51.769843 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:51.769815    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f99f91ba-56d3-43f3-8256-b0e32d702e43-data-science-lokistack-ca-bundle" pod "f99f91ba-56d3-43f3-8256-b0e32d702e43" (UID: "f99f91ba-56d3-43f3-8256-b0e32d702e43"). InnerVolumeSpecName "data-science-lokistack-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:36:51.769904 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:51.769825    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f99f91ba-56d3-43f3-8256-b0e32d702e43-config" pod "f99f91ba-56d3-43f3-8256-b0e32d702e43" (UID: "f99f91ba-56d3-43f3-8256-b0e32d702e43"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:36:51.771527 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:51.771479    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f99f91ba-56d3-43f3-8256-b0e32d702e43-data-science-lokistack-distributor-grpc" pod "f99f91ba-56d3-43f3-8256-b0e32d702e43" (UID: "f99f91ba-56d3-43f3-8256-b0e32d702e43"). InnerVolumeSpecName "data-science-lokistack-distributor-grpc". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:36:51.771661 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:51.771641    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f99f91ba-56d3-43f3-8256-b0e32d702e43-data-science-lokistack-distributor-http" pod "f99f91ba-56d3-43f3-8256-b0e32d702e43" (UID: "f99f91ba-56d3-43f3-8256-b0e32d702e43"). InnerVolumeSpecName "data-science-lokistack-distributor-http". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:36:51.771711 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:51.771641    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f99f91ba-56d3-43f3-8256-b0e32d702e43-kube-api-access-flqnr" pod "f99f91ba-56d3-43f3-8256-b0e32d702e43" (UID: "f99f91ba-56d3-43f3-8256-b0e32d702e43"). InnerVolumeSpecName "kube-api-access-flqnr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:36:51.870867 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:51.870795    4060 reconciler_common.go:299] "Volume detached for volume \"data-science-lokistack-distributor-grpc\" (UniqueName: \"kubernetes.io/secret/f99f91ba-56d3-43f3-8256-b0e32d702e43-data-science-lokistack-distributor-grpc\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:36:51.870867 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:51.870822    4060 reconciler_common.go:299] "Volume detached for volume \"data-science-lokistack-distributor-http\" (UniqueName: \"kubernetes.io/secret/f99f91ba-56d3-43f3-8256-b0e32d702e43-data-science-lokistack-distributor-http\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:36:51.870867 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:51.870833    4060 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-flqnr\" (UniqueName: \"kubernetes.io/projected/f99f91ba-56d3-43f3-8256-b0e32d702e43-kube-api-access-flqnr\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:36:51.870867 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:51.870843    4060 reconciler_common.go:299] "Volume detached for volume \"data-science-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f99f91ba-56d3-43f3-8256-b0e32d702e43-data-science-lokistack-ca-bundle\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:36:51.870867 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:51.870852    4060 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f99f91ba-56d3-43f3-8256-b0e32d702e43-config\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:36:52.505787 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:52.505750    4060 generic.go:356] "Generic (PLEG): container finished" podID="f99f91ba-56d3-43f3-8256-b0e32d702e43" containerID="70349b1af2a644b2f769ceba3bf5bd4500624caef35186f16ea983b9c589b42d" exitCode=0
Oct 30 21:36:52.506237 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:52.505797    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-lokistack-distributor-b854ccfb4-xw9h9"
Oct 30 21:36:52.506237 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:52.505833    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-lokistack-distributor-b854ccfb4-xw9h9" event={"ID":"f99f91ba-56d3-43f3-8256-b0e32d702e43","Type":"ContainerDied","Data":"70349b1af2a644b2f769ceba3bf5bd4500624caef35186f16ea983b9c589b42d"}
Oct 30 21:36:52.506237 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:52.505875    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-lokistack-distributor-b854ccfb4-xw9h9" event={"ID":"f99f91ba-56d3-43f3-8256-b0e32d702e43","Type":"ContainerDied","Data":"ca7469a154df22c136974cff332a86a97e4f6a96b48efa8b58bb29a8374341d4"}
Oct 30 21:36:52.506237 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:52.505903    4060 scope.go:122] "RemoveContainer" containerID="70349b1af2a644b2f769ceba3bf5bd4500624caef35186f16ea983b9c589b42d"
Oct 30 21:36:52.515075 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:52.515054    4060 scope.go:122] "RemoveContainer" containerID="70349b1af2a644b2f769ceba3bf5bd4500624caef35186f16ea983b9c589b42d"
Oct 30 21:36:52.515342 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:36:52.515320    4060 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"70349b1af2a644b2f769ceba3bf5bd4500624caef35186f16ea983b9c589b42d\": container with ID starting with 70349b1af2a644b2f769ceba3bf5bd4500624caef35186f16ea983b9c589b42d not found: ID does not exist" containerID="70349b1af2a644b2f769ceba3bf5bd4500624caef35186f16ea983b9c589b42d"
Oct 30 21:36:52.515387 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:52.515351    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"70349b1af2a644b2f769ceba3bf5bd4500624caef35186f16ea983b9c589b42d"} err="failed to get container status \"70349b1af2a644b2f769ceba3bf5bd4500624caef35186f16ea983b9c589b42d\": rpc error: code = NotFound desc = could not find container \"70349b1af2a644b2f769ceba3bf5bd4500624caef35186f16ea983b9c589b42d\": container with ID starting with 70349b1af2a644b2f769ceba3bf5bd4500624caef35186f16ea983b9c589b42d not found: ID does not exist"
Oct 30 21:36:52.673129 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:52.673098    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-lokistack-distributor-b854ccfb4-xw9h9"]
Oct 30 21:36:52.722544 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:52.722508    4060 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-lokistack-distributor-b854ccfb4-xw9h9"]
Oct 30 21:36:53.427513 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:53.427471    4060 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f99f91ba-56d3-43f3-8256-b0e32d702e43" path="/var/lib/kubelet/pods/f99f91ba-56d3-43f3-8256-b0e32d702e43/volumes"
Oct 30 21:36:59.840808 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:59.840773    4060 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-usage-logs-collector-8666d99d79-x9bp4"]
Oct 30 21:36:59.841197 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:59.841072    4060 cpu_manager.go:414] "containerMap: removing container" podUID="f99f91ba-56d3-43f3-8256-b0e32d702e43" containerName="loki-distributor"
Oct 30 21:36:59.841197 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:59.841083    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f99f91ba-56d3-43f3-8256-b0e32d702e43" containerName="loki-distributor"
Oct 30 21:36:59.841197 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:59.841107    4060 cpu_manager.go:414] "containerMap: removing container" podUID="19e1274f-6858-4cd0-b4ac-8dd274b77c2f" containerName="otc-container"
Oct 30 21:36:59.841197 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:59.841124    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="19e1274f-6858-4cd0-b4ac-8dd274b77c2f" containerName="otc-container"
Oct 30 21:36:59.841197 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:59.841176    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="f99f91ba-56d3-43f3-8256-b0e32d702e43" containerName="loki-distributor"
Oct 30 21:36:59.841197 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:59.841187    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="19e1274f-6858-4cd0-b4ac-8dd274b77c2f" containerName="otc-container"
Oct 30 21:36:59.844101 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:59.844085    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-usage-logs-collector-8666d99d79-x9bp4"
Oct 30 21:36:59.936770 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:59.936737    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-usage-logs-collector-8666d99d79-x9bp4"]
Oct 30 21:36:59.937833 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:59.937797    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/c2f87acd-aac4-40f0-9d35-a0e71a3ccaea-otlp-tls-certs\") pod \"data-science-usage-logs-collector-8666d99d79-x9bp4\" (UID: \"c2f87acd-aac4-40f0-9d35-a0e71a3ccaea\") " pod="redhat-ods-monitoring/data-science-usage-logs-collector-8666d99d79-x9bp4"
Oct 30 21:36:59.938004 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:59.937885    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/c2f87acd-aac4-40f0-9d35-a0e71a3ccaea-otc-internal\") pod \"data-science-usage-logs-collector-8666d99d79-x9bp4\" (UID: \"c2f87acd-aac4-40f0-9d35-a0e71a3ccaea\") " pod="redhat-ods-monitoring/data-science-usage-logs-collector-8666d99d79-x9bp4"
Oct 30 21:36:59.938004 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:36:59.937983    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-88xrj\" (UniqueName: \"kubernetes.io/projected/c2f87acd-aac4-40f0-9d35-a0e71a3ccaea-kube-api-access-88xrj\") pod \"data-science-usage-logs-collector-8666d99d79-x9bp4\" (UID: \"c2f87acd-aac4-40f0-9d35-a0e71a3ccaea\") " pod="redhat-ods-monitoring/data-science-usage-logs-collector-8666d99d79-x9bp4"
Oct 30 21:37:00.038426 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:00.038395    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/c2f87acd-aac4-40f0-9d35-a0e71a3ccaea-otlp-tls-certs\") pod \"data-science-usage-logs-collector-8666d99d79-x9bp4\" (UID: \"c2f87acd-aac4-40f0-9d35-a0e71a3ccaea\") " pod="redhat-ods-monitoring/data-science-usage-logs-collector-8666d99d79-x9bp4"
Oct 30 21:37:00.038649 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:00.038449    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/c2f87acd-aac4-40f0-9d35-a0e71a3ccaea-otc-internal\") pod \"data-science-usage-logs-collector-8666d99d79-x9bp4\" (UID: \"c2f87acd-aac4-40f0-9d35-a0e71a3ccaea\") " pod="redhat-ods-monitoring/data-science-usage-logs-collector-8666d99d79-x9bp4"
Oct 30 21:37:00.038649 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:00.038466    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-88xrj\" (UniqueName: \"kubernetes.io/projected/c2f87acd-aac4-40f0-9d35-a0e71a3ccaea-kube-api-access-88xrj\") pod \"data-science-usage-logs-collector-8666d99d79-x9bp4\" (UID: \"c2f87acd-aac4-40f0-9d35-a0e71a3ccaea\") " pod="redhat-ods-monitoring/data-science-usage-logs-collector-8666d99d79-x9bp4"
Oct 30 21:37:00.039100 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:00.039070    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/c2f87acd-aac4-40f0-9d35-a0e71a3ccaea-otc-internal\") pod \"data-science-usage-logs-collector-8666d99d79-x9bp4\" (UID: \"c2f87acd-aac4-40f0-9d35-a0e71a3ccaea\") " pod="redhat-ods-monitoring/data-science-usage-logs-collector-8666d99d79-x9bp4"
Oct 30 21:37:00.040819 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:00.040801    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/c2f87acd-aac4-40f0-9d35-a0e71a3ccaea-otlp-tls-certs\") pod \"data-science-usage-logs-collector-8666d99d79-x9bp4\" (UID: \"c2f87acd-aac4-40f0-9d35-a0e71a3ccaea\") " pod="redhat-ods-monitoring/data-science-usage-logs-collector-8666d99d79-x9bp4"
Oct 30 21:37:00.099915 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:00.099853    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-88xrj\" (UniqueName: \"kubernetes.io/projected/c2f87acd-aac4-40f0-9d35-a0e71a3ccaea-kube-api-access-88xrj\") pod \"data-science-usage-logs-collector-8666d99d79-x9bp4\" (UID: \"c2f87acd-aac4-40f0-9d35-a0e71a3ccaea\") " pod="redhat-ods-monitoring/data-science-usage-logs-collector-8666d99d79-x9bp4"
Oct 30 21:37:00.156074 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:00.156030    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-usage-logs-collector-8666d99d79-x9bp4"
Oct 30 21:37:00.528258 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:00.528230    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-usage-logs-collector-8666d99d79-x9bp4"]
Oct 30 21:37:00.530346 ip-10-0-142-4 kubenswrapper[4060]: W1030 21:37:00.530321    4060 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2f87acd_aac4_40f0_9d35_a0e71a3ccaea.slice/crio-e4aae5a769481790f745381add48ff842d3c6e69dce5ffea90cfb4d7a8eec7bb WatchSource:0}: Error finding container e4aae5a769481790f745381add48ff842d3c6e69dce5ffea90cfb4d7a8eec7bb: Status 404 returned error can't find the container with id e4aae5a769481790f745381add48ff842d3c6e69dce5ffea90cfb4d7a8eec7bb
Oct 30 21:37:00.532438 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:00.532405    4060 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 21:37:00.532544 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:00.532467    4060 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 21:37:00.548704 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:00.548674    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-usage-logs-collector-8666d99d79-x9bp4" event={"ID":"c2f87acd-aac4-40f0-9d35-a0e71a3ccaea","Type":"ContainerStarted","Data":"e4aae5a769481790f745381add48ff842d3c6e69dce5ffea90cfb4d7a8eec7bb"}
Oct 30 21:37:01.442795 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:01.442765    4060 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-usage-logs-lokistack-ingester-0"]
Oct 30 21:37:01.446157 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:01.446138    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-ingester-0"
Oct 30 21:37:01.548006 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:01.547975    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-usage-logs-lokistack-ingester-grpc\""
Oct 30 21:37:01.548006 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:01.547975    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-usage-logs-lokistack-ingester-http\""
Oct 30 21:37:01.548006 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:01.547975    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"test-loki-lifecycle-secret\""
Oct 30 21:37:01.549619 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:01.549594    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-usage-logs-lokistack-ingester-0"]
Oct 30 21:37:01.554741 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:01.554715    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-usage-logs-collector-8666d99d79-x9bp4" event={"ID":"c2f87acd-aac4-40f0-9d35-a0e71a3ccaea","Type":"ContainerStarted","Data":"1cce2d6c2c0d7a68c711b0940fad56d4c51739566c961c38f538738428e7224e"}
Oct 30 21:37:01.679554 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:01.679458    4060 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-usage-logs-collector-8666d99d79-x9bp4" podStartSLOduration=2.6794382519999997 podStartE2EDuration="2.679438252s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:36:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:37:01.679027749 +0000 UTC m=+3640.436026046" watchObservedRunningTime="2026-10-30 21:37:01.679438252 +0000 UTC m=+3640.436436551"
Oct 30 21:37:01.720086 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:01.715312    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-usage-logs-collector-59d48566db-bd2vt"]
Oct 30 21:37:01.720086 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:01.715695    4060 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-usage-logs-collector-59d48566db-bd2vt" podUID="b1aef385-f0ca-4c47-84d1-31dbb42ccff0" containerName="otc-container" containerID="cri-o://0a652843f94e0fed7209a41cbe36eacff7b1a144a276f80e359aa5d6224b4b26" gracePeriod=30
Oct 30 21:37:01.855084 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:01.855048    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-72ggv\" (UniqueName: \"kubernetes.io/projected/bb70bd79-fc94-48eb-a399-72f3e221b6de-kube-api-access-72ggv\") pod \"data-science-usage-logs-lokistack-ingester-0\" (UID: \"bb70bd79-fc94-48eb-a399-72f3e221b6de\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-ingester-0"
Oct 30 21:37:01.855249 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:01.855093    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-loki-lifecycle-secret\" (UniqueName: \"kubernetes.io/secret/bb70bd79-fc94-48eb-a399-72f3e221b6de-test-loki-lifecycle-secret\") pod \"data-science-usage-logs-lokistack-ingester-0\" (UID: \"bb70bd79-fc94-48eb-a399-72f3e221b6de\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-ingester-0"
Oct 30 21:37:01.855249 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:01.855214    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-usage-logs-lokistack-ingester-http\" (UniqueName: \"kubernetes.io/secret/bb70bd79-fc94-48eb-a399-72f3e221b6de-data-science-usage-logs-lokistack-ingester-http\") pod \"data-science-usage-logs-lokistack-ingester-0\" (UID: \"bb70bd79-fc94-48eb-a399-72f3e221b6de\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-ingester-0"
Oct 30 21:37:01.855407 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:01.855335    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bb70bd79-fc94-48eb-a399-72f3e221b6de-config\") pod \"data-science-usage-logs-lokistack-ingester-0\" (UID: \"bb70bd79-fc94-48eb-a399-72f3e221b6de\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-ingester-0"
Oct 30 21:37:01.855469 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:01.855409    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-usage-logs-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bb70bd79-fc94-48eb-a399-72f3e221b6de-data-science-usage-logs-lokistack-ca-bundle\") pod \"data-science-usage-logs-lokistack-ingester-0\" (UID: \"bb70bd79-fc94-48eb-a399-72f3e221b6de\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-ingester-0"
Oct 30 21:37:01.855469 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:01.855448    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-usage-logs-lokistack-ingester-grpc\" (UniqueName: \"kubernetes.io/secret/bb70bd79-fc94-48eb-a399-72f3e221b6de-data-science-usage-logs-lokistack-ingester-grpc\") pod \"data-science-usage-logs-lokistack-ingester-0\" (UID: \"bb70bd79-fc94-48eb-a399-72f3e221b6de\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-ingester-0"
Oct 30 21:37:01.956740 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:01.956704    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-usage-logs-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bb70bd79-fc94-48eb-a399-72f3e221b6de-data-science-usage-logs-lokistack-ca-bundle\") pod \"data-science-usage-logs-lokistack-ingester-0\" (UID: \"bb70bd79-fc94-48eb-a399-72f3e221b6de\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-ingester-0"
Oct 30 21:37:01.956906 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:01.956752    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-usage-logs-lokistack-ingester-grpc\" (UniqueName: \"kubernetes.io/secret/bb70bd79-fc94-48eb-a399-72f3e221b6de-data-science-usage-logs-lokistack-ingester-grpc\") pod \"data-science-usage-logs-lokistack-ingester-0\" (UID: \"bb70bd79-fc94-48eb-a399-72f3e221b6de\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-ingester-0"
Oct 30 21:37:01.956906 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:01.956807    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-72ggv\" (UniqueName: \"kubernetes.io/projected/bb70bd79-fc94-48eb-a399-72f3e221b6de-kube-api-access-72ggv\") pod \"data-science-usage-logs-lokistack-ingester-0\" (UID: \"bb70bd79-fc94-48eb-a399-72f3e221b6de\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-ingester-0"
Oct 30 21:37:01.956906 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:01.956834    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"test-loki-lifecycle-secret\" (UniqueName: \"kubernetes.io/secret/bb70bd79-fc94-48eb-a399-72f3e221b6de-test-loki-lifecycle-secret\") pod \"data-science-usage-logs-lokistack-ingester-0\" (UID: \"bb70bd79-fc94-48eb-a399-72f3e221b6de\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-ingester-0"
Oct 30 21:37:01.956906 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:01.956875    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-usage-logs-lokistack-ingester-http\" (UniqueName: \"kubernetes.io/secret/bb70bd79-fc94-48eb-a399-72f3e221b6de-data-science-usage-logs-lokistack-ingester-http\") pod \"data-science-usage-logs-lokistack-ingester-0\" (UID: \"bb70bd79-fc94-48eb-a399-72f3e221b6de\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-ingester-0"
Oct 30 21:37:01.957147 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:01.957115    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bb70bd79-fc94-48eb-a399-72f3e221b6de-config\") pod \"data-science-usage-logs-lokistack-ingester-0\" (UID: \"bb70bd79-fc94-48eb-a399-72f3e221b6de\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-ingester-0"
Oct 30 21:37:01.957480 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:01.957452    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-usage-logs-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bb70bd79-fc94-48eb-a399-72f3e221b6de-data-science-usage-logs-lokistack-ca-bundle\") pod \"data-science-usage-logs-lokistack-ingester-0\" (UID: \"bb70bd79-fc94-48eb-a399-72f3e221b6de\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-ingester-0"
Oct 30 21:37:01.957887 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:01.957865    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bb70bd79-fc94-48eb-a399-72f3e221b6de-config\") pod \"data-science-usage-logs-lokistack-ingester-0\" (UID: \"bb70bd79-fc94-48eb-a399-72f3e221b6de\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-ingester-0"
Oct 30 21:37:01.959882 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:01.959855    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-usage-logs-lokistack-ingester-grpc\" (UniqueName: \"kubernetes.io/secret/bb70bd79-fc94-48eb-a399-72f3e221b6de-data-science-usage-logs-lokistack-ingester-grpc\") pod \"data-science-usage-logs-lokistack-ingester-0\" (UID: \"bb70bd79-fc94-48eb-a399-72f3e221b6de\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-ingester-0"
Oct 30 21:37:01.959882 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:01.959867    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-usage-logs-lokistack-ingester-http\" (UniqueName: \"kubernetes.io/secret/bb70bd79-fc94-48eb-a399-72f3e221b6de-data-science-usage-logs-lokistack-ingester-http\") pod \"data-science-usage-logs-lokistack-ingester-0\" (UID: \"bb70bd79-fc94-48eb-a399-72f3e221b6de\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-ingester-0"
Oct 30 21:37:01.959993 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:01.959902    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-loki-lifecycle-secret\" (UniqueName: \"kubernetes.io/secret/bb70bd79-fc94-48eb-a399-72f3e221b6de-test-loki-lifecycle-secret\") pod \"data-science-usage-logs-lokistack-ingester-0\" (UID: \"bb70bd79-fc94-48eb-a399-72f3e221b6de\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-ingester-0"
Oct 30 21:37:01.981995 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:01.981936    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-usage-logs-collector-59d48566db-bd2vt"
Oct 30 21:37:02.020542 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:02.020503    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-72ggv\" (UniqueName: \"kubernetes.io/projected/bb70bd79-fc94-48eb-a399-72f3e221b6de-kube-api-access-72ggv\") pod \"data-science-usage-logs-lokistack-ingester-0\" (UID: \"bb70bd79-fc94-48eb-a399-72f3e221b6de\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-ingester-0"
Oct 30 21:37:02.057562 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:02.057529    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b1aef385-f0ca-4c47-84d1-31dbb42ccff0-otc-internal\" (UniqueName: \"kubernetes.io/configmap/b1aef385-f0ca-4c47-84d1-31dbb42ccff0-otc-internal\") pod \"b1aef385-f0ca-4c47-84d1-31dbb42ccff0\" (UID: \"b1aef385-f0ca-4c47-84d1-31dbb42ccff0\") "
Oct 30 21:37:02.057727 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:02.057594    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b1aef385-f0ca-4c47-84d1-31dbb42ccff0-otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/b1aef385-f0ca-4c47-84d1-31dbb42ccff0-otlp-tls-certs\") pod \"b1aef385-f0ca-4c47-84d1-31dbb42ccff0\" (UID: \"b1aef385-f0ca-4c47-84d1-31dbb42ccff0\") "
Oct 30 21:37:02.057727 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:02.057649    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b1aef385-f0ca-4c47-84d1-31dbb42ccff0-kube-api-access-l5h7l\" (UniqueName: \"kubernetes.io/projected/b1aef385-f0ca-4c47-84d1-31dbb42ccff0-kube-api-access-l5h7l\") pod \"b1aef385-f0ca-4c47-84d1-31dbb42ccff0\" (UID: \"b1aef385-f0ca-4c47-84d1-31dbb42ccff0\") "
Oct 30 21:37:02.057977 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:02.057947    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b1aef385-f0ca-4c47-84d1-31dbb42ccff0-otc-internal" pod "b1aef385-f0ca-4c47-84d1-31dbb42ccff0" (UID: "b1aef385-f0ca-4c47-84d1-31dbb42ccff0"). InnerVolumeSpecName "otc-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:37:02.059720 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:02.059690    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b1aef385-f0ca-4c47-84d1-31dbb42ccff0-otlp-tls-certs" pod "b1aef385-f0ca-4c47-84d1-31dbb42ccff0" (UID: "b1aef385-f0ca-4c47-84d1-31dbb42ccff0"). InnerVolumeSpecName "otlp-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:37:02.059720 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:02.059707    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b1aef385-f0ca-4c47-84d1-31dbb42ccff0-kube-api-access-l5h7l" pod "b1aef385-f0ca-4c47-84d1-31dbb42ccff0" (UID: "b1aef385-f0ca-4c47-84d1-31dbb42ccff0"). InnerVolumeSpecName "kube-api-access-l5h7l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:37:02.159192 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:02.159156    4060 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l5h7l\" (UniqueName: \"kubernetes.io/projected/b1aef385-f0ca-4c47-84d1-31dbb42ccff0-kube-api-access-l5h7l\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:37:02.159192 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:02.159185    4060 reconciler_common.go:299] "Volume detached for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/b1aef385-f0ca-4c47-84d1-31dbb42ccff0-otc-internal\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:37:02.159192 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:02.159197    4060 reconciler_common.go:299] "Volume detached for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/b1aef385-f0ca-4c47-84d1-31dbb42ccff0-otlp-tls-certs\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:37:02.560523 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:02.560469    4060 generic.go:356] "Generic (PLEG): container finished" podID="b1aef385-f0ca-4c47-84d1-31dbb42ccff0" containerID="0a652843f94e0fed7209a41cbe36eacff7b1a144a276f80e359aa5d6224b4b26" exitCode=0
Oct 30 21:37:02.560989 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:02.560544    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-usage-logs-collector-59d48566db-bd2vt" event={"ID":"b1aef385-f0ca-4c47-84d1-31dbb42ccff0","Type":"ContainerDied","Data":"0a652843f94e0fed7209a41cbe36eacff7b1a144a276f80e359aa5d6224b4b26"}
Oct 30 21:37:02.560989 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:02.560565    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-usage-logs-collector-59d48566db-bd2vt"
Oct 30 21:37:02.560989 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:02.560596    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-usage-logs-collector-59d48566db-bd2vt" event={"ID":"b1aef385-f0ca-4c47-84d1-31dbb42ccff0","Type":"ContainerDied","Data":"c9406b5076ab14697df46dafae89cdd162b9060b0e567e6391ad8a4e919d5d4c"}
Oct 30 21:37:02.560989 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:02.560624    4060 scope.go:122] "RemoveContainer" containerID="0a652843f94e0fed7209a41cbe36eacff7b1a144a276f80e359aa5d6224b4b26"
Oct 30 21:37:02.569640 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:02.569623    4060 scope.go:122] "RemoveContainer" containerID="0a652843f94e0fed7209a41cbe36eacff7b1a144a276f80e359aa5d6224b4b26"
Oct 30 21:37:02.569895 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:37:02.569874    4060 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0a652843f94e0fed7209a41cbe36eacff7b1a144a276f80e359aa5d6224b4b26\": container with ID starting with 0a652843f94e0fed7209a41cbe36eacff7b1a144a276f80e359aa5d6224b4b26 not found: ID does not exist" containerID="0a652843f94e0fed7209a41cbe36eacff7b1a144a276f80e359aa5d6224b4b26"
Oct 30 21:37:02.569964 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:02.569907    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0a652843f94e0fed7209a41cbe36eacff7b1a144a276f80e359aa5d6224b4b26"} err="failed to get container status \"0a652843f94e0fed7209a41cbe36eacff7b1a144a276f80e359aa5d6224b4b26\": rpc error: code = NotFound desc = could not find container \"0a652843f94e0fed7209a41cbe36eacff7b1a144a276f80e359aa5d6224b4b26\": container with ID starting with 0a652843f94e0fed7209a41cbe36eacff7b1a144a276f80e359aa5d6224b4b26 not found: ID does not exist"
Oct 30 21:37:02.725210 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:02.725181    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-usage-logs-collector-59d48566db-bd2vt"]
Oct 30 21:37:02.729521 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:02.729482    4060 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-usage-logs-collector-59d48566db-bd2vt"]
Oct 30 21:37:03.426822 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:03.426791    4060 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b1aef385-f0ca-4c47-84d1-31dbb42ccff0" path="/var/lib/kubelet/pods/b1aef385-f0ca-4c47-84d1-31dbb42ccff0/volumes"
Oct 30 21:37:07.068851 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:07.068816    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-usage-logs-lokistack-ingester-0"]
Oct 30 21:37:07.119918 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:37:07.119880    4060 csi_plugin.go:220] "Failed to get volume attachment" err="volumeattachments.storage.k8s.io \"csi-98c0e8637e0992454cba41778f813443cafe85bba2793f8f0cd3327e334f47a8\" is forbidden: User \"system:node:ip-10-0-142-4.us-west-1.compute.internal\" cannot get resource \"volumeattachments\" in API group \"storage.k8s.io\" at the cluster scope: no relationship found between node 'ip-10-0-142-4.us-west-1.compute.internal' and this object" attachmentName="csi-98c0e8637e0992454cba41778f813443cafe85bba2793f8f0cd3327e334f47a8"
Oct 30 21:37:07.138733 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:07.138707    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-usage-logs-lokistack-querier-8577fdf8bc-lpwhh"]
Oct 30 21:37:07.138911 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:07.138879    4060 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-querier-8577fdf8bc-lpwhh" podUID="5949fcaa-2a50-4232-82bb-1c6f24b49df5" containerName="loki-querier" containerID="cri-o://1e9eb0608f12b11a3f83418e486af59c55742ed9c30d33a14e360368fe1a67ae" gracePeriod=30
Oct 30 21:37:07.153808 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:07.153784    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-usage-logs-lokistack-query-frontend-7d747cfbbjlwg2"]
Oct 30 21:37:07.153971 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:07.153951    4060 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-query-frontend-7d747cfbbjlwg2" podUID="6a63680e-1743-4af7-be13-0add069de2da" containerName="loki-query-frontend" containerID="cri-o://aef89c096cca8c2e9bda76b081c2ce9d7e60e9580b6f4bd6476a6ea227cb450a" gracePeriod=30
Oct 30 21:37:07.170908 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:37:07.170874    4060 csi_plugin.go:220] "Failed to get volume attachment" err="volumeattachments.storage.k8s.io \"csi-9b51f5ae839120bb5470ef768acdf7cc9b5d7bed86bc1d51ff6dc39934988af7\" is forbidden: User \"system:node:ip-10-0-142-4.us-west-1.compute.internal\" cannot get resource \"volumeattachments\" in API group \"storage.k8s.io\" at the cluster scope: no relationship found between node 'ip-10-0-142-4.us-west-1.compute.internal' and this object" attachmentName="csi-9b51f5ae839120bb5470ef768acdf7cc9b5d7bed86bc1d51ff6dc39934988af7"
Oct 30 21:37:07.171016 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:37:07.170924    4060 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[storage wal], unattached volumes=[storage wal], failed to process volumes=[]: context canceled" pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-ingester-0" podUID="bb70bd79-fc94-48eb-a399-72f3e221b6de"
Oct 30 21:37:07.460605 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:07.460580    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-query-frontend-7d747cfbbjlwg2"
Oct 30 21:37:07.502944 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:07.502909    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/6a63680e-1743-4af7-be13-0add069de2da-data-science-usage-logs-lokistack-query-frontend-grpc\" (UniqueName: \"kubernetes.io/secret/6a63680e-1743-4af7-be13-0add069de2da-data-science-usage-logs-lokistack-query-frontend-grpc\") pod \"6a63680e-1743-4af7-be13-0add069de2da\" (UID: \"6a63680e-1743-4af7-be13-0add069de2da\") "
Oct 30 21:37:07.503115 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:07.502973    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/6a63680e-1743-4af7-be13-0add069de2da-data-science-usage-logs-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a63680e-1743-4af7-be13-0add069de2da-data-science-usage-logs-lokistack-ca-bundle\") pod \"6a63680e-1743-4af7-be13-0add069de2da\" (UID: \"6a63680e-1743-4af7-be13-0add069de2da\") "
Oct 30 21:37:07.503115 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:07.503032    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6a63680e-1743-4af7-be13-0add069de2da-kube-api-access-khgfv\" (UniqueName: \"kubernetes.io/projected/6a63680e-1743-4af7-be13-0add069de2da-kube-api-access-khgfv\") pod \"6a63680e-1743-4af7-be13-0add069de2da\" (UID: \"6a63680e-1743-4af7-be13-0add069de2da\") "
Oct 30 21:37:07.503115 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:07.503100    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/6a63680e-1743-4af7-be13-0add069de2da-data-science-usage-logs-lokistack-query-frontend-http\" (UniqueName: \"kubernetes.io/secret/6a63680e-1743-4af7-be13-0add069de2da-data-science-usage-logs-lokistack-query-frontend-http\") pod \"6a63680e-1743-4af7-be13-0add069de2da\" (UID: \"6a63680e-1743-4af7-be13-0add069de2da\") "
Oct 30 21:37:07.503276 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:07.503165    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/6a63680e-1743-4af7-be13-0add069de2da-config\" (UniqueName: \"kubernetes.io/configmap/6a63680e-1743-4af7-be13-0add069de2da-config\") pod \"6a63680e-1743-4af7-be13-0add069de2da\" (UID: \"6a63680e-1743-4af7-be13-0add069de2da\") "
Oct 30 21:37:07.503687 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:07.503658    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6a63680e-1743-4af7-be13-0add069de2da-data-science-usage-logs-lokistack-ca-bundle" pod "6a63680e-1743-4af7-be13-0add069de2da" (UID: "6a63680e-1743-4af7-be13-0add069de2da"). InnerVolumeSpecName "data-science-usage-logs-lokistack-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:37:07.503800 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:07.503655    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6a63680e-1743-4af7-be13-0add069de2da-config" pod "6a63680e-1743-4af7-be13-0add069de2da" (UID: "6a63680e-1743-4af7-be13-0add069de2da"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:37:07.505785 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:07.505754    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6a63680e-1743-4af7-be13-0add069de2da-data-science-usage-logs-lokistack-query-frontend-grpc" pod "6a63680e-1743-4af7-be13-0add069de2da" (UID: "6a63680e-1743-4af7-be13-0add069de2da"). InnerVolumeSpecName "data-science-usage-logs-lokistack-query-frontend-grpc". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:37:07.505891 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:07.505833    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6a63680e-1743-4af7-be13-0add069de2da-data-science-usage-logs-lokistack-query-frontend-http" pod "6a63680e-1743-4af7-be13-0add069de2da" (UID: "6a63680e-1743-4af7-be13-0add069de2da"). InnerVolumeSpecName "data-science-usage-logs-lokistack-query-frontend-http". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:37:07.507196 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:07.507174    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6a63680e-1743-4af7-be13-0add069de2da-kube-api-access-khgfv" pod "6a63680e-1743-4af7-be13-0add069de2da" (UID: "6a63680e-1743-4af7-be13-0add069de2da"). InnerVolumeSpecName "kube-api-access-khgfv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:37:07.580104 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:07.579990    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-usage-logs-collector-8666d99d79-x9bp4"]
Oct 30 21:37:07.580281 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:07.580226    4060 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-usage-logs-collector-8666d99d79-x9bp4" podUID="c2f87acd-aac4-40f0-9d35-a0e71a3ccaea" containerName="otc-container" containerID="cri-o://1cce2d6c2c0d7a68c711b0940fad56d4c51739566c961c38f538738428e7224e" gracePeriod=30
Oct 30 21:37:07.588815 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:07.588783    4060 generic.go:356] "Generic (PLEG): container finished" podID="5949fcaa-2a50-4232-82bb-1c6f24b49df5" containerID="1e9eb0608f12b11a3f83418e486af59c55742ed9c30d33a14e360368fe1a67ae" exitCode=0
Oct 30 21:37:07.588949 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:07.588856    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-querier-8577fdf8bc-lpwhh" event={"ID":"5949fcaa-2a50-4232-82bb-1c6f24b49df5","Type":"ContainerDied","Data":"1e9eb0608f12b11a3f83418e486af59c55742ed9c30d33a14e360368fe1a67ae"}
Oct 30 21:37:07.590368 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:07.590344    4060 generic.go:356] "Generic (PLEG): container finished" podID="6a63680e-1743-4af7-be13-0add069de2da" containerID="aef89c096cca8c2e9bda76b081c2ce9d7e60e9580b6f4bd6476a6ea227cb450a" exitCode=0
Oct 30 21:37:07.590505 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:07.590410    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-query-frontend-7d747cfbbjlwg2"
Oct 30 21:37:07.590505 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:07.590432    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-query-frontend-7d747cfbbjlwg2" event={"ID":"6a63680e-1743-4af7-be13-0add069de2da","Type":"ContainerDied","Data":"aef89c096cca8c2e9bda76b081c2ce9d7e60e9580b6f4bd6476a6ea227cb450a"}
Oct 30 21:37:07.590505 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:07.590476    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-query-frontend-7d747cfbbjlwg2" event={"ID":"6a63680e-1743-4af7-be13-0add069de2da","Type":"ContainerDied","Data":"0762eda7ae8fda4ab4cb13cb18b7b70651c34588175e032adbcea6790a38c3c2"}
Oct 30 21:37:07.590659 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:07.590535    4060 scope.go:122] "RemoveContainer" containerID="aef89c096cca8c2e9bda76b081c2ce9d7e60e9580b6f4bd6476a6ea227cb450a"
Oct 30 21:37:07.590711 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:07.590675    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-ingester-0"
Oct 30 21:37:07.600956 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:07.600933    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-ingester-0"
Oct 30 21:37:07.604332 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:07.604310    4060 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6a63680e-1743-4af7-be13-0add069de2da-config\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:37:07.604428 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:07.604338    4060 reconciler_common.go:299] "Volume detached for volume \"data-science-usage-logs-lokistack-query-frontend-grpc\" (UniqueName: \"kubernetes.io/secret/6a63680e-1743-4af7-be13-0add069de2da-data-science-usage-logs-lokistack-query-frontend-grpc\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:37:07.604428 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:07.604356    4060 reconciler_common.go:299] "Volume detached for volume \"data-science-usage-logs-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a63680e-1743-4af7-be13-0add069de2da-data-science-usage-logs-lokistack-ca-bundle\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:37:07.604428 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:07.604372    4060 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-khgfv\" (UniqueName: \"kubernetes.io/projected/6a63680e-1743-4af7-be13-0add069de2da-kube-api-access-khgfv\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:37:07.604428 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:07.604387    4060 reconciler_common.go:299] "Volume detached for volume \"data-science-usage-logs-lokistack-query-frontend-http\" (UniqueName: \"kubernetes.io/secret/6a63680e-1743-4af7-be13-0add069de2da-data-science-usage-logs-lokistack-query-frontend-http\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:37:07.605249 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:07.605228    4060 scope.go:122] "RemoveContainer" containerID="aef89c096cca8c2e9bda76b081c2ce9d7e60e9580b6f4bd6476a6ea227cb450a"
Oct 30 21:37:07.605562 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:37:07.605533    4060 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aef89c096cca8c2e9bda76b081c2ce9d7e60e9580b6f4bd6476a6ea227cb450a\": container with ID starting with aef89c096cca8c2e9bda76b081c2ce9d7e60e9580b6f4bd6476a6ea227cb450a not found: ID does not exist" containerID="aef89c096cca8c2e9bda76b081c2ce9d7e60e9580b6f4bd6476a6ea227cb450a"
Oct 30 21:37:07.605668 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:07.605570    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aef89c096cca8c2e9bda76b081c2ce9d7e60e9580b6f4bd6476a6ea227cb450a"} err="failed to get container status \"aef89c096cca8c2e9bda76b081c2ce9d7e60e9580b6f4bd6476a6ea227cb450a\": rpc error: code = NotFound desc = could not find container \"aef89c096cca8c2e9bda76b081c2ce9d7e60e9580b6f4bd6476a6ea227cb450a\": container with ID starting with aef89c096cca8c2e9bda76b081c2ce9d7e60e9580b6f4bd6476a6ea227cb450a not found: ID does not exist"
Oct 30 21:37:07.658122 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:07.658102    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-querier-8577fdf8bc-lpwhh"
Oct 30 21:37:07.705024 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:07.704998    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/5949fcaa-2a50-4232-82bb-1c6f24b49df5-test-usage-logs-loki-secret\" (UniqueName: \"kubernetes.io/secret/5949fcaa-2a50-4232-82bb-1c6f24b49df5-test-usage-logs-loki-secret\") pod \"5949fcaa-2a50-4232-82bb-1c6f24b49df5\" (UID: \"5949fcaa-2a50-4232-82bb-1c6f24b49df5\") "
Oct 30 21:37:07.705162 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:07.705041    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/bb70bd79-fc94-48eb-a399-72f3e221b6de-test-loki-lifecycle-secret\" (UniqueName: \"kubernetes.io/secret/bb70bd79-fc94-48eb-a399-72f3e221b6de-test-loki-lifecycle-secret\") pod \"bb70bd79-fc94-48eb-a399-72f3e221b6de\" (UID: \"bb70bd79-fc94-48eb-a399-72f3e221b6de\") "
Oct 30 21:37:07.705162 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:07.705067    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/bb70bd79-fc94-48eb-a399-72f3e221b6de-config\" (UniqueName: \"kubernetes.io/configmap/bb70bd79-fc94-48eb-a399-72f3e221b6de-config\") pod \"bb70bd79-fc94-48eb-a399-72f3e221b6de\" (UID: \"bb70bd79-fc94-48eb-a399-72f3e221b6de\") "
Oct 30 21:37:07.705162 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:07.705103    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/5949fcaa-2a50-4232-82bb-1c6f24b49df5-data-science-usage-logs-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5949fcaa-2a50-4232-82bb-1c6f24b49df5-data-science-usage-logs-lokistack-ca-bundle\") pod \"5949fcaa-2a50-4232-82bb-1c6f24b49df5\" (UID: \"5949fcaa-2a50-4232-82bb-1c6f24b49df5\") "
Oct 30 21:37:07.705162 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:07.705144    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/5949fcaa-2a50-4232-82bb-1c6f24b49df5-data-science-usage-logs-lokistack-querier-grpc\" (UniqueName: \"kubernetes.io/secret/5949fcaa-2a50-4232-82bb-1c6f24b49df5-data-science-usage-logs-lokistack-querier-grpc\") pod \"5949fcaa-2a50-4232-82bb-1c6f24b49df5\" (UID: \"5949fcaa-2a50-4232-82bb-1c6f24b49df5\") "
Oct 30 21:37:07.705436 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:07.705170    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/5949fcaa-2a50-4232-82bb-1c6f24b49df5-config\" (UniqueName: \"kubernetes.io/configmap/5949fcaa-2a50-4232-82bb-1c6f24b49df5-config\") pod \"5949fcaa-2a50-4232-82bb-1c6f24b49df5\" (UID: \"5949fcaa-2a50-4232-82bb-1c6f24b49df5\") "
Oct 30 21:37:07.705436 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:07.705199    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/bb70bd79-fc94-48eb-a399-72f3e221b6de-data-science-usage-logs-lokistack-ingester-http\" (UniqueName: \"kubernetes.io/secret/bb70bd79-fc94-48eb-a399-72f3e221b6de-data-science-usage-logs-lokistack-ingester-http\") pod \"bb70bd79-fc94-48eb-a399-72f3e221b6de\" (UID: \"bb70bd79-fc94-48eb-a399-72f3e221b6de\") "
Oct 30 21:37:07.705436 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:07.705263    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/bb70bd79-fc94-48eb-a399-72f3e221b6de-data-science-usage-logs-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bb70bd79-fc94-48eb-a399-72f3e221b6de-data-science-usage-logs-lokistack-ca-bundle\") pod \"bb70bd79-fc94-48eb-a399-72f3e221b6de\" (UID: \"bb70bd79-fc94-48eb-a399-72f3e221b6de\") "
Oct 30 21:37:07.705436 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:07.705294    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/bb70bd79-fc94-48eb-a399-72f3e221b6de-kube-api-access-72ggv\" (UniqueName: \"kubernetes.io/projected/bb70bd79-fc94-48eb-a399-72f3e221b6de-kube-api-access-72ggv\") pod \"bb70bd79-fc94-48eb-a399-72f3e221b6de\" (UID: \"bb70bd79-fc94-48eb-a399-72f3e221b6de\") "
Oct 30 21:37:07.705436 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:07.705333    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/5949fcaa-2a50-4232-82bb-1c6f24b49df5-data-science-usage-logs-lokistack-querier-http\" (UniqueName: \"kubernetes.io/secret/5949fcaa-2a50-4232-82bb-1c6f24b49df5-data-science-usage-logs-lokistack-querier-http\") pod \"5949fcaa-2a50-4232-82bb-1c6f24b49df5\" (UID: \"5949fcaa-2a50-4232-82bb-1c6f24b49df5\") "
Oct 30 21:37:07.705436 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:07.705364    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5949fcaa-2a50-4232-82bb-1c6f24b49df5-kube-api-access-rpbpc\" (UniqueName: \"kubernetes.io/projected/5949fcaa-2a50-4232-82bb-1c6f24b49df5-kube-api-access-rpbpc\") pod \"5949fcaa-2a50-4232-82bb-1c6f24b49df5\" (UID: \"5949fcaa-2a50-4232-82bb-1c6f24b49df5\") "
Oct 30 21:37:07.705436 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:07.705394    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/bb70bd79-fc94-48eb-a399-72f3e221b6de-data-science-usage-logs-lokistack-ingester-grpc\" (UniqueName: \"kubernetes.io/secret/bb70bd79-fc94-48eb-a399-72f3e221b6de-data-science-usage-logs-lokistack-ingester-grpc\") pod \"bb70bd79-fc94-48eb-a399-72f3e221b6de\" (UID: \"bb70bd79-fc94-48eb-a399-72f3e221b6de\") "
Oct 30 21:37:07.705802 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:07.705485    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bb70bd79-fc94-48eb-a399-72f3e221b6de-config" pod "bb70bd79-fc94-48eb-a399-72f3e221b6de" (UID: "bb70bd79-fc94-48eb-a399-72f3e221b6de"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:37:07.705802 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:07.705728    4060 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bb70bd79-fc94-48eb-a399-72f3e221b6de-config\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:37:07.706247 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:07.706200    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5949fcaa-2a50-4232-82bb-1c6f24b49df5-config" pod "5949fcaa-2a50-4232-82bb-1c6f24b49df5" (UID: "5949fcaa-2a50-4232-82bb-1c6f24b49df5"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:37:07.706673 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:07.706439    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5949fcaa-2a50-4232-82bb-1c6f24b49df5-data-science-usage-logs-lokistack-ca-bundle" pod "5949fcaa-2a50-4232-82bb-1c6f24b49df5" (UID: "5949fcaa-2a50-4232-82bb-1c6f24b49df5"). InnerVolumeSpecName "data-science-usage-logs-lokistack-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:37:07.706673 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:07.706579    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bb70bd79-fc94-48eb-a399-72f3e221b6de-data-science-usage-logs-lokistack-ca-bundle" pod "bb70bd79-fc94-48eb-a399-72f3e221b6de" (UID: "bb70bd79-fc94-48eb-a399-72f3e221b6de"). InnerVolumeSpecName "data-science-usage-logs-lokistack-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:37:07.708025 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:07.707998    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bb70bd79-fc94-48eb-a399-72f3e221b6de-data-science-usage-logs-lokistack-ingester-http" pod "bb70bd79-fc94-48eb-a399-72f3e221b6de" (UID: "bb70bd79-fc94-48eb-a399-72f3e221b6de"). InnerVolumeSpecName "data-science-usage-logs-lokistack-ingester-http". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:37:07.708123 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:07.708082    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5949fcaa-2a50-4232-82bb-1c6f24b49df5-data-science-usage-logs-lokistack-querier-grpc" pod "5949fcaa-2a50-4232-82bb-1c6f24b49df5" (UID: "5949fcaa-2a50-4232-82bb-1c6f24b49df5"). InnerVolumeSpecName "data-science-usage-logs-lokistack-querier-grpc". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:37:07.708242 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:07.708218    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bb70bd79-fc94-48eb-a399-72f3e221b6de-data-science-usage-logs-lokistack-ingester-grpc" pod "bb70bd79-fc94-48eb-a399-72f3e221b6de" (UID: "bb70bd79-fc94-48eb-a399-72f3e221b6de"). InnerVolumeSpecName "data-science-usage-logs-lokistack-ingester-grpc". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:37:07.708331 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:07.708302    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bb70bd79-fc94-48eb-a399-72f3e221b6de-test-loki-lifecycle-secret" pod "bb70bd79-fc94-48eb-a399-72f3e221b6de" (UID: "bb70bd79-fc94-48eb-a399-72f3e221b6de"). InnerVolumeSpecName "test-loki-lifecycle-secret". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:37:07.708539 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:07.708480    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5949fcaa-2a50-4232-82bb-1c6f24b49df5-test-usage-logs-loki-secret" pod "5949fcaa-2a50-4232-82bb-1c6f24b49df5" (UID: "5949fcaa-2a50-4232-82bb-1c6f24b49df5"). InnerVolumeSpecName "test-usage-logs-loki-secret". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:37:07.708987 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:07.708959    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5949fcaa-2a50-4232-82bb-1c6f24b49df5-data-science-usage-logs-lokistack-querier-http" pod "5949fcaa-2a50-4232-82bb-1c6f24b49df5" (UID: "5949fcaa-2a50-4232-82bb-1c6f24b49df5"). InnerVolumeSpecName "data-science-usage-logs-lokistack-querier-http". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:37:07.709287 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:07.709267    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5949fcaa-2a50-4232-82bb-1c6f24b49df5-kube-api-access-rpbpc" pod "5949fcaa-2a50-4232-82bb-1c6f24b49df5" (UID: "5949fcaa-2a50-4232-82bb-1c6f24b49df5"). InnerVolumeSpecName "kube-api-access-rpbpc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:37:07.709430 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:07.709413    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bb70bd79-fc94-48eb-a399-72f3e221b6de-kube-api-access-72ggv" pod "bb70bd79-fc94-48eb-a399-72f3e221b6de" (UID: "bb70bd79-fc94-48eb-a399-72f3e221b6de"). InnerVolumeSpecName "kube-api-access-72ggv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:37:07.806823 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:07.806795    4060 reconciler_common.go:299] "Volume detached for volume \"test-usage-logs-loki-secret\" (UniqueName: \"kubernetes.io/secret/5949fcaa-2a50-4232-82bb-1c6f24b49df5-test-usage-logs-loki-secret\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:37:07.806823 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:07.806821    4060 reconciler_common.go:299] "Volume detached for volume \"test-loki-lifecycle-secret\" (UniqueName: \"kubernetes.io/secret/bb70bd79-fc94-48eb-a399-72f3e221b6de-test-loki-lifecycle-secret\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:37:07.807022 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:07.806831    4060 reconciler_common.go:299] "Volume detached for volume \"data-science-usage-logs-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5949fcaa-2a50-4232-82bb-1c6f24b49df5-data-science-usage-logs-lokistack-ca-bundle\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:37:07.807022 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:07.806841    4060 reconciler_common.go:299] "Volume detached for volume \"data-science-usage-logs-lokistack-querier-grpc\" (UniqueName: \"kubernetes.io/secret/5949fcaa-2a50-4232-82bb-1c6f24b49df5-data-science-usage-logs-lokistack-querier-grpc\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:37:07.807022 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:07.806851    4060 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5949fcaa-2a50-4232-82bb-1c6f24b49df5-config\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:37:07.807022 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:07.806859    4060 reconciler_common.go:299] "Volume detached for volume \"data-science-usage-logs-lokistack-ingester-http\" (UniqueName: \"kubernetes.io/secret/bb70bd79-fc94-48eb-a399-72f3e221b6de-data-science-usage-logs-lokistack-ingester-http\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:37:07.807022 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:07.806868    4060 reconciler_common.go:299] "Volume detached for volume \"data-science-usage-logs-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bb70bd79-fc94-48eb-a399-72f3e221b6de-data-science-usage-logs-lokistack-ca-bundle\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:37:07.807022 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:07.806876    4060 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-72ggv\" (UniqueName: \"kubernetes.io/projected/bb70bd79-fc94-48eb-a399-72f3e221b6de-kube-api-access-72ggv\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:37:07.807022 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:07.806885    4060 reconciler_common.go:299] "Volume detached for volume \"data-science-usage-logs-lokistack-querier-http\" (UniqueName: \"kubernetes.io/secret/5949fcaa-2a50-4232-82bb-1c6f24b49df5-data-science-usage-logs-lokistack-querier-http\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:37:07.807022 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:07.806900    4060 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rpbpc\" (UniqueName: \"kubernetes.io/projected/5949fcaa-2a50-4232-82bb-1c6f24b49df5-kube-api-access-rpbpc\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:37:07.807022 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:07.806909    4060 reconciler_common.go:299] "Volume detached for volume \"data-science-usage-logs-lokistack-ingester-grpc\" (UniqueName: \"kubernetes.io/secret/bb70bd79-fc94-48eb-a399-72f3e221b6de-data-science-usage-logs-lokistack-ingester-grpc\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:37:07.810422 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:07.810392    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-usage-logs-lokistack-query-frontend-7d747cfbbjlwg2"]
Oct 30 21:37:07.815274 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:07.815249    4060 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-usage-logs-lokistack-query-frontend-7d747cfbbjlwg2"]
Oct 30 21:37:07.816768 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:07.816750    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-usage-logs-collector-8666d99d79-x9bp4"
Oct 30 21:37:07.907317 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:07.907248    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c2f87acd-aac4-40f0-9d35-a0e71a3ccaea-otc-internal\" (UniqueName: \"kubernetes.io/configmap/c2f87acd-aac4-40f0-9d35-a0e71a3ccaea-otc-internal\") pod \"c2f87acd-aac4-40f0-9d35-a0e71a3ccaea\" (UID: \"c2f87acd-aac4-40f0-9d35-a0e71a3ccaea\") "
Oct 30 21:37:07.907317 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:07.907291    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c2f87acd-aac4-40f0-9d35-a0e71a3ccaea-kube-api-access-88xrj\" (UniqueName: \"kubernetes.io/projected/c2f87acd-aac4-40f0-9d35-a0e71a3ccaea-kube-api-access-88xrj\") pod \"c2f87acd-aac4-40f0-9d35-a0e71a3ccaea\" (UID: \"c2f87acd-aac4-40f0-9d35-a0e71a3ccaea\") "
Oct 30 21:37:07.907518 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:07.907370    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/c2f87acd-aac4-40f0-9d35-a0e71a3ccaea-otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/c2f87acd-aac4-40f0-9d35-a0e71a3ccaea-otlp-tls-certs\") pod \"c2f87acd-aac4-40f0-9d35-a0e71a3ccaea\" (UID: \"c2f87acd-aac4-40f0-9d35-a0e71a3ccaea\") "
Oct 30 21:37:07.907699 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:07.907668    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c2f87acd-aac4-40f0-9d35-a0e71a3ccaea-otc-internal" pod "c2f87acd-aac4-40f0-9d35-a0e71a3ccaea" (UID: "c2f87acd-aac4-40f0-9d35-a0e71a3ccaea"). InnerVolumeSpecName "otc-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:37:07.909395 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:07.909369    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c2f87acd-aac4-40f0-9d35-a0e71a3ccaea-otlp-tls-certs" pod "c2f87acd-aac4-40f0-9d35-a0e71a3ccaea" (UID: "c2f87acd-aac4-40f0-9d35-a0e71a3ccaea"). InnerVolumeSpecName "otlp-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:37:07.909539 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:07.909428    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c2f87acd-aac4-40f0-9d35-a0e71a3ccaea-kube-api-access-88xrj" pod "c2f87acd-aac4-40f0-9d35-a0e71a3ccaea" (UID: "c2f87acd-aac4-40f0-9d35-a0e71a3ccaea"). InnerVolumeSpecName "kube-api-access-88xrj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:37:08.008896 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:08.008866    4060 reconciler_common.go:299] "Volume detached for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/c2f87acd-aac4-40f0-9d35-a0e71a3ccaea-otc-internal\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:37:08.008896 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:08.008893    4060 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-88xrj\" (UniqueName: \"kubernetes.io/projected/c2f87acd-aac4-40f0-9d35-a0e71a3ccaea-kube-api-access-88xrj\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:37:08.008896 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:08.008903    4060 reconciler_common.go:299] "Volume detached for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/c2f87acd-aac4-40f0-9d35-a0e71a3ccaea-otlp-tls-certs\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:37:08.596076 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:08.596044    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-querier-8577fdf8bc-lpwhh"
Oct 30 21:37:08.596557 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:08.596084    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-querier-8577fdf8bc-lpwhh" event={"ID":"5949fcaa-2a50-4232-82bb-1c6f24b49df5","Type":"ContainerDied","Data":"e72bc9a221aa8a808f6f2b83c2d4c108a64ddccf6042da5986232d3ef113c456"}
Oct 30 21:37:08.596557 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:08.596137    4060 scope.go:122] "RemoveContainer" containerID="1e9eb0608f12b11a3f83418e486af59c55742ed9c30d33a14e360368fe1a67ae"
Oct 30 21:37:08.598629 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:08.598605    4060 generic.go:356] "Generic (PLEG): container finished" podID="c2f87acd-aac4-40f0-9d35-a0e71a3ccaea" containerID="1cce2d6c2c0d7a68c711b0940fad56d4c51739566c961c38f538738428e7224e" exitCode=0
Oct 30 21:37:08.598772 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:08.598651    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-usage-logs-collector-8666d99d79-x9bp4"
Oct 30 21:37:08.598772 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:08.598664    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-usage-logs-collector-8666d99d79-x9bp4" event={"ID":"c2f87acd-aac4-40f0-9d35-a0e71a3ccaea","Type":"ContainerDied","Data":"1cce2d6c2c0d7a68c711b0940fad56d4c51739566c961c38f538738428e7224e"}
Oct 30 21:37:08.598772 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:08.598696    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-usage-logs-collector-8666d99d79-x9bp4" event={"ID":"c2f87acd-aac4-40f0-9d35-a0e71a3ccaea","Type":"ContainerDied","Data":"e4aae5a769481790f745381add48ff842d3c6e69dce5ffea90cfb4d7a8eec7bb"}
Oct 30 21:37:08.598772 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:08.598654    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-ingester-0"
Oct 30 21:37:08.606581 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:08.606470    4060 scope.go:122] "RemoveContainer" containerID="1cce2d6c2c0d7a68c711b0940fad56d4c51739566c961c38f538738428e7224e"
Oct 30 21:37:08.615043 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:08.615025    4060 scope.go:122] "RemoveContainer" containerID="1cce2d6c2c0d7a68c711b0940fad56d4c51739566c961c38f538738428e7224e"
Oct 30 21:37:08.615311 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:37:08.615293    4060 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1cce2d6c2c0d7a68c711b0940fad56d4c51739566c961c38f538738428e7224e\": container with ID starting with 1cce2d6c2c0d7a68c711b0940fad56d4c51739566c961c38f538738428e7224e not found: ID does not exist" containerID="1cce2d6c2c0d7a68c711b0940fad56d4c51739566c961c38f538738428e7224e"
Oct 30 21:37:08.615380 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:08.615324    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1cce2d6c2c0d7a68c711b0940fad56d4c51739566c961c38f538738428e7224e"} err="failed to get container status \"1cce2d6c2c0d7a68c711b0940fad56d4c51739566c961c38f538738428e7224e\": rpc error: code = NotFound desc = could not find container \"1cce2d6c2c0d7a68c711b0940fad56d4c51739566c961c38f538738428e7224e\": container with ID starting with 1cce2d6c2c0d7a68c711b0940fad56d4c51739566c961c38f538738428e7224e not found: ID does not exist"
Oct 30 21:37:08.761484 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:08.761454    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-usage-logs-lokistack-querier-8577fdf8bc-lpwhh"]
Oct 30 21:37:08.766726 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:08.766700    4060 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-usage-logs-lokistack-querier-8577fdf8bc-lpwhh"]
Oct 30 21:37:08.943712 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:08.943628    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-usage-logs-lokistack-ingester-0"]
Oct 30 21:37:08.948344 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:08.948319    4060 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-usage-logs-lokistack-ingester-0"]
Oct 30 21:37:09.056888 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:09.056851    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-usage-logs-collector-8666d99d79-x9bp4"]
Oct 30 21:37:09.060238 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:09.060215    4060 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-usage-logs-collector-8666d99d79-x9bp4"]
Oct 30 21:37:09.427215 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:09.427185    4060 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="5949fcaa-2a50-4232-82bb-1c6f24b49df5" path="/var/lib/kubelet/pods/5949fcaa-2a50-4232-82bb-1c6f24b49df5/volumes"
Oct 30 21:37:09.427570 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:09.427557    4060 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="6a63680e-1743-4af7-be13-0add069de2da" path="/var/lib/kubelet/pods/6a63680e-1743-4af7-be13-0add069de2da/volumes"
Oct 30 21:37:09.427903 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:09.427891    4060 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="bb70bd79-fc94-48eb-a399-72f3e221b6de" path="/var/lib/kubelet/pods/bb70bd79-fc94-48eb-a399-72f3e221b6de/volumes"
Oct 30 21:37:09.428137 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:09.428126    4060 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c2f87acd-aac4-40f0-9d35-a0e71a3ccaea" path="/var/lib/kubelet/pods/c2f87acd-aac4-40f0-9d35-a0e71a3ccaea/volumes"
Oct 30 21:37:12.151069 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:37:12.151034    4060 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v2f4x" containerName="extractor"
Oct 30 21:37:14.958500 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:14.958468    4060 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-usage-logs-lokistack-ingester-0"]
Oct 30 21:37:14.958888 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:14.958758    4060 cpu_manager.go:414] "containerMap: removing container" podUID="c2f87acd-aac4-40f0-9d35-a0e71a3ccaea" containerName="otc-container"
Oct 30 21:37:14.958888 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:14.958769    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c2f87acd-aac4-40f0-9d35-a0e71a3ccaea" containerName="otc-container"
Oct 30 21:37:14.958888 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:14.958791    4060 cpu_manager.go:414] "containerMap: removing container" podUID="b1aef385-f0ca-4c47-84d1-31dbb42ccff0" containerName="otc-container"
Oct 30 21:37:14.958888 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:14.958796    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b1aef385-f0ca-4c47-84d1-31dbb42ccff0" containerName="otc-container"
Oct 30 21:37:14.958888 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:14.958806    4060 cpu_manager.go:414] "containerMap: removing container" podUID="6a63680e-1743-4af7-be13-0add069de2da" containerName="loki-query-frontend"
Oct 30 21:37:14.958888 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:14.958811    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6a63680e-1743-4af7-be13-0add069de2da" containerName="loki-query-frontend"
Oct 30 21:37:14.958888 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:14.958821    4060 cpu_manager.go:414] "containerMap: removing container" podUID="5949fcaa-2a50-4232-82bb-1c6f24b49df5" containerName="loki-querier"
Oct 30 21:37:14.958888 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:14.958827    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5949fcaa-2a50-4232-82bb-1c6f24b49df5" containerName="loki-querier"
Oct 30 21:37:14.958888 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:14.958874    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="b1aef385-f0ca-4c47-84d1-31dbb42ccff0" containerName="otc-container"
Oct 30 21:37:14.958888 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:14.958881    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="6a63680e-1743-4af7-be13-0add069de2da" containerName="loki-query-frontend"
Oct 30 21:37:14.958888 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:14.958887    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="5949fcaa-2a50-4232-82bb-1c6f24b49df5" containerName="loki-querier"
Oct 30 21:37:14.959284 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:14.958903    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="c2f87acd-aac4-40f0-9d35-a0e71a3ccaea" containerName="otc-container"
Oct 30 21:37:14.963005 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:14.962986    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-ingester-0"
Oct 30 21:37:15.038917 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:15.038877    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"test-loki-lifecycle-secret\""
Oct 30 21:37:15.039057 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:15.038931    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-usage-logs-lokistack-ingester-grpc\""
Oct 30 21:37:15.064921 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:15.064892    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-usage-logs-lokistack-ingester-http\""
Oct 30 21:37:15.064921 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:15.064914    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-usage-logs-lokistack-dockercfg-c4bmf\""
Oct 30 21:37:15.065185 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:15.064930    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"openshift-service-ca.crt\""
Oct 30 21:37:15.065323 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:15.065194    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"kube-root-ca.crt\""
Oct 30 21:37:15.065323 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:15.065202    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-usage-logs-lokistack-ca-bundle\""
Oct 30 21:37:15.065323 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:15.065233    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-usage-logs-lokistack-config\""
Oct 30 21:37:15.067282 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:15.067259    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-usage-logs-lokistack-ingester-0"]
Oct 30 21:37:15.262848 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:15.262776    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bda3c536-9311-431c-a789-89af419b385c-config\") pod \"data-science-usage-logs-lokistack-ingester-0\" (UID: \"bda3c536-9311-431c-a789-89af419b385c\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-ingester-0"
Oct 30 21:37:15.262848 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:15.262821    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-usage-logs-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bda3c536-9311-431c-a789-89af419b385c-data-science-usage-logs-lokistack-ca-bundle\") pod \"data-science-usage-logs-lokistack-ingester-0\" (UID: \"bda3c536-9311-431c-a789-89af419b385c\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-ingester-0"
Oct 30 21:37:15.263039 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:15.262900    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-usage-logs-lokistack-ingester-grpc\" (UniqueName: \"kubernetes.io/secret/bda3c536-9311-431c-a789-89af419b385c-data-science-usage-logs-lokistack-ingester-grpc\") pod \"data-science-usage-logs-lokistack-ingester-0\" (UID: \"bda3c536-9311-431c-a789-89af419b385c\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-ingester-0"
Oct 30 21:37:15.263039 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:15.263027    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-loki-lifecycle-secret\" (UniqueName: \"kubernetes.io/secret/bda3c536-9311-431c-a789-89af419b385c-test-loki-lifecycle-secret\") pod \"data-science-usage-logs-lokistack-ingester-0\" (UID: \"bda3c536-9311-431c-a789-89af419b385c\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-ingester-0"
Oct 30 21:37:15.263113 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:15.263091    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-usage-logs-lokistack-ingester-http\" (UniqueName: \"kubernetes.io/secret/bda3c536-9311-431c-a789-89af419b385c-data-science-usage-logs-lokistack-ingester-http\") pod \"data-science-usage-logs-lokistack-ingester-0\" (UID: \"bda3c536-9311-431c-a789-89af419b385c\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-ingester-0"
Oct 30 21:37:15.263155 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:15.263128    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8d67c\" (UniqueName: \"kubernetes.io/projected/bda3c536-9311-431c-a789-89af419b385c-kube-api-access-8d67c\") pod \"data-science-usage-logs-lokistack-ingester-0\" (UID: \"bda3c536-9311-431c-a789-89af419b385c\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-ingester-0"
Oct 30 21:37:15.364400 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:15.364368    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8d67c\" (UniqueName: \"kubernetes.io/projected/bda3c536-9311-431c-a789-89af419b385c-kube-api-access-8d67c\") pod \"data-science-usage-logs-lokistack-ingester-0\" (UID: \"bda3c536-9311-431c-a789-89af419b385c\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-ingester-0"
Oct 30 21:37:15.364595 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:15.364408    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bda3c536-9311-431c-a789-89af419b385c-config\") pod \"data-science-usage-logs-lokistack-ingester-0\" (UID: \"bda3c536-9311-431c-a789-89af419b385c\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-ingester-0"
Oct 30 21:37:15.364595 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:15.364440    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-usage-logs-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bda3c536-9311-431c-a789-89af419b385c-data-science-usage-logs-lokistack-ca-bundle\") pod \"data-science-usage-logs-lokistack-ingester-0\" (UID: \"bda3c536-9311-431c-a789-89af419b385c\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-ingester-0"
Oct 30 21:37:15.364595 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:15.364471    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-usage-logs-lokistack-ingester-grpc\" (UniqueName: \"kubernetes.io/secret/bda3c536-9311-431c-a789-89af419b385c-data-science-usage-logs-lokistack-ingester-grpc\") pod \"data-science-usage-logs-lokistack-ingester-0\" (UID: \"bda3c536-9311-431c-a789-89af419b385c\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-ingester-0"
Oct 30 21:37:15.364595 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:15.364520    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"test-loki-lifecycle-secret\" (UniqueName: \"kubernetes.io/secret/bda3c536-9311-431c-a789-89af419b385c-test-loki-lifecycle-secret\") pod \"data-science-usage-logs-lokistack-ingester-0\" (UID: \"bda3c536-9311-431c-a789-89af419b385c\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-ingester-0"
Oct 30 21:37:15.364595 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:15.364547    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-usage-logs-lokistack-ingester-http\" (UniqueName: \"kubernetes.io/secret/bda3c536-9311-431c-a789-89af419b385c-data-science-usage-logs-lokistack-ingester-http\") pod \"data-science-usage-logs-lokistack-ingester-0\" (UID: \"bda3c536-9311-431c-a789-89af419b385c\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-ingester-0"
Oct 30 21:37:15.365207 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:15.365177    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-usage-logs-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bda3c536-9311-431c-a789-89af419b385c-data-science-usage-logs-lokistack-ca-bundle\") pod \"data-science-usage-logs-lokistack-ingester-0\" (UID: \"bda3c536-9311-431c-a789-89af419b385c\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-ingester-0"
Oct 30 21:37:15.365337 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:15.365296    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bda3c536-9311-431c-a789-89af419b385c-config\") pod \"data-science-usage-logs-lokistack-ingester-0\" (UID: \"bda3c536-9311-431c-a789-89af419b385c\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-ingester-0"
Oct 30 21:37:15.366993 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:15.366968    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-usage-logs-lokistack-ingester-http\" (UniqueName: \"kubernetes.io/secret/bda3c536-9311-431c-a789-89af419b385c-data-science-usage-logs-lokistack-ingester-http\") pod \"data-science-usage-logs-lokistack-ingester-0\" (UID: \"bda3c536-9311-431c-a789-89af419b385c\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-ingester-0"
Oct 30 21:37:15.367101 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:15.367082    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-usage-logs-lokistack-ingester-grpc\" (UniqueName: \"kubernetes.io/secret/bda3c536-9311-431c-a789-89af419b385c-data-science-usage-logs-lokistack-ingester-grpc\") pod \"data-science-usage-logs-lokistack-ingester-0\" (UID: \"bda3c536-9311-431c-a789-89af419b385c\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-ingester-0"
Oct 30 21:37:15.367187 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:15.367169    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-loki-lifecycle-secret\" (UniqueName: \"kubernetes.io/secret/bda3c536-9311-431c-a789-89af419b385c-test-loki-lifecycle-secret\") pod \"data-science-usage-logs-lokistack-ingester-0\" (UID: \"bda3c536-9311-431c-a789-89af419b385c\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-ingester-0"
Oct 30 21:37:15.426551 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:15.426525    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8d67c\" (UniqueName: \"kubernetes.io/projected/bda3c536-9311-431c-a789-89af419b385c-kube-api-access-8d67c\") pod \"data-science-usage-logs-lokistack-ingester-0\" (UID: \"bda3c536-9311-431c-a789-89af419b385c\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-ingester-0"
Oct 30 21:37:15.428385 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:15.428360    4060 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-usage-logs-lokistack-compactor-0"]
Oct 30 21:37:15.432572 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:15.432554    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-compactor-0"
Oct 30 21:37:15.485221 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:15.485190    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-usage-logs-lokistack-compactor-grpc\""
Oct 30 21:37:15.485221 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:15.485198    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-usage-logs-lokistack-compactor-http\""
Oct 30 21:37:15.493621 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:15.493595    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-usage-logs-lokistack-compactor-0"]
Oct 30 21:37:15.566433 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:15.566355    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8bdb92ab-f5ab-4c4b-9f3c-012c448cb342-config\") pod \"data-science-usage-logs-lokistack-compactor-0\" (UID: \"8bdb92ab-f5ab-4c4b-9f3c-012c448cb342\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-compactor-0"
Oct 30 21:37:15.566433 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:15.566383    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zl868\" (UniqueName: \"kubernetes.io/projected/8bdb92ab-f5ab-4c4b-9f3c-012c448cb342-kube-api-access-zl868\") pod \"data-science-usage-logs-lokistack-compactor-0\" (UID: \"8bdb92ab-f5ab-4c4b-9f3c-012c448cb342\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-compactor-0"
Oct 30 21:37:15.566433 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:15.566405    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-usage-logs-lokistack-compactor-grpc\" (UniqueName: \"kubernetes.io/secret/8bdb92ab-f5ab-4c4b-9f3c-012c448cb342-data-science-usage-logs-lokistack-compactor-grpc\") pod \"data-science-usage-logs-lokistack-compactor-0\" (UID: \"8bdb92ab-f5ab-4c4b-9f3c-012c448cb342\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-compactor-0"
Oct 30 21:37:15.566724 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:15.566445    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-usage-logs-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8bdb92ab-f5ab-4c4b-9f3c-012c448cb342-data-science-usage-logs-lokistack-ca-bundle\") pod \"data-science-usage-logs-lokistack-compactor-0\" (UID: \"8bdb92ab-f5ab-4c4b-9f3c-012c448cb342\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-compactor-0"
Oct 30 21:37:15.566724 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:15.566569    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-loki-lifecycle-secret\" (UniqueName: \"kubernetes.io/secret/8bdb92ab-f5ab-4c4b-9f3c-012c448cb342-test-loki-lifecycle-secret\") pod \"data-science-usage-logs-lokistack-compactor-0\" (UID: \"8bdb92ab-f5ab-4c4b-9f3c-012c448cb342\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-compactor-0"
Oct 30 21:37:15.566724 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:15.566641    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-usage-logs-lokistack-compactor-http\" (UniqueName: \"kubernetes.io/secret/8bdb92ab-f5ab-4c4b-9f3c-012c448cb342-data-science-usage-logs-lokistack-compactor-http\") pod \"data-science-usage-logs-lokistack-compactor-0\" (UID: \"8bdb92ab-f5ab-4c4b-9f3c-012c448cb342\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-compactor-0"
Oct 30 21:37:15.667130 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:15.667089    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-usage-logs-lokistack-compactor-http\" (UniqueName: \"kubernetes.io/secret/8bdb92ab-f5ab-4c4b-9f3c-012c448cb342-data-science-usage-logs-lokistack-compactor-http\") pod \"data-science-usage-logs-lokistack-compactor-0\" (UID: \"8bdb92ab-f5ab-4c4b-9f3c-012c448cb342\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-compactor-0"
Oct 30 21:37:15.667130 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:15.667137    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8bdb92ab-f5ab-4c4b-9f3c-012c448cb342-config\") pod \"data-science-usage-logs-lokistack-compactor-0\" (UID: \"8bdb92ab-f5ab-4c4b-9f3c-012c448cb342\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-compactor-0"
Oct 30 21:37:15.667391 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:15.667154    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zl868\" (UniqueName: \"kubernetes.io/projected/8bdb92ab-f5ab-4c4b-9f3c-012c448cb342-kube-api-access-zl868\") pod \"data-science-usage-logs-lokistack-compactor-0\" (UID: \"8bdb92ab-f5ab-4c4b-9f3c-012c448cb342\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-compactor-0"
Oct 30 21:37:15.667391 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:15.667176    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-usage-logs-lokistack-compactor-grpc\" (UniqueName: \"kubernetes.io/secret/8bdb92ab-f5ab-4c4b-9f3c-012c448cb342-data-science-usage-logs-lokistack-compactor-grpc\") pod \"data-science-usage-logs-lokistack-compactor-0\" (UID: \"8bdb92ab-f5ab-4c4b-9f3c-012c448cb342\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-compactor-0"
Oct 30 21:37:15.667391 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:15.667195    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-usage-logs-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8bdb92ab-f5ab-4c4b-9f3c-012c448cb342-data-science-usage-logs-lokistack-ca-bundle\") pod \"data-science-usage-logs-lokistack-compactor-0\" (UID: \"8bdb92ab-f5ab-4c4b-9f3c-012c448cb342\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-compactor-0"
Oct 30 21:37:15.667391 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:15.667219    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"test-loki-lifecycle-secret\" (UniqueName: \"kubernetes.io/secret/8bdb92ab-f5ab-4c4b-9f3c-012c448cb342-test-loki-lifecycle-secret\") pod \"data-science-usage-logs-lokistack-compactor-0\" (UID: \"8bdb92ab-f5ab-4c4b-9f3c-012c448cb342\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-compactor-0"
Oct 30 21:37:15.668083 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:15.668053    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-usage-logs-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8bdb92ab-f5ab-4c4b-9f3c-012c448cb342-data-science-usage-logs-lokistack-ca-bundle\") pod \"data-science-usage-logs-lokistack-compactor-0\" (UID: \"8bdb92ab-f5ab-4c4b-9f3c-012c448cb342\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-compactor-0"
Oct 30 21:37:15.668083 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:15.668072    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8bdb92ab-f5ab-4c4b-9f3c-012c448cb342-config\") pod \"data-science-usage-logs-lokistack-compactor-0\" (UID: \"8bdb92ab-f5ab-4c4b-9f3c-012c448cb342\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-compactor-0"
Oct 30 21:37:15.670227 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:15.670199    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-usage-logs-lokistack-compactor-http\" (UniqueName: \"kubernetes.io/secret/8bdb92ab-f5ab-4c4b-9f3c-012c448cb342-data-science-usage-logs-lokistack-compactor-http\") pod \"data-science-usage-logs-lokistack-compactor-0\" (UID: \"8bdb92ab-f5ab-4c4b-9f3c-012c448cb342\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-compactor-0"
Oct 30 21:37:15.670339 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:15.670241    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-usage-logs-lokistack-compactor-grpc\" (UniqueName: \"kubernetes.io/secret/8bdb92ab-f5ab-4c4b-9f3c-012c448cb342-data-science-usage-logs-lokistack-compactor-grpc\") pod \"data-science-usage-logs-lokistack-compactor-0\" (UID: \"8bdb92ab-f5ab-4c4b-9f3c-012c448cb342\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-compactor-0"
Oct 30 21:37:15.670396 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:15.670377    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-loki-lifecycle-secret\" (UniqueName: \"kubernetes.io/secret/8bdb92ab-f5ab-4c4b-9f3c-012c448cb342-test-loki-lifecycle-secret\") pod \"data-science-usage-logs-lokistack-compactor-0\" (UID: \"8bdb92ab-f5ab-4c4b-9f3c-012c448cb342\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-compactor-0"
Oct 30 21:37:15.728345 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:15.728316    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zl868\" (UniqueName: \"kubernetes.io/projected/8bdb92ab-f5ab-4c4b-9f3c-012c448cb342-kube-api-access-zl868\") pod \"data-science-usage-logs-lokistack-compactor-0\" (UID: \"8bdb92ab-f5ab-4c4b-9f3c-012c448cb342\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-compactor-0"
Oct 30 21:37:24.657402 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:24.657368    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-b7f34ad9-8b36-4351-b6e4-5eb5bbd79d36\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0d49f1453ab2e1b57\") pod \"data-science-usage-logs-lokistack-ingester-0\" (UID: \"bda3c536-9311-431c-a789-89af419b385c\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-ingester-0"
Oct 30 21:37:24.657853 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:24.657436    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-095ababd-be79-496f-b4fb-2d81ff245a1a\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0fdad28dd10561ce9\") pod \"data-science-usage-logs-lokistack-ingester-0\" (UID: \"bda3c536-9311-431c-a789-89af419b385c\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-ingester-0"
Oct 30 21:37:24.761909 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:24.761873    4060 operation_generator.go:1464] "Controller attach succeeded for volume \"pvc-b7f34ad9-8b36-4351-b6e4-5eb5bbd79d36\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0d49f1453ab2e1b57\") pod \"data-science-usage-logs-lokistack-ingester-0\" (UID: \"bda3c536-9311-431c-a789-89af419b385c\") device path: \"\"" pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-ingester-0"
Oct 30 21:37:24.761909 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:24.761884    4060 operation_generator.go:1464] "Controller attach succeeded for volume \"pvc-095ababd-be79-496f-b4fb-2d81ff245a1a\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0fdad28dd10561ce9\") pod \"data-science-usage-logs-lokistack-ingester-0\" (UID: \"bda3c536-9311-431c-a789-89af419b385c\") device path: \"\"" pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-ingester-0"
Oct 30 21:37:24.859402 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:24.859321    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"pvc-b7f34ad9-8b36-4351-b6e4-5eb5bbd79d36\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0d49f1453ab2e1b57\") pod \"data-science-usage-logs-lokistack-ingester-0\" (UID: \"bda3c536-9311-431c-a789-89af419b385c\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-ingester-0"
Oct 30 21:37:24.859402 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:24.859377    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"pvc-095ababd-be79-496f-b4fb-2d81ff245a1a\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0fdad28dd10561ce9\") pod \"data-science-usage-logs-lokistack-ingester-0\" (UID: \"bda3c536-9311-431c-a789-89af419b385c\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-ingester-0"
Oct 30 21:37:24.859605 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:24.859463    4060 operation_generator.go:515] "MountVolume.WaitForAttach entering for volume \"pvc-b7f34ad9-8b36-4351-b6e4-5eb5bbd79d36\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0d49f1453ab2e1b57\") pod \"data-science-usage-logs-lokistack-ingester-0\" (UID: \"bda3c536-9311-431c-a789-89af419b385c\") DevicePath \"\"" pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-ingester-0"
Oct 30 21:37:24.859605 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:24.859477    4060 operation_generator.go:515] "MountVolume.WaitForAttach entering for volume \"pvc-095ababd-be79-496f-b4fb-2d81ff245a1a\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0fdad28dd10561ce9\") pod \"data-science-usage-logs-lokistack-ingester-0\" (UID: \"bda3c536-9311-431c-a789-89af419b385c\") DevicePath \"\"" pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-ingester-0"
Oct 30 21:37:24.911577 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:24.911549    4060 operation_generator.go:525] "MountVolume.WaitForAttach succeeded for volume \"pvc-095ababd-be79-496f-b4fb-2d81ff245a1a\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0fdad28dd10561ce9\") pod \"data-science-usage-logs-lokistack-ingester-0\" (UID: \"bda3c536-9311-431c-a789-89af419b385c\") DevicePath \"csi-98c0e8637e0992454cba41778f813443cafe85bba2793f8f0cd3327e334f47a8\"" pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-ingester-0"
Oct 30 21:37:24.911689 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:24.911548    4060 operation_generator.go:525] "MountVolume.WaitForAttach succeeded for volume \"pvc-b7f34ad9-8b36-4351-b6e4-5eb5bbd79d36\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0d49f1453ab2e1b57\") pod \"data-science-usage-logs-lokistack-ingester-0\" (UID: \"bda3c536-9311-431c-a789-89af419b385c\") DevicePath \"csi-9b51f5ae839120bb5470ef768acdf7cc9b5d7bed86bc1d51ff6dc39934988af7\"" pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-ingester-0"
Oct 30 21:37:25.051336 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:25.051304    4060 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"pvc-b7f34ad9-8b36-4351-b6e4-5eb5bbd79d36\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0d49f1453ab2e1b57\") pod \"data-science-usage-logs-lokistack-ingester-0\" (UID: \"bda3c536-9311-431c-a789-89af419b385c\") device mount path \"/var/lib/kubelet/plugins/kubernetes.io/csi/ebs.csi.aws.com/c029c8b63da86bb80198b1e1499e34b65ec9380ac44499e9974f5cbb2b19b1a0/globalmount\"" pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-ingester-0"
Oct 30 21:37:25.052080 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:25.052058    4060 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"pvc-095ababd-be79-496f-b4fb-2d81ff245a1a\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0fdad28dd10561ce9\") pod \"data-science-usage-logs-lokistack-ingester-0\" (UID: \"bda3c536-9311-431c-a789-89af419b385c\") device mount path \"/var/lib/kubelet/plugins/kubernetes.io/csi/ebs.csi.aws.com/3599031f1f369668381f8de34b2d2208c927c911462778ffe2e7b80ddd4e9f9a/globalmount\"" pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-ingester-0"
Oct 30 21:37:25.115760 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:25.115677    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pvc-b7f34ad9-8b36-4351-b6e4-5eb5bbd79d36\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0d49f1453ab2e1b57\") pod \"data-science-usage-logs-lokistack-ingester-0\" (UID: \"bda3c536-9311-431c-a789-89af419b385c\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-ingester-0"
Oct 30 21:37:25.126929 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:25.126902    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pvc-095ababd-be79-496f-b4fb-2d81ff245a1a\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0fdad28dd10561ce9\") pod \"data-science-usage-logs-lokistack-ingester-0\" (UID: \"bda3c536-9311-431c-a789-89af419b385c\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-ingester-0"
Oct 30 21:37:25.525353 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:25.525322    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-usage-logs-lokistack-dockercfg-c4bmf\""
Oct 30 21:37:25.534540 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:25.534517    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-ingester-0"
Oct 30 21:37:25.956202 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:25.956177    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-usage-logs-lokistack-ingester-0"]
Oct 30 21:37:25.958000 ip-10-0-142-4 kubenswrapper[4060]: W1030 21:37:25.957975    4060 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbda3c536_9311_431c_a789_89af419b385c.slice/crio-d3470f7f5633b68118de4d56347d4f39844d0268cd0287e3699d70143b51a6f3 WatchSource:0}: Error finding container d3470f7f5633b68118de4d56347d4f39844d0268cd0287e3699d70143b51a6f3: Status 404 returned error can't find the container with id d3470f7f5633b68118de4d56347d4f39844d0268cd0287e3699d70143b51a6f3
Oct 30 21:37:26.682054 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:26.682019    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-ingester-0" event={"ID":"bda3c536-9311-431c-a789-89af419b385c","Type":"ContainerStarted","Data":"cd248834d0a3957faf137f38aabff8f497965e8f5af1a6ea7d95d395bd20b41c"}
Oct 30 21:37:26.682207 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:26.682062    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-ingester-0" event={"ID":"bda3c536-9311-431c-a789-89af419b385c","Type":"ContainerStarted","Data":"d3470f7f5633b68118de4d56347d4f39844d0268cd0287e3699d70143b51a6f3"}
Oct 30 21:37:26.682207 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:26.682093    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-ingester-0"
Oct 30 21:37:26.802406 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:26.802350    4060 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-ingester-0" podStartSLOduration=12.802336711 podStartE2EDuration="12.802336711s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 21:37:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:37:26.800332836 +0000 UTC m=+3665.557331157" watchObservedRunningTime="2026-10-30 21:37:26.802336711 +0000 UTC m=+3665.559335009"
Oct 30 21:37:26.878696 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:26.878665    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-4a867896-64e1-4d28-a8f2-4f1338cf57d1\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0bb8949dd735e3b3f\") pod \"data-science-usage-logs-lokistack-compactor-0\" (UID: \"8bdb92ab-f5ab-4c4b-9f3c-012c448cb342\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-compactor-0"
Oct 30 21:37:26.982854 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:26.982829    4060 operation_generator.go:1464] "Controller attach succeeded for volume \"pvc-4a867896-64e1-4d28-a8f2-4f1338cf57d1\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0bb8949dd735e3b3f\") pod \"data-science-usage-logs-lokistack-compactor-0\" (UID: \"8bdb92ab-f5ab-4c4b-9f3c-012c448cb342\") device path: \"\"" pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-compactor-0"
Oct 30 21:37:27.081135 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:27.081103    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"pvc-4a867896-64e1-4d28-a8f2-4f1338cf57d1\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0bb8949dd735e3b3f\") pod \"data-science-usage-logs-lokistack-compactor-0\" (UID: \"8bdb92ab-f5ab-4c4b-9f3c-012c448cb342\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-compactor-0"
Oct 30 21:37:27.081263 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:27.081240    4060 operation_generator.go:515] "MountVolume.WaitForAttach entering for volume \"pvc-4a867896-64e1-4d28-a8f2-4f1338cf57d1\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0bb8949dd735e3b3f\") pod \"data-science-usage-logs-lokistack-compactor-0\" (UID: \"8bdb92ab-f5ab-4c4b-9f3c-012c448cb342\") DevicePath \"\"" pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-compactor-0"
Oct 30 21:37:27.140186 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:27.140156    4060 operation_generator.go:525] "MountVolume.WaitForAttach succeeded for volume \"pvc-4a867896-64e1-4d28-a8f2-4f1338cf57d1\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0bb8949dd735e3b3f\") pod \"data-science-usage-logs-lokistack-compactor-0\" (UID: \"8bdb92ab-f5ab-4c4b-9f3c-012c448cb342\") DevicePath \"csi-9caaa052e55c4356b2b305b9f55b384c8d1756b92d685679802417fa155b9f73\"" pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-compactor-0"
Oct 30 21:37:27.277338 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:27.277308    4060 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"pvc-4a867896-64e1-4d28-a8f2-4f1338cf57d1\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0bb8949dd735e3b3f\") pod \"data-science-usage-logs-lokistack-compactor-0\" (UID: \"8bdb92ab-f5ab-4c4b-9f3c-012c448cb342\") device mount path \"/var/lib/kubelet/plugins/kubernetes.io/csi/ebs.csi.aws.com/fdd263e80916c99f6ceb9f70acac6dacd6dc4d7bb485176bf2f162ed785207a5/globalmount\"" pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-compactor-0"
Oct 30 21:37:27.341921 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:27.341889    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pvc-4a867896-64e1-4d28-a8f2-4f1338cf57d1\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0bb8949dd735e3b3f\") pod \"data-science-usage-logs-lokistack-compactor-0\" (UID: \"8bdb92ab-f5ab-4c4b-9f3c-012c448cb342\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-compactor-0"
Oct 30 21:37:27.443710 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:27.443683    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-compactor-0"
Oct 30 21:37:27.815722 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:27.815699    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-usage-logs-lokistack-compactor-0"]
Oct 30 21:37:27.817756 ip-10-0-142-4 kubenswrapper[4060]: W1030 21:37:27.817728    4060 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8bdb92ab_f5ab_4c4b_9f3c_012c448cb342.slice/crio-7282e17de1c002bacc0fe7014a39b7af9390f6c0d2a0ae14f7c95c8a152295bd WatchSource:0}: Error finding container 7282e17de1c002bacc0fe7014a39b7af9390f6c0d2a0ae14f7c95c8a152295bd: Status 404 returned error can't find the container with id 7282e17de1c002bacc0fe7014a39b7af9390f6c0d2a0ae14f7c95c8a152295bd
Oct 30 21:37:28.692362 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:28.692325    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-compactor-0" event={"ID":"8bdb92ab-f5ab-4c4b-9f3c-012c448cb342","Type":"ContainerStarted","Data":"a23ebe72ab443418865d3fe59ddd2bae767ff6559cb6c5fdf1d489cc3f649f11"}
Oct 30 21:37:28.692362 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:28.692366    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-compactor-0" event={"ID":"8bdb92ab-f5ab-4c4b-9f3c-012c448cb342","Type":"ContainerStarted","Data":"7282e17de1c002bacc0fe7014a39b7af9390f6c0d2a0ae14f7c95c8a152295bd"}
Oct 30 21:37:28.692865 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:28.692404    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-compactor-0"
Oct 30 21:37:28.860575 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:28.860519    4060 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-compactor-0" podStartSLOduration=13.860504805 podStartE2EDuration="13.860504805s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 21:37:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:37:28.810199133 +0000 UTC m=+3667.567197432" watchObservedRunningTime="2026-10-30 21:37:28.860504805 +0000 UTC m=+3667.617503093"
Oct 30 21:37:42.150009 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:37:42.149976    4060 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v2f4x" containerName="extractor"
Oct 30 21:37:47.692878 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:47.692839    4060 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-ingester-0" podUID="bda3c536-9311-431c-a789-89af419b385c" containerName="loki-ingester" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 21:37:49.702279 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:49.702252    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-compactor-0"
Oct 30 21:37:57.691377 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:37:57.691336    4060 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-ingester-0" podUID="bda3c536-9311-431c-a789-89af419b385c" containerName="loki-ingester" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 21:38:07.691226 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:38:07.691198    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-ingester-0"
Oct 30 21:38:12.150988 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:38:12.150950    4060 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v2f4x" containerName="extractor"
Oct 30 21:38:31.039930 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:38:31.039890    4060 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-usage-logs-collector-86f7998849-54dvs"]
Oct 30 21:38:31.043358 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:38:31.043336    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-usage-logs-collector-86f7998849-54dvs"
Oct 30 21:38:31.095948 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:38:31.095907    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-usage-logs-collector-headless-tls\""
Oct 30 21:38:31.096125 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:38:31.096073    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/a19150be-f5e0-4377-8baa-c5a48d4e1075-otc-internal\") pod \"data-science-usage-logs-collector-86f7998849-54dvs\" (UID: \"a19150be-f5e0-4377-8baa-c5a48d4e1075\") " pod="redhat-ods-monitoring/data-science-usage-logs-collector-86f7998849-54dvs"
Oct 30 21:38:31.096184 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:38:31.096125    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/a19150be-f5e0-4377-8baa-c5a48d4e1075-otlp-tls-certs\") pod \"data-science-usage-logs-collector-86f7998849-54dvs\" (UID: \"a19150be-f5e0-4377-8baa-c5a48d4e1075\") " pod="redhat-ods-monitoring/data-science-usage-logs-collector-86f7998849-54dvs"
Oct 30 21:38:31.096279 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:38:31.096256    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2z7s2\" (UniqueName: \"kubernetes.io/projected/a19150be-f5e0-4377-8baa-c5a48d4e1075-kube-api-access-2z7s2\") pod \"data-science-usage-logs-collector-86f7998849-54dvs\" (UID: \"a19150be-f5e0-4377-8baa-c5a48d4e1075\") " pod="redhat-ods-monitoring/data-science-usage-logs-collector-86f7998849-54dvs"
Oct 30 21:38:31.145546 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:38:31.145512    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-usage-logs-collector-dockercfg-z9prh\""
Oct 30 21:38:31.145730 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:38:31.145590    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-usage-logs-collector-9d8884b6\""
Oct 30 21:38:31.148863 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:38:31.148835    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-usage-logs-collector-86f7998849-54dvs"]
Oct 30 21:38:31.197566 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:38:31.197531    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/a19150be-f5e0-4377-8baa-c5a48d4e1075-otc-internal\") pod \"data-science-usage-logs-collector-86f7998849-54dvs\" (UID: \"a19150be-f5e0-4377-8baa-c5a48d4e1075\") " pod="redhat-ods-monitoring/data-science-usage-logs-collector-86f7998849-54dvs"
Oct 30 21:38:31.197754 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:38:31.197582    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/a19150be-f5e0-4377-8baa-c5a48d4e1075-otlp-tls-certs\") pod \"data-science-usage-logs-collector-86f7998849-54dvs\" (UID: \"a19150be-f5e0-4377-8baa-c5a48d4e1075\") " pod="redhat-ods-monitoring/data-science-usage-logs-collector-86f7998849-54dvs"
Oct 30 21:38:31.197754 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:38:31.197644    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2z7s2\" (UniqueName: \"kubernetes.io/projected/a19150be-f5e0-4377-8baa-c5a48d4e1075-kube-api-access-2z7s2\") pod \"data-science-usage-logs-collector-86f7998849-54dvs\" (UID: \"a19150be-f5e0-4377-8baa-c5a48d4e1075\") " pod="redhat-ods-monitoring/data-science-usage-logs-collector-86f7998849-54dvs"
Oct 30 21:38:31.197889 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:38:31.197796    4060 secret.go:189] Couldn't get secret redhat-ods-monitoring/data-science-usage-logs-collector-headless-tls: secret "data-science-usage-logs-collector-headless-tls" not found
Oct 30 21:38:31.197889 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:38:31.197879    4060 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a19150be-f5e0-4377-8baa-c5a48d4e1075-otlp-tls-certs podName:a19150be-f5e0-4377-8baa-c5a48d4e1075 nodeName:}" failed. No retries permitted until 2026-10-30 21:38:31.697862298 +0000 UTC m=+3730.454860596 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "otlp-tls-certs" (UniqueName: "kubernetes.io/secret/a19150be-f5e0-4377-8baa-c5a48d4e1075-otlp-tls-certs") pod "data-science-usage-logs-collector-86f7998849-54dvs" (UID: "a19150be-f5e0-4377-8baa-c5a48d4e1075") : secret "data-science-usage-logs-collector-headless-tls" not found
Oct 30 21:38:31.198373 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:38:31.198348    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/a19150be-f5e0-4377-8baa-c5a48d4e1075-otc-internal\") pod \"data-science-usage-logs-collector-86f7998849-54dvs\" (UID: \"a19150be-f5e0-4377-8baa-c5a48d4e1075\") " pod="redhat-ods-monitoring/data-science-usage-logs-collector-86f7998849-54dvs"
Oct 30 21:38:31.258854 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:38:31.258812    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2z7s2\" (UniqueName: \"kubernetes.io/projected/a19150be-f5e0-4377-8baa-c5a48d4e1075-kube-api-access-2z7s2\") pod \"data-science-usage-logs-collector-86f7998849-54dvs\" (UID: \"a19150be-f5e0-4377-8baa-c5a48d4e1075\") " pod="redhat-ods-monitoring/data-science-usage-logs-collector-86f7998849-54dvs"
Oct 30 21:38:31.705239 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:38:31.705188    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/a19150be-f5e0-4377-8baa-c5a48d4e1075-otlp-tls-certs\") pod \"data-science-usage-logs-collector-86f7998849-54dvs\" (UID: \"a19150be-f5e0-4377-8baa-c5a48d4e1075\") " pod="redhat-ods-monitoring/data-science-usage-logs-collector-86f7998849-54dvs"
Oct 30 21:38:31.707687 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:38:31.707656    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/a19150be-f5e0-4377-8baa-c5a48d4e1075-otlp-tls-certs\") pod \"data-science-usage-logs-collector-86f7998849-54dvs\" (UID: \"a19150be-f5e0-4377-8baa-c5a48d4e1075\") " pod="redhat-ods-monitoring/data-science-usage-logs-collector-86f7998849-54dvs"
Oct 30 21:38:31.956397 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:38:31.956312    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-usage-logs-collector-86f7998849-54dvs"
Oct 30 21:38:32.328787 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:38:32.328760    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-usage-logs-collector-86f7998849-54dvs"]
Oct 30 21:38:32.330780 ip-10-0-142-4 kubenswrapper[4060]: W1030 21:38:32.330760    4060 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda19150be_f5e0_4377_8baa_c5a48d4e1075.slice/crio-b164ab5af254a0401a933e740d4cbb3ae9d656d73ade107047ab178dada501f0 WatchSource:0}: Error finding container b164ab5af254a0401a933e740d4cbb3ae9d656d73ade107047ab178dada501f0: Status 404 returned error can't find the container with id b164ab5af254a0401a933e740d4cbb3ae9d656d73ade107047ab178dada501f0
Oct 30 21:38:32.333370 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:38:32.333339    4060 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 21:38:32.333438 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:38:32.333397    4060 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 21:38:32.983228 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:38:32.983190    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-usage-logs-collector-86f7998849-54dvs" event={"ID":"a19150be-f5e0-4377-8baa-c5a48d4e1075","Type":"ContainerStarted","Data":"77fba400e2da214f598275ed250a55b1974320c8dd8420cbcbd8f6b8164737ba"}
Oct 30 21:38:32.983415 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:38:32.983249    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-usage-logs-collector-86f7998849-54dvs" event={"ID":"a19150be-f5e0-4377-8baa-c5a48d4e1075","Type":"ContainerStarted","Data":"b164ab5af254a0401a933e740d4cbb3ae9d656d73ade107047ab178dada501f0"}
Oct 30 21:38:33.101015 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:38:33.100964    4060 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-usage-logs-collector-86f7998849-54dvs" podStartSLOduration=3.100946027 podStartE2EDuration="3.100946027s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:38:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:38:33.100543401 +0000 UTC m=+3731.857541703" watchObservedRunningTime="2026-10-30 21:38:33.100946027 +0000 UTC m=+3731.857944326"
Oct 30 21:38:37.714866 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:38:37.714828    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-usage-logs-lokistack-compactor-0"]
Oct 30 21:38:37.715294 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:38:37.715064    4060 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-compactor-0" podUID="8bdb92ab-f5ab-4c4b-9f3c-012c448cb342" containerName="loki-compactor" containerID="cri-o://a23ebe72ab443418865d3fe59ddd2bae767ff6559cb6c5fdf1d489cc3f649f11" gracePeriod=30
Oct 30 21:38:37.752359 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:38:37.752324    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-usage-logs-lokistack-ingester-0"]
Oct 30 21:38:37.752588 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:38:37.752566    4060 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-ingester-0" podUID="bda3c536-9311-431c-a789-89af419b385c" containerName="loki-ingester" containerID="cri-o://cd248834d0a3957faf137f38aabff8f497965e8f5af1a6ea7d95d395bd20b41c" gracePeriod=600
Oct 30 21:38:38.519394 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:38:38.519361    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-usage-logs-collector-86f7998849-54dvs"]
Oct 30 21:38:38.519604 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:38:38.519560    4060 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-usage-logs-collector-86f7998849-54dvs" podUID="a19150be-f5e0-4377-8baa-c5a48d4e1075" containerName="otc-container" containerID="cri-o://77fba400e2da214f598275ed250a55b1974320c8dd8420cbcbd8f6b8164737ba" gracePeriod=30
Oct 30 21:38:38.787378 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:38:38.787351    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-usage-logs-collector-86f7998849-54dvs"
Oct 30 21:38:38.802088 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:38:38.802063    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-compactor-0"
Oct 30 21:38:38.864379 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:38:38.864348    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a19150be-f5e0-4377-8baa-c5a48d4e1075-otc-internal\" (UniqueName: \"kubernetes.io/configmap/a19150be-f5e0-4377-8baa-c5a48d4e1075-otc-internal\") pod \"a19150be-f5e0-4377-8baa-c5a48d4e1075\" (UID: \"a19150be-f5e0-4377-8baa-c5a48d4e1075\") "
Oct 30 21:38:38.864582 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:38:38.864465    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/csi/ebs.csi.aws.com^vol-0bb8949dd735e3b3f\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0bb8949dd735e3b3f\") pod \"8bdb92ab-f5ab-4c4b-9f3c-012c448cb342\" (UID: \"8bdb92ab-f5ab-4c4b-9f3c-012c448cb342\") "
Oct 30 21:38:38.864582 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:38:38.864515    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/8bdb92ab-f5ab-4c4b-9f3c-012c448cb342-data-science-usage-logs-lokistack-compactor-http\" (UniqueName: \"kubernetes.io/secret/8bdb92ab-f5ab-4c4b-9f3c-012c448cb342-data-science-usage-logs-lokistack-compactor-http\") pod \"8bdb92ab-f5ab-4c4b-9f3c-012c448cb342\" (UID: \"8bdb92ab-f5ab-4c4b-9f3c-012c448cb342\") "
Oct 30 21:38:38.864582 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:38:38.864537    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8bdb92ab-f5ab-4c4b-9f3c-012c448cb342-kube-api-access-zl868\" (UniqueName: \"kubernetes.io/projected/8bdb92ab-f5ab-4c4b-9f3c-012c448cb342-kube-api-access-zl868\") pod \"8bdb92ab-f5ab-4c4b-9f3c-012c448cb342\" (UID: \"8bdb92ab-f5ab-4c4b-9f3c-012c448cb342\") "
Oct 30 21:38:38.864748 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:38:38.864667    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/8bdb92ab-f5ab-4c4b-9f3c-012c448cb342-data-science-usage-logs-lokistack-compactor-grpc\" (UniqueName: \"kubernetes.io/secret/8bdb92ab-f5ab-4c4b-9f3c-012c448cb342-data-science-usage-logs-lokistack-compactor-grpc\") pod \"8bdb92ab-f5ab-4c4b-9f3c-012c448cb342\" (UID: \"8bdb92ab-f5ab-4c4b-9f3c-012c448cb342\") "
Oct 30 21:38:38.864748 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:38:38.864695    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a19150be-f5e0-4377-8baa-c5a48d4e1075-otc-internal" pod "a19150be-f5e0-4377-8baa-c5a48d4e1075" (UID: "a19150be-f5e0-4377-8baa-c5a48d4e1075"). InnerVolumeSpecName "otc-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:38:38.864748 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:38:38.864707    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/8bdb92ab-f5ab-4c4b-9f3c-012c448cb342-config\" (UniqueName: \"kubernetes.io/configmap/8bdb92ab-f5ab-4c4b-9f3c-012c448cb342-config\") pod \"8bdb92ab-f5ab-4c4b-9f3c-012c448cb342\" (UID: \"8bdb92ab-f5ab-4c4b-9f3c-012c448cb342\") "
Oct 30 21:38:38.864748 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:38:38.864734    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/a19150be-f5e0-4377-8baa-c5a48d4e1075-otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/a19150be-f5e0-4377-8baa-c5a48d4e1075-otlp-tls-certs\") pod \"a19150be-f5e0-4377-8baa-c5a48d4e1075\" (UID: \"a19150be-f5e0-4377-8baa-c5a48d4e1075\") "
Oct 30 21:38:38.864961 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:38:38.864776    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/8bdb92ab-f5ab-4c4b-9f3c-012c448cb342-data-science-usage-logs-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8bdb92ab-f5ab-4c4b-9f3c-012c448cb342-data-science-usage-logs-lokistack-ca-bundle\") pod \"8bdb92ab-f5ab-4c4b-9f3c-012c448cb342\" (UID: \"8bdb92ab-f5ab-4c4b-9f3c-012c448cb342\") "
Oct 30 21:38:38.864961 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:38:38.864814    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a19150be-f5e0-4377-8baa-c5a48d4e1075-kube-api-access-2z7s2\" (UniqueName: \"kubernetes.io/projected/a19150be-f5e0-4377-8baa-c5a48d4e1075-kube-api-access-2z7s2\") pod \"a19150be-f5e0-4377-8baa-c5a48d4e1075\" (UID: \"a19150be-f5e0-4377-8baa-c5a48d4e1075\") "
Oct 30 21:38:38.864961 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:38:38.864863    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/8bdb92ab-f5ab-4c4b-9f3c-012c448cb342-test-loki-lifecycle-secret\" (UniqueName: \"kubernetes.io/secret/8bdb92ab-f5ab-4c4b-9f3c-012c448cb342-test-loki-lifecycle-secret\") pod \"8bdb92ab-f5ab-4c4b-9f3c-012c448cb342\" (UID: \"8bdb92ab-f5ab-4c4b-9f3c-012c448cb342\") "
Oct 30 21:38:38.865360 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:38:38.865251    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8bdb92ab-f5ab-4c4b-9f3c-012c448cb342-config" pod "8bdb92ab-f5ab-4c4b-9f3c-012c448cb342" (UID: "8bdb92ab-f5ab-4c4b-9f3c-012c448cb342"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:38:38.865360 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:38:38.865272    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8bdb92ab-f5ab-4c4b-9f3c-012c448cb342-data-science-usage-logs-lokistack-ca-bundle" pod "8bdb92ab-f5ab-4c4b-9f3c-012c448cb342" (UID: "8bdb92ab-f5ab-4c4b-9f3c-012c448cb342"). InnerVolumeSpecName "data-science-usage-logs-lokistack-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:38:38.866980 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:38:38.866956    4060 reconciler_common.go:299] "Volume detached for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/a19150be-f5e0-4377-8baa-c5a48d4e1075-otc-internal\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:38:38.867094 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:38:38.866984    4060 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8bdb92ab-f5ab-4c4b-9f3c-012c448cb342-config\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:38:38.867094 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:38:38.866999    4060 reconciler_common.go:299] "Volume detached for volume \"data-science-usage-logs-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8bdb92ab-f5ab-4c4b-9f3c-012c448cb342-data-science-usage-logs-lokistack-ca-bundle\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:38:38.867408 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:38:38.867378    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8bdb92ab-f5ab-4c4b-9f3c-012c448cb342-kube-api-access-zl868" pod "8bdb92ab-f5ab-4c4b-9f3c-012c448cb342" (UID: "8bdb92ab-f5ab-4c4b-9f3c-012c448cb342"). InnerVolumeSpecName "kube-api-access-zl868". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:38:38.867560 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:38:38.867502    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a19150be-f5e0-4377-8baa-c5a48d4e1075-otlp-tls-certs" pod "a19150be-f5e0-4377-8baa-c5a48d4e1075" (UID: "a19150be-f5e0-4377-8baa-c5a48d4e1075"). InnerVolumeSpecName "otlp-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:38:38.867560 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:38:38.867520    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8bdb92ab-f5ab-4c4b-9f3c-012c448cb342-data-science-usage-logs-lokistack-compactor-grpc" pod "8bdb92ab-f5ab-4c4b-9f3c-012c448cb342" (UID: "8bdb92ab-f5ab-4c4b-9f3c-012c448cb342"). InnerVolumeSpecName "data-science-usage-logs-lokistack-compactor-grpc". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:38:38.867683 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:38:38.867624    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8bdb92ab-f5ab-4c4b-9f3c-012c448cb342-test-loki-lifecycle-secret" pod "8bdb92ab-f5ab-4c4b-9f3c-012c448cb342" (UID: "8bdb92ab-f5ab-4c4b-9f3c-012c448cb342"). InnerVolumeSpecName "test-loki-lifecycle-secret". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:38:38.867683 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:38:38.867651    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8bdb92ab-f5ab-4c4b-9f3c-012c448cb342-data-science-usage-logs-lokistack-compactor-http" pod "8bdb92ab-f5ab-4c4b-9f3c-012c448cb342" (UID: "8bdb92ab-f5ab-4c4b-9f3c-012c448cb342"). InnerVolumeSpecName "data-science-usage-logs-lokistack-compactor-http". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:38:38.867802 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:38:38.867784    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a19150be-f5e0-4377-8baa-c5a48d4e1075-kube-api-access-2z7s2" pod "a19150be-f5e0-4377-8baa-c5a48d4e1075" (UID: "a19150be-f5e0-4377-8baa-c5a48d4e1075"). InnerVolumeSpecName "kube-api-access-2z7s2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:38:38.867888 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:38:38.867873    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/csi/ebs.csi.aws.com^vol-0bb8949dd735e3b3f" pod "8bdb92ab-f5ab-4c4b-9f3c-012c448cb342" (UID: "8bdb92ab-f5ab-4c4b-9f3c-012c448cb342"). InnerVolumeSpecName "pvc-4a867896-64e1-4d28-a8f2-4f1338cf57d1". PluginName "kubernetes.io/csi", VolumeGIDValue ""
Oct 30 21:38:38.967397 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:38:38.967370    4060 reconciler_common.go:299] "Volume detached for volume \"test-loki-lifecycle-secret\" (UniqueName: \"kubernetes.io/secret/8bdb92ab-f5ab-4c4b-9f3c-012c448cb342-test-loki-lifecycle-secret\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:38:38.967574 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:38:38.967414    4060 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"pvc-4a867896-64e1-4d28-a8f2-4f1338cf57d1\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0bb8949dd735e3b3f\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" "
Oct 30 21:38:38.967574 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:38:38.967429    4060 reconciler_common.go:299] "Volume detached for volume \"data-science-usage-logs-lokistack-compactor-http\" (UniqueName: \"kubernetes.io/secret/8bdb92ab-f5ab-4c4b-9f3c-012c448cb342-data-science-usage-logs-lokistack-compactor-http\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:38:38.967574 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:38:38.967445    4060 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zl868\" (UniqueName: \"kubernetes.io/projected/8bdb92ab-f5ab-4c4b-9f3c-012c448cb342-kube-api-access-zl868\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:38:38.967574 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:38:38.967459    4060 reconciler_common.go:299] "Volume detached for volume \"data-science-usage-logs-lokistack-compactor-grpc\" (UniqueName: \"kubernetes.io/secret/8bdb92ab-f5ab-4c4b-9f3c-012c448cb342-data-science-usage-logs-lokistack-compactor-grpc\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:38:38.967574 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:38:38.967474    4060 reconciler_common.go:299] "Volume detached for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/a19150be-f5e0-4377-8baa-c5a48d4e1075-otlp-tls-certs\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:38:38.967574 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:38:38.967508    4060 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2z7s2\" (UniqueName: \"kubernetes.io/projected/a19150be-f5e0-4377-8baa-c5a48d4e1075-kube-api-access-2z7s2\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:38:38.976460 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:38:38.976436    4060 operation_generator.go:893] UnmountDevice succeeded for volume "pvc-4a867896-64e1-4d28-a8f2-4f1338cf57d1" (UniqueName: "kubernetes.io/csi/ebs.csi.aws.com^vol-0bb8949dd735e3b3f") on node "ip-10-0-142-4.us-west-1.compute.internal"
Oct 30 21:38:39.019195 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:38:39.019164    4060 generic.go:356] "Generic (PLEG): container finished" podID="a19150be-f5e0-4377-8baa-c5a48d4e1075" containerID="77fba400e2da214f598275ed250a55b1974320c8dd8420cbcbd8f6b8164737ba" exitCode=0
Oct 30 21:38:39.019388 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:38:39.019221    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-usage-logs-collector-86f7998849-54dvs"
Oct 30 21:38:39.019388 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:38:39.019250    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-usage-logs-collector-86f7998849-54dvs" event={"ID":"a19150be-f5e0-4377-8baa-c5a48d4e1075","Type":"ContainerDied","Data":"77fba400e2da214f598275ed250a55b1974320c8dd8420cbcbd8f6b8164737ba"}
Oct 30 21:38:39.019388 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:38:39.019339    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-usage-logs-collector-86f7998849-54dvs" event={"ID":"a19150be-f5e0-4377-8baa-c5a48d4e1075","Type":"ContainerDied","Data":"b164ab5af254a0401a933e740d4cbb3ae9d656d73ade107047ab178dada501f0"}
Oct 30 21:38:39.019388 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:38:39.019367    4060 scope.go:122] "RemoveContainer" containerID="77fba400e2da214f598275ed250a55b1974320c8dd8420cbcbd8f6b8164737ba"
Oct 30 21:38:39.021127 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:38:39.021109    4060 generic.go:356] "Generic (PLEG): container finished" podID="bda3c536-9311-431c-a789-89af419b385c" containerID="cd248834d0a3957faf137f38aabff8f497965e8f5af1a6ea7d95d395bd20b41c" exitCode=0
Oct 30 21:38:39.021198 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:38:39.021173    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-ingester-0" event={"ID":"bda3c536-9311-431c-a789-89af419b385c","Type":"ContainerDied","Data":"cd248834d0a3957faf137f38aabff8f497965e8f5af1a6ea7d95d395bd20b41c"}
Oct 30 21:38:39.022744 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:38:39.022682    4060 generic.go:356] "Generic (PLEG): container finished" podID="8bdb92ab-f5ab-4c4b-9f3c-012c448cb342" containerID="a23ebe72ab443418865d3fe59ddd2bae767ff6559cb6c5fdf1d489cc3f649f11" exitCode=0
Oct 30 21:38:39.022835 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:38:39.022787    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-compactor-0" event={"ID":"8bdb92ab-f5ab-4c4b-9f3c-012c448cb342","Type":"ContainerDied","Data":"a23ebe72ab443418865d3fe59ddd2bae767ff6559cb6c5fdf1d489cc3f649f11"}
Oct 30 21:38:39.022835 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:38:39.022817    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-compactor-0" event={"ID":"8bdb92ab-f5ab-4c4b-9f3c-012c448cb342","Type":"ContainerDied","Data":"7282e17de1c002bacc0fe7014a39b7af9390f6c0d2a0ae14f7c95c8a152295bd"}
Oct 30 21:38:39.022922 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:38:39.022910    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-compactor-0"
Oct 30 21:38:39.034067 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:38:39.034043    4060 scope.go:122] "RemoveContainer" containerID="77fba400e2da214f598275ed250a55b1974320c8dd8420cbcbd8f6b8164737ba"
Oct 30 21:38:39.034462 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:38:39.034436    4060 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"77fba400e2da214f598275ed250a55b1974320c8dd8420cbcbd8f6b8164737ba\": container with ID starting with 77fba400e2da214f598275ed250a55b1974320c8dd8420cbcbd8f6b8164737ba not found: ID does not exist" containerID="77fba400e2da214f598275ed250a55b1974320c8dd8420cbcbd8f6b8164737ba"
Oct 30 21:38:39.034585 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:38:39.034472    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"77fba400e2da214f598275ed250a55b1974320c8dd8420cbcbd8f6b8164737ba"} err="failed to get container status \"77fba400e2da214f598275ed250a55b1974320c8dd8420cbcbd8f6b8164737ba\": rpc error: code = NotFound desc = could not find container \"77fba400e2da214f598275ed250a55b1974320c8dd8420cbcbd8f6b8164737ba\": container with ID starting with 77fba400e2da214f598275ed250a55b1974320c8dd8420cbcbd8f6b8164737ba not found: ID does not exist"
Oct 30 21:38:39.034585 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:38:39.034522    4060 scope.go:122] "RemoveContainer" containerID="a23ebe72ab443418865d3fe59ddd2bae767ff6559cb6c5fdf1d489cc3f649f11"
Oct 30 21:38:39.043896 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:38:39.043869    4060 scope.go:122] "RemoveContainer" containerID="a23ebe72ab443418865d3fe59ddd2bae767ff6559cb6c5fdf1d489cc3f649f11"
Oct 30 21:38:39.044305 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:38:39.044243    4060 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a23ebe72ab443418865d3fe59ddd2bae767ff6559cb6c5fdf1d489cc3f649f11\": container with ID starting with a23ebe72ab443418865d3fe59ddd2bae767ff6559cb6c5fdf1d489cc3f649f11 not found: ID does not exist" containerID="a23ebe72ab443418865d3fe59ddd2bae767ff6559cb6c5fdf1d489cc3f649f11"
Oct 30 21:38:39.044305 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:38:39.044283    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a23ebe72ab443418865d3fe59ddd2bae767ff6559cb6c5fdf1d489cc3f649f11"} err="failed to get container status \"a23ebe72ab443418865d3fe59ddd2bae767ff6559cb6c5fdf1d489cc3f649f11\": rpc error: code = NotFound desc = could not find container \"a23ebe72ab443418865d3fe59ddd2bae767ff6559cb6c5fdf1d489cc3f649f11\": container with ID starting with a23ebe72ab443418865d3fe59ddd2bae767ff6559cb6c5fdf1d489cc3f649f11 not found: ID does not exist"
Oct 30 21:38:39.068852 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:38:39.068818    4060 reconciler_common.go:299] "Volume detached for volume \"pvc-4a867896-64e1-4d28-a8f2-4f1338cf57d1\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0bb8949dd735e3b3f\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"csi-9caaa052e55c4356b2b305b9f55b384c8d1756b92d685679802417fa155b9f73\""
Oct 30 21:38:39.100580 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:38:39.100556    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-ingester-0"
Oct 30 21:38:39.169996 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:38:39.169972    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/csi/ebs.csi.aws.com^vol-0fdad28dd10561ce9\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0fdad28dd10561ce9\") pod \"bda3c536-9311-431c-a789-89af419b385c\" (UID: \"bda3c536-9311-431c-a789-89af419b385c\") "
Oct 30 21:38:39.170167 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:38:39.170016    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/bda3c536-9311-431c-a789-89af419b385c-config\" (UniqueName: \"kubernetes.io/configmap/bda3c536-9311-431c-a789-89af419b385c-config\") pod \"bda3c536-9311-431c-a789-89af419b385c\" (UID: \"bda3c536-9311-431c-a789-89af419b385c\") "
Oct 30 21:38:39.170167 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:38:39.170049    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/bda3c536-9311-431c-a789-89af419b385c-kube-api-access-8d67c\" (UniqueName: \"kubernetes.io/projected/bda3c536-9311-431c-a789-89af419b385c-kube-api-access-8d67c\") pod \"bda3c536-9311-431c-a789-89af419b385c\" (UID: \"bda3c536-9311-431c-a789-89af419b385c\") "
Oct 30 21:38:39.170167 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:38:39.170069    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/bda3c536-9311-431c-a789-89af419b385c-data-science-usage-logs-lokistack-ingester-http\" (UniqueName: \"kubernetes.io/secret/bda3c536-9311-431c-a789-89af419b385c-data-science-usage-logs-lokistack-ingester-http\") pod \"bda3c536-9311-431c-a789-89af419b385c\" (UID: \"bda3c536-9311-431c-a789-89af419b385c\") "
Oct 30 21:38:39.170167 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:38:39.170092    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/bda3c536-9311-431c-a789-89af419b385c-data-science-usage-logs-lokistack-ingester-grpc\" (UniqueName: \"kubernetes.io/secret/bda3c536-9311-431c-a789-89af419b385c-data-science-usage-logs-lokistack-ingester-grpc\") pod \"bda3c536-9311-431c-a789-89af419b385c\" (UID: \"bda3c536-9311-431c-a789-89af419b385c\") "
Oct 30 21:38:39.170167 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:38:39.170142    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/bda3c536-9311-431c-a789-89af419b385c-data-science-usage-logs-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bda3c536-9311-431c-a789-89af419b385c-data-science-usage-logs-lokistack-ca-bundle\") pod \"bda3c536-9311-431c-a789-89af419b385c\" (UID: \"bda3c536-9311-431c-a789-89af419b385c\") "
Oct 30 21:38:39.170444 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:38:39.170232    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/csi/ebs.csi.aws.com^vol-0d49f1453ab2e1b57\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0d49f1453ab2e1b57\") pod \"bda3c536-9311-431c-a789-89af419b385c\" (UID: \"bda3c536-9311-431c-a789-89af419b385c\") "
Oct 30 21:38:39.170444 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:38:39.170297    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/bda3c536-9311-431c-a789-89af419b385c-test-loki-lifecycle-secret\" (UniqueName: \"kubernetes.io/secret/bda3c536-9311-431c-a789-89af419b385c-test-loki-lifecycle-secret\") pod \"bda3c536-9311-431c-a789-89af419b385c\" (UID: \"bda3c536-9311-431c-a789-89af419b385c\") "
Oct 30 21:38:39.170689 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:38:39.170662    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bda3c536-9311-431c-a789-89af419b385c-config" pod "bda3c536-9311-431c-a789-89af419b385c" (UID: "bda3c536-9311-431c-a789-89af419b385c"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:38:39.170759 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:38:39.170686    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bda3c536-9311-431c-a789-89af419b385c-data-science-usage-logs-lokistack-ca-bundle" pod "bda3c536-9311-431c-a789-89af419b385c" (UID: "bda3c536-9311-431c-a789-89af419b385c"). InnerVolumeSpecName "data-science-usage-logs-lokistack-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:38:39.171131 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:38:39.171110    4060 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bda3c536-9311-431c-a789-89af419b385c-config\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:38:39.171276 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:38:39.171258    4060 reconciler_common.go:299] "Volume detached for volume \"data-science-usage-logs-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bda3c536-9311-431c-a789-89af419b385c-data-science-usage-logs-lokistack-ca-bundle\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:38:39.172808 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:38:39.172757    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bda3c536-9311-431c-a789-89af419b385c-kube-api-access-8d67c" pod "bda3c536-9311-431c-a789-89af419b385c" (UID: "bda3c536-9311-431c-a789-89af419b385c"). InnerVolumeSpecName "kube-api-access-8d67c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:38:39.172918 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:38:39.172854    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bda3c536-9311-431c-a789-89af419b385c-data-science-usage-logs-lokistack-ingester-http" pod "bda3c536-9311-431c-a789-89af419b385c" (UID: "bda3c536-9311-431c-a789-89af419b385c"). InnerVolumeSpecName "data-science-usage-logs-lokistack-ingester-http". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:38:39.173075 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:38:39.173054    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bda3c536-9311-431c-a789-89af419b385c-data-science-usage-logs-lokistack-ingester-grpc" pod "bda3c536-9311-431c-a789-89af419b385c" (UID: "bda3c536-9311-431c-a789-89af419b385c"). InnerVolumeSpecName "data-science-usage-logs-lokistack-ingester-grpc". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:38:39.173397 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:38:39.173377    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/csi/ebs.csi.aws.com^vol-0fdad28dd10561ce9" pod "bda3c536-9311-431c-a789-89af419b385c" (UID: "bda3c536-9311-431c-a789-89af419b385c"). InnerVolumeSpecName "pvc-095ababd-be79-496f-b4fb-2d81ff245a1a". PluginName "kubernetes.io/csi", VolumeGIDValue ""
Oct 30 21:38:39.173467 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:38:39.173384    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/csi/ebs.csi.aws.com^vol-0d49f1453ab2e1b57" pod "bda3c536-9311-431c-a789-89af419b385c" (UID: "bda3c536-9311-431c-a789-89af419b385c"). InnerVolumeSpecName "pvc-b7f34ad9-8b36-4351-b6e4-5eb5bbd79d36". PluginName "kubernetes.io/csi", VolumeGIDValue ""
Oct 30 21:38:39.173681 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:38:39.173666    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bda3c536-9311-431c-a789-89af419b385c-test-loki-lifecycle-secret" pod "bda3c536-9311-431c-a789-89af419b385c" (UID: "bda3c536-9311-431c-a789-89af419b385c"). InnerVolumeSpecName "test-loki-lifecycle-secret". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:38:39.248314 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:38:39.248274    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-usage-logs-collector-86f7998849-54dvs"]
Oct 30 21:38:39.252445 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:38:39.252421    4060 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-usage-logs-collector-86f7998849-54dvs"]
Oct 30 21:38:39.272139 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:38:39.272113    4060 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"pvc-b7f34ad9-8b36-4351-b6e4-5eb5bbd79d36\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0d49f1453ab2e1b57\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" "
Oct 30 21:38:39.272139 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:38:39.272138    4060 reconciler_common.go:299] "Volume detached for volume \"test-loki-lifecycle-secret\" (UniqueName: \"kubernetes.io/secret/bda3c536-9311-431c-a789-89af419b385c-test-loki-lifecycle-secret\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:38:39.272293 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:38:39.272153    4060 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"pvc-095ababd-be79-496f-b4fb-2d81ff245a1a\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0fdad28dd10561ce9\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" "
Oct 30 21:38:39.272293 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:38:39.272165    4060 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8d67c\" (UniqueName: \"kubernetes.io/projected/bda3c536-9311-431c-a789-89af419b385c-kube-api-access-8d67c\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:38:39.272293 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:38:39.272180    4060 reconciler_common.go:299] "Volume detached for volume \"data-science-usage-logs-lokistack-ingester-http\" (UniqueName: \"kubernetes.io/secret/bda3c536-9311-431c-a789-89af419b385c-data-science-usage-logs-lokistack-ingester-http\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:38:39.272293 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:38:39.272195    4060 reconciler_common.go:299] "Volume detached for volume \"data-science-usage-logs-lokistack-ingester-grpc\" (UniqueName: \"kubernetes.io/secret/bda3c536-9311-431c-a789-89af419b385c-data-science-usage-logs-lokistack-ingester-grpc\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:38:39.282739 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:38:39.282722    4060 operation_generator.go:893] UnmountDevice succeeded for volume "pvc-b7f34ad9-8b36-4351-b6e4-5eb5bbd79d36" (UniqueName: "kubernetes.io/csi/ebs.csi.aws.com^vol-0d49f1453ab2e1b57") on node "ip-10-0-142-4.us-west-1.compute.internal"
Oct 30 21:38:39.287211 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:38:39.287197    4060 operation_generator.go:893] UnmountDevice succeeded for volume "pvc-095ababd-be79-496f-b4fb-2d81ff245a1a" (UniqueName: "kubernetes.io/csi/ebs.csi.aws.com^vol-0fdad28dd10561ce9") on node "ip-10-0-142-4.us-west-1.compute.internal"
Oct 30 21:38:39.372835 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:38:39.372800    4060 reconciler_common.go:299] "Volume detached for volume \"pvc-b7f34ad9-8b36-4351-b6e4-5eb5bbd79d36\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0d49f1453ab2e1b57\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"csi-9b51f5ae839120bb5470ef768acdf7cc9b5d7bed86bc1d51ff6dc39934988af7\""
Oct 30 21:38:39.372835 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:38:39.372833    4060 reconciler_common.go:299] "Volume detached for volume \"pvc-095ababd-be79-496f-b4fb-2d81ff245a1a\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0fdad28dd10561ce9\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"csi-98c0e8637e0992454cba41778f813443cafe85bba2793f8f0cd3327e334f47a8\""
Oct 30 21:38:39.427564 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:38:39.427532    4060 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a19150be-f5e0-4377-8baa-c5a48d4e1075" path="/var/lib/kubelet/pods/a19150be-f5e0-4377-8baa-c5a48d4e1075/volumes"
Oct 30 21:38:39.482724 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:38:39.482693    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-usage-logs-lokistack-compactor-0"]
Oct 30 21:38:39.486842 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:38:39.486817    4060 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-usage-logs-lokistack-compactor-0"]
Oct 30 21:38:40.029359 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:38:40.029333    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-ingester-0"
Oct 30 21:38:40.029965 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:38:40.029330    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-ingester-0" event={"ID":"bda3c536-9311-431c-a789-89af419b385c","Type":"ContainerDied","Data":"d3470f7f5633b68118de4d56347d4f39844d0268cd0287e3699d70143b51a6f3"}
Oct 30 21:38:40.029965 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:38:40.029458    4060 scope.go:122] "RemoveContainer" containerID="cd248834d0a3957faf137f38aabff8f497965e8f5af1a6ea7d95d395bd20b41c"
Oct 30 21:38:40.193555 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:38:40.193523    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-usage-logs-lokistack-ingester-0"]
Oct 30 21:38:40.242868 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:38:40.242833    4060 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-usage-logs-lokistack-ingester-0"]
Oct 30 21:38:41.426456 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:38:41.426424    4060 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="8bdb92ab-f5ab-4c4b-9f3c-012c448cb342" path="/var/lib/kubelet/pods/8bdb92ab-f5ab-4c4b-9f3c-012c448cb342/volumes"
Oct 30 21:38:41.426864 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:38:41.426839    4060 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="bda3c536-9311-431c-a789-89af419b385c" path="/var/lib/kubelet/pods/bda3c536-9311-431c-a789-89af419b385c/volumes"
Oct 30 21:38:42.150317 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:38:42.150284    4060 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v2f4x" containerName="extractor"
Oct 30 21:39:12.150601 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:39:12.150562    4060 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v2f4x" containerName="extractor"
Oct 30 21:39:17.228446 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:17.228413    4060 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-gzqpf"]
Oct 30 21:39:17.228847 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:17.228731    4060 cpu_manager.go:414] "containerMap: removing container" podUID="a19150be-f5e0-4377-8baa-c5a48d4e1075" containerName="otc-container"
Oct 30 21:39:17.228847 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:17.228744    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a19150be-f5e0-4377-8baa-c5a48d4e1075" containerName="otc-container"
Oct 30 21:39:17.228847 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:17.228764    4060 cpu_manager.go:414] "containerMap: removing container" podUID="bda3c536-9311-431c-a789-89af419b385c" containerName="loki-ingester"
Oct 30 21:39:17.228847 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:17.228769    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="bda3c536-9311-431c-a789-89af419b385c" containerName="loki-ingester"
Oct 30 21:39:17.228847 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:17.228779    4060 cpu_manager.go:414] "containerMap: removing container" podUID="8bdb92ab-f5ab-4c4b-9f3c-012c448cb342" containerName="loki-compactor"
Oct 30 21:39:17.228847 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:17.228785    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8bdb92ab-f5ab-4c4b-9f3c-012c448cb342" containerName="loki-compactor"
Oct 30 21:39:17.228847 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:17.228830    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="bda3c536-9311-431c-a789-89af419b385c" containerName="loki-ingester"
Oct 30 21:39:17.228847 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:17.228839    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="8bdb92ab-f5ab-4c4b-9f3c-012c448cb342" containerName="loki-compactor"
Oct 30 21:39:17.228847 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:17.228847    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="a19150be-f5e0-4377-8baa-c5a48d4e1075" containerName="otc-container"
Oct 30 21:39:17.231675 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:17.231658    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-gzqpf"
Oct 30 21:39:17.284845 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:17.284813    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-prometheus-cluster-proxy-kube-rbac-proxy\""
Oct 30 21:39:17.316064 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:17.316034    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"prometheus-operated-tls\""
Oct 30 21:39:17.316231 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:17.316086    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-prometheus-cluster-proxy-dockercfg-b2ndj\""
Oct 30 21:39:17.333749 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:17.333726    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"openshift-service-ca.crt\""
Oct 30 21:39:17.333922 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:17.333755    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-prometheus-cluster-proxy-tls\""
Oct 30 21:39:17.333998 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:17.333830    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"prometheus-web-tls-ca\""
Oct 30 21:39:17.333998 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:17.333935    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"kube-root-ca.crt\""
Oct 30 21:39:17.335778 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:17.335753    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-gzqpf"]
Oct 30 21:39:17.388347 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:17.388309    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9t5q9\" (UniqueName: \"kubernetes.io/projected/fca5bd38-ed8d-4e6e-b48e-ba683819429a-kube-api-access-9t5q9\") pod \"data-science-prometheus-cluster-proxy-545f759f7c-gzqpf\" (UID: \"fca5bd38-ed8d-4e6e-b48e-ba683819429a\") " pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-gzqpf"
Oct 30 21:39:17.388584 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:17.388356    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/fca5bd38-ed8d-4e6e-b48e-ba683819429a-tls\") pod \"data-science-prometheus-cluster-proxy-545f759f7c-gzqpf\" (UID: \"fca5bd38-ed8d-4e6e-b48e-ba683819429a\") " pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-gzqpf"
Oct 30 21:39:17.388584 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:17.388475    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fca5bd38-ed8d-4e6e-b48e-ba683819429a-kube-rbac-proxy-config\") pod \"data-science-prometheus-cluster-proxy-545f759f7c-gzqpf\" (UID: \"fca5bd38-ed8d-4e6e-b48e-ba683819429a\") " pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-gzqpf"
Oct 30 21:39:17.388706 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:17.388577    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-ca\" (UniqueName: \"kubernetes.io/configmap/fca5bd38-ed8d-4e6e-b48e-ba683819429a-prometheus-ca\") pod \"data-science-prometheus-cluster-proxy-545f759f7c-gzqpf\" (UID: \"fca5bd38-ed8d-4e6e-b48e-ba683819429a\") " pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-gzqpf"
Oct 30 21:39:17.388762 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:17.388743    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-client-cert\" (UniqueName: \"kubernetes.io/secret/fca5bd38-ed8d-4e6e-b48e-ba683819429a-prometheus-client-cert\") pod \"data-science-prometheus-cluster-proxy-545f759f7c-gzqpf\" (UID: \"fca5bd38-ed8d-4e6e-b48e-ba683819429a\") " pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-gzqpf"
Oct 30 21:39:17.490049 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:17.489965    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-client-cert\" (UniqueName: \"kubernetes.io/secret/fca5bd38-ed8d-4e6e-b48e-ba683819429a-prometheus-client-cert\") pod \"data-science-prometheus-cluster-proxy-545f759f7c-gzqpf\" (UID: \"fca5bd38-ed8d-4e6e-b48e-ba683819429a\") " pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-gzqpf"
Oct 30 21:39:17.490049 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:17.490002    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9t5q9\" (UniqueName: \"kubernetes.io/projected/fca5bd38-ed8d-4e6e-b48e-ba683819429a-kube-api-access-9t5q9\") pod \"data-science-prometheus-cluster-proxy-545f759f7c-gzqpf\" (UID: \"fca5bd38-ed8d-4e6e-b48e-ba683819429a\") " pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-gzqpf"
Oct 30 21:39:17.490049 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:17.490030    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/fca5bd38-ed8d-4e6e-b48e-ba683819429a-tls\") pod \"data-science-prometheus-cluster-proxy-545f759f7c-gzqpf\" (UID: \"fca5bd38-ed8d-4e6e-b48e-ba683819429a\") " pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-gzqpf"
Oct 30 21:39:17.490354 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:17.490096    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fca5bd38-ed8d-4e6e-b48e-ba683819429a-kube-rbac-proxy-config\") pod \"data-science-prometheus-cluster-proxy-545f759f7c-gzqpf\" (UID: \"fca5bd38-ed8d-4e6e-b48e-ba683819429a\") " pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-gzqpf"
Oct 30 21:39:17.490354 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:17.490137    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-ca\" (UniqueName: \"kubernetes.io/configmap/fca5bd38-ed8d-4e6e-b48e-ba683819429a-prometheus-ca\") pod \"data-science-prometheus-cluster-proxy-545f759f7c-gzqpf\" (UID: \"fca5bd38-ed8d-4e6e-b48e-ba683819429a\") " pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-gzqpf"
Oct 30 21:39:17.490857 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:17.490834    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-ca\" (UniqueName: \"kubernetes.io/configmap/fca5bd38-ed8d-4e6e-b48e-ba683819429a-prometheus-ca\") pod \"data-science-prometheus-cluster-proxy-545f759f7c-gzqpf\" (UID: \"fca5bd38-ed8d-4e6e-b48e-ba683819429a\") " pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-gzqpf"
Oct 30 21:39:17.492557 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:17.492532    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-client-cert\" (UniqueName: \"kubernetes.io/secret/fca5bd38-ed8d-4e6e-b48e-ba683819429a-prometheus-client-cert\") pod \"data-science-prometheus-cluster-proxy-545f759f7c-gzqpf\" (UID: \"fca5bd38-ed8d-4e6e-b48e-ba683819429a\") " pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-gzqpf"
Oct 30 21:39:17.492673 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:17.492627    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fca5bd38-ed8d-4e6e-b48e-ba683819429a-kube-rbac-proxy-config\") pod \"data-science-prometheus-cluster-proxy-545f759f7c-gzqpf\" (UID: \"fca5bd38-ed8d-4e6e-b48e-ba683819429a\") " pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-gzqpf"
Oct 30 21:39:17.492736 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:17.492708    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls\" (UniqueName: \"kubernetes.io/secret/fca5bd38-ed8d-4e6e-b48e-ba683819429a-tls\") pod \"data-science-prometheus-cluster-proxy-545f759f7c-gzqpf\" (UID: \"fca5bd38-ed8d-4e6e-b48e-ba683819429a\") " pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-gzqpf"
Oct 30 21:39:17.551733 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:17.551705    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9t5q9\" (UniqueName: \"kubernetes.io/projected/fca5bd38-ed8d-4e6e-b48e-ba683819429a-kube-api-access-9t5q9\") pod \"data-science-prometheus-cluster-proxy-545f759f7c-gzqpf\" (UID: \"fca5bd38-ed8d-4e6e-b48e-ba683819429a\") " pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-gzqpf"
Oct 30 21:39:17.567273 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:17.567240    4060 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/korrel8r-5cbcc89b8f-6gdr6"]
Oct 30 21:39:17.570568 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:17.570553    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-6gdr6"
Oct 30 21:39:17.623269 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:17.623234    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"korrel8r-config\""
Oct 30 21:39:17.623269 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:17.623258    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"korrel8r-tls\""
Oct 30 21:39:17.623433 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:17.623332    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"korrel8r-dockercfg-nmvhl\""
Oct 30 21:39:17.632381 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:17.632359    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/korrel8r-5cbcc89b8f-6gdr6"]
Oct 30 21:39:17.692374 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:17.692344    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/14dc810e-1c4e-48f1-b8ba-393a3e241b3d-config\") pod \"korrel8r-5cbcc89b8f-6gdr6\" (UID: \"14dc810e-1c4e-48f1-b8ba-393a3e241b3d\") " pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-6gdr6"
Oct 30 21:39:17.692559 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:17.692383    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/14dc810e-1c4e-48f1-b8ba-393a3e241b3d-tls\") pod \"korrel8r-5cbcc89b8f-6gdr6\" (UID: \"14dc810e-1c4e-48f1-b8ba-393a3e241b3d\") " pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-6gdr6"
Oct 30 21:39:17.692559 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:17.692408    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8z9m5\" (UniqueName: \"kubernetes.io/projected/14dc810e-1c4e-48f1-b8ba-393a3e241b3d-kube-api-access-8z9m5\") pod \"korrel8r-5cbcc89b8f-6gdr6\" (UID: \"14dc810e-1c4e-48f1-b8ba-393a3e241b3d\") " pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-6gdr6"
Oct 30 21:39:17.793528 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:17.793428    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/14dc810e-1c4e-48f1-b8ba-393a3e241b3d-tls\") pod \"korrel8r-5cbcc89b8f-6gdr6\" (UID: \"14dc810e-1c4e-48f1-b8ba-393a3e241b3d\") " pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-6gdr6"
Oct 30 21:39:17.793528 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:17.793468    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8z9m5\" (UniqueName: \"kubernetes.io/projected/14dc810e-1c4e-48f1-b8ba-393a3e241b3d-kube-api-access-8z9m5\") pod \"korrel8r-5cbcc89b8f-6gdr6\" (UID: \"14dc810e-1c4e-48f1-b8ba-393a3e241b3d\") " pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-6gdr6"
Oct 30 21:39:17.793725 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:17.793551    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/14dc810e-1c4e-48f1-b8ba-393a3e241b3d-config\") pod \"korrel8r-5cbcc89b8f-6gdr6\" (UID: \"14dc810e-1c4e-48f1-b8ba-393a3e241b3d\") " pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-6gdr6"
Oct 30 21:39:17.794369 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:17.794350    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/14dc810e-1c4e-48f1-b8ba-393a3e241b3d-config\") pod \"korrel8r-5cbcc89b8f-6gdr6\" (UID: \"14dc810e-1c4e-48f1-b8ba-393a3e241b3d\") " pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-6gdr6"
Oct 30 21:39:17.795865 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:17.795849    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls\" (UniqueName: \"kubernetes.io/secret/14dc810e-1c4e-48f1-b8ba-393a3e241b3d-tls\") pod \"korrel8r-5cbcc89b8f-6gdr6\" (UID: \"14dc810e-1c4e-48f1-b8ba-393a3e241b3d\") " pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-6gdr6"
Oct 30 21:39:17.844043 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:17.844016    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-gzqpf"
Oct 30 21:39:17.854805 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:17.854772    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8z9m5\" (UniqueName: \"kubernetes.io/projected/14dc810e-1c4e-48f1-b8ba-393a3e241b3d-kube-api-access-8z9m5\") pod \"korrel8r-5cbcc89b8f-6gdr6\" (UID: \"14dc810e-1c4e-48f1-b8ba-393a3e241b3d\") " pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-6gdr6"
Oct 30 21:39:17.882824 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:17.882794    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-6gdr6"
Oct 30 21:39:18.216688 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:18.216666    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-gzqpf"]
Oct 30 21:39:18.218752 ip-10-0-142-4 kubenswrapper[4060]: W1030 21:39:18.218721    4060 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfca5bd38_ed8d_4e6e_b48e_ba683819429a.slice/crio-3f33548a9ec6029e7d346adefc0cbc2ef849d4f06e01808922a5fb9808c1119c WatchSource:0}: Error finding container 3f33548a9ec6029e7d346adefc0cbc2ef849d4f06e01808922a5fb9808c1119c: Status 404 returned error can't find the container with id 3f33548a9ec6029e7d346adefc0cbc2ef849d4f06e01808922a5fb9808c1119c
Oct 30 21:39:18.265840 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:18.265759    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/korrel8r-5cbcc89b8f-6gdr6"]
Oct 30 21:39:18.267956 ip-10-0-142-4 kubenswrapper[4060]: W1030 21:39:18.267929    4060 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14dc810e_1c4e_48f1_b8ba_393a3e241b3d.slice/crio-178a4b40826ff57834c1e04ba20c0d62be6bd311dd69943be886146028da4567 WatchSource:0}: Error finding container 178a4b40826ff57834c1e04ba20c0d62be6bd311dd69943be886146028da4567: Status 404 returned error can't find the container with id 178a4b40826ff57834c1e04ba20c0d62be6bd311dd69943be886146028da4567
Oct 30 21:39:19.208968 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:19.208938    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-gzqpf" event={"ID":"fca5bd38-ed8d-4e6e-b48e-ba683819429a","Type":"ContainerStarted","Data":"f5582843ecba0e8893bec7d27cba921c77c53d897cd27ef2006020d0cd3b51a3"}
Oct 30 21:39:19.209164 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:19.208987    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-gzqpf" event={"ID":"fca5bd38-ed8d-4e6e-b48e-ba683819429a","Type":"ContainerStarted","Data":"3f33548a9ec6029e7d346adefc0cbc2ef849d4f06e01808922a5fb9808c1119c"}
Oct 30 21:39:19.209164 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:19.209046    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-gzqpf"
Oct 30 21:39:19.210563 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:19.210536    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-6gdr6" event={"ID":"14dc810e-1c4e-48f1-b8ba-393a3e241b3d","Type":"ContainerStarted","Data":"4d408f3cc62a820d4d3403f69b741f90448d069433a98ff77a07aaf754b83686"}
Oct 30 21:39:19.210675 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:19.210575    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-6gdr6" event={"ID":"14dc810e-1c4e-48f1-b8ba-393a3e241b3d","Type":"ContainerStarted","Data":"178a4b40826ff57834c1e04ba20c0d62be6bd311dd69943be886146028da4567"}
Oct 30 21:39:19.210675 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:19.210594    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-6gdr6"
Oct 30 21:39:19.326839 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:19.326776    4060 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-gzqpf" podStartSLOduration=2.326758091 podStartE2EDuration="2.326758091s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:39:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:39:19.325347619 +0000 UTC m=+3778.082345917" watchObservedRunningTime="2026-10-30 21:39:19.326758091 +0000 UTC m=+3778.083756389"
Oct 30 21:39:19.441740 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:19.441687    4060 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-6gdr6" podStartSLOduration=2.4416674130000002 podStartE2EDuration="2.441667413s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:39:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:39:19.440434812 +0000 UTC m=+3778.197433127" watchObservedRunningTime="2026-10-30 21:39:19.441667413 +0000 UTC m=+3778.198665712"
Oct 30 21:39:22.134720 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:22.134691    4060 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:39:22.138064 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:22.138049    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:39:22.229635 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:22.229602    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/3e96519f-730d-4679-aa57-d178c4840345-otc-internal\") pod \"data-science-collector-collector-0\" (UID: \"3e96519f-730d-4679-aa57-d178c4840345\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:39:22.229830 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:22.229665    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/3e96519f-730d-4679-aa57-d178c4840345-monitoring-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"3e96519f-730d-4679-aa57-d178c4840345\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:39:22.229830 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:22.229761    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3e96519f-730d-4679-aa57-d178c4840345-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"3e96519f-730d-4679-aa57-d178c4840345\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:39:22.229830 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:22.229795    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/3e96519f-730d-4679-aa57-d178c4840345-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-0\" (UID: \"3e96519f-730d-4679-aa57-d178c4840345\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:39:22.230039 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:22.229913    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8kcw4\" (UniqueName: \"kubernetes.io/projected/3e96519f-730d-4679-aa57-d178c4840345-kube-api-access-8kcw4\") pod \"data-science-collector-collector-0\" (UID: \"3e96519f-730d-4679-aa57-d178c4840345\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:39:22.230039 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:22.229953    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/3e96519f-730d-4679-aa57-d178c4840345-otlp-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"3e96519f-730d-4679-aa57-d178c4840345\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:39:22.242710 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:22.242682    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-a0f9182a\""
Oct 30 21:39:22.242859 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:22.242742    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-headless-tls\""
Oct 30 21:39:22.242859 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:22.242800    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-ta-client-cert\""
Oct 30 21:39:22.242859 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:22.242806    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-monitoring-tls\""
Oct 30 21:39:22.244150 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:22.244131    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-dockercfg-khslt\""
Oct 30 21:39:22.244189 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:22.244150    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-tls\""
Oct 30 21:39:22.247416 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:22.247394    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:39:22.331618 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:22.331590    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/3e96519f-730d-4679-aa57-d178c4840345-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-0\" (UID: \"3e96519f-730d-4679-aa57-d178c4840345\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:39:22.331766 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:22.331634    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8kcw4\" (UniqueName: \"kubernetes.io/projected/3e96519f-730d-4679-aa57-d178c4840345-kube-api-access-8kcw4\") pod \"data-science-collector-collector-0\" (UID: \"3e96519f-730d-4679-aa57-d178c4840345\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:39:22.331766 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:22.331667    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/3e96519f-730d-4679-aa57-d178c4840345-otlp-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"3e96519f-730d-4679-aa57-d178c4840345\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:39:22.331766 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:22.331711    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/3e96519f-730d-4679-aa57-d178c4840345-otc-internal\") pod \"data-science-collector-collector-0\" (UID: \"3e96519f-730d-4679-aa57-d178c4840345\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:39:22.331929 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:22.331787    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/3e96519f-730d-4679-aa57-d178c4840345-monitoring-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"3e96519f-730d-4679-aa57-d178c4840345\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:39:22.331929 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:22.331828    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3e96519f-730d-4679-aa57-d178c4840345-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"3e96519f-730d-4679-aa57-d178c4840345\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:39:22.332467 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:22.332441    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/3e96519f-730d-4679-aa57-d178c4840345-otc-internal\") pod \"data-science-collector-collector-0\" (UID: \"3e96519f-730d-4679-aa57-d178c4840345\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:39:22.334182 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:22.334160    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3e96519f-730d-4679-aa57-d178c4840345-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"3e96519f-730d-4679-aa57-d178c4840345\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:39:22.334291 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:22.334221    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/3e96519f-730d-4679-aa57-d178c4840345-monitoring-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"3e96519f-730d-4679-aa57-d178c4840345\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:39:22.334291 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:22.334249    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/3e96519f-730d-4679-aa57-d178c4840345-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-0\" (UID: \"3e96519f-730d-4679-aa57-d178c4840345\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:39:22.334375 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:22.334290    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/3e96519f-730d-4679-aa57-d178c4840345-otlp-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"3e96519f-730d-4679-aa57-d178c4840345\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:39:22.393124 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:22.393045    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8kcw4\" (UniqueName: \"kubernetes.io/projected/3e96519f-730d-4679-aa57-d178c4840345-kube-api-access-8kcw4\") pod \"data-science-collector-collector-0\" (UID: \"3e96519f-730d-4679-aa57-d178c4840345\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:39:22.452316 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:22.452290    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:39:22.828636 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:22.828611    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:39:22.830088 ip-10-0-142-4 kubenswrapper[4060]: W1030 21:39:22.830064    4060 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e96519f_730d_4679_aa57_d178c4840345.slice/crio-e78c1c5b3899474050172230d9babce792f9e0b7e44c49c1f2c33c4ee5292248 WatchSource:0}: Error finding container e78c1c5b3899474050172230d9babce792f9e0b7e44c49c1f2c33c4ee5292248: Status 404 returned error can't find the container with id e78c1c5b3899474050172230d9babce792f9e0b7e44c49c1f2c33c4ee5292248
Oct 30 21:39:22.832216 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:22.832184    4060 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 21:39:22.832314 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:22.832238    4060 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 21:39:23.232349 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:23.232312    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"3e96519f-730d-4679-aa57-d178c4840345","Type":"ContainerStarted","Data":"85350816b58fa7c13bcfb48f8fdb665de2cbf944ed111e848e42d36ee8777004"}
Oct 30 21:39:23.232756 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:23.232374    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"3e96519f-730d-4679-aa57-d178c4840345","Type":"ContainerStarted","Data":"e78c1c5b3899474050172230d9babce792f9e0b7e44c49c1f2c33c4ee5292248"}
Oct 30 21:39:23.350330 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:23.350285    4060 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-collector-0" podStartSLOduration=1.3502722 podStartE2EDuration="1.3502722s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:39:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:39:23.349331415 +0000 UTC m=+3782.106329717" watchObservedRunningTime="2026-10-30 21:39:23.3502722 +0000 UTC m=+3782.107270497"
Oct 30 21:39:25.217549 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:25.217519    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-gzqpf"
Oct 30 21:39:30.217331 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:30.217300    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-6gdr6"
Oct 30 21:39:34.281541 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:34.281504    4060 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-wthvh"]
Oct 30 21:39:34.284750 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:34.284728    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-wthvh"
Oct 30 21:39:34.321934 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:34.321903    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2sr9t\" (UniqueName: \"kubernetes.io/projected/f4ca88c9-945d-4a9e-ab40-2c7390930441-kube-api-access-2sr9t\") pod \"thanos-querier-data-science-thanos-querier-74b6964bcd-wthvh\" (UID: \"f4ca88c9-945d-4a9e-ab40-2c7390930441\") " pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-wthvh"
Oct 30 21:39:34.338415 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:34.338395    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"default-dockercfg-48j4p\""
Oct 30 21:39:34.389456 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:34.389422    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-wthvh"]
Oct 30 21:39:34.423283 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:34.423252    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2sr9t\" (UniqueName: \"kubernetes.io/projected/f4ca88c9-945d-4a9e-ab40-2c7390930441-kube-api-access-2sr9t\") pod \"thanos-querier-data-science-thanos-querier-74b6964bcd-wthvh\" (UID: \"f4ca88c9-945d-4a9e-ab40-2c7390930441\") " pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-wthvh"
Oct 30 21:39:34.484024 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:34.483998    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2sr9t\" (UniqueName: \"kubernetes.io/projected/f4ca88c9-945d-4a9e-ab40-2c7390930441-kube-api-access-2sr9t\") pod \"thanos-querier-data-science-thanos-querier-74b6964bcd-wthvh\" (UID: \"f4ca88c9-945d-4a9e-ab40-2c7390930441\") " pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-wthvh"
Oct 30 21:39:34.596065 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:34.595978    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-wthvh"
Oct 30 21:39:34.964732 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:34.964707    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-wthvh"]
Oct 30 21:39:34.966838 ip-10-0-142-4 kubenswrapper[4060]: W1030 21:39:34.966808    4060 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf4ca88c9_945d_4a9e_ab40_2c7390930441.slice/crio-5d31f0f0e78b379dc4d3914248dd8fa4691d25538cf0b502bf574ef8b8c086c9 WatchSource:0}: Error finding container 5d31f0f0e78b379dc4d3914248dd8fa4691d25538cf0b502bf574ef8b8c086c9: Status 404 returned error can't find the container with id 5d31f0f0e78b379dc4d3914248dd8fa4691d25538cf0b502bf574ef8b8c086c9
Oct 30 21:39:35.288205 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:35.288121    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-wthvh" event={"ID":"f4ca88c9-945d-4a9e-ab40-2c7390930441","Type":"ContainerStarted","Data":"bcf96ca5afc805d19aecaf0c911f87fe9bc932004cbdc4b0c456afcf5b7ca5ba"}
Oct 30 21:39:35.288205 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:35.288169    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-wthvh" event={"ID":"f4ca88c9-945d-4a9e-ab40-2c7390930441","Type":"ContainerStarted","Data":"5d31f0f0e78b379dc4d3914248dd8fa4691d25538cf0b502bf574ef8b8c086c9"}
Oct 30 21:39:35.402846 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:35.402784    4060 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-wthvh" podStartSLOduration=1.402766377 podStartE2EDuration="1.402766377s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:39:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:39:35.401792837 +0000 UTC m=+3794.158791162" watchObservedRunningTime="2026-10-30 21:39:35.402766377 +0000 UTC m=+3794.159764678"
Oct 30 21:39:35.854434 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:35.854394    4060 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"]
Oct 30 21:39:35.858322 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:35.858299    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:39:35.905694 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:35.905667    4060 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"]
Oct 30 21:39:35.909165 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:35.909149    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:39:35.935856 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:35.935832    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9s97v\" (UniqueName: \"kubernetes.io/projected/d0741409-a9b0-47b6-bbbb-ada2803a855b-kube-api-access-9s97v\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"d0741409-a9b0-47b6-bbbb-ada2803a855b\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:39:35.935978 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:35.935862    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d0741409-a9b0-47b6-bbbb-ada2803a855b-config-out\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"d0741409-a9b0-47b6-bbbb-ada2803a855b\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:39:35.935978 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:35.935896    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-data-science-monitoringstack-db\" (UniqueName: \"kubernetes.io/empty-dir/d0741409-a9b0-47b6-bbbb-ada2803a855b-alertmanager-data-science-monitoringstack-db\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"d0741409-a9b0-47b6-bbbb-ada2803a855b\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:39:35.936069 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:35.935980    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d0741409-a9b0-47b6-bbbb-ada2803a855b-tls-assets\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"d0741409-a9b0-47b6-bbbb-ada2803a855b\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:39:35.936069 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:35.936002    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d0741409-a9b0-47b6-bbbb-ada2803a855b-web-config\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"d0741409-a9b0-47b6-bbbb-ada2803a855b\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:39:35.936069 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:35.936050    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d0741409-a9b0-47b6-bbbb-ada2803a855b-cluster-tls-config\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"d0741409-a9b0-47b6-bbbb-ada2803a855b\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:39:35.936178 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:35.936082    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d0741409-a9b0-47b6-bbbb-ada2803a855b-config-volume\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"d0741409-a9b0-47b6-bbbb-ada2803a855b\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:39:35.952709 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:35.952680    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"alertmanager-data-science-monitoringstack-generated\""
Oct 30 21:39:35.952709 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:35.952698    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"alertmanager-data-science-monitoringstack-tls-assets-0\""
Oct 30 21:39:35.952709 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:35.952690    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"alertmanager-data-science-monitoringstack-cluster-tls-config\""
Oct 30 21:39:35.953794 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:35.953108    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"alertmanager-data-science-monitoringstack-web-config\""
Oct 30 21:39:35.953794 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:35.953195    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-monitoringstack-alertmanager-dockercfg-btks9\""
Oct 30 21:39:35.955365 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:35.955343    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"]
Oct 30 21:39:35.961741 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:35.961717    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"prometheus-data-science-monitoringstack-rulefiles-2\""
Oct 30 21:39:35.961741 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:35.961732    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"prometheus-data-science-monitoringstack-rulefiles-1\""
Oct 30 21:39:35.961900 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:35.961777    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"prometheus-data-science-monitoringstack-rulefiles-0\""
Oct 30 21:39:35.978819 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:35.978796    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"]
Oct 30 21:39:36.016883 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:36.016843    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"prometheus-web-tls-ca\""
Oct 30 21:39:36.016883 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:36.016877    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"prometheus-data-science-monitoringstack-web-config\""
Oct 30 21:39:36.017089 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:36.016996    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"prometheus-data-science-monitoringstack-thanos-prometheus-http-client-file\""
Oct 30 21:39:36.017089 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:36.017004    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"prometheus-data-science-monitoringstack-tls-assets-0\""
Oct 30 21:39:36.017089 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:36.017036    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-monitoringstack-prometheus-dockercfg-jgwr8\""
Oct 30 21:39:36.017193 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:36.017125    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"prometheus-data-science-monitoringstack\""
Oct 30 21:39:36.036946 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:36.036918    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d0741409-a9b0-47b6-bbbb-ada2803a855b-cluster-tls-config\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"d0741409-a9b0-47b6-bbbb-ada2803a855b\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:39:36.036946 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:36.036949    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vtrzr\" (UniqueName: \"kubernetes.io/projected/937ddbc0-8ae4-452e-ab96-0654ff770a14-kube-api-access-vtrzr\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"937ddbc0-8ae4-452e-ab96-0654ff770a14\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:39:36.037138 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:36.036975    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d0741409-a9b0-47b6-bbbb-ada2803a855b-config-volume\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"d0741409-a9b0-47b6-bbbb-ada2803a855b\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:39:36.037138 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:36.036994    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/937ddbc0-8ae4-452e-ab96-0654ff770a14-tls-assets\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"937ddbc0-8ae4-452e-ab96-0654ff770a14\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:39:36.037138 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:36.037085    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/937ddbc0-8ae4-452e-ab96-0654ff770a14-web-config\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"937ddbc0-8ae4-452e-ab96-0654ff770a14\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:39:36.037138 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:36.037110    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-web-tls-ca\" (UniqueName: \"kubernetes.io/secret/937ddbc0-8ae4-452e-ab96-0654ff770a14-secret-prometheus-web-tls-ca\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"937ddbc0-8ae4-452e-ab96-0654ff770a14\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:39:36.037298 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:36.037140    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/937ddbc0-8ae4-452e-ab96-0654ff770a14-config\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"937ddbc0-8ae4-452e-ab96-0654ff770a14\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:39:36.037298 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:36.037200    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-data-science-monitoringstack-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/937ddbc0-8ae4-452e-ab96-0654ff770a14-prometheus-data-science-monitoringstack-rulefiles-0\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"937ddbc0-8ae4-452e-ab96-0654ff770a14\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:39:36.037298 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:36.037254    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9s97v\" (UniqueName: \"kubernetes.io/projected/d0741409-a9b0-47b6-bbbb-ada2803a855b-kube-api-access-9s97v\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"d0741409-a9b0-47b6-bbbb-ada2803a855b\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:39:36.037298 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:36.037284    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-data-science-monitoringstack-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/937ddbc0-8ae4-452e-ab96-0654ff770a14-prometheus-data-science-monitoringstack-rulefiles-1\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"937ddbc0-8ae4-452e-ab96-0654ff770a14\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:39:36.037448 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:36.037373    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d0741409-a9b0-47b6-bbbb-ada2803a855b-config-out\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"d0741409-a9b0-47b6-bbbb-ada2803a855b\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:39:36.037448 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:36.037417    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config-tls-secret-cert-prometheus-operated-tls-f3457c70\" (UniqueName: \"kubernetes.io/secret/937ddbc0-8ae4-452e-ab96-0654ff770a14-web-config-tls-secret-cert-prometheus-operated-tls-f3457c70\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"937ddbc0-8ae4-452e-ab96-0654ff770a14\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:39:36.037594 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:36.037451    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/937ddbc0-8ae4-452e-ab96-0654ff770a14-config-out\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"937ddbc0-8ae4-452e-ab96-0654ff770a14\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:39:36.037657 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:36.037600    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-data-science-monitoringstack-db\" (UniqueName: \"kubernetes.io/empty-dir/d0741409-a9b0-47b6-bbbb-ada2803a855b-alertmanager-data-science-monitoringstack-db\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"d0741409-a9b0-47b6-bbbb-ada2803a855b\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:39:36.037717 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:36.037656    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/937ddbc0-8ae4-452e-ab96-0654ff770a14-thanos-prometheus-http-client-file\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"937ddbc0-8ae4-452e-ab96-0654ff770a14\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:39:36.037717 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:36.037698    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config-tls-secret-key-prometheus-operated-tls-f3457c70\" (UniqueName: \"kubernetes.io/secret/937ddbc0-8ae4-452e-ab96-0654ff770a14-web-config-tls-secret-key-prometheus-operated-tls-f3457c70\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"937ddbc0-8ae4-452e-ab96-0654ff770a14\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:39:36.037831 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:36.037779    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d0741409-a9b0-47b6-bbbb-ada2803a855b-tls-assets\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"d0741409-a9b0-47b6-bbbb-ada2803a855b\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:39:36.037831 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:36.037808    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d0741409-a9b0-47b6-bbbb-ada2803a855b-web-config\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"d0741409-a9b0-47b6-bbbb-ada2803a855b\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:39:36.037946 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:36.037839    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-data-science-monitoringstack-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/937ddbc0-8ae4-452e-ab96-0654ff770a14-prometheus-data-science-monitoringstack-rulefiles-2\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"937ddbc0-8ae4-452e-ab96-0654ff770a14\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:39:36.037946 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:36.037882    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-data-science-monitoringstack-db\" (UniqueName: \"kubernetes.io/empty-dir/d0741409-a9b0-47b6-bbbb-ada2803a855b-alertmanager-data-science-monitoringstack-db\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"d0741409-a9b0-47b6-bbbb-ada2803a855b\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:39:36.039625 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:36.039583    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d0741409-a9b0-47b6-bbbb-ada2803a855b-config-out\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"d0741409-a9b0-47b6-bbbb-ada2803a855b\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:39:36.039917 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:36.039896    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d0741409-a9b0-47b6-bbbb-ada2803a855b-config-volume\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"d0741409-a9b0-47b6-bbbb-ada2803a855b\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:39:36.040058 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:36.040035    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d0741409-a9b0-47b6-bbbb-ada2803a855b-cluster-tls-config\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"d0741409-a9b0-47b6-bbbb-ada2803a855b\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:39:36.040365 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:36.040343    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d0741409-a9b0-47b6-bbbb-ada2803a855b-tls-assets\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"d0741409-a9b0-47b6-bbbb-ada2803a855b\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:39:36.040449 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:36.040402    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d0741409-a9b0-47b6-bbbb-ada2803a855b-web-config\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"d0741409-a9b0-47b6-bbbb-ada2803a855b\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:39:36.098311 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:36.098283    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9s97v\" (UniqueName: \"kubernetes.io/projected/d0741409-a9b0-47b6-bbbb-ada2803a855b-kube-api-access-9s97v\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"d0741409-a9b0-47b6-bbbb-ada2803a855b\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:39:36.138626 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:36.138557    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vtrzr\" (UniqueName: \"kubernetes.io/projected/937ddbc0-8ae4-452e-ab96-0654ff770a14-kube-api-access-vtrzr\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"937ddbc0-8ae4-452e-ab96-0654ff770a14\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:39:36.138626 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:36.138599    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/937ddbc0-8ae4-452e-ab96-0654ff770a14-tls-assets\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"937ddbc0-8ae4-452e-ab96-0654ff770a14\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:39:36.138626 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:36.138622    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/937ddbc0-8ae4-452e-ab96-0654ff770a14-web-config\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"937ddbc0-8ae4-452e-ab96-0654ff770a14\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:39:36.138899 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:36.138737    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-web-tls-ca\" (UniqueName: \"kubernetes.io/secret/937ddbc0-8ae4-452e-ab96-0654ff770a14-secret-prometheus-web-tls-ca\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"937ddbc0-8ae4-452e-ab96-0654ff770a14\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:39:36.138899 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:36.138789    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/937ddbc0-8ae4-452e-ab96-0654ff770a14-config\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"937ddbc0-8ae4-452e-ab96-0654ff770a14\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:39:36.138899 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:36.138813    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-data-science-monitoringstack-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/937ddbc0-8ae4-452e-ab96-0654ff770a14-prometheus-data-science-monitoringstack-rulefiles-0\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"937ddbc0-8ae4-452e-ab96-0654ff770a14\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:39:36.138899 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:36.138843    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-data-science-monitoringstack-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/937ddbc0-8ae4-452e-ab96-0654ff770a14-prometheus-data-science-monitoringstack-rulefiles-1\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"937ddbc0-8ae4-452e-ab96-0654ff770a14\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:39:36.138899 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:36.138897    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config-tls-secret-cert-prometheus-operated-tls-f3457c70\" (UniqueName: \"kubernetes.io/secret/937ddbc0-8ae4-452e-ab96-0654ff770a14-web-config-tls-secret-cert-prometheus-operated-tls-f3457c70\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"937ddbc0-8ae4-452e-ab96-0654ff770a14\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:39:36.139178 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:36.138934    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/937ddbc0-8ae4-452e-ab96-0654ff770a14-config-out\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"937ddbc0-8ae4-452e-ab96-0654ff770a14\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:39:36.139178 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:36.138963    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/937ddbc0-8ae4-452e-ab96-0654ff770a14-thanos-prometheus-http-client-file\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"937ddbc0-8ae4-452e-ab96-0654ff770a14\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:39:36.139178 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:36.139001    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config-tls-secret-key-prometheus-operated-tls-f3457c70\" (UniqueName: \"kubernetes.io/secret/937ddbc0-8ae4-452e-ab96-0654ff770a14-web-config-tls-secret-key-prometheus-operated-tls-f3457c70\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"937ddbc0-8ae4-452e-ab96-0654ff770a14\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:39:36.139178 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:36.139042    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-data-science-monitoringstack-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/937ddbc0-8ae4-452e-ab96-0654ff770a14-prometheus-data-science-monitoringstack-rulefiles-2\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"937ddbc0-8ae4-452e-ab96-0654ff770a14\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:39:36.139600 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:36.139572    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-data-science-monitoringstack-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/937ddbc0-8ae4-452e-ab96-0654ff770a14-prometheus-data-science-monitoringstack-rulefiles-1\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"937ddbc0-8ae4-452e-ab96-0654ff770a14\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:39:36.139713 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:36.139690    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-data-science-monitoringstack-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/937ddbc0-8ae4-452e-ab96-0654ff770a14-prometheus-data-science-monitoringstack-rulefiles-2\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"937ddbc0-8ae4-452e-ab96-0654ff770a14\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:39:36.140099 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:36.140075    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-data-science-monitoringstack-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/937ddbc0-8ae4-452e-ab96-0654ff770a14-prometheus-data-science-monitoringstack-rulefiles-0\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"937ddbc0-8ae4-452e-ab96-0654ff770a14\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:39:36.141604 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:36.141580    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/937ddbc0-8ae4-452e-ab96-0654ff770a14-web-config\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"937ddbc0-8ae4-452e-ab96-0654ff770a14\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:39:36.141811 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:36.141762    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/937ddbc0-8ae4-452e-ab96-0654ff770a14-tls-assets\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"937ddbc0-8ae4-452e-ab96-0654ff770a14\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:39:36.141811 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:36.141805    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config-tls-secret-cert-prometheus-operated-tls-f3457c70\" (UniqueName: \"kubernetes.io/secret/937ddbc0-8ae4-452e-ab96-0654ff770a14-web-config-tls-secret-cert-prometheus-operated-tls-f3457c70\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"937ddbc0-8ae4-452e-ab96-0654ff770a14\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:39:36.142243 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:36.142218    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/937ddbc0-8ae4-452e-ab96-0654ff770a14-thanos-prometheus-http-client-file\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"937ddbc0-8ae4-452e-ab96-0654ff770a14\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:39:36.142528 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:36.142479    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-web-tls-ca\" (UniqueName: \"kubernetes.io/secret/937ddbc0-8ae4-452e-ab96-0654ff770a14-secret-prometheus-web-tls-ca\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"937ddbc0-8ae4-452e-ab96-0654ff770a14\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:39:36.142638 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:36.142532    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/937ddbc0-8ae4-452e-ab96-0654ff770a14-config\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"937ddbc0-8ae4-452e-ab96-0654ff770a14\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:39:36.142861 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:36.142842    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config-tls-secret-key-prometheus-operated-tls-f3457c70\" (UniqueName: \"kubernetes.io/secret/937ddbc0-8ae4-452e-ab96-0654ff770a14-web-config-tls-secret-key-prometheus-operated-tls-f3457c70\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"937ddbc0-8ae4-452e-ab96-0654ff770a14\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:39:36.142960 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:36.142943    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/937ddbc0-8ae4-452e-ab96-0654ff770a14-config-out\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"937ddbc0-8ae4-452e-ab96-0654ff770a14\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:39:36.175041 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:36.175011    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:39:36.200067 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:36.200040    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vtrzr\" (UniqueName: \"kubernetes.io/projected/937ddbc0-8ae4-452e-ab96-0654ff770a14-kube-api-access-vtrzr\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"937ddbc0-8ae4-452e-ab96-0654ff770a14\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:39:36.602381 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:36.602356    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"]
Oct 30 21:39:36.604386 ip-10-0-142-4 kubenswrapper[4060]: W1030 21:39:36.604355    4060 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0741409_a9b0_47b6_bbbb_ada2803a855b.slice/crio-9166920866efbd6a4f27ad9e6401a0deb7b36d3efefafc217b62eec36e87cdb9 WatchSource:0}: Error finding container 9166920866efbd6a4f27ad9e6401a0deb7b36d3efefafc217b62eec36e87cdb9: Status 404 returned error can't find the container with id 9166920866efbd6a4f27ad9e6401a0deb7b36d3efefafc217b62eec36e87cdb9
Oct 30 21:39:37.304155 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:37.304107    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0" event={"ID":"d0741409-a9b0-47b6-bbbb-ada2803a855b","Type":"ContainerStarted","Data":"e8e3f6b2cef2b8843b52a1b217c9fd21583d84cfa13f2f7be912353007bc14a6"}
Oct 30 21:39:37.304364 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:37.304213    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0" event={"ID":"d0741409-a9b0-47b6-bbbb-ada2803a855b","Type":"ContainerStarted","Data":"9166920866efbd6a4f27ad9e6401a0deb7b36d3efefafc217b62eec36e87cdb9"}
Oct 30 21:39:38.356002 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:38.355963    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-e73afc79-aa37-49a0-8744-633c03cad1f4\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a155a55c1ce0e65b\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"937ddbc0-8ae4-452e-ab96-0654ff770a14\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:39:38.460104 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:38.460064    4060 operation_generator.go:1464] "Controller attach succeeded for volume \"pvc-e73afc79-aa37-49a0-8744-633c03cad1f4\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a155a55c1ce0e65b\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"937ddbc0-8ae4-452e-ab96-0654ff770a14\") device path: \"\"" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:39:38.557700 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:38.557666    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"pvc-e73afc79-aa37-49a0-8744-633c03cad1f4\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a155a55c1ce0e65b\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"937ddbc0-8ae4-452e-ab96-0654ff770a14\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:39:38.557865 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:38.557809    4060 operation_generator.go:515] "MountVolume.WaitForAttach entering for volume \"pvc-e73afc79-aa37-49a0-8744-633c03cad1f4\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a155a55c1ce0e65b\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"937ddbc0-8ae4-452e-ab96-0654ff770a14\") DevicePath \"\"" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:39:38.610015 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:38.609948    4060 operation_generator.go:525] "MountVolume.WaitForAttach succeeded for volume \"pvc-e73afc79-aa37-49a0-8744-633c03cad1f4\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a155a55c1ce0e65b\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"937ddbc0-8ae4-452e-ab96-0654ff770a14\") DevicePath \"csi-7011c01335d2502f76be252f9498c79824668beecf30ee8f6a7191145201ca4c\"" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:39:38.747766 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:38.747733    4060 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"pvc-e73afc79-aa37-49a0-8744-633c03cad1f4\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a155a55c1ce0e65b\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"937ddbc0-8ae4-452e-ab96-0654ff770a14\") device mount path \"/var/lib/kubelet/plugins/kubernetes.io/csi/ebs.csi.aws.com/fb02f91ab75afdcfd8c2ac3eaeb0ba7303c67490d38fe3164f5fc7856f2f1875/globalmount\"" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:39:38.813900 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:38.813874    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pvc-e73afc79-aa37-49a0-8744-633c03cad1f4\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a155a55c1ce0e65b\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"937ddbc0-8ae4-452e-ab96-0654ff770a14\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:39:38.928268 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:38.928180    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:39:39.411200 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:39.411173    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"]
Oct 30 21:39:39.412743 ip-10-0-142-4 kubenswrapper[4060]: W1030 21:39:39.412716    4060 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod937ddbc0_8ae4_452e_ab96_0654ff770a14.slice/crio-ba47a1b417122c85d6982ff4ec9c9bcf4c7e3f36e7fae174e0b23d7c1652cbd6 WatchSource:0}: Error finding container ba47a1b417122c85d6982ff4ec9c9bcf4c7e3f36e7fae174e0b23d7c1652cbd6: Status 404 returned error can't find the container with id ba47a1b417122c85d6982ff4ec9c9bcf4c7e3f36e7fae174e0b23d7c1652cbd6
Oct 30 21:39:40.321248 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:40.321210    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0" event={"ID":"937ddbc0-8ae4-452e-ab96-0654ff770a14","Type":"ContainerStarted","Data":"3af7b38d8c0854df7a2d2b685066fb2516b4cc264329db69a5a4d9df7f9a56a8"}
Oct 30 21:39:40.321449 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:40.321281    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0" event={"ID":"937ddbc0-8ae4-452e-ab96-0654ff770a14","Type":"ContainerStarted","Data":"ba47a1b417122c85d6982ff4ec9c9bcf4c7e3f36e7fae174e0b23d7c1652cbd6"}
Oct 30 21:39:41.327451 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:41.327414    4060 generic.go:356] "Generic (PLEG): container finished" podID="d0741409-a9b0-47b6-bbbb-ada2803a855b" containerID="e8e3f6b2cef2b8843b52a1b217c9fd21583d84cfa13f2f7be912353007bc14a6" exitCode=0
Oct 30 21:39:41.327451 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:41.327440    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0" event={"ID":"d0741409-a9b0-47b6-bbbb-ada2803a855b","Type":"ContainerDied","Data":"e8e3f6b2cef2b8843b52a1b217c9fd21583d84cfa13f2f7be912353007bc14a6"}
Oct 30 21:39:42.150685 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:39:42.150598    4060 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v2f4x" containerName="extractor"
Oct 30 21:39:42.335111 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:42.335073    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0" event={"ID":"d0741409-a9b0-47b6-bbbb-ada2803a855b","Type":"ContainerStarted","Data":"7e36e2e149f5c6ac19e7aec5ff7ed148e67618888c02cb8716db42e26d9eabeb"}
Oct 30 21:39:42.335568 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:42.335156    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0" event={"ID":"d0741409-a9b0-47b6-bbbb-ada2803a855b","Type":"ContainerStarted","Data":"9650c2854bdeda220e8d9ef86fb7f0824d5e2065b604c33deba4f2400e67b643"}
Oct 30 21:39:42.335568 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:42.335385    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:39:42.459507 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:42.459441    4060 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0" podStartSLOduration=3.7741608859999998 podStartE2EDuration="7.459429265s" totalImagesPullingTime="0s" totalInitContainerRuntime="3.685268379s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:39:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:39:42.457808408 +0000 UTC m=+3801.214806729" watchObservedRunningTime="2026-10-30 21:39:42.459429265 +0000 UTC m=+3801.216427562"
Oct 30 21:39:44.345773 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:44.345745    4060 generic.go:356] "Generic (PLEG): container finished" podID="937ddbc0-8ae4-452e-ab96-0654ff770a14" containerID="3af7b38d8c0854df7a2d2b685066fb2516b4cc264329db69a5a4d9df7f9a56a8" exitCode=0
Oct 30 21:39:44.346193 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:44.345823    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0" event={"ID":"937ddbc0-8ae4-452e-ab96-0654ff770a14","Type":"ContainerDied","Data":"3af7b38d8c0854df7a2d2b685066fb2516b4cc264329db69a5a4d9df7f9a56a8"}
Oct 30 21:39:45.353191 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:45.353106    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0" event={"ID":"937ddbc0-8ae4-452e-ab96-0654ff770a14","Type":"ContainerStarted","Data":"67adcde6c599b2800be892f6b20a202eadda2ae52cb99222ddd7a2f9265e8003"}
Oct 30 21:39:45.353191 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:45.353170    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0" event={"ID":"937ddbc0-8ae4-452e-ab96-0654ff770a14","Type":"ContainerStarted","Data":"e2c6849e14ba7b35b3a963a7d65e9c655509dd582c59672a7304d055bb87fc0b"}
Oct 30 21:39:45.353633 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:45.353195    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0" event={"ID":"937ddbc0-8ae4-452e-ab96-0654ff770a14","Type":"ContainerStarted","Data":"7c410ed7dde0b4d6b2a568b65539087a634154418b8aa8a93159565908d3d5ee"}
Oct 30 21:39:45.481483 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:45.481430    4060 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0" podStartSLOduration=6.495326939 podStartE2EDuration="10.481417163s" totalImagesPullingTime="0s" totalInitContainerRuntime="3.986090224s" isStatefulPod=true podCreationTimestamp="2026-10-30 21:39:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:39:45.480008662 +0000 UTC m=+3804.237007004" watchObservedRunningTime="2026-10-30 21:39:45.481417163 +0000 UTC m=+3804.238415460"
Oct 30 21:39:48.340962 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:48.340928    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:39:48.928680 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:48.928651    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:39:53.929282 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:53.929248    4060 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:39:53.934924 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:53.934903    4060 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:39:54.400466 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:39:54.400439    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:40:12.150670 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:40:12.150587    4060 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v2f4x" containerName="extractor"
Oct 30 21:40:24.073063 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:40:24.073026    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:40:24.073635 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:40:24.073295    4060 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-collector-0" podUID="3e96519f-730d-4679-aa57-d178c4840345" containerName="otc-container" containerID="cri-o://85350816b58fa7c13bcfb48f8fdb665de2cbf944ed111e848e42d36ee8777004" gracePeriod=30
Oct 30 21:40:26.421734 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:40:26.421710    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:40:26.549015 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:40:26.548938    4060 generic.go:356] "Generic (PLEG): container finished" podID="3e96519f-730d-4679-aa57-d178c4840345" containerID="85350816b58fa7c13bcfb48f8fdb665de2cbf944ed111e848e42d36ee8777004" exitCode=0
Oct 30 21:40:26.549015 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:40:26.548995    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:40:26.549015 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:40:26.549003    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"3e96519f-730d-4679-aa57-d178c4840345","Type":"ContainerDied","Data":"85350816b58fa7c13bcfb48f8fdb665de2cbf944ed111e848e42d36ee8777004"}
Oct 30 21:40:26.549223 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:40:26.549055    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"3e96519f-730d-4679-aa57-d178c4840345","Type":"ContainerDied","Data":"e78c1c5b3899474050172230d9babce792f9e0b7e44c49c1f2c33c4ee5292248"}
Oct 30 21:40:26.549223 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:40:26.549086    4060 scope.go:122] "RemoveContainer" containerID="85350816b58fa7c13bcfb48f8fdb665de2cbf944ed111e848e42d36ee8777004"
Oct 30 21:40:26.558097 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:40:26.558072    4060 scope.go:122] "RemoveContainer" containerID="85350816b58fa7c13bcfb48f8fdb665de2cbf944ed111e848e42d36ee8777004"
Oct 30 21:40:26.558438 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:40:26.558414    4060 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"85350816b58fa7c13bcfb48f8fdb665de2cbf944ed111e848e42d36ee8777004\": container with ID starting with 85350816b58fa7c13bcfb48f8fdb665de2cbf944ed111e848e42d36ee8777004 not found: ID does not exist" containerID="85350816b58fa7c13bcfb48f8fdb665de2cbf944ed111e848e42d36ee8777004"
Oct 30 21:40:26.558531 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:40:26.558450    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"85350816b58fa7c13bcfb48f8fdb665de2cbf944ed111e848e42d36ee8777004"} err="failed to get container status \"85350816b58fa7c13bcfb48f8fdb665de2cbf944ed111e848e42d36ee8777004\": rpc error: code = NotFound desc = could not find container \"85350816b58fa7c13bcfb48f8fdb665de2cbf944ed111e848e42d36ee8777004\": container with ID starting with 85350816b58fa7c13bcfb48f8fdb665de2cbf944ed111e848e42d36ee8777004 not found: ID does not exist"
Oct 30 21:40:26.567729 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:40:26.567700    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/3e96519f-730d-4679-aa57-d178c4840345-monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/3e96519f-730d-4679-aa57-d178c4840345-monitoring-tls-certs\") pod \"3e96519f-730d-4679-aa57-d178c4840345\" (UID: \"3e96519f-730d-4679-aa57-d178c4840345\") "
Oct 30 21:40:26.567881 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:40:26.567737    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/3e96519f-730d-4679-aa57-d178c4840345-otc-internal\" (UniqueName: \"kubernetes.io/configmap/3e96519f-730d-4679-aa57-d178c4840345-otc-internal\") pod \"3e96519f-730d-4679-aa57-d178c4840345\" (UID: \"3e96519f-730d-4679-aa57-d178c4840345\") "
Oct 30 21:40:26.567881 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:40:26.567774    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/3e96519f-730d-4679-aa57-d178c4840345-tls-certs\" (UniqueName: \"kubernetes.io/secret/3e96519f-730d-4679-aa57-d178c4840345-tls-certs\") pod \"3e96519f-730d-4679-aa57-d178c4840345\" (UID: \"3e96519f-730d-4679-aa57-d178c4840345\") "
Oct 30 21:40:26.567881 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:40:26.567808    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/3e96519f-730d-4679-aa57-d178c4840345-otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/3e96519f-730d-4679-aa57-d178c4840345-otlp-tls-certs\") pod \"3e96519f-730d-4679-aa57-d178c4840345\" (UID: \"3e96519f-730d-4679-aa57-d178c4840345\") "
Oct 30 21:40:26.567881 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:40:26.567841    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/3e96519f-730d-4679-aa57-d178c4840345-data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/3e96519f-730d-4679-aa57-d178c4840345-data-science-collector-ta-client-cert\") pod \"3e96519f-730d-4679-aa57-d178c4840345\" (UID: \"3e96519f-730d-4679-aa57-d178c4840345\") "
Oct 30 21:40:26.568119 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:40:26.567886    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3e96519f-730d-4679-aa57-d178c4840345-kube-api-access-8kcw4\" (UniqueName: \"kubernetes.io/projected/3e96519f-730d-4679-aa57-d178c4840345-kube-api-access-8kcw4\") pod \"3e96519f-730d-4679-aa57-d178c4840345\" (UID: \"3e96519f-730d-4679-aa57-d178c4840345\") "
Oct 30 21:40:26.568178 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:40:26.568121    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3e96519f-730d-4679-aa57-d178c4840345-otc-internal" pod "3e96519f-730d-4679-aa57-d178c4840345" (UID: "3e96519f-730d-4679-aa57-d178c4840345"). InnerVolumeSpecName "otc-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:40:26.570251 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:40:26.570224    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3e96519f-730d-4679-aa57-d178c4840345-data-science-collector-ta-client-cert" pod "3e96519f-730d-4679-aa57-d178c4840345" (UID: "3e96519f-730d-4679-aa57-d178c4840345"). InnerVolumeSpecName "data-science-collector-ta-client-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:40:26.570504 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:40:26.570460    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3e96519f-730d-4679-aa57-d178c4840345-kube-api-access-8kcw4" pod "3e96519f-730d-4679-aa57-d178c4840345" (UID: "3e96519f-730d-4679-aa57-d178c4840345"). InnerVolumeSpecName "kube-api-access-8kcw4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:40:26.570504 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:40:26.570471    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3e96519f-730d-4679-aa57-d178c4840345-otlp-tls-certs" pod "3e96519f-730d-4679-aa57-d178c4840345" (UID: "3e96519f-730d-4679-aa57-d178c4840345"). InnerVolumeSpecName "otlp-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:40:26.570689 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:40:26.570610    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3e96519f-730d-4679-aa57-d178c4840345-monitoring-tls-certs" pod "3e96519f-730d-4679-aa57-d178c4840345" (UID: "3e96519f-730d-4679-aa57-d178c4840345"). InnerVolumeSpecName "monitoring-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:40:26.572155 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:40:26.572130    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3e96519f-730d-4679-aa57-d178c4840345-tls-certs" pod "3e96519f-730d-4679-aa57-d178c4840345" (UID: "3e96519f-730d-4679-aa57-d178c4840345"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:40:26.668781 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:40:26.668746    4060 reconciler_common.go:299] "Volume detached for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/3e96519f-730d-4679-aa57-d178c4840345-monitoring-tls-certs\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:40:26.668781 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:40:26.668781    4060 reconciler_common.go:299] "Volume detached for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/3e96519f-730d-4679-aa57-d178c4840345-otc-internal\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:40:26.668978 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:40:26.668796    4060 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3e96519f-730d-4679-aa57-d178c4840345-tls-certs\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:40:26.668978 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:40:26.668810    4060 reconciler_common.go:299] "Volume detached for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/3e96519f-730d-4679-aa57-d178c4840345-otlp-tls-certs\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:40:26.668978 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:40:26.668825    4060 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/3e96519f-730d-4679-aa57-d178c4840345-data-science-collector-ta-client-cert\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:40:26.668978 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:40:26.668840    4060 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8kcw4\" (UniqueName: \"kubernetes.io/projected/3e96519f-730d-4679-aa57-d178c4840345-kube-api-access-8kcw4\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:40:26.971533 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:40:26.971482    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:40:26.974305 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:40:26.974283    4060 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:40:27.047997 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:40:27.047959    4060 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:40:27.048341 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:40:27.048329    4060 cpu_manager.go:414] "containerMap: removing container" podUID="3e96519f-730d-4679-aa57-d178c4840345" containerName="otc-container"
Oct 30 21:40:27.048391 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:40:27.048342    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3e96519f-730d-4679-aa57-d178c4840345" containerName="otc-container"
Oct 30 21:40:27.048427 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:40:27.048402    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="3e96519f-730d-4679-aa57-d178c4840345" containerName="otc-container"
Oct 30 21:40:27.051437 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:40:27.051413    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:40:27.071481 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:40:27.071450    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/d0867c8f-e961-4d39-8db6-448e6958b313-monitoring-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"d0867c8f-e961-4d39-8db6-448e6958b313\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:40:27.071667 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:40:27.071523    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/d0867c8f-e961-4d39-8db6-448e6958b313-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-0\" (UID: \"d0867c8f-e961-4d39-8db6-448e6958b313\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:40:27.071667 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:40:27.071626    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/d0867c8f-e961-4d39-8db6-448e6958b313-otc-internal\") pod \"data-science-collector-collector-0\" (UID: \"d0867c8f-e961-4d39-8db6-448e6958b313\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:40:27.071748 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:40:27.071663    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k9rvv\" (UniqueName: \"kubernetes.io/projected/d0867c8f-e961-4d39-8db6-448e6958b313-kube-api-access-k9rvv\") pod \"data-science-collector-collector-0\" (UID: \"d0867c8f-e961-4d39-8db6-448e6958b313\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:40:27.071748 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:40:27.071732    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/d0867c8f-e961-4d39-8db6-448e6958b313-otlp-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"d0867c8f-e961-4d39-8db6-448e6958b313\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:40:27.071821 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:40:27.071788    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d0867c8f-e961-4d39-8db6-448e6958b313-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"d0867c8f-e961-4d39-8db6-448e6958b313\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:40:27.104279 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:40:27.104237    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-ta-client-cert\""
Oct 30 21:40:27.104482 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:40:27.104311    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-a0f9182a\""
Oct 30 21:40:27.104482 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:40:27.104335    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-tls\""
Oct 30 21:40:27.104482 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:40:27.104352    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-monitoring-tls\""
Oct 30 21:40:27.104482 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:40:27.104371    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-headless-tls\""
Oct 30 21:40:27.104482 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:40:27.104380    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-dockercfg-khslt\""
Oct 30 21:40:27.113601 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:40:27.113522    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:40:27.172264 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:40:27.172228    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/d0867c8f-e961-4d39-8db6-448e6958b313-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-0\" (UID: \"d0867c8f-e961-4d39-8db6-448e6958b313\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:40:27.172264 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:40:27.172272    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/d0867c8f-e961-4d39-8db6-448e6958b313-otc-internal\") pod \"data-science-collector-collector-0\" (UID: \"d0867c8f-e961-4d39-8db6-448e6958b313\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:40:27.172575 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:40:27.172292    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k9rvv\" (UniqueName: \"kubernetes.io/projected/d0867c8f-e961-4d39-8db6-448e6958b313-kube-api-access-k9rvv\") pod \"data-science-collector-collector-0\" (UID: \"d0867c8f-e961-4d39-8db6-448e6958b313\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:40:27.172575 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:40:27.172422    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/d0867c8f-e961-4d39-8db6-448e6958b313-otlp-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"d0867c8f-e961-4d39-8db6-448e6958b313\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:40:27.172575 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:40:27.172471    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d0867c8f-e961-4d39-8db6-448e6958b313-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"d0867c8f-e961-4d39-8db6-448e6958b313\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:40:27.172575 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:40:27.172558    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/d0867c8f-e961-4d39-8db6-448e6958b313-monitoring-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"d0867c8f-e961-4d39-8db6-448e6958b313\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:40:27.173110 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:40:27.173082    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/d0867c8f-e961-4d39-8db6-448e6958b313-otc-internal\") pod \"data-science-collector-collector-0\" (UID: \"d0867c8f-e961-4d39-8db6-448e6958b313\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:40:27.175452 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:40:27.175430    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/d0867c8f-e961-4d39-8db6-448e6958b313-otlp-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"d0867c8f-e961-4d39-8db6-448e6958b313\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:40:27.175592 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:40:27.175569    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/d0867c8f-e961-4d39-8db6-448e6958b313-monitoring-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"d0867c8f-e961-4d39-8db6-448e6958b313\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:40:27.175642 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:40:27.175588    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d0867c8f-e961-4d39-8db6-448e6958b313-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"d0867c8f-e961-4d39-8db6-448e6958b313\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:40:27.176068 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:40:27.176049    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/d0867c8f-e961-4d39-8db6-448e6958b313-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-0\" (UID: \"d0867c8f-e961-4d39-8db6-448e6958b313\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:40:27.233740 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:40:27.233708    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k9rvv\" (UniqueName: \"kubernetes.io/projected/d0867c8f-e961-4d39-8db6-448e6958b313-kube-api-access-k9rvv\") pod \"data-science-collector-collector-0\" (UID: \"d0867c8f-e961-4d39-8db6-448e6958b313\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:40:27.364900 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:40:27.364826    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:40:27.429956 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:40:27.429926    4060 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="3e96519f-730d-4679-aa57-d178c4840345" path="/var/lib/kubelet/pods/3e96519f-730d-4679-aa57-d178c4840345/volumes"
Oct 30 21:40:27.739176 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:40:27.739154    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:40:27.741044 ip-10-0-142-4 kubenswrapper[4060]: W1030 21:40:27.741019    4060 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0867c8f_e961_4d39_8db6_448e6958b313.slice/crio-3ea083a04ed7522200a4110c35754c0527431b3cd1b1eebb16686a0225c611b9 WatchSource:0}: Error finding container 3ea083a04ed7522200a4110c35754c0527431b3cd1b1eebb16686a0225c611b9: Status 404 returned error can't find the container with id 3ea083a04ed7522200a4110c35754c0527431b3cd1b1eebb16686a0225c611b9
Oct 30 21:40:27.743187 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:40:27.743154    4060 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 21:40:27.743267 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:40:27.743214    4060 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 21:40:28.563060 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:40:28.563026    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"d0867c8f-e961-4d39-8db6-448e6958b313","Type":"ContainerStarted","Data":"410ec2cc6acf2e036fb64e35ac4a814c735902f7fece453e4a236ddc58e708cb"}
Oct 30 21:40:28.563439 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:40:28.563101    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"d0867c8f-e961-4d39-8db6-448e6958b313","Type":"ContainerStarted","Data":"3ea083a04ed7522200a4110c35754c0527431b3cd1b1eebb16686a0225c611b9"}
Oct 30 21:40:28.681574 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:40:28.681483    4060 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-collector-0" podStartSLOduration=1.681466569 podStartE2EDuration="1.681466569s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:40:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:40:28.680755229 +0000 UTC m=+3847.437753527" watchObservedRunningTime="2026-10-30 21:40:28.681466569 +0000 UTC m=+3847.438464868"
Oct 30 21:40:42.150974 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:40:42.150935    4060 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v2f4x" containerName="extractor"
Oct 30 21:40:55.203277 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:40:55.203238    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:40:55.203922 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:40:55.203543    4060 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-collector-0" podUID="d0867c8f-e961-4d39-8db6-448e6958b313" containerName="otc-container" containerID="cri-o://410ec2cc6acf2e036fb64e35ac4a814c735902f7fece453e4a236ddc58e708cb" gracePeriod=30
Oct 30 21:40:57.559987 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:40:57.559963    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:40:57.647069 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:40:57.646988    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d0867c8f-e961-4d39-8db6-448e6958b313-otc-internal\" (UniqueName: \"kubernetes.io/configmap/d0867c8f-e961-4d39-8db6-448e6958b313-otc-internal\") pod \"d0867c8f-e961-4d39-8db6-448e6958b313\" (UID: \"d0867c8f-e961-4d39-8db6-448e6958b313\") "
Oct 30 21:40:57.647069 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:40:57.647020    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d0867c8f-e961-4d39-8db6-448e6958b313-otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/d0867c8f-e961-4d39-8db6-448e6958b313-otlp-tls-certs\") pod \"d0867c8f-e961-4d39-8db6-448e6958b313\" (UID: \"d0867c8f-e961-4d39-8db6-448e6958b313\") "
Oct 30 21:40:57.647069 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:40:57.647054    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d0867c8f-e961-4d39-8db6-448e6958b313-tls-certs\" (UniqueName: \"kubernetes.io/secret/d0867c8f-e961-4d39-8db6-448e6958b313-tls-certs\") pod \"d0867c8f-e961-4d39-8db6-448e6958b313\" (UID: \"d0867c8f-e961-4d39-8db6-448e6958b313\") "
Oct 30 21:40:57.647368 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:40:57.647076    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d0867c8f-e961-4d39-8db6-448e6958b313-monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/d0867c8f-e961-4d39-8db6-448e6958b313-monitoring-tls-certs\") pod \"d0867c8f-e961-4d39-8db6-448e6958b313\" (UID: \"d0867c8f-e961-4d39-8db6-448e6958b313\") "
Oct 30 21:40:57.647368 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:40:57.647137    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d0867c8f-e961-4d39-8db6-448e6958b313-data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/d0867c8f-e961-4d39-8db6-448e6958b313-data-science-collector-ta-client-cert\") pod \"d0867c8f-e961-4d39-8db6-448e6958b313\" (UID: \"d0867c8f-e961-4d39-8db6-448e6958b313\") "
Oct 30 21:40:57.647368 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:40:57.647159    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d0867c8f-e961-4d39-8db6-448e6958b313-kube-api-access-k9rvv\" (UniqueName: \"kubernetes.io/projected/d0867c8f-e961-4d39-8db6-448e6958b313-kube-api-access-k9rvv\") pod \"d0867c8f-e961-4d39-8db6-448e6958b313\" (UID: \"d0867c8f-e961-4d39-8db6-448e6958b313\") "
Oct 30 21:40:57.647571 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:40:57.647521    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d0867c8f-e961-4d39-8db6-448e6958b313-otc-internal" pod "d0867c8f-e961-4d39-8db6-448e6958b313" (UID: "d0867c8f-e961-4d39-8db6-448e6958b313"). InnerVolumeSpecName "otc-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:40:57.649358 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:40:57.649315    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d0867c8f-e961-4d39-8db6-448e6958b313-data-science-collector-ta-client-cert" pod "d0867c8f-e961-4d39-8db6-448e6958b313" (UID: "d0867c8f-e961-4d39-8db6-448e6958b313"). InnerVolumeSpecName "data-science-collector-ta-client-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:40:57.649482 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:40:57.649408    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d0867c8f-e961-4d39-8db6-448e6958b313-monitoring-tls-certs" pod "d0867c8f-e961-4d39-8db6-448e6958b313" (UID: "d0867c8f-e961-4d39-8db6-448e6958b313"). InnerVolumeSpecName "monitoring-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:40:57.649482 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:40:57.649410    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d0867c8f-e961-4d39-8db6-448e6958b313-kube-api-access-k9rvv" pod "d0867c8f-e961-4d39-8db6-448e6958b313" (UID: "d0867c8f-e961-4d39-8db6-448e6958b313"). InnerVolumeSpecName "kube-api-access-k9rvv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:40:57.649701 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:40:57.649672    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d0867c8f-e961-4d39-8db6-448e6958b313-otlp-tls-certs" pod "d0867c8f-e961-4d39-8db6-448e6958b313" (UID: "d0867c8f-e961-4d39-8db6-448e6958b313"). InnerVolumeSpecName "otlp-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:40:57.649810 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:40:57.649706    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d0867c8f-e961-4d39-8db6-448e6958b313-tls-certs" pod "d0867c8f-e961-4d39-8db6-448e6958b313" (UID: "d0867c8f-e961-4d39-8db6-448e6958b313"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:40:57.709264 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:40:57.709218    4060 generic.go:356] "Generic (PLEG): container finished" podID="d0867c8f-e961-4d39-8db6-448e6958b313" containerID="410ec2cc6acf2e036fb64e35ac4a814c735902f7fece453e4a236ddc58e708cb" exitCode=0
Oct 30 21:40:57.709264 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:40:57.709264    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:40:57.709539 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:40:57.709302    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"d0867c8f-e961-4d39-8db6-448e6958b313","Type":"ContainerDied","Data":"410ec2cc6acf2e036fb64e35ac4a814c735902f7fece453e4a236ddc58e708cb"}
Oct 30 21:40:57.709539 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:40:57.709382    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"d0867c8f-e961-4d39-8db6-448e6958b313","Type":"ContainerDied","Data":"3ea083a04ed7522200a4110c35754c0527431b3cd1b1eebb16686a0225c611b9"}
Oct 30 21:40:57.709539 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:40:57.709418    4060 scope.go:122] "RemoveContainer" containerID="410ec2cc6acf2e036fb64e35ac4a814c735902f7fece453e4a236ddc58e708cb"
Oct 30 21:40:57.719115 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:40:57.719097    4060 scope.go:122] "RemoveContainer" containerID="410ec2cc6acf2e036fb64e35ac4a814c735902f7fece453e4a236ddc58e708cb"
Oct 30 21:40:57.719372 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:40:57.719354    4060 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"410ec2cc6acf2e036fb64e35ac4a814c735902f7fece453e4a236ddc58e708cb\": container with ID starting with 410ec2cc6acf2e036fb64e35ac4a814c735902f7fece453e4a236ddc58e708cb not found: ID does not exist" containerID="410ec2cc6acf2e036fb64e35ac4a814c735902f7fece453e4a236ddc58e708cb"
Oct 30 21:40:57.719425 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:40:57.719380    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"410ec2cc6acf2e036fb64e35ac4a814c735902f7fece453e4a236ddc58e708cb"} err="failed to get container status \"410ec2cc6acf2e036fb64e35ac4a814c735902f7fece453e4a236ddc58e708cb\": rpc error: code = NotFound desc = could not find container \"410ec2cc6acf2e036fb64e35ac4a814c735902f7fece453e4a236ddc58e708cb\": container with ID starting with 410ec2cc6acf2e036fb64e35ac4a814c735902f7fece453e4a236ddc58e708cb not found: ID does not exist"
Oct 30 21:40:57.747794 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:40:57.747767    4060 reconciler_common.go:299] "Volume detached for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/d0867c8f-e961-4d39-8db6-448e6958b313-otc-internal\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:40:57.747794 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:40:57.747792    4060 reconciler_common.go:299] "Volume detached for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/d0867c8f-e961-4d39-8db6-448e6958b313-otlp-tls-certs\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:40:57.747983 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:40:57.747802    4060 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d0867c8f-e961-4d39-8db6-448e6958b313-tls-certs\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:40:57.747983 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:40:57.747813    4060 reconciler_common.go:299] "Volume detached for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/d0867c8f-e961-4d39-8db6-448e6958b313-monitoring-tls-certs\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:40:57.747983 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:40:57.747822    4060 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/d0867c8f-e961-4d39-8db6-448e6958b313-data-science-collector-ta-client-cert\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:40:57.747983 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:40:57.747833    4060 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k9rvv\" (UniqueName: \"kubernetes.io/projected/d0867c8f-e961-4d39-8db6-448e6958b313-kube-api-access-k9rvv\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:40:57.879447 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:40:57.879413    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:40:57.881892 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:40:57.881870    4060 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:40:57.957164 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:40:57.957133    4060 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:40:57.957591 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:40:57.957573    4060 cpu_manager.go:414] "containerMap: removing container" podUID="d0867c8f-e961-4d39-8db6-448e6958b313" containerName="otc-container"
Oct 30 21:40:57.957701 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:40:57.957593    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d0867c8f-e961-4d39-8db6-448e6958b313" containerName="otc-container"
Oct 30 21:40:57.957701 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:40:57.957681    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="d0867c8f-e961-4d39-8db6-448e6958b313" containerName="otc-container"
Oct 30 21:40:57.962126 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:40:57.962105    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:40:58.015101 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:40:58.015062    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-monitoring-tls\""
Oct 30 21:40:58.015266 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:40:58.015147    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-a0f9182a\""
Oct 30 21:40:58.015266 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:40:58.015198    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-tls\""
Oct 30 21:40:58.015266 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:40:58.015215    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-dockercfg-khslt\""
Oct 30 21:40:58.015266 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:40:58.015240    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-ta-client-cert\""
Oct 30 21:40:58.015516 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:40:58.015423    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-headless-tls\""
Oct 30 21:40:58.021613 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:40:58.021594    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:40:58.051069 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:40:58.051043    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-497lv\" (UniqueName: \"kubernetes.io/projected/ad3bfc3b-f209-4cc1-abe0-d477d84aebec-kube-api-access-497lv\") pod \"data-science-collector-collector-0\" (UID: \"ad3bfc3b-f209-4cc1-abe0-d477d84aebec\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:40:58.051213 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:40:58.051086    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/ad3bfc3b-f209-4cc1-abe0-d477d84aebec-otc-internal\") pod \"data-science-collector-collector-0\" (UID: \"ad3bfc3b-f209-4cc1-abe0-d477d84aebec\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:40:58.051213 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:40:58.051180    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ad3bfc3b-f209-4cc1-abe0-d477d84aebec-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"ad3bfc3b-f209-4cc1-abe0-d477d84aebec\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:40:58.051335 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:40:58.051312    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/ad3bfc3b-f209-4cc1-abe0-d477d84aebec-monitoring-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"ad3bfc3b-f209-4cc1-abe0-d477d84aebec\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:40:58.051389 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:40:58.051344    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/ad3bfc3b-f209-4cc1-abe0-d477d84aebec-otlp-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"ad3bfc3b-f209-4cc1-abe0-d477d84aebec\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:40:58.051389 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:40:58.051382    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/ad3bfc3b-f209-4cc1-abe0-d477d84aebec-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-0\" (UID: \"ad3bfc3b-f209-4cc1-abe0-d477d84aebec\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:40:58.152790 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:40:58.152746    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ad3bfc3b-f209-4cc1-abe0-d477d84aebec-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"ad3bfc3b-f209-4cc1-abe0-d477d84aebec\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:40:58.152790 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:40:58.152802    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/ad3bfc3b-f209-4cc1-abe0-d477d84aebec-monitoring-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"ad3bfc3b-f209-4cc1-abe0-d477d84aebec\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:40:58.153046 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:40:58.152914    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/ad3bfc3b-f209-4cc1-abe0-d477d84aebec-otlp-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"ad3bfc3b-f209-4cc1-abe0-d477d84aebec\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:40:58.153046 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:40:58.152964    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/ad3bfc3b-f209-4cc1-abe0-d477d84aebec-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-0\" (UID: \"ad3bfc3b-f209-4cc1-abe0-d477d84aebec\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:40:58.153166 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:40:58.153072    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-497lv\" (UniqueName: \"kubernetes.io/projected/ad3bfc3b-f209-4cc1-abe0-d477d84aebec-kube-api-access-497lv\") pod \"data-science-collector-collector-0\" (UID: \"ad3bfc3b-f209-4cc1-abe0-d477d84aebec\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:40:58.153166 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:40:58.153105    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/ad3bfc3b-f209-4cc1-abe0-d477d84aebec-otc-internal\") pod \"data-science-collector-collector-0\" (UID: \"ad3bfc3b-f209-4cc1-abe0-d477d84aebec\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:40:58.153793 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:40:58.153772    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/ad3bfc3b-f209-4cc1-abe0-d477d84aebec-otc-internal\") pod \"data-science-collector-collector-0\" (UID: \"ad3bfc3b-f209-4cc1-abe0-d477d84aebec\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:40:58.155383 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:40:58.155361    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/ad3bfc3b-f209-4cc1-abe0-d477d84aebec-otlp-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"ad3bfc3b-f209-4cc1-abe0-d477d84aebec\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:40:58.155677 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:40:58.155662    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ad3bfc3b-f209-4cc1-abe0-d477d84aebec-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"ad3bfc3b-f209-4cc1-abe0-d477d84aebec\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:40:58.155741 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:40:58.155662    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/ad3bfc3b-f209-4cc1-abe0-d477d84aebec-monitoring-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"ad3bfc3b-f209-4cc1-abe0-d477d84aebec\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:40:58.156035 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:40:58.156014    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/ad3bfc3b-f209-4cc1-abe0-d477d84aebec-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-0\" (UID: \"ad3bfc3b-f209-4cc1-abe0-d477d84aebec\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:40:58.215515 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:40:58.215436    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-497lv\" (UniqueName: \"kubernetes.io/projected/ad3bfc3b-f209-4cc1-abe0-d477d84aebec-kube-api-access-497lv\") pod \"data-science-collector-collector-0\" (UID: \"ad3bfc3b-f209-4cc1-abe0-d477d84aebec\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:40:58.277999 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:40:58.277969    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:40:58.652181 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:40:58.652155    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:40:58.654476 ip-10-0-142-4 kubenswrapper[4060]: W1030 21:40:58.654448    4060 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad3bfc3b_f209_4cc1_abe0_d477d84aebec.slice/crio-3a8dc1c57e184eea42552e990fc768cbd64a7ec82efe8aeb90078b23ae1af6d7 WatchSource:0}: Error finding container 3a8dc1c57e184eea42552e990fc768cbd64a7ec82efe8aeb90078b23ae1af6d7: Status 404 returned error can't find the container with id 3a8dc1c57e184eea42552e990fc768cbd64a7ec82efe8aeb90078b23ae1af6d7
Oct 30 21:40:58.656959 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:40:58.656922    4060 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 21:40:58.657039 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:40:58.656999    4060 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 21:40:58.717389 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:40:58.717358    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"ad3bfc3b-f209-4cc1-abe0-d477d84aebec","Type":"ContainerStarted","Data":"3a8dc1c57e184eea42552e990fc768cbd64a7ec82efe8aeb90078b23ae1af6d7"}
Oct 30 21:40:59.427160 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:40:59.427128    4060 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d0867c8f-e961-4d39-8db6-448e6958b313" path="/var/lib/kubelet/pods/d0867c8f-e961-4d39-8db6-448e6958b313/volumes"
Oct 30 21:40:59.723793 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:40:59.723757    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"ad3bfc3b-f209-4cc1-abe0-d477d84aebec","Type":"ContainerStarted","Data":"61a52b700c20d1ce6bb92e2534ea0ce6fce9d20677f5a7a85d0cfafb48dd5bd0"}
Oct 30 21:40:59.893616 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:40:59.893482    4060 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-collector-0" podStartSLOduration=2.893458907 podStartE2EDuration="2.893458907s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:40:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:40:59.841047306 +0000 UTC m=+3878.598045606" watchObservedRunningTime="2026-10-30 21:40:59.893458907 +0000 UTC m=+3878.650457208"
Oct 30 21:41:12.151010 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:41:12.150971    4060 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v2f4x" containerName="extractor"
Oct 30 21:41:39.429006 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:39.428915    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:41:39.429573 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:39.429171    4060 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-collector-0" podUID="ad3bfc3b-f209-4cc1-abe0-d477d84aebec" containerName="otc-container" containerID="cri-o://61a52b700c20d1ce6bb92e2534ea0ce6fce9d20677f5a7a85d0cfafb48dd5bd0" gracePeriod=30
Oct 30 21:41:41.773743 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:41.773720    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:41:41.802404 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:41.802382    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ad3bfc3b-f209-4cc1-abe0-d477d84aebec-data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/ad3bfc3b-f209-4cc1-abe0-d477d84aebec-data-science-collector-ta-client-cert\") pod \"ad3bfc3b-f209-4cc1-abe0-d477d84aebec\" (UID: \"ad3bfc3b-f209-4cc1-abe0-d477d84aebec\") "
Oct 30 21:41:41.802519 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:41.802434    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ad3bfc3b-f209-4cc1-abe0-d477d84aebec-otc-internal\" (UniqueName: \"kubernetes.io/configmap/ad3bfc3b-f209-4cc1-abe0-d477d84aebec-otc-internal\") pod \"ad3bfc3b-f209-4cc1-abe0-d477d84aebec\" (UID: \"ad3bfc3b-f209-4cc1-abe0-d477d84aebec\") "
Oct 30 21:41:41.802519 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:41.802476    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ad3bfc3b-f209-4cc1-abe0-d477d84aebec-tls-certs\" (UniqueName: \"kubernetes.io/secret/ad3bfc3b-f209-4cc1-abe0-d477d84aebec-tls-certs\") pod \"ad3bfc3b-f209-4cc1-abe0-d477d84aebec\" (UID: \"ad3bfc3b-f209-4cc1-abe0-d477d84aebec\") "
Oct 30 21:41:41.802519 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:41.802508    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ad3bfc3b-f209-4cc1-abe0-d477d84aebec-otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/ad3bfc3b-f209-4cc1-abe0-d477d84aebec-otlp-tls-certs\") pod \"ad3bfc3b-f209-4cc1-abe0-d477d84aebec\" (UID: \"ad3bfc3b-f209-4cc1-abe0-d477d84aebec\") "
Oct 30 21:41:41.802683 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:41.802531    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ad3bfc3b-f209-4cc1-abe0-d477d84aebec-monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/ad3bfc3b-f209-4cc1-abe0-d477d84aebec-monitoring-tls-certs\") pod \"ad3bfc3b-f209-4cc1-abe0-d477d84aebec\" (UID: \"ad3bfc3b-f209-4cc1-abe0-d477d84aebec\") "
Oct 30 21:41:41.802683 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:41.802552    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ad3bfc3b-f209-4cc1-abe0-d477d84aebec-kube-api-access-497lv\" (UniqueName: \"kubernetes.io/projected/ad3bfc3b-f209-4cc1-abe0-d477d84aebec-kube-api-access-497lv\") pod \"ad3bfc3b-f209-4cc1-abe0-d477d84aebec\" (UID: \"ad3bfc3b-f209-4cc1-abe0-d477d84aebec\") "
Oct 30 21:41:41.802970 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:41.802937    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ad3bfc3b-f209-4cc1-abe0-d477d84aebec-otc-internal" pod "ad3bfc3b-f209-4cc1-abe0-d477d84aebec" (UID: "ad3bfc3b-f209-4cc1-abe0-d477d84aebec"). InnerVolumeSpecName "otc-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:41:41.804789 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:41.804762    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ad3bfc3b-f209-4cc1-abe0-d477d84aebec-otlp-tls-certs" pod "ad3bfc3b-f209-4cc1-abe0-d477d84aebec" (UID: "ad3bfc3b-f209-4cc1-abe0-d477d84aebec"). InnerVolumeSpecName "otlp-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:41:41.805116 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:41.805083    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ad3bfc3b-f209-4cc1-abe0-d477d84aebec-monitoring-tls-certs" pod "ad3bfc3b-f209-4cc1-abe0-d477d84aebec" (UID: "ad3bfc3b-f209-4cc1-abe0-d477d84aebec"). InnerVolumeSpecName "monitoring-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:41:41.805116 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:41.805105    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ad3bfc3b-f209-4cc1-abe0-d477d84aebec-tls-certs" pod "ad3bfc3b-f209-4cc1-abe0-d477d84aebec" (UID: "ad3bfc3b-f209-4cc1-abe0-d477d84aebec"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:41:41.805285 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:41.805122    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ad3bfc3b-f209-4cc1-abe0-d477d84aebec-data-science-collector-ta-client-cert" pod "ad3bfc3b-f209-4cc1-abe0-d477d84aebec" (UID: "ad3bfc3b-f209-4cc1-abe0-d477d84aebec"). InnerVolumeSpecName "data-science-collector-ta-client-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:41:41.805285 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:41.805234    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ad3bfc3b-f209-4cc1-abe0-d477d84aebec-kube-api-access-497lv" pod "ad3bfc3b-f209-4cc1-abe0-d477d84aebec" (UID: "ad3bfc3b-f209-4cc1-abe0-d477d84aebec"). InnerVolumeSpecName "kube-api-access-497lv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:41:41.903824 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:41.903754    4060 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ad3bfc3b-f209-4cc1-abe0-d477d84aebec-tls-certs\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:41:41.903824 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:41.903782    4060 reconciler_common.go:299] "Volume detached for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/ad3bfc3b-f209-4cc1-abe0-d477d84aebec-otlp-tls-certs\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:41:41.903824 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:41.903794    4060 reconciler_common.go:299] "Volume detached for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/ad3bfc3b-f209-4cc1-abe0-d477d84aebec-monitoring-tls-certs\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:41:41.903824 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:41.903803    4060 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-497lv\" (UniqueName: \"kubernetes.io/projected/ad3bfc3b-f209-4cc1-abe0-d477d84aebec-kube-api-access-497lv\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:41:41.903824 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:41.903812    4060 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/ad3bfc3b-f209-4cc1-abe0-d477d84aebec-data-science-collector-ta-client-cert\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:41:41.903824 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:41.903822    4060 reconciler_common.go:299] "Volume detached for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/ad3bfc3b-f209-4cc1-abe0-d477d84aebec-otc-internal\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:41:41.930070 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:41.930034    4060 generic.go:356] "Generic (PLEG): container finished" podID="ad3bfc3b-f209-4cc1-abe0-d477d84aebec" containerID="61a52b700c20d1ce6bb92e2534ea0ce6fce9d20677f5a7a85d0cfafb48dd5bd0" exitCode=0
Oct 30 21:41:41.930232 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:41.930091    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:41:41.930232 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:41.930118    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"ad3bfc3b-f209-4cc1-abe0-d477d84aebec","Type":"ContainerDied","Data":"61a52b700c20d1ce6bb92e2534ea0ce6fce9d20677f5a7a85d0cfafb48dd5bd0"}
Oct 30 21:41:41.930232 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:41.930193    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"ad3bfc3b-f209-4cc1-abe0-d477d84aebec","Type":"ContainerDied","Data":"3a8dc1c57e184eea42552e990fc768cbd64a7ec82efe8aeb90078b23ae1af6d7"}
Oct 30 21:41:41.930232 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:41.930215    4060 scope.go:122] "RemoveContainer" containerID="61a52b700c20d1ce6bb92e2534ea0ce6fce9d20677f5a7a85d0cfafb48dd5bd0"
Oct 30 21:41:41.939052 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:41.939022    4060 scope.go:122] "RemoveContainer" containerID="61a52b700c20d1ce6bb92e2534ea0ce6fce9d20677f5a7a85d0cfafb48dd5bd0"
Oct 30 21:41:41.939326 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:41:41.939307    4060 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"61a52b700c20d1ce6bb92e2534ea0ce6fce9d20677f5a7a85d0cfafb48dd5bd0\": container with ID starting with 61a52b700c20d1ce6bb92e2534ea0ce6fce9d20677f5a7a85d0cfafb48dd5bd0 not found: ID does not exist" containerID="61a52b700c20d1ce6bb92e2534ea0ce6fce9d20677f5a7a85d0cfafb48dd5bd0"
Oct 30 21:41:41.939381 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:41.939336    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"61a52b700c20d1ce6bb92e2534ea0ce6fce9d20677f5a7a85d0cfafb48dd5bd0"} err="failed to get container status \"61a52b700c20d1ce6bb92e2534ea0ce6fce9d20677f5a7a85d0cfafb48dd5bd0\": rpc error: code = NotFound desc = could not find container \"61a52b700c20d1ce6bb92e2534ea0ce6fce9d20677f5a7a85d0cfafb48dd5bd0\": container with ID starting with 61a52b700c20d1ce6bb92e2534ea0ce6fce9d20677f5a7a85d0cfafb48dd5bd0 not found: ID does not exist"
Oct 30 21:41:42.096729 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:42.096698    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:41:42.101419 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:42.101391    4060 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:41:42.150264 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:41:42.150227    4060 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v2f4x" containerName="extractor"
Oct 30 21:41:42.177660 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:42.177586    4060 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:41:42.177949 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:42.177936    4060 cpu_manager.go:414] "containerMap: removing container" podUID="ad3bfc3b-f209-4cc1-abe0-d477d84aebec" containerName="otc-container"
Oct 30 21:41:42.177995 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:42.177951    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ad3bfc3b-f209-4cc1-abe0-d477d84aebec" containerName="otc-container"
Oct 30 21:41:42.178044 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:42.178034    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="ad3bfc3b-f209-4cc1-abe0-d477d84aebec" containerName="otc-container"
Oct 30 21:41:42.182623 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:42.182604    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:41:42.235398 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:42.235374    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-monitoring-tls\""
Oct 30 21:41:42.235398 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:42.235387    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-headless-tls\""
Oct 30 21:41:42.235658 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:42.235425    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-tls\""
Oct 30 21:41:42.235658 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:42.235518    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-ta-client-cert\""
Oct 30 21:41:42.235658 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:42.235565    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-dockercfg-khslt\""
Oct 30 21:41:42.235658 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:42.235636    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-a0f9182a\""
Oct 30 21:41:42.243323 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:42.243291    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:41:42.306566 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:42.306532    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/99cc29a0-750a-45a9-b689-3367f37bae60-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-0\" (UID: \"99cc29a0-750a-45a9-b689-3367f37bae60\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:41:42.306721 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:42.306579    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/99cc29a0-750a-45a9-b689-3367f37bae60-otlp-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"99cc29a0-750a-45a9-b689-3367f37bae60\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:41:42.306721 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:42.306701    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/99cc29a0-750a-45a9-b689-3367f37bae60-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"99cc29a0-750a-45a9-b689-3367f37bae60\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:41:42.306792 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:42.306734    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v8rfb\" (UniqueName: \"kubernetes.io/projected/99cc29a0-750a-45a9-b689-3367f37bae60-kube-api-access-v8rfb\") pod \"data-science-collector-collector-0\" (UID: \"99cc29a0-750a-45a9-b689-3367f37bae60\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:41:42.306792 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:42.306769    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/99cc29a0-750a-45a9-b689-3367f37bae60-otc-internal\") pod \"data-science-collector-collector-0\" (UID: \"99cc29a0-750a-45a9-b689-3367f37bae60\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:41:42.306861 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:42.306801    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/99cc29a0-750a-45a9-b689-3367f37bae60-monitoring-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"99cc29a0-750a-45a9-b689-3367f37bae60\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:41:42.407681 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:42.407646    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/99cc29a0-750a-45a9-b689-3367f37bae60-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-0\" (UID: \"99cc29a0-750a-45a9-b689-3367f37bae60\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:41:42.407854 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:42.407689    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/99cc29a0-750a-45a9-b689-3367f37bae60-otlp-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"99cc29a0-750a-45a9-b689-3367f37bae60\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:41:42.407854 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:42.407735    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/99cc29a0-750a-45a9-b689-3367f37bae60-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"99cc29a0-750a-45a9-b689-3367f37bae60\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:41:42.407854 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:42.407756    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v8rfb\" (UniqueName: \"kubernetes.io/projected/99cc29a0-750a-45a9-b689-3367f37bae60-kube-api-access-v8rfb\") pod \"data-science-collector-collector-0\" (UID: \"99cc29a0-750a-45a9-b689-3367f37bae60\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:41:42.407854 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:42.407781    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/99cc29a0-750a-45a9-b689-3367f37bae60-otc-internal\") pod \"data-science-collector-collector-0\" (UID: \"99cc29a0-750a-45a9-b689-3367f37bae60\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:41:42.407854 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:42.407798    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/99cc29a0-750a-45a9-b689-3367f37bae60-monitoring-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"99cc29a0-750a-45a9-b689-3367f37bae60\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:41:42.408546 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:42.408512    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/99cc29a0-750a-45a9-b689-3367f37bae60-otc-internal\") pod \"data-science-collector-collector-0\" (UID: \"99cc29a0-750a-45a9-b689-3367f37bae60\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:41:42.410202 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:42.410178    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/99cc29a0-750a-45a9-b689-3367f37bae60-otlp-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"99cc29a0-750a-45a9-b689-3367f37bae60\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:41:42.410309 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:42.410255    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/99cc29a0-750a-45a9-b689-3367f37bae60-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-0\" (UID: \"99cc29a0-750a-45a9-b689-3367f37bae60\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:41:42.410393 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:42.410372    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/99cc29a0-750a-45a9-b689-3367f37bae60-monitoring-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"99cc29a0-750a-45a9-b689-3367f37bae60\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:41:42.410431 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:42.410372    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/99cc29a0-750a-45a9-b689-3367f37bae60-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"99cc29a0-750a-45a9-b689-3367f37bae60\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:41:42.469203 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:42.469173    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v8rfb\" (UniqueName: \"kubernetes.io/projected/99cc29a0-750a-45a9-b689-3367f37bae60-kube-api-access-v8rfb\") pod \"data-science-collector-collector-0\" (UID: \"99cc29a0-750a-45a9-b689-3367f37bae60\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:41:42.494783 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:42.494760    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:41:42.867788 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:42.867351    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:41:42.870350 ip-10-0-142-4 kubenswrapper[4060]: W1030 21:41:42.870322    4060 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99cc29a0_750a_45a9_b689_3367f37bae60.slice/crio-66690c2fe695b9ee382a08cb9101c88fdffa90f708115aa00e06b80802d5ddac WatchSource:0}: Error finding container 66690c2fe695b9ee382a08cb9101c88fdffa90f708115aa00e06b80802d5ddac: Status 404 returned error can't find the container with id 66690c2fe695b9ee382a08cb9101c88fdffa90f708115aa00e06b80802d5ddac
Oct 30 21:41:42.872671 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:42.872633    4060 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 21:41:42.872748 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:42.872716    4060 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 21:41:42.936803 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:42.936775    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"99cc29a0-750a-45a9-b689-3367f37bae60","Type":"ContainerStarted","Data":"389164a9a81f7cbd867a88b06197af4eb0df75794c79a7838989703c1f3dac73"}
Oct 30 21:41:42.936932 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:42.936832    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"99cc29a0-750a-45a9-b689-3367f37bae60","Type":"ContainerStarted","Data":"66690c2fe695b9ee382a08cb9101c88fdffa90f708115aa00e06b80802d5ddac"}
Oct 30 21:41:43.055756 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:43.055678    4060 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-collector-0" podStartSLOduration=1.055664635 podStartE2EDuration="1.055664635s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:41:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:41:43.054959466 +0000 UTC m=+3921.811957769" watchObservedRunningTime="2026-10-30 21:41:43.055664635 +0000 UTC m=+3921.812662933"
Oct 30 21:41:43.426879 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:43.426845    4060 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ad3bfc3b-f209-4cc1-abe0-d477d84aebec" path="/var/lib/kubelet/pods/ad3bfc3b-f209-4cc1-abe0-d477d84aebec/volumes"
Oct 30 21:41:52.515332 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:52.515301    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-gzqpf"]
Oct 30 21:41:52.515853 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:52.515480    4060 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-gzqpf" podUID="fca5bd38-ed8d-4e6e-b48e-ba683819429a" containerName="kube-rbac-proxy" containerID="cri-o://f5582843ecba0e8893bec7d27cba921c77c53d897cd27ef2006020d0cd3b51a3" gracePeriod=30
Oct 30 21:41:52.669662 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:52.669623    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/korrel8r-5cbcc89b8f-6gdr6"]
Oct 30 21:41:52.764119 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:52.764096    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-gzqpf"
Oct 30 21:41:52.891845 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:52.891766    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/fca5bd38-ed8d-4e6e-b48e-ba683819429a-kube-api-access-9t5q9\" (UniqueName: \"kubernetes.io/projected/fca5bd38-ed8d-4e6e-b48e-ba683819429a-kube-api-access-9t5q9\") pod \"fca5bd38-ed8d-4e6e-b48e-ba683819429a\" (UID: \"fca5bd38-ed8d-4e6e-b48e-ba683819429a\") "
Oct 30 21:41:52.892017 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:52.891845    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/fca5bd38-ed8d-4e6e-b48e-ba683819429a-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fca5bd38-ed8d-4e6e-b48e-ba683819429a-kube-rbac-proxy-config\") pod \"fca5bd38-ed8d-4e6e-b48e-ba683819429a\" (UID: \"fca5bd38-ed8d-4e6e-b48e-ba683819429a\") "
Oct 30 21:41:52.892017 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:52.891905    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/fca5bd38-ed8d-4e6e-b48e-ba683819429a-tls\" (UniqueName: \"kubernetes.io/secret/fca5bd38-ed8d-4e6e-b48e-ba683819429a-tls\") pod \"fca5bd38-ed8d-4e6e-b48e-ba683819429a\" (UID: \"fca5bd38-ed8d-4e6e-b48e-ba683819429a\") "
Oct 30 21:41:52.892017 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:52.891961    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/fca5bd38-ed8d-4e6e-b48e-ba683819429a-prometheus-ca\" (UniqueName: \"kubernetes.io/configmap/fca5bd38-ed8d-4e6e-b48e-ba683819429a-prometheus-ca\") pod \"fca5bd38-ed8d-4e6e-b48e-ba683819429a\" (UID: \"fca5bd38-ed8d-4e6e-b48e-ba683819429a\") "
Oct 30 21:41:52.892017 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:52.891991    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/fca5bd38-ed8d-4e6e-b48e-ba683819429a-prometheus-client-cert\" (UniqueName: \"kubernetes.io/secret/fca5bd38-ed8d-4e6e-b48e-ba683819429a-prometheus-client-cert\") pod \"fca5bd38-ed8d-4e6e-b48e-ba683819429a\" (UID: \"fca5bd38-ed8d-4e6e-b48e-ba683819429a\") "
Oct 30 21:41:52.892548 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:52.892477    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fca5bd38-ed8d-4e6e-b48e-ba683819429a-prometheus-ca" pod "fca5bd38-ed8d-4e6e-b48e-ba683819429a" (UID: "fca5bd38-ed8d-4e6e-b48e-ba683819429a"). InnerVolumeSpecName "prometheus-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:41:52.894661 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:52.894635    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fca5bd38-ed8d-4e6e-b48e-ba683819429a-prometheus-client-cert" pod "fca5bd38-ed8d-4e6e-b48e-ba683819429a" (UID: "fca5bd38-ed8d-4e6e-b48e-ba683819429a"). InnerVolumeSpecName "prometheus-client-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:41:52.894754 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:52.894673    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fca5bd38-ed8d-4e6e-b48e-ba683819429a-kube-api-access-9t5q9" pod "fca5bd38-ed8d-4e6e-b48e-ba683819429a" (UID: "fca5bd38-ed8d-4e6e-b48e-ba683819429a"). InnerVolumeSpecName "kube-api-access-9t5q9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:41:52.894754 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:52.894715    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fca5bd38-ed8d-4e6e-b48e-ba683819429a-tls" pod "fca5bd38-ed8d-4e6e-b48e-ba683819429a" (UID: "fca5bd38-ed8d-4e6e-b48e-ba683819429a"). InnerVolumeSpecName "tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:41:52.895846 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:52.895825    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fca5bd38-ed8d-4e6e-b48e-ba683819429a-kube-rbac-proxy-config" pod "fca5bd38-ed8d-4e6e-b48e-ba683819429a" (UID: "fca5bd38-ed8d-4e6e-b48e-ba683819429a"). InnerVolumeSpecName "kube-rbac-proxy-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:41:52.993187 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:52.993157    4060 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9t5q9\" (UniqueName: \"kubernetes.io/projected/fca5bd38-ed8d-4e6e-b48e-ba683819429a-kube-api-access-9t5q9\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:41:52.993187 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:52.993183    4060 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fca5bd38-ed8d-4e6e-b48e-ba683819429a-kube-rbac-proxy-config\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:41:52.993187 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:52.993194    4060 reconciler_common.go:299] "Volume detached for volume \"tls\" (UniqueName: \"kubernetes.io/secret/fca5bd38-ed8d-4e6e-b48e-ba683819429a-tls\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:41:52.993408 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:52.993204    4060 reconciler_common.go:299] "Volume detached for volume \"prometheus-ca\" (UniqueName: \"kubernetes.io/configmap/fca5bd38-ed8d-4e6e-b48e-ba683819429a-prometheus-ca\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:41:52.993408 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:52.993215    4060 reconciler_common.go:299] "Volume detached for volume \"prometheus-client-cert\" (UniqueName: \"kubernetes.io/secret/fca5bd38-ed8d-4e6e-b48e-ba683819429a-prometheus-client-cert\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:41:52.994957 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:52.994929    4060 generic.go:356] "Generic (PLEG): container finished" podID="fca5bd38-ed8d-4e6e-b48e-ba683819429a" containerID="f5582843ecba0e8893bec7d27cba921c77c53d897cd27ef2006020d0cd3b51a3" exitCode=0
Oct 30 21:41:52.995118 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:52.995001    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-gzqpf"
Oct 30 21:41:52.995118 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:52.995013    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-gzqpf" event={"ID":"fca5bd38-ed8d-4e6e-b48e-ba683819429a","Type":"ContainerDied","Data":"f5582843ecba0e8893bec7d27cba921c77c53d897cd27ef2006020d0cd3b51a3"}
Oct 30 21:41:52.995118 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:52.995096    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-gzqpf" event={"ID":"fca5bd38-ed8d-4e6e-b48e-ba683819429a","Type":"ContainerDied","Data":"3f33548a9ec6029e7d346adefc0cbc2ef849d4f06e01808922a5fb9808c1119c"}
Oct 30 21:41:52.995285 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:52.995121    4060 scope.go:122] "RemoveContainer" containerID="f5582843ecba0e8893bec7d27cba921c77c53d897cd27ef2006020d0cd3b51a3"
Oct 30 21:41:52.995371 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:52.995347    4060 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-6gdr6" podUID="14dc810e-1c4e-48f1-b8ba-393a3e241b3d" containerName="korrel8r" containerID="cri-o://4d408f3cc62a820d4d3403f69b741f90448d069433a98ff77a07aaf754b83686" gracePeriod=30
Oct 30 21:41:53.004412 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:53.004396    4060 scope.go:122] "RemoveContainer" containerID="f5582843ecba0e8893bec7d27cba921c77c53d897cd27ef2006020d0cd3b51a3"
Oct 30 21:41:53.004674 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:41:53.004655    4060 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f5582843ecba0e8893bec7d27cba921c77c53d897cd27ef2006020d0cd3b51a3\": container with ID starting with f5582843ecba0e8893bec7d27cba921c77c53d897cd27ef2006020d0cd3b51a3 not found: ID does not exist" containerID="f5582843ecba0e8893bec7d27cba921c77c53d897cd27ef2006020d0cd3b51a3"
Oct 30 21:41:53.004731 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:53.004688    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f5582843ecba0e8893bec7d27cba921c77c53d897cd27ef2006020d0cd3b51a3"} err="failed to get container status \"f5582843ecba0e8893bec7d27cba921c77c53d897cd27ef2006020d0cd3b51a3\": rpc error: code = NotFound desc = could not find container \"f5582843ecba0e8893bec7d27cba921c77c53d897cd27ef2006020d0cd3b51a3\": container with ID starting with f5582843ecba0e8893bec7d27cba921c77c53d897cd27ef2006020d0cd3b51a3 not found: ID does not exist"
Oct 30 21:41:53.245455 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:53.245431    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-6gdr6"
Oct 30 21:41:53.290044 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:53.290012    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-gzqpf"]
Oct 30 21:41:53.295457 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:53.295416    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/14dc810e-1c4e-48f1-b8ba-393a3e241b3d-kube-api-access-8z9m5\" (UniqueName: \"kubernetes.io/projected/14dc810e-1c4e-48f1-b8ba-393a3e241b3d-kube-api-access-8z9m5\") pod \"14dc810e-1c4e-48f1-b8ba-393a3e241b3d\" (UID: \"14dc810e-1c4e-48f1-b8ba-393a3e241b3d\") "
Oct 30 21:41:53.296430 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:53.295555    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/14dc810e-1c4e-48f1-b8ba-393a3e241b3d-tls\" (UniqueName: \"kubernetes.io/secret/14dc810e-1c4e-48f1-b8ba-393a3e241b3d-tls\") pod \"14dc810e-1c4e-48f1-b8ba-393a3e241b3d\" (UID: \"14dc810e-1c4e-48f1-b8ba-393a3e241b3d\") "
Oct 30 21:41:53.296430 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:53.295591    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/14dc810e-1c4e-48f1-b8ba-393a3e241b3d-config\" (UniqueName: \"kubernetes.io/configmap/14dc810e-1c4e-48f1-b8ba-393a3e241b3d-config\") pod \"14dc810e-1c4e-48f1-b8ba-393a3e241b3d\" (UID: \"14dc810e-1c4e-48f1-b8ba-393a3e241b3d\") "
Oct 30 21:41:53.296430 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:53.296287    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/14dc810e-1c4e-48f1-b8ba-393a3e241b3d-config" pod "14dc810e-1c4e-48f1-b8ba-393a3e241b3d" (UID: "14dc810e-1c4e-48f1-b8ba-393a3e241b3d"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:41:53.298272 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:53.298248    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/14dc810e-1c4e-48f1-b8ba-393a3e241b3d-kube-api-access-8z9m5" pod "14dc810e-1c4e-48f1-b8ba-393a3e241b3d" (UID: "14dc810e-1c4e-48f1-b8ba-393a3e241b3d"). InnerVolumeSpecName "kube-api-access-8z9m5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:41:53.298355 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:53.298330    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/14dc810e-1c4e-48f1-b8ba-393a3e241b3d-tls" pod "14dc810e-1c4e-48f1-b8ba-393a3e241b3d" (UID: "14dc810e-1c4e-48f1-b8ba-393a3e241b3d"). InnerVolumeSpecName "tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:41:53.299949 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:53.299921    4060 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-gzqpf"]
Oct 30 21:41:53.397073 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:53.397044    4060 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8z9m5\" (UniqueName: \"kubernetes.io/projected/14dc810e-1c4e-48f1-b8ba-393a3e241b3d-kube-api-access-8z9m5\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:41:53.397073 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:53.397069    4060 reconciler_common.go:299] "Volume detached for volume \"tls\" (UniqueName: \"kubernetes.io/secret/14dc810e-1c4e-48f1-b8ba-393a3e241b3d-tls\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:41:53.397073 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:53.397082    4060 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/14dc810e-1c4e-48f1-b8ba-393a3e241b3d-config\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:41:53.428730 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:53.428660    4060 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="fca5bd38-ed8d-4e6e-b48e-ba683819429a" path="/var/lib/kubelet/pods/fca5bd38-ed8d-4e6e-b48e-ba683819429a/volumes"
Oct 30 21:41:53.592525 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:53.592482    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-wthvh"]
Oct 30 21:41:53.592961 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:53.592723    4060 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-wthvh" podUID="f4ca88c9-945d-4a9e-ab40-2c7390930441" containerName="thanos-querier" containerID="cri-o://bcf96ca5afc805d19aecaf0c911f87fe9bc932004cbdc4b0c456afcf5b7ca5ba" gracePeriod=30
Oct 30 21:41:53.836770 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:53.836745    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-wthvh"
Oct 30 21:41:53.900451 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:53.900424    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f4ca88c9-945d-4a9e-ab40-2c7390930441-kube-api-access-2sr9t\" (UniqueName: \"kubernetes.io/projected/f4ca88c9-945d-4a9e-ab40-2c7390930441-kube-api-access-2sr9t\") pod \"f4ca88c9-945d-4a9e-ab40-2c7390930441\" (UID: \"f4ca88c9-945d-4a9e-ab40-2c7390930441\") "
Oct 30 21:41:53.903064 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:53.903039    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f4ca88c9-945d-4a9e-ab40-2c7390930441-kube-api-access-2sr9t" pod "f4ca88c9-945d-4a9e-ab40-2c7390930441" (UID: "f4ca88c9-945d-4a9e-ab40-2c7390930441"). InnerVolumeSpecName "kube-api-access-2sr9t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:41:53.932561 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:53.932525    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"]
Oct 30 21:41:53.932823 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:53.932795    4060 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0" podUID="937ddbc0-8ae4-452e-ab96-0654ff770a14" containerName="prometheus" containerID="cri-o://7c410ed7dde0b4d6b2a568b65539087a634154418b8aa8a93159565908d3d5ee" gracePeriod=600
Oct 30 21:41:53.932913 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:53.932821    4060 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0" podUID="937ddbc0-8ae4-452e-ab96-0654ff770a14" containerName="thanos-sidecar" containerID="cri-o://67adcde6c599b2800be892f6b20a202eadda2ae52cb99222ddd7a2f9265e8003" gracePeriod=600
Oct 30 21:41:53.932980 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:53.932823    4060 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0" podUID="937ddbc0-8ae4-452e-ab96-0654ff770a14" containerName="config-reloader" containerID="cri-o://e2c6849e14ba7b35b3a963a7d65e9c655509dd582c59672a7304d055bb87fc0b" gracePeriod=600
Oct 30 21:41:53.946644 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:53.941923    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"]
Oct 30 21:41:53.946644 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:53.942261    4060 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0" podUID="d0741409-a9b0-47b6-bbbb-ada2803a855b" containerName="alertmanager" containerID="cri-o://9650c2854bdeda220e8d9ef86fb7f0824d5e2065b604c33deba4f2400e67b643" gracePeriod=120
Oct 30 21:41:53.946644 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:53.942437    4060 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0" podUID="d0741409-a9b0-47b6-bbbb-ada2803a855b" containerName="config-reloader" containerID="cri-o://7e36e2e149f5c6ac19e7aec5ff7ed148e67618888c02cb8716db42e26d9eabeb" gracePeriod=120
Oct 30 21:41:54.001456 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:54.001398    4060 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2sr9t\" (UniqueName: \"kubernetes.io/projected/f4ca88c9-945d-4a9e-ab40-2c7390930441-kube-api-access-2sr9t\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:41:54.003068 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:54.003044    4060 generic.go:356] "Generic (PLEG): container finished" podID="14dc810e-1c4e-48f1-b8ba-393a3e241b3d" containerID="4d408f3cc62a820d4d3403f69b741f90448d069433a98ff77a07aaf754b83686" exitCode=0
Oct 30 21:41:54.003203 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:54.003126    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-6gdr6"
Oct 30 21:41:54.003263 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:54.003128    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-6gdr6" event={"ID":"14dc810e-1c4e-48f1-b8ba-393a3e241b3d","Type":"ContainerDied","Data":"4d408f3cc62a820d4d3403f69b741f90448d069433a98ff77a07aaf754b83686"}
Oct 30 21:41:54.003304 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:54.003274    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-6gdr6" event={"ID":"14dc810e-1c4e-48f1-b8ba-393a3e241b3d","Type":"ContainerDied","Data":"178a4b40826ff57834c1e04ba20c0d62be6bd311dd69943be886146028da4567"}
Oct 30 21:41:54.003304 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:54.003301    4060 scope.go:122] "RemoveContainer" containerID="4d408f3cc62a820d4d3403f69b741f90448d069433a98ff77a07aaf754b83686"
Oct 30 21:41:54.004898 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:54.004874    4060 generic.go:356] "Generic (PLEG): container finished" podID="f4ca88c9-945d-4a9e-ab40-2c7390930441" containerID="bcf96ca5afc805d19aecaf0c911f87fe9bc932004cbdc4b0c456afcf5b7ca5ba" exitCode=0
Oct 30 21:41:54.005013 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:54.004920    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-wthvh" event={"ID":"f4ca88c9-945d-4a9e-ab40-2c7390930441","Type":"ContainerDied","Data":"bcf96ca5afc805d19aecaf0c911f87fe9bc932004cbdc4b0c456afcf5b7ca5ba"}
Oct 30 21:41:54.005013 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:54.004950    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-wthvh" event={"ID":"f4ca88c9-945d-4a9e-ab40-2c7390930441","Type":"ContainerDied","Data":"5d31f0f0e78b379dc4d3914248dd8fa4691d25538cf0b502bf574ef8b8c086c9"}
Oct 30 21:41:54.005013 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:54.004983    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-wthvh"
Oct 30 21:41:54.055581 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:54.055474    4060 scope.go:122] "RemoveContainer" containerID="4d408f3cc62a820d4d3403f69b741f90448d069433a98ff77a07aaf754b83686"
Oct 30 21:41:54.056004 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:41:54.055908    4060 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4d408f3cc62a820d4d3403f69b741f90448d069433a98ff77a07aaf754b83686\": container with ID starting with 4d408f3cc62a820d4d3403f69b741f90448d069433a98ff77a07aaf754b83686 not found: ID does not exist" containerID="4d408f3cc62a820d4d3403f69b741f90448d069433a98ff77a07aaf754b83686"
Oct 30 21:41:54.056004 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:54.055936    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d408f3cc62a820d4d3403f69b741f90448d069433a98ff77a07aaf754b83686"} err="failed to get container status \"4d408f3cc62a820d4d3403f69b741f90448d069433a98ff77a07aaf754b83686\": rpc error: code = NotFound desc = could not find container \"4d408f3cc62a820d4d3403f69b741f90448d069433a98ff77a07aaf754b83686\": container with ID starting with 4d408f3cc62a820d4d3403f69b741f90448d069433a98ff77a07aaf754b83686 not found: ID does not exist"
Oct 30 21:41:54.056004 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:54.055959    4060 scope.go:122] "RemoveContainer" containerID="bcf96ca5afc805d19aecaf0c911f87fe9bc932004cbdc4b0c456afcf5b7ca5ba"
Oct 30 21:41:54.063482 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:54.063461    4060 scope.go:122] "RemoveContainer" containerID="bcf96ca5afc805d19aecaf0c911f87fe9bc932004cbdc4b0c456afcf5b7ca5ba"
Oct 30 21:41:54.063758 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:41:54.063737    4060 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bcf96ca5afc805d19aecaf0c911f87fe9bc932004cbdc4b0c456afcf5b7ca5ba\": container with ID starting with bcf96ca5afc805d19aecaf0c911f87fe9bc932004cbdc4b0c456afcf5b7ca5ba not found: ID does not exist" containerID="bcf96ca5afc805d19aecaf0c911f87fe9bc932004cbdc4b0c456afcf5b7ca5ba"
Oct 30 21:41:54.063810 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:54.063765    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bcf96ca5afc805d19aecaf0c911f87fe9bc932004cbdc4b0c456afcf5b7ca5ba"} err="failed to get container status \"bcf96ca5afc805d19aecaf0c911f87fe9bc932004cbdc4b0c456afcf5b7ca5ba\": rpc error: code = NotFound desc = could not find container \"bcf96ca5afc805d19aecaf0c911f87fe9bc932004cbdc4b0c456afcf5b7ca5ba\": container with ID starting with bcf96ca5afc805d19aecaf0c911f87fe9bc932004cbdc4b0c456afcf5b7ca5ba not found: ID does not exist"
Oct 30 21:41:54.332515 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:54.332421    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-wthvh"]
Oct 30 21:41:54.336881 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:54.336857    4060 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-wthvh"]
Oct 30 21:41:54.397604 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:54.397563    4060 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0" podUID="937ddbc0-8ae4-452e-ab96-0654ff770a14" containerName="prometheus" probeResult="failure" output="Get \"https://10.133.0.151:9090/-/ready\": dial tcp 10.133.0.151:9090: connect: connection refused"
Oct 30 21:41:54.449951 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:54.449920    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/korrel8r-5cbcc89b8f-6gdr6"]
Oct 30 21:41:54.456232 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:54.456200    4060 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/korrel8r-5cbcc89b8f-6gdr6"]
Oct 30 21:41:54.684193 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:54.684169    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:41:54.806691 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:54.806658    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/937ddbc0-8ae4-452e-ab96-0654ff770a14-web-config-tls-secret-cert-prometheus-operated-tls-f3457c70\" (UniqueName: \"kubernetes.io/secret/937ddbc0-8ae4-452e-ab96-0654ff770a14-web-config-tls-secret-cert-prometheus-operated-tls-f3457c70\") pod \"937ddbc0-8ae4-452e-ab96-0654ff770a14\" (UID: \"937ddbc0-8ae4-452e-ab96-0654ff770a14\") "
Oct 30 21:41:54.806878 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:54.806703    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/937ddbc0-8ae4-452e-ab96-0654ff770a14-prometheus-data-science-monitoringstack-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/937ddbc0-8ae4-452e-ab96-0654ff770a14-prometheus-data-science-monitoringstack-rulefiles-2\") pod \"937ddbc0-8ae4-452e-ab96-0654ff770a14\" (UID: \"937ddbc0-8ae4-452e-ab96-0654ff770a14\") "
Oct 30 21:41:54.806878 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:54.806759    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/937ddbc0-8ae4-452e-ab96-0654ff770a14-web-config\" (UniqueName: \"kubernetes.io/secret/937ddbc0-8ae4-452e-ab96-0654ff770a14-web-config\") pod \"937ddbc0-8ae4-452e-ab96-0654ff770a14\" (UID: \"937ddbc0-8ae4-452e-ab96-0654ff770a14\") "
Oct 30 21:41:54.806878 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:54.806792    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/937ddbc0-8ae4-452e-ab96-0654ff770a14-kube-api-access-vtrzr\" (UniqueName: \"kubernetes.io/projected/937ddbc0-8ae4-452e-ab96-0654ff770a14-kube-api-access-vtrzr\") pod \"937ddbc0-8ae4-452e-ab96-0654ff770a14\" (UID: \"937ddbc0-8ae4-452e-ab96-0654ff770a14\") "
Oct 30 21:41:54.806878 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:54.806817    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/937ddbc0-8ae4-452e-ab96-0654ff770a14-thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/937ddbc0-8ae4-452e-ab96-0654ff770a14-thanos-prometheus-http-client-file\") pod \"937ddbc0-8ae4-452e-ab96-0654ff770a14\" (UID: \"937ddbc0-8ae4-452e-ab96-0654ff770a14\") "
Oct 30 21:41:54.806878 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:54.806863    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/937ddbc0-8ae4-452e-ab96-0654ff770a14-web-config-tls-secret-key-prometheus-operated-tls-f3457c70\" (UniqueName: \"kubernetes.io/secret/937ddbc0-8ae4-452e-ab96-0654ff770a14-web-config-tls-secret-key-prometheus-operated-tls-f3457c70\") pod \"937ddbc0-8ae4-452e-ab96-0654ff770a14\" (UID: \"937ddbc0-8ae4-452e-ab96-0654ff770a14\") "
Oct 30 21:41:54.807180 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:54.806913    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/937ddbc0-8ae4-452e-ab96-0654ff770a14-config-out\" (UniqueName: \"kubernetes.io/empty-dir/937ddbc0-8ae4-452e-ab96-0654ff770a14-config-out\") pod \"937ddbc0-8ae4-452e-ab96-0654ff770a14\" (UID: \"937ddbc0-8ae4-452e-ab96-0654ff770a14\") "
Oct 30 21:41:54.807180 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:54.806961    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/937ddbc0-8ae4-452e-ab96-0654ff770a14-tls-assets\" (UniqueName: \"kubernetes.io/projected/937ddbc0-8ae4-452e-ab96-0654ff770a14-tls-assets\") pod \"937ddbc0-8ae4-452e-ab96-0654ff770a14\" (UID: \"937ddbc0-8ae4-452e-ab96-0654ff770a14\") "
Oct 30 21:41:54.807180 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:54.807009    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/937ddbc0-8ae4-452e-ab96-0654ff770a14-config\" (UniqueName: \"kubernetes.io/secret/937ddbc0-8ae4-452e-ab96-0654ff770a14-config\") pod \"937ddbc0-8ae4-452e-ab96-0654ff770a14\" (UID: \"937ddbc0-8ae4-452e-ab96-0654ff770a14\") "
Oct 30 21:41:54.807180 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:54.807046    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/937ddbc0-8ae4-452e-ab96-0654ff770a14-prometheus-data-science-monitoringstack-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/937ddbc0-8ae4-452e-ab96-0654ff770a14-prometheus-data-science-monitoringstack-rulefiles-0\") pod \"937ddbc0-8ae4-452e-ab96-0654ff770a14\" (UID: \"937ddbc0-8ae4-452e-ab96-0654ff770a14\") "
Oct 30 21:41:54.807180 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:54.807077    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/937ddbc0-8ae4-452e-ab96-0654ff770a14-prometheus-data-science-monitoringstack-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/937ddbc0-8ae4-452e-ab96-0654ff770a14-prometheus-data-science-monitoringstack-rulefiles-1\") pod \"937ddbc0-8ae4-452e-ab96-0654ff770a14\" (UID: \"937ddbc0-8ae4-452e-ab96-0654ff770a14\") "
Oct 30 21:41:54.807180 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:54.807109    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/937ddbc0-8ae4-452e-ab96-0654ff770a14-secret-prometheus-web-tls-ca\" (UniqueName: \"kubernetes.io/secret/937ddbc0-8ae4-452e-ab96-0654ff770a14-secret-prometheus-web-tls-ca\") pod \"937ddbc0-8ae4-452e-ab96-0654ff770a14\" (UID: \"937ddbc0-8ae4-452e-ab96-0654ff770a14\") "
Oct 30 21:41:54.807553 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:54.807213    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a155a55c1ce0e65b\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a155a55c1ce0e65b\") pod \"937ddbc0-8ae4-452e-ab96-0654ff770a14\" (UID: \"937ddbc0-8ae4-452e-ab96-0654ff770a14\") "
Oct 30 21:41:54.808014 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:54.807760    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/937ddbc0-8ae4-452e-ab96-0654ff770a14-prometheus-data-science-monitoringstack-rulefiles-2" pod "937ddbc0-8ae4-452e-ab96-0654ff770a14" (UID: "937ddbc0-8ae4-452e-ab96-0654ff770a14"). InnerVolumeSpecName "prometheus-data-science-monitoringstack-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:41:54.808198 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:54.808149    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/937ddbc0-8ae4-452e-ab96-0654ff770a14-prometheus-data-science-monitoringstack-rulefiles-0" pod "937ddbc0-8ae4-452e-ab96-0654ff770a14" (UID: "937ddbc0-8ae4-452e-ab96-0654ff770a14"). InnerVolumeSpecName "prometheus-data-science-monitoringstack-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:41:54.808324 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:54.808290    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/937ddbc0-8ae4-452e-ab96-0654ff770a14-prometheus-data-science-monitoringstack-rulefiles-1" pod "937ddbc0-8ae4-452e-ab96-0654ff770a14" (UID: "937ddbc0-8ae4-452e-ab96-0654ff770a14"). InnerVolumeSpecName "prometheus-data-science-monitoringstack-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:41:54.809613 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:54.809584    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/937ddbc0-8ae4-452e-ab96-0654ff770a14-web-config-tls-secret-cert-prometheus-operated-tls-f3457c70" pod "937ddbc0-8ae4-452e-ab96-0654ff770a14" (UID: "937ddbc0-8ae4-452e-ab96-0654ff770a14"). InnerVolumeSpecName "web-config-tls-secret-cert-prometheus-operated-tls-f3457c70". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:41:54.809715 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:54.809621    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/937ddbc0-8ae4-452e-ab96-0654ff770a14-web-config-tls-secret-key-prometheus-operated-tls-f3457c70" pod "937ddbc0-8ae4-452e-ab96-0654ff770a14" (UID: "937ddbc0-8ae4-452e-ab96-0654ff770a14"). InnerVolumeSpecName "web-config-tls-secret-key-prometheus-operated-tls-f3457c70". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:41:54.810112 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:54.810090    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/937ddbc0-8ae4-452e-ab96-0654ff770a14-kube-api-access-vtrzr" pod "937ddbc0-8ae4-452e-ab96-0654ff770a14" (UID: "937ddbc0-8ae4-452e-ab96-0654ff770a14"). InnerVolumeSpecName "kube-api-access-vtrzr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:41:54.810205 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:54.810102    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/937ddbc0-8ae4-452e-ab96-0654ff770a14-secret-prometheus-web-tls-ca" pod "937ddbc0-8ae4-452e-ab96-0654ff770a14" (UID: "937ddbc0-8ae4-452e-ab96-0654ff770a14"). InnerVolumeSpecName "secret-prometheus-web-tls-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:41:54.810567 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:54.810531    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/937ddbc0-8ae4-452e-ab96-0654ff770a14-config-out" pod "937ddbc0-8ae4-452e-ab96-0654ff770a14" (UID: "937ddbc0-8ae4-452e-ab96-0654ff770a14"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:41:54.810653 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:54.810627    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/937ddbc0-8ae4-452e-ab96-0654ff770a14-thanos-prometheus-http-client-file" pod "937ddbc0-8ae4-452e-ab96-0654ff770a14" (UID: "937ddbc0-8ae4-452e-ab96-0654ff770a14"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:41:54.811754 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:54.811730    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/937ddbc0-8ae4-452e-ab96-0654ff770a14-tls-assets" pod "937ddbc0-8ae4-452e-ab96-0654ff770a14" (UID: "937ddbc0-8ae4-452e-ab96-0654ff770a14"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:41:54.812914 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:54.812890    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/937ddbc0-8ae4-452e-ab96-0654ff770a14-config" pod "937ddbc0-8ae4-452e-ab96-0654ff770a14" (UID: "937ddbc0-8ae4-452e-ab96-0654ff770a14"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:41:54.814318 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:54.814297    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/csi/ebs.csi.aws.com^vol-0a155a55c1ce0e65b" pod "937ddbc0-8ae4-452e-ab96-0654ff770a14" (UID: "937ddbc0-8ae4-452e-ab96-0654ff770a14"). InnerVolumeSpecName "pvc-e73afc79-aa37-49a0-8744-633c03cad1f4". PluginName "kubernetes.io/csi", VolumeGIDValue ""
Oct 30 21:41:54.826108 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:54.826083    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/937ddbc0-8ae4-452e-ab96-0654ff770a14-web-config" pod "937ddbc0-8ae4-452e-ab96-0654ff770a14" (UID: "937ddbc0-8ae4-452e-ab96-0654ff770a14"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:41:54.908549 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:54.908445    4060 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/937ddbc0-8ae4-452e-ab96-0654ff770a14-config\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:41:54.908549 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:54.908474    4060 reconciler_common.go:299] "Volume detached for volume \"prometheus-data-science-monitoringstack-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/937ddbc0-8ae4-452e-ab96-0654ff770a14-prometheus-data-science-monitoringstack-rulefiles-0\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:41:54.908549 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:54.908485    4060 reconciler_common.go:299] "Volume detached for volume \"prometheus-data-science-monitoringstack-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/937ddbc0-8ae4-452e-ab96-0654ff770a14-prometheus-data-science-monitoringstack-rulefiles-1\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:41:54.908549 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:54.908522    4060 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-web-tls-ca\" (UniqueName: \"kubernetes.io/secret/937ddbc0-8ae4-452e-ab96-0654ff770a14-secret-prometheus-web-tls-ca\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:41:54.908549 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:54.908551    4060 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"pvc-e73afc79-aa37-49a0-8744-633c03cad1f4\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a155a55c1ce0e65b\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" "
Oct 30 21:41:54.908820 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:54.908561    4060 reconciler_common.go:299] "Volume detached for volume \"web-config-tls-secret-cert-prometheus-operated-tls-f3457c70\" (UniqueName: \"kubernetes.io/secret/937ddbc0-8ae4-452e-ab96-0654ff770a14-web-config-tls-secret-cert-prometheus-operated-tls-f3457c70\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:41:54.908820 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:54.908572    4060 reconciler_common.go:299] "Volume detached for volume \"prometheus-data-science-monitoringstack-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/937ddbc0-8ae4-452e-ab96-0654ff770a14-prometheus-data-science-monitoringstack-rulefiles-2\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:41:54.908820 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:54.908583    4060 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/937ddbc0-8ae4-452e-ab96-0654ff770a14-web-config\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:41:54.908820 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:54.908592    4060 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vtrzr\" (UniqueName: \"kubernetes.io/projected/937ddbc0-8ae4-452e-ab96-0654ff770a14-kube-api-access-vtrzr\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:41:54.908820 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:54.908601    4060 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/937ddbc0-8ae4-452e-ab96-0654ff770a14-thanos-prometheus-http-client-file\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:41:54.908820 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:54.908610    4060 reconciler_common.go:299] "Volume detached for volume \"web-config-tls-secret-key-prometheus-operated-tls-f3457c70\" (UniqueName: \"kubernetes.io/secret/937ddbc0-8ae4-452e-ab96-0654ff770a14-web-config-tls-secret-key-prometheus-operated-tls-f3457c70\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:41:54.908820 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:54.908619    4060 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/937ddbc0-8ae4-452e-ab96-0654ff770a14-config-out\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:41:54.908820 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:54.908627    4060 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/937ddbc0-8ae4-452e-ab96-0654ff770a14-tls-assets\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:41:54.920164 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:54.920145    4060 operation_generator.go:893] UnmountDevice succeeded for volume "pvc-e73afc79-aa37-49a0-8744-633c03cad1f4" (UniqueName: "kubernetes.io/csi/ebs.csi.aws.com^vol-0a155a55c1ce0e65b") on node "ip-10-0-142-4.us-west-1.compute.internal"
Oct 30 21:41:55.009212 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:55.009183    4060 reconciler_common.go:299] "Volume detached for volume \"pvc-e73afc79-aa37-49a0-8744-633c03cad1f4\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a155a55c1ce0e65b\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"csi-7011c01335d2502f76be252f9498c79824668beecf30ee8f6a7191145201ca4c\""
Oct 30 21:41:55.013718 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:55.013692    4060 generic.go:356] "Generic (PLEG): container finished" podID="d0741409-a9b0-47b6-bbbb-ada2803a855b" containerID="7e36e2e149f5c6ac19e7aec5ff7ed148e67618888c02cb8716db42e26d9eabeb" exitCode=0
Oct 30 21:41:55.013847 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:55.013764    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0" event={"ID":"d0741409-a9b0-47b6-bbbb-ada2803a855b","Type":"ContainerDied","Data":"7e36e2e149f5c6ac19e7aec5ff7ed148e67618888c02cb8716db42e26d9eabeb"}
Oct 30 21:41:55.015837 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:55.015811    4060 generic.go:356] "Generic (PLEG): container finished" podID="937ddbc0-8ae4-452e-ab96-0654ff770a14" containerID="67adcde6c599b2800be892f6b20a202eadda2ae52cb99222ddd7a2f9265e8003" exitCode=0
Oct 30 21:41:55.015837 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:55.015826    4060 generic.go:356] "Generic (PLEG): container finished" podID="937ddbc0-8ae4-452e-ab96-0654ff770a14" containerID="e2c6849e14ba7b35b3a963a7d65e9c655509dd582c59672a7304d055bb87fc0b" exitCode=0
Oct 30 21:41:55.015837 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:55.015833    4060 generic.go:356] "Generic (PLEG): container finished" podID="937ddbc0-8ae4-452e-ab96-0654ff770a14" containerID="7c410ed7dde0b4d6b2a568b65539087a634154418b8aa8a93159565908d3d5ee" exitCode=0
Oct 30 21:41:55.016039 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:55.015892    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:41:55.016039 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:55.015891    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0" event={"ID":"937ddbc0-8ae4-452e-ab96-0654ff770a14","Type":"ContainerDied","Data":"67adcde6c599b2800be892f6b20a202eadda2ae52cb99222ddd7a2f9265e8003"}
Oct 30 21:41:55.016039 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:55.016013    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0" event={"ID":"937ddbc0-8ae4-452e-ab96-0654ff770a14","Type":"ContainerDied","Data":"e2c6849e14ba7b35b3a963a7d65e9c655509dd582c59672a7304d055bb87fc0b"}
Oct 30 21:41:55.016039 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:55.016038    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0" event={"ID":"937ddbc0-8ae4-452e-ab96-0654ff770a14","Type":"ContainerDied","Data":"7c410ed7dde0b4d6b2a568b65539087a634154418b8aa8a93159565908d3d5ee"}
Oct 30 21:41:55.016507 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:55.016061    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0" event={"ID":"937ddbc0-8ae4-452e-ab96-0654ff770a14","Type":"ContainerDied","Data":"ba47a1b417122c85d6982ff4ec9c9bcf4c7e3f36e7fae174e0b23d7c1652cbd6"}
Oct 30 21:41:55.016507 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:55.016076    4060 scope.go:122] "RemoveContainer" containerID="67adcde6c599b2800be892f6b20a202eadda2ae52cb99222ddd7a2f9265e8003"
Oct 30 21:41:55.024890 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:55.024874    4060 scope.go:122] "RemoveContainer" containerID="e2c6849e14ba7b35b3a963a7d65e9c655509dd582c59672a7304d055bb87fc0b"
Oct 30 21:41:55.032873 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:55.032859    4060 scope.go:122] "RemoveContainer" containerID="7c410ed7dde0b4d6b2a568b65539087a634154418b8aa8a93159565908d3d5ee"
Oct 30 21:41:55.040459 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:55.040442    4060 scope.go:122] "RemoveContainer" containerID="3af7b38d8c0854df7a2d2b685066fb2516b4cc264329db69a5a4d9df7f9a56a8"
Oct 30 21:41:55.049133 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:55.049117    4060 scope.go:122] "RemoveContainer" containerID="67adcde6c599b2800be892f6b20a202eadda2ae52cb99222ddd7a2f9265e8003"
Oct 30 21:41:55.049371 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:41:55.049353    4060 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"67adcde6c599b2800be892f6b20a202eadda2ae52cb99222ddd7a2f9265e8003\": container with ID starting with 67adcde6c599b2800be892f6b20a202eadda2ae52cb99222ddd7a2f9265e8003 not found: ID does not exist" containerID="67adcde6c599b2800be892f6b20a202eadda2ae52cb99222ddd7a2f9265e8003"
Oct 30 21:41:55.049431 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:55.049379    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"67adcde6c599b2800be892f6b20a202eadda2ae52cb99222ddd7a2f9265e8003"} err="failed to get container status \"67adcde6c599b2800be892f6b20a202eadda2ae52cb99222ddd7a2f9265e8003\": rpc error: code = NotFound desc = could not find container \"67adcde6c599b2800be892f6b20a202eadda2ae52cb99222ddd7a2f9265e8003\": container with ID starting with 67adcde6c599b2800be892f6b20a202eadda2ae52cb99222ddd7a2f9265e8003 not found: ID does not exist"
Oct 30 21:41:55.049431 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:55.049396    4060 scope.go:122] "RemoveContainer" containerID="e2c6849e14ba7b35b3a963a7d65e9c655509dd582c59672a7304d055bb87fc0b"
Oct 30 21:41:55.049697 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:41:55.049679    4060 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e2c6849e14ba7b35b3a963a7d65e9c655509dd582c59672a7304d055bb87fc0b\": container with ID starting with e2c6849e14ba7b35b3a963a7d65e9c655509dd582c59672a7304d055bb87fc0b not found: ID does not exist" containerID="e2c6849e14ba7b35b3a963a7d65e9c655509dd582c59672a7304d055bb87fc0b"
Oct 30 21:41:55.049743 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:55.049703    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e2c6849e14ba7b35b3a963a7d65e9c655509dd582c59672a7304d055bb87fc0b"} err="failed to get container status \"e2c6849e14ba7b35b3a963a7d65e9c655509dd582c59672a7304d055bb87fc0b\": rpc error: code = NotFound desc = could not find container \"e2c6849e14ba7b35b3a963a7d65e9c655509dd582c59672a7304d055bb87fc0b\": container with ID starting with e2c6849e14ba7b35b3a963a7d65e9c655509dd582c59672a7304d055bb87fc0b not found: ID does not exist"
Oct 30 21:41:55.049743 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:55.049718    4060 scope.go:122] "RemoveContainer" containerID="7c410ed7dde0b4d6b2a568b65539087a634154418b8aa8a93159565908d3d5ee"
Oct 30 21:41:55.049962 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:41:55.049942    4060 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7c410ed7dde0b4d6b2a568b65539087a634154418b8aa8a93159565908d3d5ee\": container with ID starting with 7c410ed7dde0b4d6b2a568b65539087a634154418b8aa8a93159565908d3d5ee not found: ID does not exist" containerID="7c410ed7dde0b4d6b2a568b65539087a634154418b8aa8a93159565908d3d5ee"
Oct 30 21:41:55.050032 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:55.049971    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c410ed7dde0b4d6b2a568b65539087a634154418b8aa8a93159565908d3d5ee"} err="failed to get container status \"7c410ed7dde0b4d6b2a568b65539087a634154418b8aa8a93159565908d3d5ee\": rpc error: code = NotFound desc = could not find container \"7c410ed7dde0b4d6b2a568b65539087a634154418b8aa8a93159565908d3d5ee\": container with ID starting with 7c410ed7dde0b4d6b2a568b65539087a634154418b8aa8a93159565908d3d5ee not found: ID does not exist"
Oct 30 21:41:55.050032 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:55.049993    4060 scope.go:122] "RemoveContainer" containerID="3af7b38d8c0854df7a2d2b685066fb2516b4cc264329db69a5a4d9df7f9a56a8"
Oct 30 21:41:55.050244 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:41:55.050229    4060 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3af7b38d8c0854df7a2d2b685066fb2516b4cc264329db69a5a4d9df7f9a56a8\": container with ID starting with 3af7b38d8c0854df7a2d2b685066fb2516b4cc264329db69a5a4d9df7f9a56a8 not found: ID does not exist" containerID="3af7b38d8c0854df7a2d2b685066fb2516b4cc264329db69a5a4d9df7f9a56a8"
Oct 30 21:41:55.050309 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:55.050252    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3af7b38d8c0854df7a2d2b685066fb2516b4cc264329db69a5a4d9df7f9a56a8"} err="failed to get container status \"3af7b38d8c0854df7a2d2b685066fb2516b4cc264329db69a5a4d9df7f9a56a8\": rpc error: code = NotFound desc = could not find container \"3af7b38d8c0854df7a2d2b685066fb2516b4cc264329db69a5a4d9df7f9a56a8\": container with ID starting with 3af7b38d8c0854df7a2d2b685066fb2516b4cc264329db69a5a4d9df7f9a56a8 not found: ID does not exist"
Oct 30 21:41:55.050309 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:55.050274    4060 scope.go:122] "RemoveContainer" containerID="67adcde6c599b2800be892f6b20a202eadda2ae52cb99222ddd7a2f9265e8003"
Oct 30 21:41:55.050530 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:55.050505    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"67adcde6c599b2800be892f6b20a202eadda2ae52cb99222ddd7a2f9265e8003"} err="failed to get container status \"67adcde6c599b2800be892f6b20a202eadda2ae52cb99222ddd7a2f9265e8003\": rpc error: code = NotFound desc = could not find container \"67adcde6c599b2800be892f6b20a202eadda2ae52cb99222ddd7a2f9265e8003\": container with ID starting with 67adcde6c599b2800be892f6b20a202eadda2ae52cb99222ddd7a2f9265e8003 not found: ID does not exist"
Oct 30 21:41:55.050584 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:55.050530    4060 scope.go:122] "RemoveContainer" containerID="e2c6849e14ba7b35b3a963a7d65e9c655509dd582c59672a7304d055bb87fc0b"
Oct 30 21:41:55.050750 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:55.050730    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e2c6849e14ba7b35b3a963a7d65e9c655509dd582c59672a7304d055bb87fc0b"} err="failed to get container status \"e2c6849e14ba7b35b3a963a7d65e9c655509dd582c59672a7304d055bb87fc0b\": rpc error: code = NotFound desc = could not find container \"e2c6849e14ba7b35b3a963a7d65e9c655509dd582c59672a7304d055bb87fc0b\": container with ID starting with e2c6849e14ba7b35b3a963a7d65e9c655509dd582c59672a7304d055bb87fc0b not found: ID does not exist"
Oct 30 21:41:55.050797 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:55.050751    4060 scope.go:122] "RemoveContainer" containerID="7c410ed7dde0b4d6b2a568b65539087a634154418b8aa8a93159565908d3d5ee"
Oct 30 21:41:55.050964 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:55.050944    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c410ed7dde0b4d6b2a568b65539087a634154418b8aa8a93159565908d3d5ee"} err="failed to get container status \"7c410ed7dde0b4d6b2a568b65539087a634154418b8aa8a93159565908d3d5ee\": rpc error: code = NotFound desc = could not find container \"7c410ed7dde0b4d6b2a568b65539087a634154418b8aa8a93159565908d3d5ee\": container with ID starting with 7c410ed7dde0b4d6b2a568b65539087a634154418b8aa8a93159565908d3d5ee not found: ID does not exist"
Oct 30 21:41:55.051021 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:55.050964    4060 scope.go:122] "RemoveContainer" containerID="3af7b38d8c0854df7a2d2b685066fb2516b4cc264329db69a5a4d9df7f9a56a8"
Oct 30 21:41:55.051154 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:55.051136    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3af7b38d8c0854df7a2d2b685066fb2516b4cc264329db69a5a4d9df7f9a56a8"} err="failed to get container status \"3af7b38d8c0854df7a2d2b685066fb2516b4cc264329db69a5a4d9df7f9a56a8\": rpc error: code = NotFound desc = could not find container \"3af7b38d8c0854df7a2d2b685066fb2516b4cc264329db69a5a4d9df7f9a56a8\": container with ID starting with 3af7b38d8c0854df7a2d2b685066fb2516b4cc264329db69a5a4d9df7f9a56a8 not found: ID does not exist"
Oct 30 21:41:55.051197 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:55.051154    4060 scope.go:122] "RemoveContainer" containerID="67adcde6c599b2800be892f6b20a202eadda2ae52cb99222ddd7a2f9265e8003"
Oct 30 21:41:55.051342 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:55.051326    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"67adcde6c599b2800be892f6b20a202eadda2ae52cb99222ddd7a2f9265e8003"} err="failed to get container status \"67adcde6c599b2800be892f6b20a202eadda2ae52cb99222ddd7a2f9265e8003\": rpc error: code = NotFound desc = could not find container \"67adcde6c599b2800be892f6b20a202eadda2ae52cb99222ddd7a2f9265e8003\": container with ID starting with 67adcde6c599b2800be892f6b20a202eadda2ae52cb99222ddd7a2f9265e8003 not found: ID does not exist"
Oct 30 21:41:55.051390 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:55.051342    4060 scope.go:122] "RemoveContainer" containerID="e2c6849e14ba7b35b3a963a7d65e9c655509dd582c59672a7304d055bb87fc0b"
Oct 30 21:41:55.051593 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:55.051574    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e2c6849e14ba7b35b3a963a7d65e9c655509dd582c59672a7304d055bb87fc0b"} err="failed to get container status \"e2c6849e14ba7b35b3a963a7d65e9c655509dd582c59672a7304d055bb87fc0b\": rpc error: code = NotFound desc = could not find container \"e2c6849e14ba7b35b3a963a7d65e9c655509dd582c59672a7304d055bb87fc0b\": container with ID starting with e2c6849e14ba7b35b3a963a7d65e9c655509dd582c59672a7304d055bb87fc0b not found: ID does not exist"
Oct 30 21:41:55.051710 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:55.051594    4060 scope.go:122] "RemoveContainer" containerID="7c410ed7dde0b4d6b2a568b65539087a634154418b8aa8a93159565908d3d5ee"
Oct 30 21:41:55.051846 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:55.051827    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c410ed7dde0b4d6b2a568b65539087a634154418b8aa8a93159565908d3d5ee"} err="failed to get container status \"7c410ed7dde0b4d6b2a568b65539087a634154418b8aa8a93159565908d3d5ee\": rpc error: code = NotFound desc = could not find container \"7c410ed7dde0b4d6b2a568b65539087a634154418b8aa8a93159565908d3d5ee\": container with ID starting with 7c410ed7dde0b4d6b2a568b65539087a634154418b8aa8a93159565908d3d5ee not found: ID does not exist"
Oct 30 21:41:55.051896 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:55.051847    4060 scope.go:122] "RemoveContainer" containerID="3af7b38d8c0854df7a2d2b685066fb2516b4cc264329db69a5a4d9df7f9a56a8"
Oct 30 21:41:55.052080 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:55.052064    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3af7b38d8c0854df7a2d2b685066fb2516b4cc264329db69a5a4d9df7f9a56a8"} err="failed to get container status \"3af7b38d8c0854df7a2d2b685066fb2516b4cc264329db69a5a4d9df7f9a56a8\": rpc error: code = NotFound desc = could not find container \"3af7b38d8c0854df7a2d2b685066fb2516b4cc264329db69a5a4d9df7f9a56a8\": container with ID starting with 3af7b38d8c0854df7a2d2b685066fb2516b4cc264329db69a5a4d9df7f9a56a8 not found: ID does not exist"
Oct 30 21:41:55.189630 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:55.189544    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"]
Oct 30 21:41:55.193773 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:55.193745    4060 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"]
Oct 30 21:41:55.426469 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:55.426436    4060 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="14dc810e-1c4e-48f1-b8ba-393a3e241b3d" path="/var/lib/kubelet/pods/14dc810e-1c4e-48f1-b8ba-393a3e241b3d/volumes"
Oct 30 21:41:55.426891 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:55.426877    4060 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="937ddbc0-8ae4-452e-ab96-0654ff770a14" path="/var/lib/kubelet/pods/937ddbc0-8ae4-452e-ab96-0654ff770a14/volumes"
Oct 30 21:41:55.427291 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:55.427280    4060 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f4ca88c9-945d-4a9e-ab40-2c7390930441" path="/var/lib/kubelet/pods/f4ca88c9-945d-4a9e-ab40-2c7390930441/volumes"
Oct 30 21:41:56.263292 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:56.263259    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:41:56.263741 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:56.263457    4060 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-collector-0" podUID="99cc29a0-750a-45a9-b689-3367f37bae60" containerName="otc-container" containerID="cri-o://389164a9a81f7cbd867a88b06197af4eb0df75794c79a7838989703c1f3dac73" gracePeriod=30
Oct 30 21:41:56.512131 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:56.512106    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:41:56.623380 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:56.623307    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/99cc29a0-750a-45a9-b689-3367f37bae60-kube-api-access-v8rfb\" (UniqueName: \"kubernetes.io/projected/99cc29a0-750a-45a9-b689-3367f37bae60-kube-api-access-v8rfb\") pod \"99cc29a0-750a-45a9-b689-3367f37bae60\" (UID: \"99cc29a0-750a-45a9-b689-3367f37bae60\") "
Oct 30 21:41:56.623380 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:56.623340    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/99cc29a0-750a-45a9-b689-3367f37bae60-otc-internal\" (UniqueName: \"kubernetes.io/configmap/99cc29a0-750a-45a9-b689-3367f37bae60-otc-internal\") pod \"99cc29a0-750a-45a9-b689-3367f37bae60\" (UID: \"99cc29a0-750a-45a9-b689-3367f37bae60\") "
Oct 30 21:41:56.623380 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:56.623374    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/99cc29a0-750a-45a9-b689-3367f37bae60-tls-certs\" (UniqueName: \"kubernetes.io/secret/99cc29a0-750a-45a9-b689-3367f37bae60-tls-certs\") pod \"99cc29a0-750a-45a9-b689-3367f37bae60\" (UID: \"99cc29a0-750a-45a9-b689-3367f37bae60\") "
Oct 30 21:41:56.623681 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:56.623395    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/99cc29a0-750a-45a9-b689-3367f37bae60-monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/99cc29a0-750a-45a9-b689-3367f37bae60-monitoring-tls-certs\") pod \"99cc29a0-750a-45a9-b689-3367f37bae60\" (UID: \"99cc29a0-750a-45a9-b689-3367f37bae60\") "
Oct 30 21:41:56.623681 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:56.623472    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/99cc29a0-750a-45a9-b689-3367f37bae60-data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/99cc29a0-750a-45a9-b689-3367f37bae60-data-science-collector-ta-client-cert\") pod \"99cc29a0-750a-45a9-b689-3367f37bae60\" (UID: \"99cc29a0-750a-45a9-b689-3367f37bae60\") "
Oct 30 21:41:56.623681 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:56.623539    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/99cc29a0-750a-45a9-b689-3367f37bae60-otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/99cc29a0-750a-45a9-b689-3367f37bae60-otlp-tls-certs\") pod \"99cc29a0-750a-45a9-b689-3367f37bae60\" (UID: \"99cc29a0-750a-45a9-b689-3367f37bae60\") "
Oct 30 21:41:56.623856 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:56.623770    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/99cc29a0-750a-45a9-b689-3367f37bae60-otc-internal" pod "99cc29a0-750a-45a9-b689-3367f37bae60" (UID: "99cc29a0-750a-45a9-b689-3367f37bae60"). InnerVolumeSpecName "otc-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:41:56.625690 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:56.625657    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/99cc29a0-750a-45a9-b689-3367f37bae60-tls-certs" pod "99cc29a0-750a-45a9-b689-3367f37bae60" (UID: "99cc29a0-750a-45a9-b689-3367f37bae60"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:41:56.625806 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:56.625718    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/99cc29a0-750a-45a9-b689-3367f37bae60-data-science-collector-ta-client-cert" pod "99cc29a0-750a-45a9-b689-3367f37bae60" (UID: "99cc29a0-750a-45a9-b689-3367f37bae60"). InnerVolumeSpecName "data-science-collector-ta-client-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:41:56.625806 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:56.625789    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/99cc29a0-750a-45a9-b689-3367f37bae60-otlp-tls-certs" pod "99cc29a0-750a-45a9-b689-3367f37bae60" (UID: "99cc29a0-750a-45a9-b689-3367f37bae60"). InnerVolumeSpecName "otlp-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:41:56.626064 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:56.626047    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/99cc29a0-750a-45a9-b689-3367f37bae60-kube-api-access-v8rfb" pod "99cc29a0-750a-45a9-b689-3367f37bae60" (UID: "99cc29a0-750a-45a9-b689-3367f37bae60"). InnerVolumeSpecName "kube-api-access-v8rfb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:41:56.626064 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:56.626053    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/99cc29a0-750a-45a9-b689-3367f37bae60-monitoring-tls-certs" pod "99cc29a0-750a-45a9-b689-3367f37bae60" (UID: "99cc29a0-750a-45a9-b689-3367f37bae60"). InnerVolumeSpecName "monitoring-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:41:56.724476 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:56.724444    4060 reconciler_common.go:299] "Volume detached for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/99cc29a0-750a-45a9-b689-3367f37bae60-otlp-tls-certs\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:41:56.724476 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:56.724477    4060 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v8rfb\" (UniqueName: \"kubernetes.io/projected/99cc29a0-750a-45a9-b689-3367f37bae60-kube-api-access-v8rfb\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:41:56.724687 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:56.724508    4060 reconciler_common.go:299] "Volume detached for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/99cc29a0-750a-45a9-b689-3367f37bae60-otc-internal\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:41:56.724687 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:56.724523    4060 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/99cc29a0-750a-45a9-b689-3367f37bae60-tls-certs\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:41:56.724687 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:56.724539    4060 reconciler_common.go:299] "Volume detached for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/99cc29a0-750a-45a9-b689-3367f37bae60-monitoring-tls-certs\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:41:56.724687 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:56.724553    4060 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/99cc29a0-750a-45a9-b689-3367f37bae60-data-science-collector-ta-client-cert\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:41:57.027727 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:57.027692    4060 generic.go:356] "Generic (PLEG): container finished" podID="99cc29a0-750a-45a9-b689-3367f37bae60" containerID="389164a9a81f7cbd867a88b06197af4eb0df75794c79a7838989703c1f3dac73" exitCode=0
Oct 30 21:41:57.027901 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:57.027737    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:41:57.027901 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:57.027748    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"99cc29a0-750a-45a9-b689-3367f37bae60","Type":"ContainerDied","Data":"389164a9a81f7cbd867a88b06197af4eb0df75794c79a7838989703c1f3dac73"}
Oct 30 21:41:57.027901 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:57.027791    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"99cc29a0-750a-45a9-b689-3367f37bae60","Type":"ContainerDied","Data":"66690c2fe695b9ee382a08cb9101c88fdffa90f708115aa00e06b80802d5ddac"}
Oct 30 21:41:57.027901 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:57.027814    4060 scope.go:122] "RemoveContainer" containerID="389164a9a81f7cbd867a88b06197af4eb0df75794c79a7838989703c1f3dac73"
Oct 30 21:41:57.036590 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:57.036568    4060 scope.go:122] "RemoveContainer" containerID="389164a9a81f7cbd867a88b06197af4eb0df75794c79a7838989703c1f3dac73"
Oct 30 21:41:57.036873 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:41:57.036854    4060 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"389164a9a81f7cbd867a88b06197af4eb0df75794c79a7838989703c1f3dac73\": container with ID starting with 389164a9a81f7cbd867a88b06197af4eb0df75794c79a7838989703c1f3dac73 not found: ID does not exist" containerID="389164a9a81f7cbd867a88b06197af4eb0df75794c79a7838989703c1f3dac73"
Oct 30 21:41:57.036959 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:57.036882    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"389164a9a81f7cbd867a88b06197af4eb0df75794c79a7838989703c1f3dac73"} err="failed to get container status \"389164a9a81f7cbd867a88b06197af4eb0df75794c79a7838989703c1f3dac73\": rpc error: code = NotFound desc = could not find container \"389164a9a81f7cbd867a88b06197af4eb0df75794c79a7838989703c1f3dac73\": container with ID starting with 389164a9a81f7cbd867a88b06197af4eb0df75794c79a7838989703c1f3dac73 not found: ID does not exist"
Oct 30 21:41:57.193471 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:57.193438    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:41:57.201020 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:57.200992    4060 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:41:57.427621 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:57.427542    4060 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="99cc29a0-750a-45a9-b689-3367f37bae60" path="/var/lib/kubelet/pods/99cc29a0-750a-45a9-b689-3367f37bae60/volumes"
Oct 30 21:41:58.340834 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:41:58.340767    4060 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0" podUID="d0741409-a9b0-47b6-bbbb-ada2803a855b" containerName="alertmanager" probeResult="failure" output="Get \"http://10.133.0.150:9093/-/ready\": dial tcp 10.133.0.150:9093: connect: connection refused"
Oct 30 21:42:03.340584 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:03.340541    4060 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0" podUID="d0741409-a9b0-47b6-bbbb-ada2803a855b" containerName="alertmanager" probeResult="failure" output="Get \"http://10.133.0.150:9093/-/ready\": dial tcp 10.133.0.150:9093: connect: connection refused"
Oct 30 21:42:04.067620 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:04.067589    4060 generic.go:356] "Generic (PLEG): container finished" podID="d0741409-a9b0-47b6-bbbb-ada2803a855b" containerID="9650c2854bdeda220e8d9ef86fb7f0824d5e2065b604c33deba4f2400e67b643" exitCode=0
Oct 30 21:42:04.067760 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:04.067672    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0" event={"ID":"d0741409-a9b0-47b6-bbbb-ada2803a855b","Type":"ContainerDied","Data":"9650c2854bdeda220e8d9ef86fb7f0824d5e2065b604c33deba4f2400e67b643"}
Oct 30 21:42:04.203830 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:04.203768    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:42:04.296471 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:04.296440    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d0741409-a9b0-47b6-bbbb-ada2803a855b-web-config\" (UniqueName: \"kubernetes.io/secret/d0741409-a9b0-47b6-bbbb-ada2803a855b-web-config\") pod \"d0741409-a9b0-47b6-bbbb-ada2803a855b\" (UID: \"d0741409-a9b0-47b6-bbbb-ada2803a855b\") "
Oct 30 21:42:04.296662 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:04.296535    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d0741409-a9b0-47b6-bbbb-ada2803a855b-kube-api-access-9s97v\" (UniqueName: \"kubernetes.io/projected/d0741409-a9b0-47b6-bbbb-ada2803a855b-kube-api-access-9s97v\") pod \"d0741409-a9b0-47b6-bbbb-ada2803a855b\" (UID: \"d0741409-a9b0-47b6-bbbb-ada2803a855b\") "
Oct 30 21:42:04.296662 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:04.296563    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d0741409-a9b0-47b6-bbbb-ada2803a855b-alertmanager-data-science-monitoringstack-db\" (UniqueName: \"kubernetes.io/empty-dir/d0741409-a9b0-47b6-bbbb-ada2803a855b-alertmanager-data-science-monitoringstack-db\") pod \"d0741409-a9b0-47b6-bbbb-ada2803a855b\" (UID: \"d0741409-a9b0-47b6-bbbb-ada2803a855b\") "
Oct 30 21:42:04.296662 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:04.296585    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d0741409-a9b0-47b6-bbbb-ada2803a855b-config-out\" (UniqueName: \"kubernetes.io/empty-dir/d0741409-a9b0-47b6-bbbb-ada2803a855b-config-out\") pod \"d0741409-a9b0-47b6-bbbb-ada2803a855b\" (UID: \"d0741409-a9b0-47b6-bbbb-ada2803a855b\") "
Oct 30 21:42:04.296662 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:04.296615    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d0741409-a9b0-47b6-bbbb-ada2803a855b-tls-assets\" (UniqueName: \"kubernetes.io/projected/d0741409-a9b0-47b6-bbbb-ada2803a855b-tls-assets\") pod \"d0741409-a9b0-47b6-bbbb-ada2803a855b\" (UID: \"d0741409-a9b0-47b6-bbbb-ada2803a855b\") "
Oct 30 21:42:04.296662 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:04.296660    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d0741409-a9b0-47b6-bbbb-ada2803a855b-config-volume\" (UniqueName: \"kubernetes.io/secret/d0741409-a9b0-47b6-bbbb-ada2803a855b-config-volume\") pod \"d0741409-a9b0-47b6-bbbb-ada2803a855b\" (UID: \"d0741409-a9b0-47b6-bbbb-ada2803a855b\") "
Oct 30 21:42:04.296930 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:04.296692    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d0741409-a9b0-47b6-bbbb-ada2803a855b-cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d0741409-a9b0-47b6-bbbb-ada2803a855b-cluster-tls-config\") pod \"d0741409-a9b0-47b6-bbbb-ada2803a855b\" (UID: \"d0741409-a9b0-47b6-bbbb-ada2803a855b\") "
Oct 30 21:42:04.296996 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:04.296968    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0741409-a9b0-47b6-bbbb-ada2803a855b-alertmanager-data-science-monitoringstack-db" pod "d0741409-a9b0-47b6-bbbb-ada2803a855b" (UID: "d0741409-a9b0-47b6-bbbb-ada2803a855b"). InnerVolumeSpecName "alertmanager-data-science-monitoringstack-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:42:04.299291 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:04.299263    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0741409-a9b0-47b6-bbbb-ada2803a855b-config-out" pod "d0741409-a9b0-47b6-bbbb-ada2803a855b" (UID: "d0741409-a9b0-47b6-bbbb-ada2803a855b"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:42:04.299441 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:04.299366    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d0741409-a9b0-47b6-bbbb-ada2803a855b-tls-assets" pod "d0741409-a9b0-47b6-bbbb-ada2803a855b" (UID: "d0741409-a9b0-47b6-bbbb-ada2803a855b"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:42:04.299598 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:04.299574    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d0741409-a9b0-47b6-bbbb-ada2803a855b-config-volume" pod "d0741409-a9b0-47b6-bbbb-ada2803a855b" (UID: "d0741409-a9b0-47b6-bbbb-ada2803a855b"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:42:04.299669 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:04.299659    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d0741409-a9b0-47b6-bbbb-ada2803a855b-kube-api-access-9s97v" pod "d0741409-a9b0-47b6-bbbb-ada2803a855b" (UID: "d0741409-a9b0-47b6-bbbb-ada2803a855b"). InnerVolumeSpecName "kube-api-access-9s97v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:42:04.304019 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:04.303993    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d0741409-a9b0-47b6-bbbb-ada2803a855b-cluster-tls-config" pod "d0741409-a9b0-47b6-bbbb-ada2803a855b" (UID: "d0741409-a9b0-47b6-bbbb-ada2803a855b"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:42:04.309652 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:04.309628    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d0741409-a9b0-47b6-bbbb-ada2803a855b-web-config" pod "d0741409-a9b0-47b6-bbbb-ada2803a855b" (UID: "d0741409-a9b0-47b6-bbbb-ada2803a855b"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:42:04.397856 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:04.397823    4060 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9s97v\" (UniqueName: \"kubernetes.io/projected/d0741409-a9b0-47b6-bbbb-ada2803a855b-kube-api-access-9s97v\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:42:04.397856 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:04.397849    4060 reconciler_common.go:299] "Volume detached for volume \"alertmanager-data-science-monitoringstack-db\" (UniqueName: \"kubernetes.io/empty-dir/d0741409-a9b0-47b6-bbbb-ada2803a855b-alertmanager-data-science-monitoringstack-db\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:42:04.397856 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:04.397860    4060 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d0741409-a9b0-47b6-bbbb-ada2803a855b-config-out\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:42:04.398285 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:04.397868    4060 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d0741409-a9b0-47b6-bbbb-ada2803a855b-tls-assets\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:42:04.398285 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:04.397877    4060 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d0741409-a9b0-47b6-bbbb-ada2803a855b-config-volume\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:42:04.398285 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:04.397885    4060 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d0741409-a9b0-47b6-bbbb-ada2803a855b-cluster-tls-config\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:42:04.398285 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:04.397893    4060 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d0741409-a9b0-47b6-bbbb-ada2803a855b-web-config\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:42:05.075201 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:05.075175    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:42:05.075373 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:05.075172    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0" event={"ID":"d0741409-a9b0-47b6-bbbb-ada2803a855b","Type":"ContainerDied","Data":"9166920866efbd6a4f27ad9e6401a0deb7b36d3efefafc217b62eec36e87cdb9"}
Oct 30 21:42:05.075373 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:05.075311    4060 scope.go:122] "RemoveContainer" containerID="7e36e2e149f5c6ac19e7aec5ff7ed148e67618888c02cb8716db42e26d9eabeb"
Oct 30 21:42:05.084381 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:05.084361    4060 scope.go:122] "RemoveContainer" containerID="9650c2854bdeda220e8d9ef86fb7f0824d5e2065b604c33deba4f2400e67b643"
Oct 30 21:42:05.092196 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:05.092177    4060 scope.go:122] "RemoveContainer" containerID="e8e3f6b2cef2b8843b52a1b217c9fd21583d84cfa13f2f7be912353007bc14a6"
Oct 30 21:42:05.291456 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:05.291375    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"]
Oct 30 21:42:05.339897 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:05.339866    4060 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"]
Oct 30 21:42:05.426368 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:05.426324    4060 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d0741409-a9b0-47b6-bbbb-ada2803a855b" path="/var/lib/kubelet/pods/d0741409-a9b0-47b6-bbbb-ada2803a855b/volumes"
Oct 30 21:42:12.150530 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:42:12.150480    4060 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v2f4x" containerName="extractor"
Oct 30 21:42:12.652142 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:12.652109    4060 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-6br6z"]
Oct 30 21:42:12.652410 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:12.652398    4060 cpu_manager.go:414] "containerMap: removing container" podUID="99cc29a0-750a-45a9-b689-3367f37bae60" containerName="otc-container"
Oct 30 21:42:12.652453 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:12.652411    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="99cc29a0-750a-45a9-b689-3367f37bae60" containerName="otc-container"
Oct 30 21:42:12.652453 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:12.652421    4060 cpu_manager.go:414] "containerMap: removing container" podUID="d0741409-a9b0-47b6-bbbb-ada2803a855b" containerName="alertmanager"
Oct 30 21:42:12.652453 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:12.652426    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d0741409-a9b0-47b6-bbbb-ada2803a855b" containerName="alertmanager"
Oct 30 21:42:12.652453 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:12.652438    4060 cpu_manager.go:414] "containerMap: removing container" podUID="f4ca88c9-945d-4a9e-ab40-2c7390930441" containerName="thanos-querier"
Oct 30 21:42:12.652453 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:12.652443    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f4ca88c9-945d-4a9e-ab40-2c7390930441" containerName="thanos-querier"
Oct 30 21:42:12.652453 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:12.652449    4060 cpu_manager.go:414] "containerMap: removing container" podUID="d0741409-a9b0-47b6-bbbb-ada2803a855b" containerName="init-config-reloader"
Oct 30 21:42:12.652453 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:12.652454    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d0741409-a9b0-47b6-bbbb-ada2803a855b" containerName="init-config-reloader"
Oct 30 21:42:12.652691 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:12.652462    4060 cpu_manager.go:414] "containerMap: removing container" podUID="d0741409-a9b0-47b6-bbbb-ada2803a855b" containerName="config-reloader"
Oct 30 21:42:12.652691 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:12.652466    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d0741409-a9b0-47b6-bbbb-ada2803a855b" containerName="config-reloader"
Oct 30 21:42:12.652691 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:12.652472    4060 cpu_manager.go:414] "containerMap: removing container" podUID="937ddbc0-8ae4-452e-ab96-0654ff770a14" containerName="prometheus"
Oct 30 21:42:12.652691 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:12.652476    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="937ddbc0-8ae4-452e-ab96-0654ff770a14" containerName="prometheus"
Oct 30 21:42:12.652691 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:12.652482    4060 cpu_manager.go:414] "containerMap: removing container" podUID="937ddbc0-8ae4-452e-ab96-0654ff770a14" containerName="thanos-sidecar"
Oct 30 21:42:12.652691 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:12.652486    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="937ddbc0-8ae4-452e-ab96-0654ff770a14" containerName="thanos-sidecar"
Oct 30 21:42:12.652691 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:12.652510    4060 cpu_manager.go:414] "containerMap: removing container" podUID="14dc810e-1c4e-48f1-b8ba-393a3e241b3d" containerName="korrel8r"
Oct 30 21:42:12.652691 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:12.652516    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="14dc810e-1c4e-48f1-b8ba-393a3e241b3d" containerName="korrel8r"
Oct 30 21:42:12.652691 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:12.652528    4060 cpu_manager.go:414] "containerMap: removing container" podUID="fca5bd38-ed8d-4e6e-b48e-ba683819429a" containerName="kube-rbac-proxy"
Oct 30 21:42:12.652691 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:12.652533    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="fca5bd38-ed8d-4e6e-b48e-ba683819429a" containerName="kube-rbac-proxy"
Oct 30 21:42:12.652691 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:12.652539    4060 cpu_manager.go:414] "containerMap: removing container" podUID="937ddbc0-8ae4-452e-ab96-0654ff770a14" containerName="config-reloader"
Oct 30 21:42:12.652691 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:12.652545    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="937ddbc0-8ae4-452e-ab96-0654ff770a14" containerName="config-reloader"
Oct 30 21:42:12.652691 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:12.652551    4060 cpu_manager.go:414] "containerMap: removing container" podUID="937ddbc0-8ae4-452e-ab96-0654ff770a14" containerName="init-config-reloader"
Oct 30 21:42:12.652691 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:12.652555    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="937ddbc0-8ae4-452e-ab96-0654ff770a14" containerName="init-config-reloader"
Oct 30 21:42:12.652691 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:12.652600    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="f4ca88c9-945d-4a9e-ab40-2c7390930441" containerName="thanos-querier"
Oct 30 21:42:12.652691 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:12.652607    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="d0741409-a9b0-47b6-bbbb-ada2803a855b" containerName="config-reloader"
Oct 30 21:42:12.652691 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:12.652615    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="937ddbc0-8ae4-452e-ab96-0654ff770a14" containerName="prometheus"
Oct 30 21:42:12.652691 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:12.652620    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="937ddbc0-8ae4-452e-ab96-0654ff770a14" containerName="thanos-sidecar"
Oct 30 21:42:12.652691 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:12.652626    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="14dc810e-1c4e-48f1-b8ba-393a3e241b3d" containerName="korrel8r"
Oct 30 21:42:12.652691 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:12.652631    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="fca5bd38-ed8d-4e6e-b48e-ba683819429a" containerName="kube-rbac-proxy"
Oct 30 21:42:12.652691 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:12.652635    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="937ddbc0-8ae4-452e-ab96-0654ff770a14" containerName="config-reloader"
Oct 30 21:42:12.652691 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:12.652643    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="99cc29a0-750a-45a9-b689-3367f37bae60" containerName="otc-container"
Oct 30 21:42:12.652691 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:12.652647    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="d0741409-a9b0-47b6-bbbb-ada2803a855b" containerName="alertmanager"
Oct 30 21:42:12.657006 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:12.656979    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-6br6z"
Oct 30 21:42:12.709622 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:12.709587    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"prometheus-web-tls-ca\""
Oct 30 21:42:12.709751 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:12.709645    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"kube-root-ca.crt\""
Oct 30 21:42:12.709751 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:12.709663    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-prometheus-cluster-proxy-kube-rbac-proxy\""
Oct 30 21:42:12.709971 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:12.709952    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"openshift-service-ca.crt\""
Oct 30 21:42:12.710023 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:12.709973    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-prometheus-cluster-proxy-dockercfg-68mrr\""
Oct 30 21:42:12.710067 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:12.710027    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-prometheus-cluster-proxy-tls\""
Oct 30 21:42:12.710100 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:12.710087    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"prometheus-operated-tls\""
Oct 30 21:42:12.715314 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:12.715289    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-6br6z"]
Oct 30 21:42:12.763781 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:12.763751    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/c5cf796f-2064-4662-9918-919a6d58e027-tls\") pod \"data-science-prometheus-cluster-proxy-545f759f7c-6br6z\" (UID: \"c5cf796f-2064-4662-9918-919a6d58e027\") " pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-6br6z"
Oct 30 21:42:12.763955 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:12.763786    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xrv7l\" (UniqueName: \"kubernetes.io/projected/c5cf796f-2064-4662-9918-919a6d58e027-kube-api-access-xrv7l\") pod \"data-science-prometheus-cluster-proxy-545f759f7c-6br6z\" (UID: \"c5cf796f-2064-4662-9918-919a6d58e027\") " pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-6br6z"
Oct 30 21:42:12.763955 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:12.763809    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c5cf796f-2064-4662-9918-919a6d58e027-kube-rbac-proxy-config\") pod \"data-science-prometheus-cluster-proxy-545f759f7c-6br6z\" (UID: \"c5cf796f-2064-4662-9918-919a6d58e027\") " pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-6br6z"
Oct 30 21:42:12.763955 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:12.763892    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-ca\" (UniqueName: \"kubernetes.io/configmap/c5cf796f-2064-4662-9918-919a6d58e027-prometheus-ca\") pod \"data-science-prometheus-cluster-proxy-545f759f7c-6br6z\" (UID: \"c5cf796f-2064-4662-9918-919a6d58e027\") " pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-6br6z"
Oct 30 21:42:12.763955 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:12.763933    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-client-cert\" (UniqueName: \"kubernetes.io/secret/c5cf796f-2064-4662-9918-919a6d58e027-prometheus-client-cert\") pod \"data-science-prometheus-cluster-proxy-545f759f7c-6br6z\" (UID: \"c5cf796f-2064-4662-9918-919a6d58e027\") " pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-6br6z"
Oct 30 21:42:12.864557 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:12.864524    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/c5cf796f-2064-4662-9918-919a6d58e027-tls\") pod \"data-science-prometheus-cluster-proxy-545f759f7c-6br6z\" (UID: \"c5cf796f-2064-4662-9918-919a6d58e027\") " pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-6br6z"
Oct 30 21:42:12.864557 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:12.864564    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xrv7l\" (UniqueName: \"kubernetes.io/projected/c5cf796f-2064-4662-9918-919a6d58e027-kube-api-access-xrv7l\") pod \"data-science-prometheus-cluster-proxy-545f759f7c-6br6z\" (UID: \"c5cf796f-2064-4662-9918-919a6d58e027\") " pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-6br6z"
Oct 30 21:42:12.864786 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:12.864585    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c5cf796f-2064-4662-9918-919a6d58e027-kube-rbac-proxy-config\") pod \"data-science-prometheus-cluster-proxy-545f759f7c-6br6z\" (UID: \"c5cf796f-2064-4662-9918-919a6d58e027\") " pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-6br6z"
Oct 30 21:42:12.864786 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:12.864611    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-ca\" (UniqueName: \"kubernetes.io/configmap/c5cf796f-2064-4662-9918-919a6d58e027-prometheus-ca\") pod \"data-science-prometheus-cluster-proxy-545f759f7c-6br6z\" (UID: \"c5cf796f-2064-4662-9918-919a6d58e027\") " pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-6br6z"
Oct 30 21:42:12.864786 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:12.864631    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-client-cert\" (UniqueName: \"kubernetes.io/secret/c5cf796f-2064-4662-9918-919a6d58e027-prometheus-client-cert\") pod \"data-science-prometheus-cluster-proxy-545f759f7c-6br6z\" (UID: \"c5cf796f-2064-4662-9918-919a6d58e027\") " pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-6br6z"
Oct 30 21:42:12.865301 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:12.865270    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-ca\" (UniqueName: \"kubernetes.io/configmap/c5cf796f-2064-4662-9918-919a6d58e027-prometheus-ca\") pod \"data-science-prometheus-cluster-proxy-545f759f7c-6br6z\" (UID: \"c5cf796f-2064-4662-9918-919a6d58e027\") " pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-6br6z"
Oct 30 21:42:12.867123 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:12.867100    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-client-cert\" (UniqueName: \"kubernetes.io/secret/c5cf796f-2064-4662-9918-919a6d58e027-prometheus-client-cert\") pod \"data-science-prometheus-cluster-proxy-545f759f7c-6br6z\" (UID: \"c5cf796f-2064-4662-9918-919a6d58e027\") " pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-6br6z"
Oct 30 21:42:12.867226 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:12.867164    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c5cf796f-2064-4662-9918-919a6d58e027-kube-rbac-proxy-config\") pod \"data-science-prometheus-cluster-proxy-545f759f7c-6br6z\" (UID: \"c5cf796f-2064-4662-9918-919a6d58e027\") " pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-6br6z"
Oct 30 21:42:12.867269 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:12.867248    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls\" (UniqueName: \"kubernetes.io/secret/c5cf796f-2064-4662-9918-919a6d58e027-tls\") pod \"data-science-prometheus-cluster-proxy-545f759f7c-6br6z\" (UID: \"c5cf796f-2064-4662-9918-919a6d58e027\") " pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-6br6z"
Oct 30 21:42:12.927854 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:12.927778    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xrv7l\" (UniqueName: \"kubernetes.io/projected/c5cf796f-2064-4662-9918-919a6d58e027-kube-api-access-xrv7l\") pod \"data-science-prometheus-cluster-proxy-545f759f7c-6br6z\" (UID: \"c5cf796f-2064-4662-9918-919a6d58e027\") " pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-6br6z"
Oct 30 21:42:12.969589 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:12.969559    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-6br6z"
Oct 30 21:42:12.991633 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:12.991603    4060 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/korrel8r-5cbcc89b8f-nfph4"]
Oct 30 21:42:12.996093 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:12.996072    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-nfph4"
Oct 30 21:42:13.051389 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:13.051354    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"korrel8r-tls\""
Oct 30 21:42:13.051562 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:13.051474    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"korrel8r-config\""
Oct 30 21:42:13.051627 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:13.051559    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"korrel8r-dockercfg-7vjfb\""
Oct 30 21:42:13.056455 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:13.056431    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/korrel8r-5cbcc89b8f-nfph4"]
Oct 30 21:42:13.166563 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:13.166529    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/13545120-2b3f-445d-bb4c-02c5a3b34c4b-config\") pod \"korrel8r-5cbcc89b8f-nfph4\" (UID: \"13545120-2b3f-445d-bb4c-02c5a3b34c4b\") " pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-nfph4"
Oct 30 21:42:13.166945 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:13.166578    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/13545120-2b3f-445d-bb4c-02c5a3b34c4b-tls\") pod \"korrel8r-5cbcc89b8f-nfph4\" (UID: \"13545120-2b3f-445d-bb4c-02c5a3b34c4b\") " pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-nfph4"
Oct 30 21:42:13.166945 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:13.166689    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sb2j8\" (UniqueName: \"kubernetes.io/projected/13545120-2b3f-445d-bb4c-02c5a3b34c4b-kube-api-access-sb2j8\") pod \"korrel8r-5cbcc89b8f-nfph4\" (UID: \"13545120-2b3f-445d-bb4c-02c5a3b34c4b\") " pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-nfph4"
Oct 30 21:42:13.267825 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:13.267791    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/13545120-2b3f-445d-bb4c-02c5a3b34c4b-config\") pod \"korrel8r-5cbcc89b8f-nfph4\" (UID: \"13545120-2b3f-445d-bb4c-02c5a3b34c4b\") " pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-nfph4"
Oct 30 21:42:13.267964 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:13.267839    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/13545120-2b3f-445d-bb4c-02c5a3b34c4b-tls\") pod \"korrel8r-5cbcc89b8f-nfph4\" (UID: \"13545120-2b3f-445d-bb4c-02c5a3b34c4b\") " pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-nfph4"
Oct 30 21:42:13.267964 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:13.267867    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sb2j8\" (UniqueName: \"kubernetes.io/projected/13545120-2b3f-445d-bb4c-02c5a3b34c4b-kube-api-access-sb2j8\") pod \"korrel8r-5cbcc89b8f-nfph4\" (UID: \"13545120-2b3f-445d-bb4c-02c5a3b34c4b\") " pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-nfph4"
Oct 30 21:42:13.268622 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:13.268599    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/13545120-2b3f-445d-bb4c-02c5a3b34c4b-config\") pod \"korrel8r-5cbcc89b8f-nfph4\" (UID: \"13545120-2b3f-445d-bb4c-02c5a3b34c4b\") " pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-nfph4"
Oct 30 21:42:13.270264 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:13.270240    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls\" (UniqueName: \"kubernetes.io/secret/13545120-2b3f-445d-bb4c-02c5a3b34c4b-tls\") pod \"korrel8r-5cbcc89b8f-nfph4\" (UID: \"13545120-2b3f-445d-bb4c-02c5a3b34c4b\") " pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-nfph4"
Oct 30 21:42:13.329626 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:13.329594    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sb2j8\" (UniqueName: \"kubernetes.io/projected/13545120-2b3f-445d-bb4c-02c5a3b34c4b-kube-api-access-sb2j8\") pod \"korrel8r-5cbcc89b8f-nfph4\" (UID: \"13545120-2b3f-445d-bb4c-02c5a3b34c4b\") " pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-nfph4"
Oct 30 21:42:13.342455 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:13.342433    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-6br6z"]
Oct 30 21:42:13.344770 ip-10-0-142-4 kubenswrapper[4060]: W1030 21:42:13.344743    4060 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5cf796f_2064_4662_9918_919a6d58e027.slice/crio-f1c720d3a73144aa08dfed2bbbb37e68b2d47dbded7242488070f16d7bcd3672 WatchSource:0}: Error finding container f1c720d3a73144aa08dfed2bbbb37e68b2d47dbded7242488070f16d7bcd3672: Status 404 returned error can't find the container with id f1c720d3a73144aa08dfed2bbbb37e68b2d47dbded7242488070f16d7bcd3672
Oct 30 21:42:13.609603 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:13.609517    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-nfph4"
Oct 30 21:42:13.984294 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:13.984252    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/korrel8r-5cbcc89b8f-nfph4"]
Oct 30 21:42:13.986205 ip-10-0-142-4 kubenswrapper[4060]: W1030 21:42:13.986176    4060 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13545120_2b3f_445d_bb4c_02c5a3b34c4b.slice/crio-62e4595beebd1754c711b0cdb03d1f28b34b3bf149e46404cf6ba62b25c623fb WatchSource:0}: Error finding container 62e4595beebd1754c711b0cdb03d1f28b34b3bf149e46404cf6ba62b25c623fb: Status 404 returned error can't find the container with id 62e4595beebd1754c711b0cdb03d1f28b34b3bf149e46404cf6ba62b25c623fb
Oct 30 21:42:14.117423 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:14.117384    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-6br6z" event={"ID":"c5cf796f-2064-4662-9918-919a6d58e027","Type":"ContainerStarted","Data":"ac79282debaea2750c2d8aba11e07460b1c1e5b7d26bc1c2170c7d3b468331a9"}
Oct 30 21:42:14.117612 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:14.117459    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-6br6z"
Oct 30 21:42:14.117612 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:14.117513    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-6br6z" event={"ID":"c5cf796f-2064-4662-9918-919a6d58e027","Type":"ContainerStarted","Data":"f1c720d3a73144aa08dfed2bbbb37e68b2d47dbded7242488070f16d7bcd3672"}
Oct 30 21:42:14.118922 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:14.118890    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-nfph4" event={"ID":"13545120-2b3f-445d-bb4c-02c5a3b34c4b","Type":"ContainerStarted","Data":"0a1d72b47618ff98b7c08a5747a44665bde1c70ea1e3d6f7c1a27ad593cae159"}
Oct 30 21:42:14.124731 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:14.119253    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-nfph4" event={"ID":"13545120-2b3f-445d-bb4c-02c5a3b34c4b","Type":"ContainerStarted","Data":"62e4595beebd1754c711b0cdb03d1f28b34b3bf149e46404cf6ba62b25c623fb"}
Oct 30 21:42:14.239804 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:14.239704    4060 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-6br6z" podStartSLOduration=2.239686814 podStartE2EDuration="2.239686814s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:42:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:42:14.238522684 +0000 UTC m=+3952.995520983" watchObservedRunningTime="2026-10-30 21:42:14.239686814 +0000 UTC m=+3952.996685112"
Oct 30 21:42:14.353882 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:14.353833    4060 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-nfph4" podStartSLOduration=2.353820973 podStartE2EDuration="2.353820973s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:42:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:42:14.353558342 +0000 UTC m=+3953.110556639" watchObservedRunningTime="2026-10-30 21:42:14.353820973 +0000 UTC m=+3953.110819270"
Oct 30 21:42:15.124093 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:15.124062    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-nfph4"
Oct 30 21:42:17.500911 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:17.500879    4060 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:42:17.504434 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:17.504414    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:42:17.605193 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:17.605156    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kt8wp\" (UniqueName: \"kubernetes.io/projected/e8ae86cf-b836-4025-ba4b-850d41dac1cd-kube-api-access-kt8wp\") pod \"data-science-collector-collector-0\" (UID: \"e8ae86cf-b836-4025-ba4b-850d41dac1cd\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:42:17.605351 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:17.605204    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/e8ae86cf-b836-4025-ba4b-850d41dac1cd-otlp-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"e8ae86cf-b836-4025-ba4b-850d41dac1cd\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:42:17.605351 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:17.605313    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/e8ae86cf-b836-4025-ba4b-850d41dac1cd-monitoring-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"e8ae86cf-b836-4025-ba4b-850d41dac1cd\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:42:17.605351 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:17.605335    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/e8ae86cf-b836-4025-ba4b-850d41dac1cd-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-0\" (UID: \"e8ae86cf-b836-4025-ba4b-850d41dac1cd\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:42:17.605457 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:17.605368    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/e8ae86cf-b836-4025-ba4b-850d41dac1cd-otc-internal\") pod \"data-science-collector-collector-0\" (UID: \"e8ae86cf-b836-4025-ba4b-850d41dac1cd\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:42:17.605457 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:17.605392    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e8ae86cf-b836-4025-ba4b-850d41dac1cd-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"e8ae86cf-b836-4025-ba4b-850d41dac1cd\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:42:17.608427 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:17.608398    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-ta-client-cert\""
Oct 30 21:42:17.608579 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:17.608447    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-monitoring-tls\""
Oct 30 21:42:17.608579 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:17.608455    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-dockercfg-s9tf6\""
Oct 30 21:42:17.608766 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:17.608748    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-a0f9182a\""
Oct 30 21:42:17.610657 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:17.610640    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:42:17.659525 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:17.659465    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-headless-tls\""
Oct 30 21:42:17.659664 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:17.659631    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-tls\""
Oct 30 21:42:17.706323 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:17.706294    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/e8ae86cf-b836-4025-ba4b-850d41dac1cd-otlp-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"e8ae86cf-b836-4025-ba4b-850d41dac1cd\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:42:17.706531 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:17.706335    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/e8ae86cf-b836-4025-ba4b-850d41dac1cd-monitoring-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"e8ae86cf-b836-4025-ba4b-850d41dac1cd\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:42:17.706531 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:17.706360    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/e8ae86cf-b836-4025-ba4b-850d41dac1cd-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-0\" (UID: \"e8ae86cf-b836-4025-ba4b-850d41dac1cd\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:42:17.706531 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:17.706401    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/e8ae86cf-b836-4025-ba4b-850d41dac1cd-otc-internal\") pod \"data-science-collector-collector-0\" (UID: \"e8ae86cf-b836-4025-ba4b-850d41dac1cd\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:42:17.706531 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:17.706424    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e8ae86cf-b836-4025-ba4b-850d41dac1cd-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"e8ae86cf-b836-4025-ba4b-850d41dac1cd\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:42:17.706531 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:42:17.706438    4060 secret.go:189] Couldn't get secret redhat-ods-monitoring/data-science-collector-collector-headless-tls: secret "data-science-collector-collector-headless-tls" not found
Oct 30 21:42:17.706531 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:42:17.706516    4060 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e8ae86cf-b836-4025-ba4b-850d41dac1cd-otlp-tls-certs podName:e8ae86cf-b836-4025-ba4b-850d41dac1cd nodeName:}" failed. No retries permitted until 2026-10-30 21:42:18.206475513 +0000 UTC m=+3956.963473790 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "otlp-tls-certs" (UniqueName: "kubernetes.io/secret/e8ae86cf-b836-4025-ba4b-850d41dac1cd-otlp-tls-certs") pod "data-science-collector-collector-0" (UID: "e8ae86cf-b836-4025-ba4b-850d41dac1cd") : secret "data-science-collector-collector-headless-tls" not found
Oct 30 21:42:17.706867 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:17.706538    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kt8wp\" (UniqueName: \"kubernetes.io/projected/e8ae86cf-b836-4025-ba4b-850d41dac1cd-kube-api-access-kt8wp\") pod \"data-science-collector-collector-0\" (UID: \"e8ae86cf-b836-4025-ba4b-850d41dac1cd\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:42:17.707244 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:17.707224    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/e8ae86cf-b836-4025-ba4b-850d41dac1cd-otc-internal\") pod \"data-science-collector-collector-0\" (UID: \"e8ae86cf-b836-4025-ba4b-850d41dac1cd\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:42:17.708901 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:17.708873    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/e8ae86cf-b836-4025-ba4b-850d41dac1cd-monitoring-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"e8ae86cf-b836-4025-ba4b-850d41dac1cd\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:42:17.709001 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:17.708879    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/e8ae86cf-b836-4025-ba4b-850d41dac1cd-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-0\" (UID: \"e8ae86cf-b836-4025-ba4b-850d41dac1cd\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:42:17.709048 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:17.709019    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e8ae86cf-b836-4025-ba4b-850d41dac1cd-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"e8ae86cf-b836-4025-ba4b-850d41dac1cd\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:42:17.772351 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:17.772277    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kt8wp\" (UniqueName: \"kubernetes.io/projected/e8ae86cf-b836-4025-ba4b-850d41dac1cd-kube-api-access-kt8wp\") pod \"data-science-collector-collector-0\" (UID: \"e8ae86cf-b836-4025-ba4b-850d41dac1cd\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:42:18.210305 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:18.210273    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/e8ae86cf-b836-4025-ba4b-850d41dac1cd-otlp-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"e8ae86cf-b836-4025-ba4b-850d41dac1cd\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:42:18.212848 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:18.212811    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/e8ae86cf-b836-4025-ba4b-850d41dac1cd-otlp-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"e8ae86cf-b836-4025-ba4b-850d41dac1cd\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:42:18.416742 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:18.416707    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:42:18.790987 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:18.790963    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:42:18.793053 ip-10-0-142-4 kubenswrapper[4060]: W1030 21:42:18.793024    4060 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8ae86cf_b836_4025_ba4b_850d41dac1cd.slice/crio-ca6b1ea7ba22dca9ef052127d21ce9fb0977ffd2c1a9361fcd8e8eb1fb5c694e WatchSource:0}: Error finding container ca6b1ea7ba22dca9ef052127d21ce9fb0977ffd2c1a9361fcd8e8eb1fb5c694e: Status 404 returned error can't find the container with id ca6b1ea7ba22dca9ef052127d21ce9fb0977ffd2c1a9361fcd8e8eb1fb5c694e
Oct 30 21:42:18.795293 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:18.795255    4060 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 21:42:18.795374 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:18.795331    4060 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 21:42:19.144362 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:19.144280    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"e8ae86cf-b836-4025-ba4b-850d41dac1cd","Type":"ContainerStarted","Data":"0c133be411645ff2a71175e9586740539b499fc605a495c3a0311a567937628f"}
Oct 30 21:42:19.144362 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:19.144336    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"e8ae86cf-b836-4025-ba4b-850d41dac1cd","Type":"ContainerStarted","Data":"ca6b1ea7ba22dca9ef052127d21ce9fb0977ffd2c1a9361fcd8e8eb1fb5c694e"}
Oct 30 21:42:19.263316 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:19.263263    4060 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-collector-0" podStartSLOduration=2.263247833 podStartE2EDuration="2.263247833s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:42:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:42:19.261631627 +0000 UTC m=+3958.018629925" watchObservedRunningTime="2026-10-30 21:42:19.263247833 +0000 UTC m=+3958.020246130"
Oct 30 21:42:20.126553 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:20.126521    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-6br6z"
Oct 30 21:42:26.130886 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:26.130859    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-nfph4"
Oct 30 21:42:29.734383 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:29.734344    4060 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-w6ndk"]
Oct 30 21:42:29.737599 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:29.737585    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-w6ndk"
Oct 30 21:42:29.789818 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:29.789788    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"default-dockercfg-48j4p\""
Oct 30 21:42:29.801313 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:29.801280    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-htctx\" (UniqueName: \"kubernetes.io/projected/bfc42f46-be94-443f-86d3-4d7457a1c66c-kube-api-access-htctx\") pod \"thanos-querier-data-science-thanos-querier-74b6964bcd-w6ndk\" (UID: \"bfc42f46-be94-443f-86d3-4d7457a1c66c\") " pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-w6ndk"
Oct 30 21:42:29.840535 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:29.840482    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-w6ndk"]
Oct 30 21:42:29.902270 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:29.902230    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-htctx\" (UniqueName: \"kubernetes.io/projected/bfc42f46-be94-443f-86d3-4d7457a1c66c-kube-api-access-htctx\") pod \"thanos-querier-data-science-thanos-querier-74b6964bcd-w6ndk\" (UID: \"bfc42f46-be94-443f-86d3-4d7457a1c66c\") " pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-w6ndk"
Oct 30 21:42:29.963356 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:29.963323    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-htctx\" (UniqueName: \"kubernetes.io/projected/bfc42f46-be94-443f-86d3-4d7457a1c66c-kube-api-access-htctx\") pod \"thanos-querier-data-science-thanos-querier-74b6964bcd-w6ndk\" (UID: \"bfc42f46-be94-443f-86d3-4d7457a1c66c\") " pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-w6ndk"
Oct 30 21:42:30.049350 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:30.049270    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-w6ndk"
Oct 30 21:42:30.418142 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:30.418066    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-w6ndk"]
Oct 30 21:42:30.420265 ip-10-0-142-4 kubenswrapper[4060]: W1030 21:42:30.420236    4060 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbfc42f46_be94_443f_86d3_4d7457a1c66c.slice/crio-c5b95ee49f7d8bc8e21878bac83be750755e2fb08c93eb2bfb0eb77e162f00e8 WatchSource:0}: Error finding container c5b95ee49f7d8bc8e21878bac83be750755e2fb08c93eb2bfb0eb77e162f00e8: Status 404 returned error can't find the container with id c5b95ee49f7d8bc8e21878bac83be750755e2fb08c93eb2bfb0eb77e162f00e8
Oct 30 21:42:31.207348 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:31.207314    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-w6ndk" event={"ID":"bfc42f46-be94-443f-86d3-4d7457a1c66c","Type":"ContainerStarted","Data":"09dc23ed00acf1f61aa844f81009175848c000d1ee29eb1f7fd3540e74f82b46"}
Oct 30 21:42:31.207880 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:31.207359    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-w6ndk" event={"ID":"bfc42f46-be94-443f-86d3-4d7457a1c66c","Type":"ContainerStarted","Data":"c5b95ee49f7d8bc8e21878bac83be750755e2fb08c93eb2bfb0eb77e162f00e8"}
Oct 30 21:42:31.323116 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:31.323053    4060 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-w6ndk" podStartSLOduration=2.323026998 podStartE2EDuration="2.323026998s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:42:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:42:31.322877322 +0000 UTC m=+3970.079875620" watchObservedRunningTime="2026-10-30 21:42:31.323026998 +0000 UTC m=+3970.080025323"
Oct 30 21:42:31.374806 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:31.374773    4060 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"]
Oct 30 21:42:31.378620 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:31.378593    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:42:31.432352 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:31.432289    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"prometheus-web-tls-ca\""
Oct 30 21:42:31.432603 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:31.432391    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"prometheus-data-science-monitoringstack-web-config\""
Oct 30 21:42:31.432603 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:31.432439    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"prometheus-data-science-monitoringstack-thanos-prometheus-http-client-file\""
Oct 30 21:42:31.432860 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:31.432834    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"prometheus-data-science-monitoringstack-tls-assets-0\""
Oct 30 21:42:31.432986 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:31.432861    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"prometheus-data-science-monitoringstack\""
Oct 30 21:42:31.432986 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:31.432945    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-monitoringstack-prometheus-dockercfg-rfvbp\""
Oct 30 21:42:31.482570 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:31.482481    4060 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"]
Oct 30 21:42:31.486005 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:31.485987    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:42:31.497837 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:31.497806    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"]
Oct 30 21:42:31.510834 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:31.510804    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"prometheus-data-science-monitoringstack-rulefiles-1\""
Oct 30 21:42:31.510834 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:31.510805    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"prometheus-data-science-monitoringstack-rulefiles-2\""
Oct 30 21:42:31.511063 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:31.511020    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"prometheus-data-science-monitoringstack-rulefiles-0\""
Oct 30 21:42:31.557156 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:31.557127    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"]
Oct 30 21:42:31.615147 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:31.615115    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-web-tls-ca\" (UniqueName: \"kubernetes.io/secret/2f6bc90c-dc24-4dac-abb8-d2af9a293d7c-secret-prometheus-web-tls-ca\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"2f6bc90c-dc24-4dac-abb8-d2af9a293d7c\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:42:31.615327 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:31.615162    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-data-science-monitoringstack-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/2f6bc90c-dc24-4dac-abb8-d2af9a293d7c-prometheus-data-science-monitoringstack-rulefiles-1\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"2f6bc90c-dc24-4dac-abb8-d2af9a293d7c\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:42:31.615327 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:31.615226    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-data-science-monitoringstack-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2f6bc90c-dc24-4dac-abb8-d2af9a293d7c-prometheus-data-science-monitoringstack-rulefiles-0\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"2f6bc90c-dc24-4dac-abb8-d2af9a293d7c\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:42:31.615327 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:31.615253    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config-tls-secret-key-prometheus-operated-tls-f3457c70\" (UniqueName: \"kubernetes.io/secret/2f6bc90c-dc24-4dac-abb8-d2af9a293d7c-web-config-tls-secret-key-prometheus-operated-tls-f3457c70\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"2f6bc90c-dc24-4dac-abb8-d2af9a293d7c\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:42:31.615327 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:31.615269    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2f6bc90c-dc24-4dac-abb8-d2af9a293d7c-tls-assets\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"2f6bc90c-dc24-4dac-abb8-d2af9a293d7c\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:42:31.615327 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:31.615289    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/2f6bc90c-dc24-4dac-abb8-d2af9a293d7c-config\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"2f6bc90c-dc24-4dac-abb8-d2af9a293d7c\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:42:31.615624 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:31.615485    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2f6bc90c-dc24-4dac-abb8-d2af9a293d7c-config-out\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"2f6bc90c-dc24-4dac-abb8-d2af9a293d7c\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:42:31.615624 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:31.615553    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2f6bc90c-dc24-4dac-abb8-d2af9a293d7c-thanos-prometheus-http-client-file\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"2f6bc90c-dc24-4dac-abb8-d2af9a293d7c\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:42:31.615691 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:31.615667    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2f6bc90c-dc24-4dac-abb8-d2af9a293d7c-web-config\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"2f6bc90c-dc24-4dac-abb8-d2af9a293d7c\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:42:31.615735 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:31.615716    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m2md9\" (UniqueName: \"kubernetes.io/projected/2f6bc90c-dc24-4dac-abb8-d2af9a293d7c-kube-api-access-m2md9\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"2f6bc90c-dc24-4dac-abb8-d2af9a293d7c\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:42:31.615794 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:31.615774    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-data-science-monitoringstack-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/2f6bc90c-dc24-4dac-abb8-d2af9a293d7c-prometheus-data-science-monitoringstack-rulefiles-2\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"2f6bc90c-dc24-4dac-abb8-d2af9a293d7c\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:42:31.615849 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:31.615833    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config-tls-secret-cert-prometheus-operated-tls-f3457c70\" (UniqueName: \"kubernetes.io/secret/2f6bc90c-dc24-4dac-abb8-d2af9a293d7c-web-config-tls-secret-cert-prometheus-operated-tls-f3457c70\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"2f6bc90c-dc24-4dac-abb8-d2af9a293d7c\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:42:31.631457 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:31.631432    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"alertmanager-data-science-monitoringstack-generated\""
Oct 30 21:42:31.631457 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:31.631432    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"alertmanager-data-science-monitoringstack-web-config\""
Oct 30 21:42:31.631660 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:31.631464    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"alertmanager-data-science-monitoringstack-tls-assets-0\""
Oct 30 21:42:31.631708 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:31.631693    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-monitoringstack-alertmanager-dockercfg-crhsh\""
Oct 30 21:42:31.631747 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:31.631704    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"alertmanager-data-science-monitoringstack-cluster-tls-config\""
Oct 30 21:42:31.716471 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:31.716437    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2f6bc90c-dc24-4dac-abb8-d2af9a293d7c-thanos-prometheus-http-client-file\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"2f6bc90c-dc24-4dac-abb8-d2af9a293d7c\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:42:31.716687 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:31.716506    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2f6bc90c-dc24-4dac-abb8-d2af9a293d7c-web-config\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"2f6bc90c-dc24-4dac-abb8-d2af9a293d7c\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:42:31.716687 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:31.716541    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m2md9\" (UniqueName: \"kubernetes.io/projected/2f6bc90c-dc24-4dac-abb8-d2af9a293d7c-kube-api-access-m2md9\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"2f6bc90c-dc24-4dac-abb8-d2af9a293d7c\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:42:31.716687 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:31.716671    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-data-science-monitoringstack-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/2f6bc90c-dc24-4dac-abb8-d2af9a293d7c-prometheus-data-science-monitoringstack-rulefiles-2\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"2f6bc90c-dc24-4dac-abb8-d2af9a293d7c\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:42:31.716877 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:31.716706    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8ec52a7c-c49d-42f2-906a-824dfa80be19-config-volume\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"8ec52a7c-c49d-42f2-906a-824dfa80be19\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:42:31.716877 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:31.716778    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config-tls-secret-cert-prometheus-operated-tls-f3457c70\" (UniqueName: \"kubernetes.io/secret/2f6bc90c-dc24-4dac-abb8-d2af9a293d7c-web-config-tls-secret-cert-prometheus-operated-tls-f3457c70\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"2f6bc90c-dc24-4dac-abb8-d2af9a293d7c\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:42:31.717168 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:31.717141    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-web-tls-ca\" (UniqueName: \"kubernetes.io/secret/2f6bc90c-dc24-4dac-abb8-d2af9a293d7c-secret-prometheus-web-tls-ca\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"2f6bc90c-dc24-4dac-abb8-d2af9a293d7c\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:42:31.717320 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:31.717179    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8ec52a7c-c49d-42f2-906a-824dfa80be19-tls-assets\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"8ec52a7c-c49d-42f2-906a-824dfa80be19\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:42:31.717320 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:31.717208    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-data-science-monitoringstack-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/2f6bc90c-dc24-4dac-abb8-d2af9a293d7c-prometheus-data-science-monitoringstack-rulefiles-1\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"2f6bc90c-dc24-4dac-abb8-d2af9a293d7c\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:42:31.717320 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:31.717237    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-data-science-monitoringstack-db\" (UniqueName: \"kubernetes.io/empty-dir/8ec52a7c-c49d-42f2-906a-824dfa80be19-alertmanager-data-science-monitoringstack-db\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"8ec52a7c-c49d-42f2-906a-824dfa80be19\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:42:31.717320 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:31.717269    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-data-science-monitoringstack-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2f6bc90c-dc24-4dac-abb8-d2af9a293d7c-prometheus-data-science-monitoringstack-rulefiles-0\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"2f6bc90c-dc24-4dac-abb8-d2af9a293d7c\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:42:31.717320 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:31.717294    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-data-science-monitoringstack-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/2f6bc90c-dc24-4dac-abb8-d2af9a293d7c-prometheus-data-science-monitoringstack-rulefiles-2\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"2f6bc90c-dc24-4dac-abb8-d2af9a293d7c\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:42:31.717664 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:31.717300    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config-tls-secret-key-prometheus-operated-tls-f3457c70\" (UniqueName: \"kubernetes.io/secret/2f6bc90c-dc24-4dac-abb8-d2af9a293d7c-web-config-tls-secret-key-prometheus-operated-tls-f3457c70\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"2f6bc90c-dc24-4dac-abb8-d2af9a293d7c\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:42:31.717664 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:31.717382    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2f6bc90c-dc24-4dac-abb8-d2af9a293d7c-tls-assets\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"2f6bc90c-dc24-4dac-abb8-d2af9a293d7c\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:42:31.717664 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:31.717419    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/2f6bc90c-dc24-4dac-abb8-d2af9a293d7c-config\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"2f6bc90c-dc24-4dac-abb8-d2af9a293d7c\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:42:31.717664 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:31.717449    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8ec52a7c-c49d-42f2-906a-824dfa80be19-web-config\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"8ec52a7c-c49d-42f2-906a-824dfa80be19\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:42:31.717664 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:31.717479    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8ec52a7c-c49d-42f2-906a-824dfa80be19-config-out\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"8ec52a7c-c49d-42f2-906a-824dfa80be19\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:42:31.717664 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:31.717526    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8ec52a7c-c49d-42f2-906a-824dfa80be19-cluster-tls-config\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"8ec52a7c-c49d-42f2-906a-824dfa80be19\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:42:31.717664 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:31.717580    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2f6bc90c-dc24-4dac-abb8-d2af9a293d7c-config-out\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"2f6bc90c-dc24-4dac-abb8-d2af9a293d7c\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:42:31.717664 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:31.717609    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k25dw\" (UniqueName: \"kubernetes.io/projected/8ec52a7c-c49d-42f2-906a-824dfa80be19-kube-api-access-k25dw\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"8ec52a7c-c49d-42f2-906a-824dfa80be19\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:42:31.718251 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:31.718143    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-data-science-monitoringstack-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/2f6bc90c-dc24-4dac-abb8-d2af9a293d7c-prometheus-data-science-monitoringstack-rulefiles-1\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"2f6bc90c-dc24-4dac-abb8-d2af9a293d7c\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:42:31.718620 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:31.718591    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-data-science-monitoringstack-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2f6bc90c-dc24-4dac-abb8-d2af9a293d7c-prometheus-data-science-monitoringstack-rulefiles-0\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"2f6bc90c-dc24-4dac-abb8-d2af9a293d7c\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:42:31.719821 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:31.719736    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2f6bc90c-dc24-4dac-abb8-d2af9a293d7c-thanos-prometheus-http-client-file\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"2f6bc90c-dc24-4dac-abb8-d2af9a293d7c\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:42:31.720287 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:31.720256    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config-tls-secret-cert-prometheus-operated-tls-f3457c70\" (UniqueName: \"kubernetes.io/secret/2f6bc90c-dc24-4dac-abb8-d2af9a293d7c-web-config-tls-secret-cert-prometheus-operated-tls-f3457c70\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"2f6bc90c-dc24-4dac-abb8-d2af9a293d7c\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:42:31.720392 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:31.720281    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config-tls-secret-key-prometheus-operated-tls-f3457c70\" (UniqueName: \"kubernetes.io/secret/2f6bc90c-dc24-4dac-abb8-d2af9a293d7c-web-config-tls-secret-key-prometheus-operated-tls-f3457c70\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"2f6bc90c-dc24-4dac-abb8-d2af9a293d7c\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:42:31.720477 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:31.720458    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/2f6bc90c-dc24-4dac-abb8-d2af9a293d7c-config\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"2f6bc90c-dc24-4dac-abb8-d2af9a293d7c\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:42:31.720591 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:31.720575    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2f6bc90c-dc24-4dac-abb8-d2af9a293d7c-web-config\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"2f6bc90c-dc24-4dac-abb8-d2af9a293d7c\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:42:31.720638 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:31.720601    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2f6bc90c-dc24-4dac-abb8-d2af9a293d7c-tls-assets\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"2f6bc90c-dc24-4dac-abb8-d2af9a293d7c\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:42:31.720691 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:31.720670    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-web-tls-ca\" (UniqueName: \"kubernetes.io/secret/2f6bc90c-dc24-4dac-abb8-d2af9a293d7c-secret-prometheus-web-tls-ca\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"2f6bc90c-dc24-4dac-abb8-d2af9a293d7c\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:42:31.721125 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:31.721104    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2f6bc90c-dc24-4dac-abb8-d2af9a293d7c-config-out\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"2f6bc90c-dc24-4dac-abb8-d2af9a293d7c\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:42:31.778151 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:31.778081    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m2md9\" (UniqueName: \"kubernetes.io/projected/2f6bc90c-dc24-4dac-abb8-d2af9a293d7c-kube-api-access-m2md9\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"2f6bc90c-dc24-4dac-abb8-d2af9a293d7c\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:42:31.818811 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:31.818778    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8ec52a7c-c49d-42f2-906a-824dfa80be19-web-config\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"8ec52a7c-c49d-42f2-906a-824dfa80be19\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:42:31.818811 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:31.818810    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8ec52a7c-c49d-42f2-906a-824dfa80be19-config-out\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"8ec52a7c-c49d-42f2-906a-824dfa80be19\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:42:31.819066 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:31.818832    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8ec52a7c-c49d-42f2-906a-824dfa80be19-cluster-tls-config\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"8ec52a7c-c49d-42f2-906a-824dfa80be19\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:42:31.819066 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:31.818860    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k25dw\" (UniqueName: \"kubernetes.io/projected/8ec52a7c-c49d-42f2-906a-824dfa80be19-kube-api-access-k25dw\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"8ec52a7c-c49d-42f2-906a-824dfa80be19\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:42:31.819066 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:31.818918    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8ec52a7c-c49d-42f2-906a-824dfa80be19-config-volume\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"8ec52a7c-c49d-42f2-906a-824dfa80be19\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:42:31.819066 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:31.818966    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8ec52a7c-c49d-42f2-906a-824dfa80be19-tls-assets\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"8ec52a7c-c49d-42f2-906a-824dfa80be19\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:42:31.819293 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:31.819127    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-data-science-monitoringstack-db\" (UniqueName: \"kubernetes.io/empty-dir/8ec52a7c-c49d-42f2-906a-824dfa80be19-alertmanager-data-science-monitoringstack-db\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"8ec52a7c-c49d-42f2-906a-824dfa80be19\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:42:31.819469 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:31.819446    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-data-science-monitoringstack-db\" (UniqueName: \"kubernetes.io/empty-dir/8ec52a7c-c49d-42f2-906a-824dfa80be19-alertmanager-data-science-monitoringstack-db\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"8ec52a7c-c49d-42f2-906a-824dfa80be19\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:42:31.821060 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:31.821039    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8ec52a7c-c49d-42f2-906a-824dfa80be19-config-out\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"8ec52a7c-c49d-42f2-906a-824dfa80be19\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:42:31.821745 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:31.821721    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8ec52a7c-c49d-42f2-906a-824dfa80be19-cluster-tls-config\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"8ec52a7c-c49d-42f2-906a-824dfa80be19\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:42:31.821745 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:31.821738    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8ec52a7c-c49d-42f2-906a-824dfa80be19-config-volume\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"8ec52a7c-c49d-42f2-906a-824dfa80be19\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:42:31.821867 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:31.821723    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8ec52a7c-c49d-42f2-906a-824dfa80be19-web-config\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"8ec52a7c-c49d-42f2-906a-824dfa80be19\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:42:31.821867 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:31.821727    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8ec52a7c-c49d-42f2-906a-824dfa80be19-tls-assets\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"8ec52a7c-c49d-42f2-906a-824dfa80be19\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:42:31.881416 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:31.881389    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k25dw\" (UniqueName: \"kubernetes.io/projected/8ec52a7c-c49d-42f2-906a-824dfa80be19-kube-api-access-k25dw\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"8ec52a7c-c49d-42f2-906a-824dfa80be19\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:42:32.104457 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:32.104364    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:42:32.579938 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:32.579914    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"]
Oct 30 21:42:32.581954 ip-10-0-142-4 kubenswrapper[4060]: W1030 21:42:32.581924    4060 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ec52a7c_c49d_42f2_906a_824dfa80be19.slice/crio-d5ee8a2b915e23688288fdc78a89d25c3d91fade5b5d86c3c7aeddc0e026b4bf WatchSource:0}: Error finding container d5ee8a2b915e23688288fdc78a89d25c3d91fade5b5d86c3c7aeddc0e026b4bf: Status 404 returned error can't find the container with id d5ee8a2b915e23688288fdc78a89d25c3d91fade5b5d86c3c7aeddc0e026b4bf
Oct 30 21:42:33.218290 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:33.218255    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0" event={"ID":"8ec52a7c-c49d-42f2-906a-824dfa80be19","Type":"ContainerStarted","Data":"5b2dc4bcc1fe375ed8c178f66a708f400b84d02bfd71d8807050563bf067d4d5"}
Oct 30 21:42:33.218464 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:33.218324    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0" event={"ID":"8ec52a7c-c49d-42f2-906a-824dfa80be19","Type":"ContainerStarted","Data":"d5ee8a2b915e23688288fdc78a89d25c3d91fade5b5d86c3c7aeddc0e026b4bf"}
Oct 30 21:42:33.736260 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:33.736230    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-e73afc79-aa37-49a0-8744-633c03cad1f4\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a155a55c1ce0e65b\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"2f6bc90c-dc24-4dac-abb8-d2af9a293d7c\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:42:33.840067 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:33.840033    4060 operation_generator.go:1464] "Controller attach succeeded for volume \"pvc-e73afc79-aa37-49a0-8744-633c03cad1f4\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a155a55c1ce0e65b\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"2f6bc90c-dc24-4dac-abb8-d2af9a293d7c\") device path: \"\"" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:42:33.937800 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:33.937768    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"pvc-e73afc79-aa37-49a0-8744-633c03cad1f4\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a155a55c1ce0e65b\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"2f6bc90c-dc24-4dac-abb8-d2af9a293d7c\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:42:33.937966 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:33.937905    4060 operation_generator.go:515] "MountVolume.WaitForAttach entering for volume \"pvc-e73afc79-aa37-49a0-8744-633c03cad1f4\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a155a55c1ce0e65b\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"2f6bc90c-dc24-4dac-abb8-d2af9a293d7c\") DevicePath \"\"" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:42:33.990013 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:33.989935    4060 operation_generator.go:525] "MountVolume.WaitForAttach succeeded for volume \"pvc-e73afc79-aa37-49a0-8744-633c03cad1f4\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a155a55c1ce0e65b\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"2f6bc90c-dc24-4dac-abb8-d2af9a293d7c\") DevicePath \"csi-7011c01335d2502f76be252f9498c79824668beecf30ee8f6a7191145201ca4c\"" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:42:34.127020 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:34.126987    4060 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"pvc-e73afc79-aa37-49a0-8744-633c03cad1f4\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a155a55c1ce0e65b\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"2f6bc90c-dc24-4dac-abb8-d2af9a293d7c\") device mount path \"/var/lib/kubelet/plugins/kubernetes.io/csi/ebs.csi.aws.com/fb02f91ab75afdcfd8c2ac3eaeb0ba7303c67490d38fe3164f5fc7856f2f1875/globalmount\"" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:42:34.190973 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:34.190921    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pvc-e73afc79-aa37-49a0-8744-633c03cad1f4\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a155a55c1ce0e65b\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"2f6bc90c-dc24-4dac-abb8-d2af9a293d7c\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:42:34.399959 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:34.399882    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:42:34.899557 ip-10-0-142-4 kubenswrapper[4060]: W1030 21:42:34.899530    4060 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f6bc90c_dc24_4dac_abb8_d2af9a293d7c.slice/crio-acb11a94d3a2650482a49d79915eb5e219fa21c76dcdf9163c3e9ecedc161481 WatchSource:0}: Error finding container acb11a94d3a2650482a49d79915eb5e219fa21c76dcdf9163c3e9ecedc161481: Status 404 returned error can't find the container with id acb11a94d3a2650482a49d79915eb5e219fa21c76dcdf9163c3e9ecedc161481
Oct 30 21:42:34.947297 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:34.947269    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"]
Oct 30 21:42:35.228461 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:35.228427    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0" event={"ID":"2f6bc90c-dc24-4dac-abb8-d2af9a293d7c","Type":"ContainerStarted","Data":"acb11a94d3a2650482a49d79915eb5e219fa21c76dcdf9163c3e9ecedc161481"}
Oct 30 21:42:36.234815 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:36.234778    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0" event={"ID":"2f6bc90c-dc24-4dac-abb8-d2af9a293d7c","Type":"ContainerStarted","Data":"80204328175c924af9d78f8e11d52693cf75a4628a0da69e5dc2188bc8b5f8bd"}
Oct 30 21:42:37.240857 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:37.240821    4060 generic.go:356] "Generic (PLEG): container finished" podID="8ec52a7c-c49d-42f2-906a-824dfa80be19" containerID="5b2dc4bcc1fe375ed8c178f66a708f400b84d02bfd71d8807050563bf067d4d5" exitCode=0
Oct 30 21:42:37.241274 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:37.240897    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0" event={"ID":"8ec52a7c-c49d-42f2-906a-824dfa80be19","Type":"ContainerDied","Data":"5b2dc4bcc1fe375ed8c178f66a708f400b84d02bfd71d8807050563bf067d4d5"}
Oct 30 21:42:38.248217 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:38.248166    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0" event={"ID":"8ec52a7c-c49d-42f2-906a-824dfa80be19","Type":"ContainerStarted","Data":"971ccc0e1233ea571c2801253e0f3582d4713f9597d8ccf4fceef6e1381760d0"}
Oct 30 21:42:38.248755 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:38.248257    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0" event={"ID":"8ec52a7c-c49d-42f2-906a-824dfa80be19","Type":"ContainerStarted","Data":"8619ddc0d101e448e22f6e9b3e5c357375287b0ba677b32b110e88c6d1a30c4d"}
Oct 30 21:42:38.248755 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:38.248474    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:42:38.417597 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:38.417543    4060 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0" podStartSLOduration=3.931066635 podStartE2EDuration="7.417528132s" totalImagesPullingTime="0s" totalInitContainerRuntime="3.486461497s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:42:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:42:38.416082592 +0000 UTC m=+3977.173080912" watchObservedRunningTime="2026-10-30 21:42:38.417528132 +0000 UTC m=+3977.174526444"
Oct 30 21:42:39.254738 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:39.254708    4060 generic.go:356] "Generic (PLEG): container finished" podID="2f6bc90c-dc24-4dac-abb8-d2af9a293d7c" containerID="80204328175c924af9d78f8e11d52693cf75a4628a0da69e5dc2188bc8b5f8bd" exitCode=0
Oct 30 21:42:39.255226 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:39.254784    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0" event={"ID":"2f6bc90c-dc24-4dac-abb8-d2af9a293d7c","Type":"ContainerDied","Data":"80204328175c924af9d78f8e11d52693cf75a4628a0da69e5dc2188bc8b5f8bd"}
Oct 30 21:42:40.262282 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:40.262203    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0" event={"ID":"2f6bc90c-dc24-4dac-abb8-d2af9a293d7c","Type":"ContainerStarted","Data":"de859dcaba757c5e747b2a9c93dfe85e66c5b8689bac5bc3473b81ccb12498b3"}
Oct 30 21:42:40.262282 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:40.262271    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0" event={"ID":"2f6bc90c-dc24-4dac-abb8-d2af9a293d7c","Type":"ContainerStarted","Data":"d1fbcc021580be88f17c7f5658dc107983c76f3b3d5c8d9d3e8deb7c213d9fe9"}
Oct 30 21:42:40.262710 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:40.262298    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0" event={"ID":"2f6bc90c-dc24-4dac-abb8-d2af9a293d7c","Type":"ContainerStarted","Data":"59730cc31db0c9223066529d7c6ee3f9ef6aea477bca5618de5faf9243282541"}
Oct 30 21:42:40.466287 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:40.466232    4060 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0" podStartSLOduration=5.781120529 podStartE2EDuration="9.466214771s" totalImagesPullingTime="0s" totalInitContainerRuntime="3.685094242s" isStatefulPod=true podCreationTimestamp="2026-10-30 21:42:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:42:40.438638654 +0000 UTC m=+3979.195636952" watchObservedRunningTime="2026-10-30 21:42:40.466214771 +0000 UTC m=+3979.223213132"
Oct 30 21:42:42.150576 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:42:42.150539    4060 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v2f4x" containerName="extractor"
Oct 30 21:42:44.256756 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:44.256727    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:42:44.400171 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:44.400141    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:42:49.400342 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:49.400294    4060 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:42:49.406056 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:49.406032    4060 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:42:50.314538 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:42:50.314510    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:43:12.149895 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:43:12.149820    4060 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v2f4x" containerName="extractor"
Oct 30 21:43:20.953908 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:43:20.953876    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:43:20.954329 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:43:20.954063    4060 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-collector-0" podUID="e8ae86cf-b836-4025-ba4b-850d41dac1cd" containerName="otc-container" containerID="cri-o://0c133be411645ff2a71175e9586740539b499fc605a495c3a0311a567937628f" gracePeriod=30
Oct 30 21:43:23.304545 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:43:23.304519    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:43:23.465928 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:43:23.465894    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e8ae86cf-b836-4025-ba4b-850d41dac1cd-kube-api-access-kt8wp\" (UniqueName: \"kubernetes.io/projected/e8ae86cf-b836-4025-ba4b-850d41dac1cd-kube-api-access-kt8wp\") pod \"e8ae86cf-b836-4025-ba4b-850d41dac1cd\" (UID: \"e8ae86cf-b836-4025-ba4b-850d41dac1cd\") "
Oct 30 21:43:23.466119 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:43:23.465940    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/e8ae86cf-b836-4025-ba4b-850d41dac1cd-tls-certs\" (UniqueName: \"kubernetes.io/secret/e8ae86cf-b836-4025-ba4b-850d41dac1cd-tls-certs\") pod \"e8ae86cf-b836-4025-ba4b-850d41dac1cd\" (UID: \"e8ae86cf-b836-4025-ba4b-850d41dac1cd\") "
Oct 30 21:43:23.466119 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:43:23.465971    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/e8ae86cf-b836-4025-ba4b-850d41dac1cd-otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/e8ae86cf-b836-4025-ba4b-850d41dac1cd-otlp-tls-certs\") pod \"e8ae86cf-b836-4025-ba4b-850d41dac1cd\" (UID: \"e8ae86cf-b836-4025-ba4b-850d41dac1cd\") "
Oct 30 21:43:23.466119 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:43:23.466063    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/e8ae86cf-b836-4025-ba4b-850d41dac1cd-monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/e8ae86cf-b836-4025-ba4b-850d41dac1cd-monitoring-tls-certs\") pod \"e8ae86cf-b836-4025-ba4b-850d41dac1cd\" (UID: \"e8ae86cf-b836-4025-ba4b-850d41dac1cd\") "
Oct 30 21:43:23.466297 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:43:23.466133    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/e8ae86cf-b836-4025-ba4b-850d41dac1cd-data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/e8ae86cf-b836-4025-ba4b-850d41dac1cd-data-science-collector-ta-client-cert\") pod \"e8ae86cf-b836-4025-ba4b-850d41dac1cd\" (UID: \"e8ae86cf-b836-4025-ba4b-850d41dac1cd\") "
Oct 30 21:43:23.466297 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:43:23.466170    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/e8ae86cf-b836-4025-ba4b-850d41dac1cd-otc-internal\" (UniqueName: \"kubernetes.io/configmap/e8ae86cf-b836-4025-ba4b-850d41dac1cd-otc-internal\") pod \"e8ae86cf-b836-4025-ba4b-850d41dac1cd\" (UID: \"e8ae86cf-b836-4025-ba4b-850d41dac1cd\") "
Oct 30 21:43:23.466699 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:43:23.466669    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e8ae86cf-b836-4025-ba4b-850d41dac1cd-otc-internal" pod "e8ae86cf-b836-4025-ba4b-850d41dac1cd" (UID: "e8ae86cf-b836-4025-ba4b-850d41dac1cd"). InnerVolumeSpecName "otc-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:43:23.468332 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:43:23.468306    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e8ae86cf-b836-4025-ba4b-850d41dac1cd-tls-certs" pod "e8ae86cf-b836-4025-ba4b-850d41dac1cd" (UID: "e8ae86cf-b836-4025-ba4b-850d41dac1cd"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:43:23.468332 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:43:23.468324    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e8ae86cf-b836-4025-ba4b-850d41dac1cd-monitoring-tls-certs" pod "e8ae86cf-b836-4025-ba4b-850d41dac1cd" (UID: "e8ae86cf-b836-4025-ba4b-850d41dac1cd"). InnerVolumeSpecName "monitoring-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:43:23.468693 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:43:23.468656    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e8ae86cf-b836-4025-ba4b-850d41dac1cd-data-science-collector-ta-client-cert" pod "e8ae86cf-b836-4025-ba4b-850d41dac1cd" (UID: "e8ae86cf-b836-4025-ba4b-850d41dac1cd"). InnerVolumeSpecName "data-science-collector-ta-client-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:43:23.468817 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:43:23.468740    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e8ae86cf-b836-4025-ba4b-850d41dac1cd-kube-api-access-kt8wp" pod "e8ae86cf-b836-4025-ba4b-850d41dac1cd" (UID: "e8ae86cf-b836-4025-ba4b-850d41dac1cd"). InnerVolumeSpecName "kube-api-access-kt8wp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:43:23.469594 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:43:23.469572    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e8ae86cf-b836-4025-ba4b-850d41dac1cd-otlp-tls-certs" pod "e8ae86cf-b836-4025-ba4b-850d41dac1cd" (UID: "e8ae86cf-b836-4025-ba4b-850d41dac1cd"). InnerVolumeSpecName "otlp-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:43:23.477048 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:43:23.477023    4060 generic.go:356] "Generic (PLEG): container finished" podID="e8ae86cf-b836-4025-ba4b-850d41dac1cd" containerID="0c133be411645ff2a71175e9586740539b499fc605a495c3a0311a567937628f" exitCode=0
Oct 30 21:43:23.477136 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:43:23.477065    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:43:23.477180 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:43:23.477063    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"e8ae86cf-b836-4025-ba4b-850d41dac1cd","Type":"ContainerDied","Data":"0c133be411645ff2a71175e9586740539b499fc605a495c3a0311a567937628f"}
Oct 30 21:43:23.477218 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:43:23.477185    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"e8ae86cf-b836-4025-ba4b-850d41dac1cd","Type":"ContainerDied","Data":"ca6b1ea7ba22dca9ef052127d21ce9fb0977ffd2c1a9361fcd8e8eb1fb5c694e"}
Oct 30 21:43:23.477252 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:43:23.477217    4060 scope.go:122] "RemoveContainer" containerID="0c133be411645ff2a71175e9586740539b499fc605a495c3a0311a567937628f"
Oct 30 21:43:23.488412 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:43:23.488392    4060 scope.go:122] "RemoveContainer" containerID="0c133be411645ff2a71175e9586740539b499fc605a495c3a0311a567937628f"
Oct 30 21:43:23.488702 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:43:23.488682    4060 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0c133be411645ff2a71175e9586740539b499fc605a495c3a0311a567937628f\": container with ID starting with 0c133be411645ff2a71175e9586740539b499fc605a495c3a0311a567937628f not found: ID does not exist" containerID="0c133be411645ff2a71175e9586740539b499fc605a495c3a0311a567937628f"
Oct 30 21:43:23.488780 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:43:23.488711    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c133be411645ff2a71175e9586740539b499fc605a495c3a0311a567937628f"} err="failed to get container status \"0c133be411645ff2a71175e9586740539b499fc605a495c3a0311a567937628f\": rpc error: code = NotFound desc = could not find container \"0c133be411645ff2a71175e9586740539b499fc605a495c3a0311a567937628f\": container with ID starting with 0c133be411645ff2a71175e9586740539b499fc605a495c3a0311a567937628f not found: ID does not exist"
Oct 30 21:43:23.567740 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:43:23.567702    4060 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kt8wp\" (UniqueName: \"kubernetes.io/projected/e8ae86cf-b836-4025-ba4b-850d41dac1cd-kube-api-access-kt8wp\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:43:23.567740 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:43:23.567737    4060 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e8ae86cf-b836-4025-ba4b-850d41dac1cd-tls-certs\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:43:23.567942 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:43:23.567753    4060 reconciler_common.go:299] "Volume detached for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/e8ae86cf-b836-4025-ba4b-850d41dac1cd-otlp-tls-certs\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:43:23.567942 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:43:23.567766    4060 reconciler_common.go:299] "Volume detached for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/e8ae86cf-b836-4025-ba4b-850d41dac1cd-monitoring-tls-certs\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:43:23.567942 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:43:23.567780    4060 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/e8ae86cf-b836-4025-ba4b-850d41dac1cd-data-science-collector-ta-client-cert\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:43:23.567942 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:43:23.567794    4060 reconciler_common.go:299] "Volume detached for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/e8ae86cf-b836-4025-ba4b-850d41dac1cd-otc-internal\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:43:23.644255 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:43:23.644224    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:43:23.656672 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:43:23.656642    4060 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:43:23.739985 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:43:23.739904    4060 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:43:23.740288 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:43:23.740275    4060 cpu_manager.go:414] "containerMap: removing container" podUID="e8ae86cf-b836-4025-ba4b-850d41dac1cd" containerName="otc-container"
Oct 30 21:43:23.740348 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:43:23.740290    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e8ae86cf-b836-4025-ba4b-850d41dac1cd" containerName="otc-container"
Oct 30 21:43:23.740427 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:43:23.740369    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="e8ae86cf-b836-4025-ba4b-850d41dac1cd" containerName="otc-container"
Oct 30 21:43:23.744838 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:43:23.744813    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:43:23.814529 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:43:23.813761    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-a0f9182a\""
Oct 30 21:43:23.816660 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:43:23.816607    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:43:23.823662 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:43:23.823640    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-headless-tls\""
Oct 30 21:43:23.823940 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:43:23.823921    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-ta-client-cert\""
Oct 30 21:43:23.824141 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:43:23.824128    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-dockercfg-s9tf6\""
Oct 30 21:43:23.824275 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:43:23.824262    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-tls\""
Oct 30 21:43:23.862362 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:43:23.862335    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-monitoring-tls\""
Oct 30 21:43:23.870726 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:43:23.870702    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/3fb8b20d-2fd5-459a-a000-30e1394c3f06-monitoring-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"3fb8b20d-2fd5-459a-a000-30e1394c3f06\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:43:23.870839 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:43:23.870734    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rwx9p\" (UniqueName: \"kubernetes.io/projected/3fb8b20d-2fd5-459a-a000-30e1394c3f06-kube-api-access-rwx9p\") pod \"data-science-collector-collector-0\" (UID: \"3fb8b20d-2fd5-459a-a000-30e1394c3f06\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:43:23.870839 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:43:23.870758    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/3fb8b20d-2fd5-459a-a000-30e1394c3f06-otlp-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"3fb8b20d-2fd5-459a-a000-30e1394c3f06\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:43:23.870839 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:43:23.870807    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/3fb8b20d-2fd5-459a-a000-30e1394c3f06-otc-internal\") pod \"data-science-collector-collector-0\" (UID: \"3fb8b20d-2fd5-459a-a000-30e1394c3f06\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:43:23.871020 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:43:23.870900    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3fb8b20d-2fd5-459a-a000-30e1394c3f06-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"3fb8b20d-2fd5-459a-a000-30e1394c3f06\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:43:23.871020 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:43:23.870930    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/3fb8b20d-2fd5-459a-a000-30e1394c3f06-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-0\" (UID: \"3fb8b20d-2fd5-459a-a000-30e1394c3f06\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:43:23.971829 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:43:23.971790    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/3fb8b20d-2fd5-459a-a000-30e1394c3f06-monitoring-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"3fb8b20d-2fd5-459a-a000-30e1394c3f06\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:43:23.971829 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:43:23.971832    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rwx9p\" (UniqueName: \"kubernetes.io/projected/3fb8b20d-2fd5-459a-a000-30e1394c3f06-kube-api-access-rwx9p\") pod \"data-science-collector-collector-0\" (UID: \"3fb8b20d-2fd5-459a-a000-30e1394c3f06\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:43:23.972031 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:43:23.971853    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/3fb8b20d-2fd5-459a-a000-30e1394c3f06-otlp-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"3fb8b20d-2fd5-459a-a000-30e1394c3f06\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:43:23.972031 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:43:23.971874    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/3fb8b20d-2fd5-459a-a000-30e1394c3f06-otc-internal\") pod \"data-science-collector-collector-0\" (UID: \"3fb8b20d-2fd5-459a-a000-30e1394c3f06\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:43:23.972031 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:43:23.971926    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3fb8b20d-2fd5-459a-a000-30e1394c3f06-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"3fb8b20d-2fd5-459a-a000-30e1394c3f06\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:43:23.972031 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:43:23.971955    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/3fb8b20d-2fd5-459a-a000-30e1394c3f06-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-0\" (UID: \"3fb8b20d-2fd5-459a-a000-30e1394c3f06\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:43:23.972849 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:43:23.972822    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/3fb8b20d-2fd5-459a-a000-30e1394c3f06-otc-internal\") pod \"data-science-collector-collector-0\" (UID: \"3fb8b20d-2fd5-459a-a000-30e1394c3f06\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:43:23.974413 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:43:23.974391    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3fb8b20d-2fd5-459a-a000-30e1394c3f06-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"3fb8b20d-2fd5-459a-a000-30e1394c3f06\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:43:23.974563 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:43:23.974450    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/3fb8b20d-2fd5-459a-a000-30e1394c3f06-otlp-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"3fb8b20d-2fd5-459a-a000-30e1394c3f06\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:43:23.974563 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:43:23.974466    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/3fb8b20d-2fd5-459a-a000-30e1394c3f06-monitoring-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"3fb8b20d-2fd5-459a-a000-30e1394c3f06\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:43:23.974690 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:43:23.974627    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/3fb8b20d-2fd5-459a-a000-30e1394c3f06-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-0\" (UID: \"3fb8b20d-2fd5-459a-a000-30e1394c3f06\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:43:24.036018 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:43:24.035956    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rwx9p\" (UniqueName: \"kubernetes.io/projected/3fb8b20d-2fd5-459a-a000-30e1394c3f06-kube-api-access-rwx9p\") pod \"data-science-collector-collector-0\" (UID: \"3fb8b20d-2fd5-459a-a000-30e1394c3f06\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:43:24.057312 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:43:24.057289    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:43:24.438798 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:43:24.438765    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:43:24.439878 ip-10-0-142-4 kubenswrapper[4060]: W1030 21:43:24.439848    4060 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3fb8b20d_2fd5_459a_a000_30e1394c3f06.slice/crio-270d868362317ef2776c075ae47de68cb62f8620e696aa8ecba217f6a3a24d8f WatchSource:0}: Error finding container 270d868362317ef2776c075ae47de68cb62f8620e696aa8ecba217f6a3a24d8f: Status 404 returned error can't find the container with id 270d868362317ef2776c075ae47de68cb62f8620e696aa8ecba217f6a3a24d8f
Oct 30 21:43:24.442119 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:43:24.442082    4060 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 21:43:24.442196 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:43:24.442148    4060 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 21:43:24.483448 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:43:24.483416    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"3fb8b20d-2fd5-459a-a000-30e1394c3f06","Type":"ContainerStarted","Data":"270d868362317ef2776c075ae47de68cb62f8620e696aa8ecba217f6a3a24d8f"}
Oct 30 21:43:25.427910 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:43:25.427877    4060 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="e8ae86cf-b836-4025-ba4b-850d41dac1cd" path="/var/lib/kubelet/pods/e8ae86cf-b836-4025-ba4b-850d41dac1cd/volumes"
Oct 30 21:43:25.490756 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:43:25.490723    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"3fb8b20d-2fd5-459a-a000-30e1394c3f06","Type":"ContainerStarted","Data":"0812511040fee2a04fca5793d8cdfe665bef7b576c355ba2a0fdc467728f225c"}
Oct 30 21:43:42.151165 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:43:42.151124    4060 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v2f4x" containerName="extractor"
Oct 30 21:43:52.106213 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:43:52.106161    4060 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-collector-0" podStartSLOduration=29.106146948 podStartE2EDuration="29.106146948s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:43:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:43:25.611925274 +0000 UTC m=+4024.368923571" watchObservedRunningTime="2026-10-30 21:43:52.106146948 +0000 UTC m=+4050.863145246"
Oct 30 21:43:52.107268 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:43:52.107248    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:43:52.107455 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:43:52.107437    4060 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-collector-0" podUID="3fb8b20d-2fd5-459a-a000-30e1394c3f06" containerName="otc-container" containerID="cri-o://0812511040fee2a04fca5793d8cdfe665bef7b576c355ba2a0fdc467728f225c" gracePeriod=30
Oct 30 21:43:54.452956 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:43:54.452932    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:43:54.524681 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:43:54.524600    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/3fb8b20d-2fd5-459a-a000-30e1394c3f06-tls-certs\" (UniqueName: \"kubernetes.io/secret/3fb8b20d-2fd5-459a-a000-30e1394c3f06-tls-certs\") pod \"3fb8b20d-2fd5-459a-a000-30e1394c3f06\" (UID: \"3fb8b20d-2fd5-459a-a000-30e1394c3f06\") "
Oct 30 21:43:54.524681 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:43:54.524640    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/3fb8b20d-2fd5-459a-a000-30e1394c3f06-monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/3fb8b20d-2fd5-459a-a000-30e1394c3f06-monitoring-tls-certs\") pod \"3fb8b20d-2fd5-459a-a000-30e1394c3f06\" (UID: \"3fb8b20d-2fd5-459a-a000-30e1394c3f06\") "
Oct 30 21:43:54.524920 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:43:54.524698    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/3fb8b20d-2fd5-459a-a000-30e1394c3f06-otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/3fb8b20d-2fd5-459a-a000-30e1394c3f06-otlp-tls-certs\") pod \"3fb8b20d-2fd5-459a-a000-30e1394c3f06\" (UID: \"3fb8b20d-2fd5-459a-a000-30e1394c3f06\") "
Oct 30 21:43:54.524920 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:43:54.524722    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/3fb8b20d-2fd5-459a-a000-30e1394c3f06-otc-internal\" (UniqueName: \"kubernetes.io/configmap/3fb8b20d-2fd5-459a-a000-30e1394c3f06-otc-internal\") pod \"3fb8b20d-2fd5-459a-a000-30e1394c3f06\" (UID: \"3fb8b20d-2fd5-459a-a000-30e1394c3f06\") "
Oct 30 21:43:54.524920 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:43:54.524762    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/3fb8b20d-2fd5-459a-a000-30e1394c3f06-data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/3fb8b20d-2fd5-459a-a000-30e1394c3f06-data-science-collector-ta-client-cert\") pod \"3fb8b20d-2fd5-459a-a000-30e1394c3f06\" (UID: \"3fb8b20d-2fd5-459a-a000-30e1394c3f06\") "
Oct 30 21:43:54.524920 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:43:54.524839    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3fb8b20d-2fd5-459a-a000-30e1394c3f06-kube-api-access-rwx9p\" (UniqueName: \"kubernetes.io/projected/3fb8b20d-2fd5-459a-a000-30e1394c3f06-kube-api-access-rwx9p\") pod \"3fb8b20d-2fd5-459a-a000-30e1394c3f06\" (UID: \"3fb8b20d-2fd5-459a-a000-30e1394c3f06\") "
Oct 30 21:43:54.525620 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:43:54.525135    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3fb8b20d-2fd5-459a-a000-30e1394c3f06-otc-internal" pod "3fb8b20d-2fd5-459a-a000-30e1394c3f06" (UID: "3fb8b20d-2fd5-459a-a000-30e1394c3f06"). InnerVolumeSpecName "otc-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:43:54.526962 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:43:54.526941    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3fb8b20d-2fd5-459a-a000-30e1394c3f06-monitoring-tls-certs" pod "3fb8b20d-2fd5-459a-a000-30e1394c3f06" (UID: "3fb8b20d-2fd5-459a-a000-30e1394c3f06"). InnerVolumeSpecName "monitoring-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:43:54.527356 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:43:54.527338    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3fb8b20d-2fd5-459a-a000-30e1394c3f06-otlp-tls-certs" pod "3fb8b20d-2fd5-459a-a000-30e1394c3f06" (UID: "3fb8b20d-2fd5-459a-a000-30e1394c3f06"). InnerVolumeSpecName "otlp-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:43:54.527425 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:43:54.527361    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3fb8b20d-2fd5-459a-a000-30e1394c3f06-kube-api-access-rwx9p" pod "3fb8b20d-2fd5-459a-a000-30e1394c3f06" (UID: "3fb8b20d-2fd5-459a-a000-30e1394c3f06"). InnerVolumeSpecName "kube-api-access-rwx9p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:43:54.527425 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:43:54.527398    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3fb8b20d-2fd5-459a-a000-30e1394c3f06-tls-certs" pod "3fb8b20d-2fd5-459a-a000-30e1394c3f06" (UID: "3fb8b20d-2fd5-459a-a000-30e1394c3f06"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:43:54.527554 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:43:54.527460    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3fb8b20d-2fd5-459a-a000-30e1394c3f06-data-science-collector-ta-client-cert" pod "3fb8b20d-2fd5-459a-a000-30e1394c3f06" (UID: "3fb8b20d-2fd5-459a-a000-30e1394c3f06"). InnerVolumeSpecName "data-science-collector-ta-client-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:43:54.625961 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:43:54.625931    4060 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rwx9p\" (UniqueName: \"kubernetes.io/projected/3fb8b20d-2fd5-459a-a000-30e1394c3f06-kube-api-access-rwx9p\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:43:54.625961 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:43:54.625955    4060 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3fb8b20d-2fd5-459a-a000-30e1394c3f06-tls-certs\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:43:54.625961 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:43:54.625965    4060 reconciler_common.go:299] "Volume detached for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/3fb8b20d-2fd5-459a-a000-30e1394c3f06-monitoring-tls-certs\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:43:54.626244 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:43:54.625974    4060 reconciler_common.go:299] "Volume detached for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/3fb8b20d-2fd5-459a-a000-30e1394c3f06-otlp-tls-certs\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:43:54.626244 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:43:54.625984    4060 reconciler_common.go:299] "Volume detached for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/3fb8b20d-2fd5-459a-a000-30e1394c3f06-otc-internal\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:43:54.626244 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:43:54.625992    4060 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/3fb8b20d-2fd5-459a-a000-30e1394c3f06-data-science-collector-ta-client-cert\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:43:54.635764 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:43:54.635731    4060 generic.go:356] "Generic (PLEG): container finished" podID="3fb8b20d-2fd5-459a-a000-30e1394c3f06" containerID="0812511040fee2a04fca5793d8cdfe665bef7b576c355ba2a0fdc467728f225c" exitCode=0
Oct 30 21:43:54.635941 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:43:54.635768    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:43:54.635941 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:43:54.635806    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"3fb8b20d-2fd5-459a-a000-30e1394c3f06","Type":"ContainerDied","Data":"0812511040fee2a04fca5793d8cdfe665bef7b576c355ba2a0fdc467728f225c"}
Oct 30 21:43:54.635941 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:43:54.635871    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"3fb8b20d-2fd5-459a-a000-30e1394c3f06","Type":"ContainerDied","Data":"270d868362317ef2776c075ae47de68cb62f8620e696aa8ecba217f6a3a24d8f"}
Oct 30 21:43:54.635941 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:43:54.635901    4060 scope.go:122] "RemoveContainer" containerID="0812511040fee2a04fca5793d8cdfe665bef7b576c355ba2a0fdc467728f225c"
Oct 30 21:43:54.644932 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:43:54.644899    4060 scope.go:122] "RemoveContainer" containerID="0812511040fee2a04fca5793d8cdfe665bef7b576c355ba2a0fdc467728f225c"
Oct 30 21:43:54.645210 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:43:54.645189    4060 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0812511040fee2a04fca5793d8cdfe665bef7b576c355ba2a0fdc467728f225c\": container with ID starting with 0812511040fee2a04fca5793d8cdfe665bef7b576c355ba2a0fdc467728f225c not found: ID does not exist" containerID="0812511040fee2a04fca5793d8cdfe665bef7b576c355ba2a0fdc467728f225c"
Oct 30 21:43:54.645258 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:43:54.645221    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0812511040fee2a04fca5793d8cdfe665bef7b576c355ba2a0fdc467728f225c"} err="failed to get container status \"0812511040fee2a04fca5793d8cdfe665bef7b576c355ba2a0fdc467728f225c\": rpc error: code = NotFound desc = could not find container \"0812511040fee2a04fca5793d8cdfe665bef7b576c355ba2a0fdc467728f225c\": container with ID starting with 0812511040fee2a04fca5793d8cdfe665bef7b576c355ba2a0fdc467728f225c not found: ID does not exist"
Oct 30 21:43:54.802747 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:43:54.802654    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:43:54.807043 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:43:54.807013    4060 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:43:54.894972 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:43:54.894936    4060 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:43:54.895363 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:43:54.895346    4060 cpu_manager.go:414] "containerMap: removing container" podUID="3fb8b20d-2fd5-459a-a000-30e1394c3f06" containerName="otc-container"
Oct 30 21:43:54.895465 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:43:54.895365    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3fb8b20d-2fd5-459a-a000-30e1394c3f06" containerName="otc-container"
Oct 30 21:43:54.895554 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:43:54.895470    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="3fb8b20d-2fd5-459a-a000-30e1394c3f06" containerName="otc-container"
Oct 30 21:43:54.900038 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:43:54.900015    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:43:54.929517 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:43:54.929474    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/cd221ce3-5e38-4efc-9194-3695bb4b7a91-otc-internal\") pod \"data-science-collector-collector-0\" (UID: \"cd221ce3-5e38-4efc-9194-3695bb4b7a91\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:43:54.929660 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:43:54.929526    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cd221ce3-5e38-4efc-9194-3695bb4b7a91-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"cd221ce3-5e38-4efc-9194-3695bb4b7a91\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:43:54.929660 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:43:54.929583    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4g58t\" (UniqueName: \"kubernetes.io/projected/cd221ce3-5e38-4efc-9194-3695bb4b7a91-kube-api-access-4g58t\") pod \"data-science-collector-collector-0\" (UID: \"cd221ce3-5e38-4efc-9194-3695bb4b7a91\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:43:54.929738 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:43:54.929662    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/cd221ce3-5e38-4efc-9194-3695bb4b7a91-monitoring-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"cd221ce3-5e38-4efc-9194-3695bb4b7a91\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:43:54.929738 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:43:54.929722    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/cd221ce3-5e38-4efc-9194-3695bb4b7a91-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-0\" (UID: \"cd221ce3-5e38-4efc-9194-3695bb4b7a91\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:43:54.929819 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:43:54.929756    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/cd221ce3-5e38-4efc-9194-3695bb4b7a91-otlp-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"cd221ce3-5e38-4efc-9194-3695bb4b7a91\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:43:54.952383 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:43:54.952347    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-a0f9182a\""
Oct 30 21:43:54.952575 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:43:54.952558    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-monitoring-tls\""
Oct 30 21:43:54.952657 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:43:54.952645    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-ta-client-cert\""
Oct 30 21:43:54.952749 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:43:54.952736    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-headless-tls\""
Oct 30 21:43:54.952799 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:43:54.952756    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-tls\""
Oct 30 21:43:54.952844 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:43:54.952805    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-dockercfg-s9tf6\""
Oct 30 21:43:54.961483 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:43:54.961457    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:43:55.030814 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:43:55.030783    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/cd221ce3-5e38-4efc-9194-3695bb4b7a91-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-0\" (UID: \"cd221ce3-5e38-4efc-9194-3695bb4b7a91\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:43:55.031017 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:43:55.030822    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/cd221ce3-5e38-4efc-9194-3695bb4b7a91-otlp-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"cd221ce3-5e38-4efc-9194-3695bb4b7a91\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:43:55.031017 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:43:55.030880    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/cd221ce3-5e38-4efc-9194-3695bb4b7a91-otc-internal\") pod \"data-science-collector-collector-0\" (UID: \"cd221ce3-5e38-4efc-9194-3695bb4b7a91\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:43:55.031017 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:43:55.030901    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cd221ce3-5e38-4efc-9194-3695bb4b7a91-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"cd221ce3-5e38-4efc-9194-3695bb4b7a91\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:43:55.031017 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:43:55.030931    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4g58t\" (UniqueName: \"kubernetes.io/projected/cd221ce3-5e38-4efc-9194-3695bb4b7a91-kube-api-access-4g58t\") pod \"data-science-collector-collector-0\" (UID: \"cd221ce3-5e38-4efc-9194-3695bb4b7a91\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:43:55.031017 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:43:55.030972    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/cd221ce3-5e38-4efc-9194-3695bb4b7a91-monitoring-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"cd221ce3-5e38-4efc-9194-3695bb4b7a91\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:43:55.031751 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:43:55.031701    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/cd221ce3-5e38-4efc-9194-3695bb4b7a91-otc-internal\") pod \"data-science-collector-collector-0\" (UID: \"cd221ce3-5e38-4efc-9194-3695bb4b7a91\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:43:55.033459 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:43:55.033436    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/cd221ce3-5e38-4efc-9194-3695bb4b7a91-monitoring-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"cd221ce3-5e38-4efc-9194-3695bb4b7a91\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:43:55.033592 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:43:55.033473    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cd221ce3-5e38-4efc-9194-3695bb4b7a91-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"cd221ce3-5e38-4efc-9194-3695bb4b7a91\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:43:55.033592 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:43:55.033574    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/cd221ce3-5e38-4efc-9194-3695bb4b7a91-otlp-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"cd221ce3-5e38-4efc-9194-3695bb4b7a91\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:43:55.033672 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:43:55.033605    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/cd221ce3-5e38-4efc-9194-3695bb4b7a91-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-0\" (UID: \"cd221ce3-5e38-4efc-9194-3695bb4b7a91\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:43:55.092209 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:43:55.092141    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4g58t\" (UniqueName: \"kubernetes.io/projected/cd221ce3-5e38-4efc-9194-3695bb4b7a91-kube-api-access-4g58t\") pod \"data-science-collector-collector-0\" (UID: \"cd221ce3-5e38-4efc-9194-3695bb4b7a91\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:43:55.212769 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:43:55.212737    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:43:55.432258 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:43:55.432179    4060 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="3fb8b20d-2fd5-459a-a000-30e1394c3f06" path="/var/lib/kubelet/pods/3fb8b20d-2fd5-459a-a000-30e1394c3f06/volumes"
Oct 30 21:43:55.585964 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:43:55.585940    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:43:55.588666 ip-10-0-142-4 kubenswrapper[4060]: W1030 21:43:55.588639    4060 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd221ce3_5e38_4efc_9194_3695bb4b7a91.slice/crio-2c06a7033698dbaea66eb5cf45a3082021f60618a7eea9f56bf027675b8498a0 WatchSource:0}: Error finding container 2c06a7033698dbaea66eb5cf45a3082021f60618a7eea9f56bf027675b8498a0: Status 404 returned error can't find the container with id 2c06a7033698dbaea66eb5cf45a3082021f60618a7eea9f56bf027675b8498a0
Oct 30 21:43:55.590771 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:43:55.590735    4060 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 21:43:55.590875 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:43:55.590808    4060 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 21:43:55.642114 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:43:55.642079    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"cd221ce3-5e38-4efc-9194-3695bb4b7a91","Type":"ContainerStarted","Data":"2c06a7033698dbaea66eb5cf45a3082021f60618a7eea9f56bf027675b8498a0"}
Oct 30 21:43:56.649333 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:43:56.649291    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"cd221ce3-5e38-4efc-9194-3695bb4b7a91","Type":"ContainerStarted","Data":"cecdf46587c7f9cf9fb4b2623357126b901ffa3ed4bf1acde29890f4cf988922"}
Oct 30 21:44:04.665220 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:04.665168    4060 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-collector-0" podStartSLOduration=10.66515344 podStartE2EDuration="10.66515344s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:43:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:43:56.802203837 +0000 UTC m=+4055.559202135" watchObservedRunningTime="2026-10-30 21:44:04.66515344 +0000 UTC m=+4063.422151731"
Oct 30 21:44:04.665684 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:04.665669    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-6br6z"]
Oct 30 21:44:04.665860 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:04.665841    4060 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-6br6z" podUID="c5cf796f-2064-4662-9918-919a6d58e027" containerName="kube-rbac-proxy" containerID="cri-o://ac79282debaea2750c2d8aba11e07460b1c1e5b7d26bc1c2170c7d3b468331a9" gracePeriod=30
Oct 30 21:44:04.827429 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:04.827396    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/korrel8r-5cbcc89b8f-nfph4"]
Oct 30 21:44:04.827665 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:04.827639    4060 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-nfph4" podUID="13545120-2b3f-445d-bb4c-02c5a3b34c4b" containerName="korrel8r" containerID="cri-o://0a1d72b47618ff98b7c08a5747a44665bde1c70ea1e3d6f7c1a27ad593cae159" gracePeriod=30
Oct 30 21:44:04.952484 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:04.952462    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-6br6z"
Oct 30 21:44:05.022100 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:05.022070    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/c5cf796f-2064-4662-9918-919a6d58e027-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c5cf796f-2064-4662-9918-919a6d58e027-kube-rbac-proxy-config\") pod \"c5cf796f-2064-4662-9918-919a6d58e027\" (UID: \"c5cf796f-2064-4662-9918-919a6d58e027\") "
Oct 30 21:44:05.022293 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:05.022159    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/c5cf796f-2064-4662-9918-919a6d58e027-tls\" (UniqueName: \"kubernetes.io/secret/c5cf796f-2064-4662-9918-919a6d58e027-tls\") pod \"c5cf796f-2064-4662-9918-919a6d58e027\" (UID: \"c5cf796f-2064-4662-9918-919a6d58e027\") "
Oct 30 21:44:05.022293 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:05.022255    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/c5cf796f-2064-4662-9918-919a6d58e027-prometheus-client-cert\" (UniqueName: \"kubernetes.io/secret/c5cf796f-2064-4662-9918-919a6d58e027-prometheus-client-cert\") pod \"c5cf796f-2064-4662-9918-919a6d58e027\" (UID: \"c5cf796f-2064-4662-9918-919a6d58e027\") "
Oct 30 21:44:05.022426 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:05.022308    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c5cf796f-2064-4662-9918-919a6d58e027-kube-api-access-xrv7l\" (UniqueName: \"kubernetes.io/projected/c5cf796f-2064-4662-9918-919a6d58e027-kube-api-access-xrv7l\") pod \"c5cf796f-2064-4662-9918-919a6d58e027\" (UID: \"c5cf796f-2064-4662-9918-919a6d58e027\") "
Oct 30 21:44:05.022426 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:05.022387    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c5cf796f-2064-4662-9918-919a6d58e027-prometheus-ca\" (UniqueName: \"kubernetes.io/configmap/c5cf796f-2064-4662-9918-919a6d58e027-prometheus-ca\") pod \"c5cf796f-2064-4662-9918-919a6d58e027\" (UID: \"c5cf796f-2064-4662-9918-919a6d58e027\") "
Oct 30 21:44:05.022976 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:05.022942    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c5cf796f-2064-4662-9918-919a6d58e027-prometheus-ca" pod "c5cf796f-2064-4662-9918-919a6d58e027" (UID: "c5cf796f-2064-4662-9918-919a6d58e027"). InnerVolumeSpecName "prometheus-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:44:05.024599 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:05.024525    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c5cf796f-2064-4662-9918-919a6d58e027-kube-api-access-xrv7l" pod "c5cf796f-2064-4662-9918-919a6d58e027" (UID: "c5cf796f-2064-4662-9918-919a6d58e027"). InnerVolumeSpecName "kube-api-access-xrv7l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:44:05.024751 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:05.024725    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c5cf796f-2064-4662-9918-919a6d58e027-prometheus-client-cert" pod "c5cf796f-2064-4662-9918-919a6d58e027" (UID: "c5cf796f-2064-4662-9918-919a6d58e027"). InnerVolumeSpecName "prometheus-client-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:44:05.024797 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:05.024771    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c5cf796f-2064-4662-9918-919a6d58e027-tls" pod "c5cf796f-2064-4662-9918-919a6d58e027" (UID: "c5cf796f-2064-4662-9918-919a6d58e027"). InnerVolumeSpecName "tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:44:05.025260 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:05.025244    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c5cf796f-2064-4662-9918-919a6d58e027-kube-rbac-proxy-config" pod "c5cf796f-2064-4662-9918-919a6d58e027" (UID: "c5cf796f-2064-4662-9918-919a6d58e027"). InnerVolumeSpecName "kube-rbac-proxy-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:44:05.061340 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:05.061320    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-nfph4"
Oct 30 21:44:05.123902 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:05.123870    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/13545120-2b3f-445d-bb4c-02c5a3b34c4b-config\" (UniqueName: \"kubernetes.io/configmap/13545120-2b3f-445d-bb4c-02c5a3b34c4b-config\") pod \"13545120-2b3f-445d-bb4c-02c5a3b34c4b\" (UID: \"13545120-2b3f-445d-bb4c-02c5a3b34c4b\") "
Oct 30 21:44:05.124088 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:05.123915    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/13545120-2b3f-445d-bb4c-02c5a3b34c4b-kube-api-access-sb2j8\" (UniqueName: \"kubernetes.io/projected/13545120-2b3f-445d-bb4c-02c5a3b34c4b-kube-api-access-sb2j8\") pod \"13545120-2b3f-445d-bb4c-02c5a3b34c4b\" (UID: \"13545120-2b3f-445d-bb4c-02c5a3b34c4b\") "
Oct 30 21:44:05.124088 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:05.124049    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/13545120-2b3f-445d-bb4c-02c5a3b34c4b-tls\" (UniqueName: \"kubernetes.io/secret/13545120-2b3f-445d-bb4c-02c5a3b34c4b-tls\") pod \"13545120-2b3f-445d-bb4c-02c5a3b34c4b\" (UID: \"13545120-2b3f-445d-bb4c-02c5a3b34c4b\") "
Oct 30 21:44:05.124284 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:05.124262    4060 reconciler_common.go:299] "Volume detached for volume \"prometheus-ca\" (UniqueName: \"kubernetes.io/configmap/c5cf796f-2064-4662-9918-919a6d58e027-prometheus-ca\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:44:05.124284 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:05.124286    4060 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c5cf796f-2064-4662-9918-919a6d58e027-kube-rbac-proxy-config\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:44:05.124481 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:05.124302    4060 reconciler_common.go:299] "Volume detached for volume \"tls\" (UniqueName: \"kubernetes.io/secret/c5cf796f-2064-4662-9918-919a6d58e027-tls\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:44:05.124481 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:05.124315    4060 reconciler_common.go:299] "Volume detached for volume \"prometheus-client-cert\" (UniqueName: \"kubernetes.io/secret/c5cf796f-2064-4662-9918-919a6d58e027-prometheus-client-cert\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:44:05.124481 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:05.124318    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/13545120-2b3f-445d-bb4c-02c5a3b34c4b-config" pod "13545120-2b3f-445d-bb4c-02c5a3b34c4b" (UID: "13545120-2b3f-445d-bb4c-02c5a3b34c4b"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:44:05.124481 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:05.124331    4060 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xrv7l\" (UniqueName: \"kubernetes.io/projected/c5cf796f-2064-4662-9918-919a6d58e027-kube-api-access-xrv7l\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:44:05.126105 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:05.126077    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/13545120-2b3f-445d-bb4c-02c5a3b34c4b-tls" pod "13545120-2b3f-445d-bb4c-02c5a3b34c4b" (UID: "13545120-2b3f-445d-bb4c-02c5a3b34c4b"). InnerVolumeSpecName "tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:44:05.126228 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:05.126169    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/13545120-2b3f-445d-bb4c-02c5a3b34c4b-kube-api-access-sb2j8" pod "13545120-2b3f-445d-bb4c-02c5a3b34c4b" (UID: "13545120-2b3f-445d-bb4c-02c5a3b34c4b"). InnerVolumeSpecName "kube-api-access-sb2j8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:44:05.225249 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:05.225217    4060 reconciler_common.go:299] "Volume detached for volume \"tls\" (UniqueName: \"kubernetes.io/secret/13545120-2b3f-445d-bb4c-02c5a3b34c4b-tls\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:44:05.225249 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:05.225251    4060 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/13545120-2b3f-445d-bb4c-02c5a3b34c4b-config\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:44:05.225448 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:05.225266    4060 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sb2j8\" (UniqueName: \"kubernetes.io/projected/13545120-2b3f-445d-bb4c-02c5a3b34c4b-kube-api-access-sb2j8\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:44:05.693273 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:05.693182    4060 generic.go:356] "Generic (PLEG): container finished" podID="c5cf796f-2064-4662-9918-919a6d58e027" containerID="ac79282debaea2750c2d8aba11e07460b1c1e5b7d26bc1c2170c7d3b468331a9" exitCode=0
Oct 30 21:44:05.693273 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:05.693236    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-6br6z"
Oct 30 21:44:05.693817 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:05.693271    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-6br6z" event={"ID":"c5cf796f-2064-4662-9918-919a6d58e027","Type":"ContainerDied","Data":"ac79282debaea2750c2d8aba11e07460b1c1e5b7d26bc1c2170c7d3b468331a9"}
Oct 30 21:44:05.693817 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:05.693320    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-6br6z" event={"ID":"c5cf796f-2064-4662-9918-919a6d58e027","Type":"ContainerDied","Data":"f1c720d3a73144aa08dfed2bbbb37e68b2d47dbded7242488070f16d7bcd3672"}
Oct 30 21:44:05.693817 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:05.693348    4060 scope.go:122] "RemoveContainer" containerID="ac79282debaea2750c2d8aba11e07460b1c1e5b7d26bc1c2170c7d3b468331a9"
Oct 30 21:44:05.694834 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:05.694813    4060 generic.go:356] "Generic (PLEG): container finished" podID="13545120-2b3f-445d-bb4c-02c5a3b34c4b" containerID="0a1d72b47618ff98b7c08a5747a44665bde1c70ea1e3d6f7c1a27ad593cae159" exitCode=0
Oct 30 21:44:05.694905 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:05.694856    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-nfph4"
Oct 30 21:44:05.694961 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:05.694914    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-nfph4" event={"ID":"13545120-2b3f-445d-bb4c-02c5a3b34c4b","Type":"ContainerDied","Data":"0a1d72b47618ff98b7c08a5747a44665bde1c70ea1e3d6f7c1a27ad593cae159"}
Oct 30 21:44:05.694995 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:05.694957    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-nfph4" event={"ID":"13545120-2b3f-445d-bb4c-02c5a3b34c4b","Type":"ContainerDied","Data":"62e4595beebd1754c711b0cdb03d1f28b34b3bf149e46404cf6ba62b25c623fb"}
Oct 30 21:44:05.702468 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:05.702428    4060 scope.go:122] "RemoveContainer" containerID="ac79282debaea2750c2d8aba11e07460b1c1e5b7d26bc1c2170c7d3b468331a9"
Oct 30 21:44:05.702744 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:44:05.702726    4060 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ac79282debaea2750c2d8aba11e07460b1c1e5b7d26bc1c2170c7d3b468331a9\": container with ID starting with ac79282debaea2750c2d8aba11e07460b1c1e5b7d26bc1c2170c7d3b468331a9 not found: ID does not exist" containerID="ac79282debaea2750c2d8aba11e07460b1c1e5b7d26bc1c2170c7d3b468331a9"
Oct 30 21:44:05.702800 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:05.702757    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac79282debaea2750c2d8aba11e07460b1c1e5b7d26bc1c2170c7d3b468331a9"} err="failed to get container status \"ac79282debaea2750c2d8aba11e07460b1c1e5b7d26bc1c2170c7d3b468331a9\": rpc error: code = NotFound desc = could not find container \"ac79282debaea2750c2d8aba11e07460b1c1e5b7d26bc1c2170c7d3b468331a9\": container with ID starting with ac79282debaea2750c2d8aba11e07460b1c1e5b7d26bc1c2170c7d3b468331a9 not found: ID does not exist"
Oct 30 21:44:05.702800 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:05.702774    4060 scope.go:122] "RemoveContainer" containerID="0a1d72b47618ff98b7c08a5747a44665bde1c70ea1e3d6f7c1a27ad593cae159"
Oct 30 21:44:05.710666 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:05.710648    4060 scope.go:122] "RemoveContainer" containerID="0a1d72b47618ff98b7c08a5747a44665bde1c70ea1e3d6f7c1a27ad593cae159"
Oct 30 21:44:05.710939 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:44:05.710921    4060 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0a1d72b47618ff98b7c08a5747a44665bde1c70ea1e3d6f7c1a27ad593cae159\": container with ID starting with 0a1d72b47618ff98b7c08a5747a44665bde1c70ea1e3d6f7c1a27ad593cae159 not found: ID does not exist" containerID="0a1d72b47618ff98b7c08a5747a44665bde1c70ea1e3d6f7c1a27ad593cae159"
Oct 30 21:44:05.710995 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:05.710946    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0a1d72b47618ff98b7c08a5747a44665bde1c70ea1e3d6f7c1a27ad593cae159"} err="failed to get container status \"0a1d72b47618ff98b7c08a5747a44665bde1c70ea1e3d6f7c1a27ad593cae159\": rpc error: code = NotFound desc = could not find container \"0a1d72b47618ff98b7c08a5747a44665bde1c70ea1e3d6f7c1a27ad593cae159\": container with ID starting with 0a1d72b47618ff98b7c08a5747a44665bde1c70ea1e3d6f7c1a27ad593cae159 not found: ID does not exist"
Oct 30 21:44:05.821942 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:05.821909    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-w6ndk"]
Oct 30 21:44:05.822110 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:05.822074    4060 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-w6ndk" podUID="bfc42f46-be94-443f-86d3-4d7457a1c66c" containerName="thanos-querier" containerID="cri-o://09dc23ed00acf1f61aa844f81009175848c000d1ee29eb1f7fd3540e74f82b46" gracePeriod=30
Oct 30 21:44:05.882713 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:05.882684    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-6br6z"]
Oct 30 21:44:05.895683 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:05.895646    4060 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-6br6z"]
Oct 30 21:44:06.006799 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:06.006770    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/korrel8r-5cbcc89b8f-nfph4"]
Oct 30 21:44:06.011280 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:06.011250    4060 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/korrel8r-5cbcc89b8f-nfph4"]
Oct 30 21:44:06.062306 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:06.062286    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-w6ndk"
Oct 30 21:44:06.132250 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:06.132208    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/bfc42f46-be94-443f-86d3-4d7457a1c66c-kube-api-access-htctx\" (UniqueName: \"kubernetes.io/projected/bfc42f46-be94-443f-86d3-4d7457a1c66c-kube-api-access-htctx\") pod \"bfc42f46-be94-443f-86d3-4d7457a1c66c\" (UID: \"bfc42f46-be94-443f-86d3-4d7457a1c66c\") "
Oct 30 21:44:06.134270 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:06.134238    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bfc42f46-be94-443f-86d3-4d7457a1c66c-kube-api-access-htctx" pod "bfc42f46-be94-443f-86d3-4d7457a1c66c" (UID: "bfc42f46-be94-443f-86d3-4d7457a1c66c"). InnerVolumeSpecName "kube-api-access-htctx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:44:06.232704 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:06.232675    4060 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-htctx\" (UniqueName: \"kubernetes.io/projected/bfc42f46-be94-443f-86d3-4d7457a1c66c-kube-api-access-htctx\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:44:06.702151 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:06.702118    4060 generic.go:356] "Generic (PLEG): container finished" podID="bfc42f46-be94-443f-86d3-4d7457a1c66c" containerID="09dc23ed00acf1f61aa844f81009175848c000d1ee29eb1f7fd3540e74f82b46" exitCode=0
Oct 30 21:44:06.702151 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:06.702154    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-w6ndk"
Oct 30 21:44:06.702675 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:06.702175    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-w6ndk" event={"ID":"bfc42f46-be94-443f-86d3-4d7457a1c66c","Type":"ContainerDied","Data":"09dc23ed00acf1f61aa844f81009175848c000d1ee29eb1f7fd3540e74f82b46"}
Oct 30 21:44:06.702675 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:06.702211    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-w6ndk" event={"ID":"bfc42f46-be94-443f-86d3-4d7457a1c66c","Type":"ContainerDied","Data":"c5b95ee49f7d8bc8e21878bac83be750755e2fb08c93eb2bfb0eb77e162f00e8"}
Oct 30 21:44:06.702675 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:06.702232    4060 scope.go:122] "RemoveContainer" containerID="09dc23ed00acf1f61aa844f81009175848c000d1ee29eb1f7fd3540e74f82b46"
Oct 30 21:44:06.711375 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:06.711339    4060 scope.go:122] "RemoveContainer" containerID="09dc23ed00acf1f61aa844f81009175848c000d1ee29eb1f7fd3540e74f82b46"
Oct 30 21:44:06.711650 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:44:06.711632    4060 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"09dc23ed00acf1f61aa844f81009175848c000d1ee29eb1f7fd3540e74f82b46\": container with ID starting with 09dc23ed00acf1f61aa844f81009175848c000d1ee29eb1f7fd3540e74f82b46 not found: ID does not exist" containerID="09dc23ed00acf1f61aa844f81009175848c000d1ee29eb1f7fd3540e74f82b46"
Oct 30 21:44:06.711711 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:06.711660    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"09dc23ed00acf1f61aa844f81009175848c000d1ee29eb1f7fd3540e74f82b46"} err="failed to get container status \"09dc23ed00acf1f61aa844f81009175848c000d1ee29eb1f7fd3540e74f82b46\": rpc error: code = NotFound desc = could not find container \"09dc23ed00acf1f61aa844f81009175848c000d1ee29eb1f7fd3540e74f82b46\": container with ID starting with 09dc23ed00acf1f61aa844f81009175848c000d1ee29eb1f7fd3540e74f82b46 not found: ID does not exist"
Oct 30 21:44:06.869410 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:06.869375    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-w6ndk"]
Oct 30 21:44:06.879535 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:06.877188    4060 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-w6ndk"]
Oct 30 21:44:06.942825 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:06.942787    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"]
Oct 30 21:44:06.943110 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:06.943084    4060 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0" podUID="8ec52a7c-c49d-42f2-906a-824dfa80be19" containerName="alertmanager" containerID="cri-o://8619ddc0d101e448e22f6e9b3e5c357375287b0ba677b32b110e88c6d1a30c4d" gracePeriod=120
Oct 30 21:44:06.943220 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:06.943113    4060 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0" podUID="8ec52a7c-c49d-42f2-906a-824dfa80be19" containerName="config-reloader" containerID="cri-o://971ccc0e1233ea571c2801253e0f3582d4713f9597d8ccf4fceef6e1381760d0" gracePeriod=120
Oct 30 21:44:06.947824 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:06.947800    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"]
Oct 30 21:44:06.948056 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:06.948030    4060 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0" podUID="2f6bc90c-dc24-4dac-abb8-d2af9a293d7c" containerName="prometheus" containerID="cri-o://59730cc31db0c9223066529d7c6ee3f9ef6aea477bca5618de5faf9243282541" gracePeriod=600
Oct 30 21:44:06.948056 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:06.948041    4060 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0" podUID="2f6bc90c-dc24-4dac-abb8-d2af9a293d7c" containerName="thanos-sidecar" containerID="cri-o://de859dcaba757c5e747b2a9c93dfe85e66c5b8689bac5bc3473b81ccb12498b3" gracePeriod=600
Oct 30 21:44:06.948056 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:06.948058    4060 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0" podUID="2f6bc90c-dc24-4dac-abb8-d2af9a293d7c" containerName="config-reloader" containerID="cri-o://d1fbcc021580be88f17c7f5658dc107983c76f3b3d5c8d9d3e8deb7c213d9fe9" gracePeriod=600
Oct 30 21:44:07.213082 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:07.213017    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:44:07.242716 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:07.242686    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/2f6bc90c-dc24-4dac-abb8-d2af9a293d7c-config\" (UniqueName: \"kubernetes.io/secret/2f6bc90c-dc24-4dac-abb8-d2af9a293d7c-config\") pod \"2f6bc90c-dc24-4dac-abb8-d2af9a293d7c\" (UID: \"2f6bc90c-dc24-4dac-abb8-d2af9a293d7c\") "
Oct 30 21:44:07.242831 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:07.242723    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/2f6bc90c-dc24-4dac-abb8-d2af9a293d7c-web-config-tls-secret-cert-prometheus-operated-tls-f3457c70\" (UniqueName: \"kubernetes.io/secret/2f6bc90c-dc24-4dac-abb8-d2af9a293d7c-web-config-tls-secret-cert-prometheus-operated-tls-f3457c70\") pod \"2f6bc90c-dc24-4dac-abb8-d2af9a293d7c\" (UID: \"2f6bc90c-dc24-4dac-abb8-d2af9a293d7c\") "
Oct 30 21:44:07.242831 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:07.242767    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2f6bc90c-dc24-4dac-abb8-d2af9a293d7c-config-out\" (UniqueName: \"kubernetes.io/empty-dir/2f6bc90c-dc24-4dac-abb8-d2af9a293d7c-config-out\") pod \"2f6bc90c-dc24-4dac-abb8-d2af9a293d7c\" (UID: \"2f6bc90c-dc24-4dac-abb8-d2af9a293d7c\") "
Oct 30 21:44:07.242831 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:07.242786    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2f6bc90c-dc24-4dac-abb8-d2af9a293d7c-kube-api-access-m2md9\" (UniqueName: \"kubernetes.io/projected/2f6bc90c-dc24-4dac-abb8-d2af9a293d7c-kube-api-access-m2md9\") pod \"2f6bc90c-dc24-4dac-abb8-d2af9a293d7c\" (UID: \"2f6bc90c-dc24-4dac-abb8-d2af9a293d7c\") "
Oct 30 21:44:07.242831 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:07.242826    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2f6bc90c-dc24-4dac-abb8-d2af9a293d7c-prometheus-data-science-monitoringstack-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/2f6bc90c-dc24-4dac-abb8-d2af9a293d7c-prometheus-data-science-monitoringstack-rulefiles-1\") pod \"2f6bc90c-dc24-4dac-abb8-d2af9a293d7c\" (UID: \"2f6bc90c-dc24-4dac-abb8-d2af9a293d7c\") "
Oct 30 21:44:07.243045 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:07.242863    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2f6bc90c-dc24-4dac-abb8-d2af9a293d7c-prometheus-data-science-monitoringstack-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2f6bc90c-dc24-4dac-abb8-d2af9a293d7c-prometheus-data-science-monitoringstack-rulefiles-0\") pod \"2f6bc90c-dc24-4dac-abb8-d2af9a293d7c\" (UID: \"2f6bc90c-dc24-4dac-abb8-d2af9a293d7c\") "
Oct 30 21:44:07.243045 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:07.242887    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2f6bc90c-dc24-4dac-abb8-d2af9a293d7c-tls-assets\" (UniqueName: \"kubernetes.io/projected/2f6bc90c-dc24-4dac-abb8-d2af9a293d7c-tls-assets\") pod \"2f6bc90c-dc24-4dac-abb8-d2af9a293d7c\" (UID: \"2f6bc90c-dc24-4dac-abb8-d2af9a293d7c\") "
Oct 30 21:44:07.243045 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:07.242930    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/2f6bc90c-dc24-4dac-abb8-d2af9a293d7c-secret-prometheus-web-tls-ca\" (UniqueName: \"kubernetes.io/secret/2f6bc90c-dc24-4dac-abb8-d2af9a293d7c-secret-prometheus-web-tls-ca\") pod \"2f6bc90c-dc24-4dac-abb8-d2af9a293d7c\" (UID: \"2f6bc90c-dc24-4dac-abb8-d2af9a293d7c\") "
Oct 30 21:44:07.243045 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:07.242963    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/2f6bc90c-dc24-4dac-abb8-d2af9a293d7c-web-config\" (UniqueName: \"kubernetes.io/secret/2f6bc90c-dc24-4dac-abb8-d2af9a293d7c-web-config\") pod \"2f6bc90c-dc24-4dac-abb8-d2af9a293d7c\" (UID: \"2f6bc90c-dc24-4dac-abb8-d2af9a293d7c\") "
Oct 30 21:44:07.243317 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:07.243277    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2f6bc90c-dc24-4dac-abb8-d2af9a293d7c-prometheus-data-science-monitoringstack-rulefiles-1" pod "2f6bc90c-dc24-4dac-abb8-d2af9a293d7c" (UID: "2f6bc90c-dc24-4dac-abb8-d2af9a293d7c"). InnerVolumeSpecName "prometheus-data-science-monitoringstack-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:44:07.243669 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:07.243639    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/2f6bc90c-dc24-4dac-abb8-d2af9a293d7c-thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2f6bc90c-dc24-4dac-abb8-d2af9a293d7c-thanos-prometheus-http-client-file\") pod \"2f6bc90c-dc24-4dac-abb8-d2af9a293d7c\" (UID: \"2f6bc90c-dc24-4dac-abb8-d2af9a293d7c\") "
Oct 30 21:44:07.243892 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:07.243869    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a155a55c1ce0e65b\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a155a55c1ce0e65b\") pod \"2f6bc90c-dc24-4dac-abb8-d2af9a293d7c\" (UID: \"2f6bc90c-dc24-4dac-abb8-d2af9a293d7c\") "
Oct 30 21:44:07.243972 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:07.243919    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/2f6bc90c-dc24-4dac-abb8-d2af9a293d7c-web-config-tls-secret-key-prometheus-operated-tls-f3457c70\" (UniqueName: \"kubernetes.io/secret/2f6bc90c-dc24-4dac-abb8-d2af9a293d7c-web-config-tls-secret-key-prometheus-operated-tls-f3457c70\") pod \"2f6bc90c-dc24-4dac-abb8-d2af9a293d7c\" (UID: \"2f6bc90c-dc24-4dac-abb8-d2af9a293d7c\") "
Oct 30 21:44:07.243972 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:07.243953    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2f6bc90c-dc24-4dac-abb8-d2af9a293d7c-prometheus-data-science-monitoringstack-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/2f6bc90c-dc24-4dac-abb8-d2af9a293d7c-prometheus-data-science-monitoringstack-rulefiles-2\") pod \"2f6bc90c-dc24-4dac-abb8-d2af9a293d7c\" (UID: \"2f6bc90c-dc24-4dac-abb8-d2af9a293d7c\") "
Oct 30 21:44:07.244168 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:07.244143    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2f6bc90c-dc24-4dac-abb8-d2af9a293d7c-prometheus-data-science-monitoringstack-rulefiles-0" pod "2f6bc90c-dc24-4dac-abb8-d2af9a293d7c" (UID: "2f6bc90c-dc24-4dac-abb8-d2af9a293d7c"). InnerVolumeSpecName "prometheus-data-science-monitoringstack-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:44:07.244268 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:07.244222    4060 reconciler_common.go:299] "Volume detached for volume \"prometheus-data-science-monitoringstack-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/2f6bc90c-dc24-4dac-abb8-d2af9a293d7c-prometheus-data-science-monitoringstack-rulefiles-1\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:44:07.244579 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:07.244541    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2f6bc90c-dc24-4dac-abb8-d2af9a293d7c-prometheus-data-science-monitoringstack-rulefiles-2" pod "2f6bc90c-dc24-4dac-abb8-d2af9a293d7c" (UID: "2f6bc90c-dc24-4dac-abb8-d2af9a293d7c"). InnerVolumeSpecName "prometheus-data-science-monitoringstack-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:44:07.245581 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:07.245550    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2f6bc90c-dc24-4dac-abb8-d2af9a293d7c-kube-api-access-m2md9" pod "2f6bc90c-dc24-4dac-abb8-d2af9a293d7c" (UID: "2f6bc90c-dc24-4dac-abb8-d2af9a293d7c"). InnerVolumeSpecName "kube-api-access-m2md9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:44:07.245701 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:07.245645    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2f6bc90c-dc24-4dac-abb8-d2af9a293d7c-web-config-tls-secret-cert-prometheus-operated-tls-f3457c70" pod "2f6bc90c-dc24-4dac-abb8-d2af9a293d7c" (UID: "2f6bc90c-dc24-4dac-abb8-d2af9a293d7c"). InnerVolumeSpecName "web-config-tls-secret-cert-prometheus-operated-tls-f3457c70". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:44:07.245769 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:07.245703    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2f6bc90c-dc24-4dac-abb8-d2af9a293d7c-secret-prometheus-web-tls-ca" pod "2f6bc90c-dc24-4dac-abb8-d2af9a293d7c" (UID: "2f6bc90c-dc24-4dac-abb8-d2af9a293d7c"). InnerVolumeSpecName "secret-prometheus-web-tls-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:44:07.245769 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:07.245747    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f6bc90c-dc24-4dac-abb8-d2af9a293d7c-config-out" pod "2f6bc90c-dc24-4dac-abb8-d2af9a293d7c" (UID: "2f6bc90c-dc24-4dac-abb8-d2af9a293d7c"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:44:07.246070 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:07.246050    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2f6bc90c-dc24-4dac-abb8-d2af9a293d7c-config" pod "2f6bc90c-dc24-4dac-abb8-d2af9a293d7c" (UID: "2f6bc90c-dc24-4dac-abb8-d2af9a293d7c"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:44:07.246973 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:07.246946    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2f6bc90c-dc24-4dac-abb8-d2af9a293d7c-tls-assets" pod "2f6bc90c-dc24-4dac-abb8-d2af9a293d7c" (UID: "2f6bc90c-dc24-4dac-abb8-d2af9a293d7c"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:44:07.247216 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:07.247191    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2f6bc90c-dc24-4dac-abb8-d2af9a293d7c-web-config-tls-secret-key-prometheus-operated-tls-f3457c70" pod "2f6bc90c-dc24-4dac-abb8-d2af9a293d7c" (UID: "2f6bc90c-dc24-4dac-abb8-d2af9a293d7c"). InnerVolumeSpecName "web-config-tls-secret-key-prometheus-operated-tls-f3457c70". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:44:07.247296 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:07.247276    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2f6bc90c-dc24-4dac-abb8-d2af9a293d7c-thanos-prometheus-http-client-file" pod "2f6bc90c-dc24-4dac-abb8-d2af9a293d7c" (UID: "2f6bc90c-dc24-4dac-abb8-d2af9a293d7c"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:44:07.250021 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:07.249999    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/csi/ebs.csi.aws.com^vol-0a155a55c1ce0e65b" pod "2f6bc90c-dc24-4dac-abb8-d2af9a293d7c" (UID: "2f6bc90c-dc24-4dac-abb8-d2af9a293d7c"). InnerVolumeSpecName "pvc-e73afc79-aa37-49a0-8744-633c03cad1f4". PluginName "kubernetes.io/csi", VolumeGIDValue ""
Oct 30 21:44:07.256630 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:07.256613    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2f6bc90c-dc24-4dac-abb8-d2af9a293d7c-web-config" pod "2f6bc90c-dc24-4dac-abb8-d2af9a293d7c" (UID: "2f6bc90c-dc24-4dac-abb8-d2af9a293d7c"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:44:07.344689 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:07.344659    4060 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2f6bc90c-dc24-4dac-abb8-d2af9a293d7c-thanos-prometheus-http-client-file\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:44:07.344824 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:07.344702    4060 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"pvc-e73afc79-aa37-49a0-8744-633c03cad1f4\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a155a55c1ce0e65b\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" "
Oct 30 21:44:07.344824 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:07.344716    4060 reconciler_common.go:299] "Volume detached for volume \"web-config-tls-secret-key-prometheus-operated-tls-f3457c70\" (UniqueName: \"kubernetes.io/secret/2f6bc90c-dc24-4dac-abb8-d2af9a293d7c-web-config-tls-secret-key-prometheus-operated-tls-f3457c70\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:44:07.344824 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:07.344726    4060 reconciler_common.go:299] "Volume detached for volume \"prometheus-data-science-monitoringstack-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/2f6bc90c-dc24-4dac-abb8-d2af9a293d7c-prometheus-data-science-monitoringstack-rulefiles-2\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:44:07.344824 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:07.344736    4060 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/2f6bc90c-dc24-4dac-abb8-d2af9a293d7c-config\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:44:07.344824 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:07.344746    4060 reconciler_common.go:299] "Volume detached for volume \"web-config-tls-secret-cert-prometheus-operated-tls-f3457c70\" (UniqueName: \"kubernetes.io/secret/2f6bc90c-dc24-4dac-abb8-d2af9a293d7c-web-config-tls-secret-cert-prometheus-operated-tls-f3457c70\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:44:07.344824 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:07.344755    4060 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2f6bc90c-dc24-4dac-abb8-d2af9a293d7c-config-out\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:44:07.344824 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:07.344764    4060 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m2md9\" (UniqueName: \"kubernetes.io/projected/2f6bc90c-dc24-4dac-abb8-d2af9a293d7c-kube-api-access-m2md9\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:44:07.344824 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:07.344773    4060 reconciler_common.go:299] "Volume detached for volume \"prometheus-data-science-monitoringstack-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2f6bc90c-dc24-4dac-abb8-d2af9a293d7c-prometheus-data-science-monitoringstack-rulefiles-0\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:44:07.344824 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:07.344782    4060 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2f6bc90c-dc24-4dac-abb8-d2af9a293d7c-tls-assets\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:44:07.344824 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:07.344790    4060 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-web-tls-ca\" (UniqueName: \"kubernetes.io/secret/2f6bc90c-dc24-4dac-abb8-d2af9a293d7c-secret-prometheus-web-tls-ca\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:44:07.344824 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:07.344798    4060 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2f6bc90c-dc24-4dac-abb8-d2af9a293d7c-web-config\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:44:07.356525 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:07.356483    4060 operation_generator.go:893] UnmountDevice succeeded for volume "pvc-e73afc79-aa37-49a0-8744-633c03cad1f4" (UniqueName: "kubernetes.io/csi/ebs.csi.aws.com^vol-0a155a55c1ce0e65b") on node "ip-10-0-142-4.us-west-1.compute.internal"
Oct 30 21:44:07.430672 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:07.430634    4060 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="13545120-2b3f-445d-bb4c-02c5a3b34c4b" path="/var/lib/kubelet/pods/13545120-2b3f-445d-bb4c-02c5a3b34c4b/volumes"
Oct 30 21:44:07.431055 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:07.431035    4060 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="bfc42f46-be94-443f-86d3-4d7457a1c66c" path="/var/lib/kubelet/pods/bfc42f46-be94-443f-86d3-4d7457a1c66c/volumes"
Oct 30 21:44:07.431436 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:07.431418    4060 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c5cf796f-2064-4662-9918-919a6d58e027" path="/var/lib/kubelet/pods/c5cf796f-2064-4662-9918-919a6d58e027/volumes"
Oct 30 21:44:07.446013 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:07.445991    4060 reconciler_common.go:299] "Volume detached for volume \"pvc-e73afc79-aa37-49a0-8744-633c03cad1f4\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a155a55c1ce0e65b\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"csi-7011c01335d2502f76be252f9498c79824668beecf30ee8f6a7191145201ca4c\""
Oct 30 21:44:07.581852 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:07.581828    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:44:07.647486 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:07.647456    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/8ec52a7c-c49d-42f2-906a-824dfa80be19-config-volume\" (UniqueName: \"kubernetes.io/secret/8ec52a7c-c49d-42f2-906a-824dfa80be19-config-volume\") pod \"8ec52a7c-c49d-42f2-906a-824dfa80be19\" (UID: \"8ec52a7c-c49d-42f2-906a-824dfa80be19\") "
Oct 30 21:44:07.647631 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:07.647536    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8ec52a7c-c49d-42f2-906a-824dfa80be19-tls-assets\" (UniqueName: \"kubernetes.io/projected/8ec52a7c-c49d-42f2-906a-824dfa80be19-tls-assets\") pod \"8ec52a7c-c49d-42f2-906a-824dfa80be19\" (UID: \"8ec52a7c-c49d-42f2-906a-824dfa80be19\") "
Oct 30 21:44:07.647631 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:07.647555    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8ec52a7c-c49d-42f2-906a-824dfa80be19-config-out\" (UniqueName: \"kubernetes.io/empty-dir/8ec52a7c-c49d-42f2-906a-824dfa80be19-config-out\") pod \"8ec52a7c-c49d-42f2-906a-824dfa80be19\" (UID: \"8ec52a7c-c49d-42f2-906a-824dfa80be19\") "
Oct 30 21:44:07.647631 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:07.647586    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8ec52a7c-c49d-42f2-906a-824dfa80be19-alertmanager-data-science-monitoringstack-db\" (UniqueName: \"kubernetes.io/empty-dir/8ec52a7c-c49d-42f2-906a-824dfa80be19-alertmanager-data-science-monitoringstack-db\") pod \"8ec52a7c-c49d-42f2-906a-824dfa80be19\" (UID: \"8ec52a7c-c49d-42f2-906a-824dfa80be19\") "
Oct 30 21:44:07.647631 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:07.647616    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8ec52a7c-c49d-42f2-906a-824dfa80be19-kube-api-access-k25dw\" (UniqueName: \"kubernetes.io/projected/8ec52a7c-c49d-42f2-906a-824dfa80be19-kube-api-access-k25dw\") pod \"8ec52a7c-c49d-42f2-906a-824dfa80be19\" (UID: \"8ec52a7c-c49d-42f2-906a-824dfa80be19\") "
Oct 30 21:44:07.647867 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:07.647703    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/8ec52a7c-c49d-42f2-906a-824dfa80be19-web-config\" (UniqueName: \"kubernetes.io/secret/8ec52a7c-c49d-42f2-906a-824dfa80be19-web-config\") pod \"8ec52a7c-c49d-42f2-906a-824dfa80be19\" (UID: \"8ec52a7c-c49d-42f2-906a-824dfa80be19\") "
Oct 30 21:44:07.647867 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:07.647749    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/8ec52a7c-c49d-42f2-906a-824dfa80be19-cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8ec52a7c-c49d-42f2-906a-824dfa80be19-cluster-tls-config\") pod \"8ec52a7c-c49d-42f2-906a-824dfa80be19\" (UID: \"8ec52a7c-c49d-42f2-906a-824dfa80be19\") "
Oct 30 21:44:07.648046 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:07.648019    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ec52a7c-c49d-42f2-906a-824dfa80be19-alertmanager-data-science-monitoringstack-db" pod "8ec52a7c-c49d-42f2-906a-824dfa80be19" (UID: "8ec52a7c-c49d-42f2-906a-824dfa80be19"). InnerVolumeSpecName "alertmanager-data-science-monitoringstack-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:44:07.649879 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:07.649857    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ec52a7c-c49d-42f2-906a-824dfa80be19-config-out" pod "8ec52a7c-c49d-42f2-906a-824dfa80be19" (UID: "8ec52a7c-c49d-42f2-906a-824dfa80be19"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:44:07.650089 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:07.650063    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8ec52a7c-c49d-42f2-906a-824dfa80be19-config-volume" pod "8ec52a7c-c49d-42f2-906a-824dfa80be19" (UID: "8ec52a7c-c49d-42f2-906a-824dfa80be19"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:44:07.650216 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:07.650148    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ec52a7c-c49d-42f2-906a-824dfa80be19-kube-api-access-k25dw" pod "8ec52a7c-c49d-42f2-906a-824dfa80be19" (UID: "8ec52a7c-c49d-42f2-906a-824dfa80be19"). InnerVolumeSpecName "kube-api-access-k25dw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:44:07.650216 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:07.650173    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ec52a7c-c49d-42f2-906a-824dfa80be19-tls-assets" pod "8ec52a7c-c49d-42f2-906a-824dfa80be19" (UID: "8ec52a7c-c49d-42f2-906a-824dfa80be19"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:44:07.653612 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:07.653590    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8ec52a7c-c49d-42f2-906a-824dfa80be19-cluster-tls-config" pod "8ec52a7c-c49d-42f2-906a-824dfa80be19" (UID: "8ec52a7c-c49d-42f2-906a-824dfa80be19"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:44:07.660378 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:07.660356    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8ec52a7c-c49d-42f2-906a-824dfa80be19-web-config" pod "8ec52a7c-c49d-42f2-906a-824dfa80be19" (UID: "8ec52a7c-c49d-42f2-906a-824dfa80be19"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:44:07.709815 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:07.709783    4060 generic.go:356] "Generic (PLEG): container finished" podID="2f6bc90c-dc24-4dac-abb8-d2af9a293d7c" containerID="de859dcaba757c5e747b2a9c93dfe85e66c5b8689bac5bc3473b81ccb12498b3" exitCode=0
Oct 30 21:44:07.709815 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:07.709812    4060 generic.go:356] "Generic (PLEG): container finished" podID="2f6bc90c-dc24-4dac-abb8-d2af9a293d7c" containerID="d1fbcc021580be88f17c7f5658dc107983c76f3b3d5c8d9d3e8deb7c213d9fe9" exitCode=0
Oct 30 21:44:07.710429 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:07.709822    4060 generic.go:356] "Generic (PLEG): container finished" podID="2f6bc90c-dc24-4dac-abb8-d2af9a293d7c" containerID="59730cc31db0c9223066529d7c6ee3f9ef6aea477bca5618de5faf9243282541" exitCode=0
Oct 30 21:44:07.710429 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:07.709860    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:44:07.710429 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:07.709862    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0" event={"ID":"2f6bc90c-dc24-4dac-abb8-d2af9a293d7c","Type":"ContainerDied","Data":"de859dcaba757c5e747b2a9c93dfe85e66c5b8689bac5bc3473b81ccb12498b3"}
Oct 30 21:44:07.710429 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:07.709924    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0" event={"ID":"2f6bc90c-dc24-4dac-abb8-d2af9a293d7c","Type":"ContainerDied","Data":"d1fbcc021580be88f17c7f5658dc107983c76f3b3d5c8d9d3e8deb7c213d9fe9"}
Oct 30 21:44:07.710429 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:07.709951    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0" event={"ID":"2f6bc90c-dc24-4dac-abb8-d2af9a293d7c","Type":"ContainerDied","Data":"59730cc31db0c9223066529d7c6ee3f9ef6aea477bca5618de5faf9243282541"}
Oct 30 21:44:07.710429 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:07.709982    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0" event={"ID":"2f6bc90c-dc24-4dac-abb8-d2af9a293d7c","Type":"ContainerDied","Data":"acb11a94d3a2650482a49d79915eb5e219fa21c76dcdf9163c3e9ecedc161481"}
Oct 30 21:44:07.710429 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:07.709994    4060 scope.go:122] "RemoveContainer" containerID="de859dcaba757c5e747b2a9c93dfe85e66c5b8689bac5bc3473b81ccb12498b3"
Oct 30 21:44:07.713342 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:07.713288    4060 generic.go:356] "Generic (PLEG): container finished" podID="8ec52a7c-c49d-42f2-906a-824dfa80be19" containerID="971ccc0e1233ea571c2801253e0f3582d4713f9597d8ccf4fceef6e1381760d0" exitCode=0
Oct 30 21:44:07.714303 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:07.713347    4060 generic.go:356] "Generic (PLEG): container finished" podID="8ec52a7c-c49d-42f2-906a-824dfa80be19" containerID="8619ddc0d101e448e22f6e9b3e5c357375287b0ba677b32b110e88c6d1a30c4d" exitCode=0
Oct 30 21:44:07.714303 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:07.713555    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0" event={"ID":"8ec52a7c-c49d-42f2-906a-824dfa80be19","Type":"ContainerDied","Data":"971ccc0e1233ea571c2801253e0f3582d4713f9597d8ccf4fceef6e1381760d0"}
Oct 30 21:44:07.714303 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:07.713622    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0" event={"ID":"8ec52a7c-c49d-42f2-906a-824dfa80be19","Type":"ContainerDied","Data":"8619ddc0d101e448e22f6e9b3e5c357375287b0ba677b32b110e88c6d1a30c4d"}
Oct 30 21:44:07.714303 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:07.713656    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0" event={"ID":"8ec52a7c-c49d-42f2-906a-824dfa80be19","Type":"ContainerDied","Data":"d5ee8a2b915e23688288fdc78a89d25c3d91fade5b5d86c3c7aeddc0e026b4bf"}
Oct 30 21:44:07.714303 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:07.713690    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:44:07.720448 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:07.720424    4060 scope.go:122] "RemoveContainer" containerID="d1fbcc021580be88f17c7f5658dc107983c76f3b3d5c8d9d3e8deb7c213d9fe9"
Oct 30 21:44:07.728918 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:07.728896    4060 scope.go:122] "RemoveContainer" containerID="59730cc31db0c9223066529d7c6ee3f9ef6aea477bca5618de5faf9243282541"
Oct 30 21:44:07.737088 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:07.737065    4060 scope.go:122] "RemoveContainer" containerID="80204328175c924af9d78f8e11d52693cf75a4628a0da69e5dc2188bc8b5f8bd"
Oct 30 21:44:07.744792 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:07.744775    4060 scope.go:122] "RemoveContainer" containerID="de859dcaba757c5e747b2a9c93dfe85e66c5b8689bac5bc3473b81ccb12498b3"
Oct 30 21:44:07.745032 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:44:07.745015    4060 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"de859dcaba757c5e747b2a9c93dfe85e66c5b8689bac5bc3473b81ccb12498b3\": container with ID starting with de859dcaba757c5e747b2a9c93dfe85e66c5b8689bac5bc3473b81ccb12498b3 not found: ID does not exist" containerID="de859dcaba757c5e747b2a9c93dfe85e66c5b8689bac5bc3473b81ccb12498b3"
Oct 30 21:44:07.745077 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:07.745041    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de859dcaba757c5e747b2a9c93dfe85e66c5b8689bac5bc3473b81ccb12498b3"} err="failed to get container status \"de859dcaba757c5e747b2a9c93dfe85e66c5b8689bac5bc3473b81ccb12498b3\": rpc error: code = NotFound desc = could not find container \"de859dcaba757c5e747b2a9c93dfe85e66c5b8689bac5bc3473b81ccb12498b3\": container with ID starting with de859dcaba757c5e747b2a9c93dfe85e66c5b8689bac5bc3473b81ccb12498b3 not found: ID does not exist"
Oct 30 21:44:07.745077 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:07.745064    4060 scope.go:122] "RemoveContainer" containerID="d1fbcc021580be88f17c7f5658dc107983c76f3b3d5c8d9d3e8deb7c213d9fe9"
Oct 30 21:44:07.745297 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:44:07.745281    4060 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d1fbcc021580be88f17c7f5658dc107983c76f3b3d5c8d9d3e8deb7c213d9fe9\": container with ID starting with d1fbcc021580be88f17c7f5658dc107983c76f3b3d5c8d9d3e8deb7c213d9fe9 not found: ID does not exist" containerID="d1fbcc021580be88f17c7f5658dc107983c76f3b3d5c8d9d3e8deb7c213d9fe9"
Oct 30 21:44:07.745342 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:07.745302    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d1fbcc021580be88f17c7f5658dc107983c76f3b3d5c8d9d3e8deb7c213d9fe9"} err="failed to get container status \"d1fbcc021580be88f17c7f5658dc107983c76f3b3d5c8d9d3e8deb7c213d9fe9\": rpc error: code = NotFound desc = could not find container \"d1fbcc021580be88f17c7f5658dc107983c76f3b3d5c8d9d3e8deb7c213d9fe9\": container with ID starting with d1fbcc021580be88f17c7f5658dc107983c76f3b3d5c8d9d3e8deb7c213d9fe9 not found: ID does not exist"
Oct 30 21:44:07.745342 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:07.745315    4060 scope.go:122] "RemoveContainer" containerID="59730cc31db0c9223066529d7c6ee3f9ef6aea477bca5618de5faf9243282541"
Oct 30 21:44:07.745541 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:44:07.745526    4060 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"59730cc31db0c9223066529d7c6ee3f9ef6aea477bca5618de5faf9243282541\": container with ID starting with 59730cc31db0c9223066529d7c6ee3f9ef6aea477bca5618de5faf9243282541 not found: ID does not exist" containerID="59730cc31db0c9223066529d7c6ee3f9ef6aea477bca5618de5faf9243282541"
Oct 30 21:44:07.745591 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:07.745546    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"59730cc31db0c9223066529d7c6ee3f9ef6aea477bca5618de5faf9243282541"} err="failed to get container status \"59730cc31db0c9223066529d7c6ee3f9ef6aea477bca5618de5faf9243282541\": rpc error: code = NotFound desc = could not find container \"59730cc31db0c9223066529d7c6ee3f9ef6aea477bca5618de5faf9243282541\": container with ID starting with 59730cc31db0c9223066529d7c6ee3f9ef6aea477bca5618de5faf9243282541 not found: ID does not exist"
Oct 30 21:44:07.745591 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:07.745559    4060 scope.go:122] "RemoveContainer" containerID="80204328175c924af9d78f8e11d52693cf75a4628a0da69e5dc2188bc8b5f8bd"
Oct 30 21:44:07.745751 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:44:07.745732    4060 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"80204328175c924af9d78f8e11d52693cf75a4628a0da69e5dc2188bc8b5f8bd\": container with ID starting with 80204328175c924af9d78f8e11d52693cf75a4628a0da69e5dc2188bc8b5f8bd not found: ID does not exist" containerID="80204328175c924af9d78f8e11d52693cf75a4628a0da69e5dc2188bc8b5f8bd"
Oct 30 21:44:07.745789 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:07.745758    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"80204328175c924af9d78f8e11d52693cf75a4628a0da69e5dc2188bc8b5f8bd"} err="failed to get container status \"80204328175c924af9d78f8e11d52693cf75a4628a0da69e5dc2188bc8b5f8bd\": rpc error: code = NotFound desc = could not find container \"80204328175c924af9d78f8e11d52693cf75a4628a0da69e5dc2188bc8b5f8bd\": container with ID starting with 80204328175c924af9d78f8e11d52693cf75a4628a0da69e5dc2188bc8b5f8bd not found: ID does not exist"
Oct 30 21:44:07.745789 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:07.745776    4060 scope.go:122] "RemoveContainer" containerID="de859dcaba757c5e747b2a9c93dfe85e66c5b8689bac5bc3473b81ccb12498b3"
Oct 30 21:44:07.745999 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:07.745983    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de859dcaba757c5e747b2a9c93dfe85e66c5b8689bac5bc3473b81ccb12498b3"} err="failed to get container status \"de859dcaba757c5e747b2a9c93dfe85e66c5b8689bac5bc3473b81ccb12498b3\": rpc error: code = NotFound desc = could not find container \"de859dcaba757c5e747b2a9c93dfe85e66c5b8689bac5bc3473b81ccb12498b3\": container with ID starting with de859dcaba757c5e747b2a9c93dfe85e66c5b8689bac5bc3473b81ccb12498b3 not found: ID does not exist"
Oct 30 21:44:07.746058 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:07.746001    4060 scope.go:122] "RemoveContainer" containerID="d1fbcc021580be88f17c7f5658dc107983c76f3b3d5c8d9d3e8deb7c213d9fe9"
Oct 30 21:44:07.746235 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:07.746219    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d1fbcc021580be88f17c7f5658dc107983c76f3b3d5c8d9d3e8deb7c213d9fe9"} err="failed to get container status \"d1fbcc021580be88f17c7f5658dc107983c76f3b3d5c8d9d3e8deb7c213d9fe9\": rpc error: code = NotFound desc = could not find container \"d1fbcc021580be88f17c7f5658dc107983c76f3b3d5c8d9d3e8deb7c213d9fe9\": container with ID starting with d1fbcc021580be88f17c7f5658dc107983c76f3b3d5c8d9d3e8deb7c213d9fe9 not found: ID does not exist"
Oct 30 21:44:07.746235 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:07.746234    4060 scope.go:122] "RemoveContainer" containerID="59730cc31db0c9223066529d7c6ee3f9ef6aea477bca5618de5faf9243282541"
Oct 30 21:44:07.746420 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:07.746398    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"59730cc31db0c9223066529d7c6ee3f9ef6aea477bca5618de5faf9243282541"} err="failed to get container status \"59730cc31db0c9223066529d7c6ee3f9ef6aea477bca5618de5faf9243282541\": rpc error: code = NotFound desc = could not find container \"59730cc31db0c9223066529d7c6ee3f9ef6aea477bca5618de5faf9243282541\": container with ID starting with 59730cc31db0c9223066529d7c6ee3f9ef6aea477bca5618de5faf9243282541 not found: ID does not exist"
Oct 30 21:44:07.746464 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:07.746421    4060 scope.go:122] "RemoveContainer" containerID="80204328175c924af9d78f8e11d52693cf75a4628a0da69e5dc2188bc8b5f8bd"
Oct 30 21:44:07.746588 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:07.746572    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"80204328175c924af9d78f8e11d52693cf75a4628a0da69e5dc2188bc8b5f8bd"} err="failed to get container status \"80204328175c924af9d78f8e11d52693cf75a4628a0da69e5dc2188bc8b5f8bd\": rpc error: code = NotFound desc = could not find container \"80204328175c924af9d78f8e11d52693cf75a4628a0da69e5dc2188bc8b5f8bd\": container with ID starting with 80204328175c924af9d78f8e11d52693cf75a4628a0da69e5dc2188bc8b5f8bd not found: ID does not exist"
Oct 30 21:44:07.746628 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:07.746588    4060 scope.go:122] "RemoveContainer" containerID="de859dcaba757c5e747b2a9c93dfe85e66c5b8689bac5bc3473b81ccb12498b3"
Oct 30 21:44:07.746834 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:07.746817    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de859dcaba757c5e747b2a9c93dfe85e66c5b8689bac5bc3473b81ccb12498b3"} err="failed to get container status \"de859dcaba757c5e747b2a9c93dfe85e66c5b8689bac5bc3473b81ccb12498b3\": rpc error: code = NotFound desc = could not find container \"de859dcaba757c5e747b2a9c93dfe85e66c5b8689bac5bc3473b81ccb12498b3\": container with ID starting with de859dcaba757c5e747b2a9c93dfe85e66c5b8689bac5bc3473b81ccb12498b3 not found: ID does not exist"
Oct 30 21:44:07.746878 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:07.746834    4060 scope.go:122] "RemoveContainer" containerID="d1fbcc021580be88f17c7f5658dc107983c76f3b3d5c8d9d3e8deb7c213d9fe9"
Oct 30 21:44:07.747031 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:07.747012    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d1fbcc021580be88f17c7f5658dc107983c76f3b3d5c8d9d3e8deb7c213d9fe9"} err="failed to get container status \"d1fbcc021580be88f17c7f5658dc107983c76f3b3d5c8d9d3e8deb7c213d9fe9\": rpc error: code = NotFound desc = could not find container \"d1fbcc021580be88f17c7f5658dc107983c76f3b3d5c8d9d3e8deb7c213d9fe9\": container with ID starting with d1fbcc021580be88f17c7f5658dc107983c76f3b3d5c8d9d3e8deb7c213d9fe9 not found: ID does not exist"
Oct 30 21:44:07.747085 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:07.747031    4060 scope.go:122] "RemoveContainer" containerID="59730cc31db0c9223066529d7c6ee3f9ef6aea477bca5618de5faf9243282541"
Oct 30 21:44:07.747268 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:07.747249    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"59730cc31db0c9223066529d7c6ee3f9ef6aea477bca5618de5faf9243282541"} err="failed to get container status \"59730cc31db0c9223066529d7c6ee3f9ef6aea477bca5618de5faf9243282541\": rpc error: code = NotFound desc = could not find container \"59730cc31db0c9223066529d7c6ee3f9ef6aea477bca5618de5faf9243282541\": container with ID starting with 59730cc31db0c9223066529d7c6ee3f9ef6aea477bca5618de5faf9243282541 not found: ID does not exist"
Oct 30 21:44:07.747321 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:07.747270    4060 scope.go:122] "RemoveContainer" containerID="80204328175c924af9d78f8e11d52693cf75a4628a0da69e5dc2188bc8b5f8bd"
Oct 30 21:44:07.747477 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:07.747460    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"80204328175c924af9d78f8e11d52693cf75a4628a0da69e5dc2188bc8b5f8bd"} err="failed to get container status \"80204328175c924af9d78f8e11d52693cf75a4628a0da69e5dc2188bc8b5f8bd\": rpc error: code = NotFound desc = could not find container \"80204328175c924af9d78f8e11d52693cf75a4628a0da69e5dc2188bc8b5f8bd\": container with ID starting with 80204328175c924af9d78f8e11d52693cf75a4628a0da69e5dc2188bc8b5f8bd not found: ID does not exist"
Oct 30 21:44:07.747554 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:07.747478    4060 scope.go:122] "RemoveContainer" containerID="971ccc0e1233ea571c2801253e0f3582d4713f9597d8ccf4fceef6e1381760d0"
Oct 30 21:44:07.748382 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:07.748293    4060 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8ec52a7c-c49d-42f2-906a-824dfa80be19-config-volume\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:44:07.748382 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:07.748313    4060 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8ec52a7c-c49d-42f2-906a-824dfa80be19-tls-assets\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:44:07.748382 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:07.748325    4060 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8ec52a7c-c49d-42f2-906a-824dfa80be19-config-out\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:44:07.748382 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:07.748334    4060 reconciler_common.go:299] "Volume detached for volume \"alertmanager-data-science-monitoringstack-db\" (UniqueName: \"kubernetes.io/empty-dir/8ec52a7c-c49d-42f2-906a-824dfa80be19-alertmanager-data-science-monitoringstack-db\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:44:07.748382 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:07.748343    4060 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k25dw\" (UniqueName: \"kubernetes.io/projected/8ec52a7c-c49d-42f2-906a-824dfa80be19-kube-api-access-k25dw\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:44:07.748382 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:07.748351    4060 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8ec52a7c-c49d-42f2-906a-824dfa80be19-web-config\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:44:07.748382 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:07.748359    4060 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8ec52a7c-c49d-42f2-906a-824dfa80be19-cluster-tls-config\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:44:07.754862 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:07.754846    4060 scope.go:122] "RemoveContainer" containerID="8619ddc0d101e448e22f6e9b3e5c357375287b0ba677b32b110e88c6d1a30c4d"
Oct 30 21:44:07.762100 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:07.762080    4060 scope.go:122] "RemoveContainer" containerID="5b2dc4bcc1fe375ed8c178f66a708f400b84d02bfd71d8807050563bf067d4d5"
Oct 30 21:44:07.769566 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:07.769546    4060 scope.go:122] "RemoveContainer" containerID="971ccc0e1233ea571c2801253e0f3582d4713f9597d8ccf4fceef6e1381760d0"
Oct 30 21:44:07.769836 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:44:07.769819    4060 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"971ccc0e1233ea571c2801253e0f3582d4713f9597d8ccf4fceef6e1381760d0\": container with ID starting with 971ccc0e1233ea571c2801253e0f3582d4713f9597d8ccf4fceef6e1381760d0 not found: ID does not exist" containerID="971ccc0e1233ea571c2801253e0f3582d4713f9597d8ccf4fceef6e1381760d0"
Oct 30 21:44:07.769920 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:07.769846    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"971ccc0e1233ea571c2801253e0f3582d4713f9597d8ccf4fceef6e1381760d0"} err="failed to get container status \"971ccc0e1233ea571c2801253e0f3582d4713f9597d8ccf4fceef6e1381760d0\": rpc error: code = NotFound desc = could not find container \"971ccc0e1233ea571c2801253e0f3582d4713f9597d8ccf4fceef6e1381760d0\": container with ID starting with 971ccc0e1233ea571c2801253e0f3582d4713f9597d8ccf4fceef6e1381760d0 not found: ID does not exist"
Oct 30 21:44:07.769920 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:07.769868    4060 scope.go:122] "RemoveContainer" containerID="8619ddc0d101e448e22f6e9b3e5c357375287b0ba677b32b110e88c6d1a30c4d"
Oct 30 21:44:07.770117 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:44:07.770102    4060 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8619ddc0d101e448e22f6e9b3e5c357375287b0ba677b32b110e88c6d1a30c4d\": container with ID starting with 8619ddc0d101e448e22f6e9b3e5c357375287b0ba677b32b110e88c6d1a30c4d not found: ID does not exist" containerID="8619ddc0d101e448e22f6e9b3e5c357375287b0ba677b32b110e88c6d1a30c4d"
Oct 30 21:44:07.770182 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:07.770124    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8619ddc0d101e448e22f6e9b3e5c357375287b0ba677b32b110e88c6d1a30c4d"} err="failed to get container status \"8619ddc0d101e448e22f6e9b3e5c357375287b0ba677b32b110e88c6d1a30c4d\": rpc error: code = NotFound desc = could not find container \"8619ddc0d101e448e22f6e9b3e5c357375287b0ba677b32b110e88c6d1a30c4d\": container with ID starting with 8619ddc0d101e448e22f6e9b3e5c357375287b0ba677b32b110e88c6d1a30c4d not found: ID does not exist"
Oct 30 21:44:07.770182 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:07.770146    4060 scope.go:122] "RemoveContainer" containerID="5b2dc4bcc1fe375ed8c178f66a708f400b84d02bfd71d8807050563bf067d4d5"
Oct 30 21:44:07.770350 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:44:07.770335    4060 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5b2dc4bcc1fe375ed8c178f66a708f400b84d02bfd71d8807050563bf067d4d5\": container with ID starting with 5b2dc4bcc1fe375ed8c178f66a708f400b84d02bfd71d8807050563bf067d4d5 not found: ID does not exist" containerID="5b2dc4bcc1fe375ed8c178f66a708f400b84d02bfd71d8807050563bf067d4d5"
Oct 30 21:44:07.770416 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:07.770355    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5b2dc4bcc1fe375ed8c178f66a708f400b84d02bfd71d8807050563bf067d4d5"} err="failed to get container status \"5b2dc4bcc1fe375ed8c178f66a708f400b84d02bfd71d8807050563bf067d4d5\": rpc error: code = NotFound desc = could not find container \"5b2dc4bcc1fe375ed8c178f66a708f400b84d02bfd71d8807050563bf067d4d5\": container with ID starting with 5b2dc4bcc1fe375ed8c178f66a708f400b84d02bfd71d8807050563bf067d4d5 not found: ID does not exist"
Oct 30 21:44:07.770416 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:07.770375    4060 scope.go:122] "RemoveContainer" containerID="971ccc0e1233ea571c2801253e0f3582d4713f9597d8ccf4fceef6e1381760d0"
Oct 30 21:44:07.770819 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:07.770610    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"971ccc0e1233ea571c2801253e0f3582d4713f9597d8ccf4fceef6e1381760d0"} err="failed to get container status \"971ccc0e1233ea571c2801253e0f3582d4713f9597d8ccf4fceef6e1381760d0\": rpc error: code = NotFound desc = could not find container \"971ccc0e1233ea571c2801253e0f3582d4713f9597d8ccf4fceef6e1381760d0\": container with ID starting with 971ccc0e1233ea571c2801253e0f3582d4713f9597d8ccf4fceef6e1381760d0 not found: ID does not exist"
Oct 30 21:44:07.770819 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:07.770629    4060 scope.go:122] "RemoveContainer" containerID="8619ddc0d101e448e22f6e9b3e5c357375287b0ba677b32b110e88c6d1a30c4d"
Oct 30 21:44:07.770932 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:07.770872    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8619ddc0d101e448e22f6e9b3e5c357375287b0ba677b32b110e88c6d1a30c4d"} err="failed to get container status \"8619ddc0d101e448e22f6e9b3e5c357375287b0ba677b32b110e88c6d1a30c4d\": rpc error: code = NotFound desc = could not find container \"8619ddc0d101e448e22f6e9b3e5c357375287b0ba677b32b110e88c6d1a30c4d\": container with ID starting with 8619ddc0d101e448e22f6e9b3e5c357375287b0ba677b32b110e88c6d1a30c4d not found: ID does not exist"
Oct 30 21:44:07.770932 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:07.770902    4060 scope.go:122] "RemoveContainer" containerID="5b2dc4bcc1fe375ed8c178f66a708f400b84d02bfd71d8807050563bf067d4d5"
Oct 30 21:44:07.771145 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:07.771129    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5b2dc4bcc1fe375ed8c178f66a708f400b84d02bfd71d8807050563bf067d4d5"} err="failed to get container status \"5b2dc4bcc1fe375ed8c178f66a708f400b84d02bfd71d8807050563bf067d4d5\": rpc error: code = NotFound desc = could not find container \"5b2dc4bcc1fe375ed8c178f66a708f400b84d02bfd71d8807050563bf067d4d5\": container with ID starting with 5b2dc4bcc1fe375ed8c178f66a708f400b84d02bfd71d8807050563bf067d4d5 not found: ID does not exist"
Oct 30 21:44:07.882774 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:07.882747    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"]
Oct 30 21:44:07.889903 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:07.889876    4060 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"]
Oct 30 21:44:08.003753 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:08.003723    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"]
Oct 30 21:44:08.016916 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:08.016852    4060 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"]
Oct 30 21:44:08.527289 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:08.527255    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:44:08.527541 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:08.527510    4060 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-collector-0" podUID="cd221ce3-5e38-4efc-9194-3695bb4b7a91" containerName="otc-container" containerID="cri-o://cecdf46587c7f9cf9fb4b2623357126b901ffa3ed4bf1acde29890f4cf988922" gracePeriod=30
Oct 30 21:44:08.725429 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:08.725394    4060 generic.go:356] "Generic (PLEG): container finished" podID="cd221ce3-5e38-4efc-9194-3695bb4b7a91" containerID="cecdf46587c7f9cf9fb4b2623357126b901ffa3ed4bf1acde29890f4cf988922" exitCode=0
Oct 30 21:44:08.725831 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:08.725463    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"cd221ce3-5e38-4efc-9194-3695bb4b7a91","Type":"ContainerDied","Data":"cecdf46587c7f9cf9fb4b2623357126b901ffa3ed4bf1acde29890f4cf988922"}
Oct 30 21:44:08.783459 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:08.783403    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:44:08.858254 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:08.858224    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/cd221ce3-5e38-4efc-9194-3695bb4b7a91-kube-api-access-4g58t\" (UniqueName: \"kubernetes.io/projected/cd221ce3-5e38-4efc-9194-3695bb4b7a91-kube-api-access-4g58t\") pod \"cd221ce3-5e38-4efc-9194-3695bb4b7a91\" (UID: \"cd221ce3-5e38-4efc-9194-3695bb4b7a91\") "
Oct 30 21:44:08.858386 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:08.858311    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/cd221ce3-5e38-4efc-9194-3695bb4b7a91-otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/cd221ce3-5e38-4efc-9194-3695bb4b7a91-otlp-tls-certs\") pod \"cd221ce3-5e38-4efc-9194-3695bb4b7a91\" (UID: \"cd221ce3-5e38-4efc-9194-3695bb4b7a91\") "
Oct 30 21:44:08.858386 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:08.858343    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/cd221ce3-5e38-4efc-9194-3695bb4b7a91-data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/cd221ce3-5e38-4efc-9194-3695bb4b7a91-data-science-collector-ta-client-cert\") pod \"cd221ce3-5e38-4efc-9194-3695bb4b7a91\" (UID: \"cd221ce3-5e38-4efc-9194-3695bb4b7a91\") "
Oct 30 21:44:08.858515 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:08.858402    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/cd221ce3-5e38-4efc-9194-3695bb4b7a91-otc-internal\" (UniqueName: \"kubernetes.io/configmap/cd221ce3-5e38-4efc-9194-3695bb4b7a91-otc-internal\") pod \"cd221ce3-5e38-4efc-9194-3695bb4b7a91\" (UID: \"cd221ce3-5e38-4efc-9194-3695bb4b7a91\") "
Oct 30 21:44:08.858515 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:08.858443    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/cd221ce3-5e38-4efc-9194-3695bb4b7a91-monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/cd221ce3-5e38-4efc-9194-3695bb4b7a91-monitoring-tls-certs\") pod \"cd221ce3-5e38-4efc-9194-3695bb4b7a91\" (UID: \"cd221ce3-5e38-4efc-9194-3695bb4b7a91\") "
Oct 30 21:44:08.858515 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:08.858478    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/cd221ce3-5e38-4efc-9194-3695bb4b7a91-tls-certs\" (UniqueName: \"kubernetes.io/secret/cd221ce3-5e38-4efc-9194-3695bb4b7a91-tls-certs\") pod \"cd221ce3-5e38-4efc-9194-3695bb4b7a91\" (UID: \"cd221ce3-5e38-4efc-9194-3695bb4b7a91\") "
Oct 30 21:44:08.858882 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:08.858851    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cd221ce3-5e38-4efc-9194-3695bb4b7a91-otc-internal" pod "cd221ce3-5e38-4efc-9194-3695bb4b7a91" (UID: "cd221ce3-5e38-4efc-9194-3695bb4b7a91"). InnerVolumeSpecName "otc-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:44:08.860580 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:08.860557    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cd221ce3-5e38-4efc-9194-3695bb4b7a91-otlp-tls-certs" pod "cd221ce3-5e38-4efc-9194-3695bb4b7a91" (UID: "cd221ce3-5e38-4efc-9194-3695bb4b7a91"). InnerVolumeSpecName "otlp-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:44:08.860708 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:08.860609    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cd221ce3-5e38-4efc-9194-3695bb4b7a91-kube-api-access-4g58t" pod "cd221ce3-5e38-4efc-9194-3695bb4b7a91" (UID: "cd221ce3-5e38-4efc-9194-3695bb4b7a91"). InnerVolumeSpecName "kube-api-access-4g58t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:44:08.860708 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:08.860673    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cd221ce3-5e38-4efc-9194-3695bb4b7a91-tls-certs" pod "cd221ce3-5e38-4efc-9194-3695bb4b7a91" (UID: "cd221ce3-5e38-4efc-9194-3695bb4b7a91"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:44:08.860931 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:08.860910    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cd221ce3-5e38-4efc-9194-3695bb4b7a91-data-science-collector-ta-client-cert" pod "cd221ce3-5e38-4efc-9194-3695bb4b7a91" (UID: "cd221ce3-5e38-4efc-9194-3695bb4b7a91"). InnerVolumeSpecName "data-science-collector-ta-client-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:44:08.860931 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:08.860927    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cd221ce3-5e38-4efc-9194-3695bb4b7a91-monitoring-tls-certs" pod "cd221ce3-5e38-4efc-9194-3695bb4b7a91" (UID: "cd221ce3-5e38-4efc-9194-3695bb4b7a91"). InnerVolumeSpecName "monitoring-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:44:08.959695 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:08.959659    4060 reconciler_common.go:299] "Volume detached for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/cd221ce3-5e38-4efc-9194-3695bb4b7a91-otc-internal\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:44:08.959695 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:08.959697    4060 reconciler_common.go:299] "Volume detached for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/cd221ce3-5e38-4efc-9194-3695bb4b7a91-monitoring-tls-certs\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:44:08.959923 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:08.959714    4060 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cd221ce3-5e38-4efc-9194-3695bb4b7a91-tls-certs\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:44:08.959923 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:08.959730    4060 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4g58t\" (UniqueName: \"kubernetes.io/projected/cd221ce3-5e38-4efc-9194-3695bb4b7a91-kube-api-access-4g58t\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:44:08.959923 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:08.959746    4060 reconciler_common.go:299] "Volume detached for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/cd221ce3-5e38-4efc-9194-3695bb4b7a91-otlp-tls-certs\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:44:08.959923 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:08.959761    4060 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/cd221ce3-5e38-4efc-9194-3695bb4b7a91-data-science-collector-ta-client-cert\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:44:09.427328 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:09.427293    4060 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2f6bc90c-dc24-4dac-abb8-d2af9a293d7c" path="/var/lib/kubelet/pods/2f6bc90c-dc24-4dac-abb8-d2af9a293d7c/volumes"
Oct 30 21:44:09.427830 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:09.427816    4060 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="8ec52a7c-c49d-42f2-906a-824dfa80be19" path="/var/lib/kubelet/pods/8ec52a7c-c49d-42f2-906a-824dfa80be19/volumes"
Oct 30 21:44:09.733434 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:09.733410    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:44:09.734101 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:09.733407    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"cd221ce3-5e38-4efc-9194-3695bb4b7a91","Type":"ContainerDied","Data":"2c06a7033698dbaea66eb5cf45a3082021f60618a7eea9f56bf027675b8498a0"}
Oct 30 21:44:09.734101 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:09.733557    4060 scope.go:122] "RemoveContainer" containerID="cecdf46587c7f9cf9fb4b2623357126b901ffa3ed4bf1acde29890f4cf988922"
Oct 30 21:44:09.905136 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:09.905102    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:44:09.954621 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:09.954589    4060 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:44:11.426685 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:11.426653    4060 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="cd221ce3-5e38-4efc-9194-3695bb4b7a91" path="/var/lib/kubelet/pods/cd221ce3-5e38-4efc-9194-3695bb4b7a91/volumes"
Oct 30 21:44:12.150348 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:44:12.150304    4060 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v2f4x" containerName="extractor"
Oct 30 21:44:26.452928 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:26.452887    4060 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-kld84"]
Oct 30 21:44:26.453406 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:26.453177    4060 cpu_manager.go:414] "containerMap: removing container" podUID="cd221ce3-5e38-4efc-9194-3695bb4b7a91" containerName="otc-container"
Oct 30 21:44:26.453406 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:26.453187    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="cd221ce3-5e38-4efc-9194-3695bb4b7a91" containerName="otc-container"
Oct 30 21:44:26.453406 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:26.453198    4060 cpu_manager.go:414] "containerMap: removing container" podUID="8ec52a7c-c49d-42f2-906a-824dfa80be19" containerName="alertmanager"
Oct 30 21:44:26.453406 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:26.453204    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8ec52a7c-c49d-42f2-906a-824dfa80be19" containerName="alertmanager"
Oct 30 21:44:26.453406 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:26.453215    4060 cpu_manager.go:414] "containerMap: removing container" podUID="2f6bc90c-dc24-4dac-abb8-d2af9a293d7c" containerName="prometheus"
Oct 30 21:44:26.453406 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:26.453220    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2f6bc90c-dc24-4dac-abb8-d2af9a293d7c" containerName="prometheus"
Oct 30 21:44:26.453406 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:26.453230    4060 cpu_manager.go:414] "containerMap: removing container" podUID="bfc42f46-be94-443f-86d3-4d7457a1c66c" containerName="thanos-querier"
Oct 30 21:44:26.453406 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:26.453235    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="bfc42f46-be94-443f-86d3-4d7457a1c66c" containerName="thanos-querier"
Oct 30 21:44:26.453406 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:26.453241    4060 cpu_manager.go:414] "containerMap: removing container" podUID="8ec52a7c-c49d-42f2-906a-824dfa80be19" containerName="config-reloader"
Oct 30 21:44:26.453406 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:26.453245    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8ec52a7c-c49d-42f2-906a-824dfa80be19" containerName="config-reloader"
Oct 30 21:44:26.453406 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:26.453258    4060 cpu_manager.go:414] "containerMap: removing container" podUID="2f6bc90c-dc24-4dac-abb8-d2af9a293d7c" containerName="thanos-sidecar"
Oct 30 21:44:26.453406 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:26.453263    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2f6bc90c-dc24-4dac-abb8-d2af9a293d7c" containerName="thanos-sidecar"
Oct 30 21:44:26.453406 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:26.453269    4060 cpu_manager.go:414] "containerMap: removing container" podUID="8ec52a7c-c49d-42f2-906a-824dfa80be19" containerName="init-config-reloader"
Oct 30 21:44:26.453406 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:26.453274    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8ec52a7c-c49d-42f2-906a-824dfa80be19" containerName="init-config-reloader"
Oct 30 21:44:26.453406 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:26.453282    4060 cpu_manager.go:414] "containerMap: removing container" podUID="c5cf796f-2064-4662-9918-919a6d58e027" containerName="kube-rbac-proxy"
Oct 30 21:44:26.453406 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:26.453286    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c5cf796f-2064-4662-9918-919a6d58e027" containerName="kube-rbac-proxy"
Oct 30 21:44:26.453406 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:26.453291    4060 cpu_manager.go:414] "containerMap: removing container" podUID="2f6bc90c-dc24-4dac-abb8-d2af9a293d7c" containerName="init-config-reloader"
Oct 30 21:44:26.453406 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:26.453295    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2f6bc90c-dc24-4dac-abb8-d2af9a293d7c" containerName="init-config-reloader"
Oct 30 21:44:26.453406 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:26.453301    4060 cpu_manager.go:414] "containerMap: removing container" podUID="2f6bc90c-dc24-4dac-abb8-d2af9a293d7c" containerName="config-reloader"
Oct 30 21:44:26.453406 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:26.453305    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2f6bc90c-dc24-4dac-abb8-d2af9a293d7c" containerName="config-reloader"
Oct 30 21:44:26.453406 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:26.453313    4060 cpu_manager.go:414] "containerMap: removing container" podUID="13545120-2b3f-445d-bb4c-02c5a3b34c4b" containerName="korrel8r"
Oct 30 21:44:26.453406 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:26.453317    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="13545120-2b3f-445d-bb4c-02c5a3b34c4b" containerName="korrel8r"
Oct 30 21:44:26.453406 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:26.453365    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="2f6bc90c-dc24-4dac-abb8-d2af9a293d7c" containerName="thanos-sidecar"
Oct 30 21:44:26.453406 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:26.453374    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="c5cf796f-2064-4662-9918-919a6d58e027" containerName="kube-rbac-proxy"
Oct 30 21:44:26.453406 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:26.453390    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="2f6bc90c-dc24-4dac-abb8-d2af9a293d7c" containerName="config-reloader"
Oct 30 21:44:26.453406 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:26.453396    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="13545120-2b3f-445d-bb4c-02c5a3b34c4b" containerName="korrel8r"
Oct 30 21:44:26.453406 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:26.453402    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="cd221ce3-5e38-4efc-9194-3695bb4b7a91" containerName="otc-container"
Oct 30 21:44:26.453406 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:26.453407    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="8ec52a7c-c49d-42f2-906a-824dfa80be19" containerName="alertmanager"
Oct 30 21:44:26.453406 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:26.453413    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="2f6bc90c-dc24-4dac-abb8-d2af9a293d7c" containerName="prometheus"
Oct 30 21:44:26.453406 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:26.453419    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="bfc42f46-be94-443f-86d3-4d7457a1c66c" containerName="thanos-querier"
Oct 30 21:44:26.454332 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:26.453425    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="8ec52a7c-c49d-42f2-906a-824dfa80be19" containerName="config-reloader"
Oct 30 21:44:26.457951 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:26.457932    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-kld84"
Oct 30 21:44:26.521118 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:26.521072    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"kube-root-ca.crt\""
Oct 30 21:44:26.521317 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:26.521082    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"openshift-service-ca.crt\""
Oct 30 21:44:26.568655 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:26.568624    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"prometheus-web-tls-ca\""
Oct 30 21:44:26.568831 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:26.568728    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-prometheus-cluster-proxy-dockercfg-bxqkc\""
Oct 30 21:44:26.569156 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:26.569134    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-prometheus-cluster-proxy-tls\""
Oct 30 21:44:26.569200 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:26.569144    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"prometheus-operated-tls\""
Oct 30 21:44:26.569814 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:26.569793    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-prometheus-cluster-proxy-kube-rbac-proxy\""
Oct 30 21:44:26.571568 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:26.571551    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-kld84"]
Oct 30 21:44:26.604246 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:26.604214    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/6d0bf513-04a6-4525-b66f-0e3f8b79a0f5-tls\") pod \"data-science-prometheus-cluster-proxy-545f759f7c-kld84\" (UID: \"6d0bf513-04a6-4525-b66f-0e3f8b79a0f5\") " pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-kld84"
Oct 30 21:44:26.604405 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:26.604252    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-client-cert\" (UniqueName: \"kubernetes.io/secret/6d0bf513-04a6-4525-b66f-0e3f8b79a0f5-prometheus-client-cert\") pod \"data-science-prometheus-cluster-proxy-545f759f7c-kld84\" (UID: \"6d0bf513-04a6-4525-b66f-0e3f8b79a0f5\") " pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-kld84"
Oct 30 21:44:26.604405 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:26.604282    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6d0bf513-04a6-4525-b66f-0e3f8b79a0f5-kube-rbac-proxy-config\") pod \"data-science-prometheus-cluster-proxy-545f759f7c-kld84\" (UID: \"6d0bf513-04a6-4525-b66f-0e3f8b79a0f5\") " pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-kld84"
Oct 30 21:44:26.604405 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:26.604368    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-ca\" (UniqueName: \"kubernetes.io/configmap/6d0bf513-04a6-4525-b66f-0e3f8b79a0f5-prometheus-ca\") pod \"data-science-prometheus-cluster-proxy-545f759f7c-kld84\" (UID: \"6d0bf513-04a6-4525-b66f-0e3f8b79a0f5\") " pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-kld84"
Oct 30 21:44:26.604405 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:26.604395    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2gc4d\" (UniqueName: \"kubernetes.io/projected/6d0bf513-04a6-4525-b66f-0e3f8b79a0f5-kube-api-access-2gc4d\") pod \"data-science-prometheus-cluster-proxy-545f759f7c-kld84\" (UID: \"6d0bf513-04a6-4525-b66f-0e3f8b79a0f5\") " pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-kld84"
Oct 30 21:44:26.705783 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:26.705693    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6d0bf513-04a6-4525-b66f-0e3f8b79a0f5-kube-rbac-proxy-config\") pod \"data-science-prometheus-cluster-proxy-545f759f7c-kld84\" (UID: \"6d0bf513-04a6-4525-b66f-0e3f8b79a0f5\") " pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-kld84"
Oct 30 21:44:26.705783 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:26.705733    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-ca\" (UniqueName: \"kubernetes.io/configmap/6d0bf513-04a6-4525-b66f-0e3f8b79a0f5-prometheus-ca\") pod \"data-science-prometheus-cluster-proxy-545f759f7c-kld84\" (UID: \"6d0bf513-04a6-4525-b66f-0e3f8b79a0f5\") " pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-kld84"
Oct 30 21:44:26.705783 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:26.705752    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2gc4d\" (UniqueName: \"kubernetes.io/projected/6d0bf513-04a6-4525-b66f-0e3f8b79a0f5-kube-api-access-2gc4d\") pod \"data-science-prometheus-cluster-proxy-545f759f7c-kld84\" (UID: \"6d0bf513-04a6-4525-b66f-0e3f8b79a0f5\") " pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-kld84"
Oct 30 21:44:26.706042 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:26.705807    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/6d0bf513-04a6-4525-b66f-0e3f8b79a0f5-tls\") pod \"data-science-prometheus-cluster-proxy-545f759f7c-kld84\" (UID: \"6d0bf513-04a6-4525-b66f-0e3f8b79a0f5\") " pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-kld84"
Oct 30 21:44:26.706042 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:26.705825    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-client-cert\" (UniqueName: \"kubernetes.io/secret/6d0bf513-04a6-4525-b66f-0e3f8b79a0f5-prometheus-client-cert\") pod \"data-science-prometheus-cluster-proxy-545f759f7c-kld84\" (UID: \"6d0bf513-04a6-4525-b66f-0e3f8b79a0f5\") " pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-kld84"
Oct 30 21:44:26.706379 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:26.706356    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-ca\" (UniqueName: \"kubernetes.io/configmap/6d0bf513-04a6-4525-b66f-0e3f8b79a0f5-prometheus-ca\") pod \"data-science-prometheus-cluster-proxy-545f759f7c-kld84\" (UID: \"6d0bf513-04a6-4525-b66f-0e3f8b79a0f5\") " pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-kld84"
Oct 30 21:44:26.708287 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:26.708262    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6d0bf513-04a6-4525-b66f-0e3f8b79a0f5-kube-rbac-proxy-config\") pod \"data-science-prometheus-cluster-proxy-545f759f7c-kld84\" (UID: \"6d0bf513-04a6-4525-b66f-0e3f8b79a0f5\") " pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-kld84"
Oct 30 21:44:26.708402 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:26.708384    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-client-cert\" (UniqueName: \"kubernetes.io/secret/6d0bf513-04a6-4525-b66f-0e3f8b79a0f5-prometheus-client-cert\") pod \"data-science-prometheus-cluster-proxy-545f759f7c-kld84\" (UID: \"6d0bf513-04a6-4525-b66f-0e3f8b79a0f5\") " pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-kld84"
Oct 30 21:44:26.708467 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:26.708447    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls\" (UniqueName: \"kubernetes.io/secret/6d0bf513-04a6-4525-b66f-0e3f8b79a0f5-tls\") pod \"data-science-prometheus-cluster-proxy-545f759f7c-kld84\" (UID: \"6d0bf513-04a6-4525-b66f-0e3f8b79a0f5\") " pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-kld84"
Oct 30 21:44:26.772219 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:26.772188    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2gc4d\" (UniqueName: \"kubernetes.io/projected/6d0bf513-04a6-4525-b66f-0e3f8b79a0f5-kube-api-access-2gc4d\") pod \"data-science-prometheus-cluster-proxy-545f759f7c-kld84\" (UID: \"6d0bf513-04a6-4525-b66f-0e3f8b79a0f5\") " pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-kld84"
Oct 30 21:44:26.809610 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:26.809574    4060 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/korrel8r-5cbcc89b8f-t59pj"]
Oct 30 21:44:26.812995 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:26.812976    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-t59pj"
Oct 30 21:44:26.884687 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:26.884648    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/korrel8r-5cbcc89b8f-t59pj"]
Oct 30 21:44:26.890245 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:26.890220    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"korrel8r-tls\""
Oct 30 21:44:26.890390 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:26.890263    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"korrel8r-dockercfg-6r7fs\""
Oct 30 21:44:26.893228 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:26.893215    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"korrel8r-config\""
Oct 30 21:44:26.906619 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:26.906590    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/99506ac5-5ea3-4889-8486-b0c05f375235-tls\") pod \"korrel8r-5cbcc89b8f-t59pj\" (UID: \"99506ac5-5ea3-4889-8486-b0c05f375235\") " pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-t59pj"
Oct 30 21:44:26.906735 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:26.906641    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/99506ac5-5ea3-4889-8486-b0c05f375235-config\") pod \"korrel8r-5cbcc89b8f-t59pj\" (UID: \"99506ac5-5ea3-4889-8486-b0c05f375235\") " pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-t59pj"
Oct 30 21:44:26.906735 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:26.906713    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w7jvq\" (UniqueName: \"kubernetes.io/projected/99506ac5-5ea3-4889-8486-b0c05f375235-kube-api-access-w7jvq\") pod \"korrel8r-5cbcc89b8f-t59pj\" (UID: \"99506ac5-5ea3-4889-8486-b0c05f375235\") " pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-t59pj"
Oct 30 21:44:27.007126 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:27.007047    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/99506ac5-5ea3-4889-8486-b0c05f375235-tls\") pod \"korrel8r-5cbcc89b8f-t59pj\" (UID: \"99506ac5-5ea3-4889-8486-b0c05f375235\") " pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-t59pj"
Oct 30 21:44:27.007126 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:27.007114    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/99506ac5-5ea3-4889-8486-b0c05f375235-config\") pod \"korrel8r-5cbcc89b8f-t59pj\" (UID: \"99506ac5-5ea3-4889-8486-b0c05f375235\") " pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-t59pj"
Oct 30 21:44:27.007323 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:27.007163    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w7jvq\" (UniqueName: \"kubernetes.io/projected/99506ac5-5ea3-4889-8486-b0c05f375235-kube-api-access-w7jvq\") pod \"korrel8r-5cbcc89b8f-t59pj\" (UID: \"99506ac5-5ea3-4889-8486-b0c05f375235\") " pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-t59pj"
Oct 30 21:44:27.007979 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:27.007955    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/99506ac5-5ea3-4889-8486-b0c05f375235-config\") pod \"korrel8r-5cbcc89b8f-t59pj\" (UID: \"99506ac5-5ea3-4889-8486-b0c05f375235\") " pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-t59pj"
Oct 30 21:44:27.009645 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:27.009616    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls\" (UniqueName: \"kubernetes.io/secret/99506ac5-5ea3-4889-8486-b0c05f375235-tls\") pod \"korrel8r-5cbcc89b8f-t59pj\" (UID: \"99506ac5-5ea3-4889-8486-b0c05f375235\") " pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-t59pj"
Oct 30 21:44:27.070670 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:27.070617    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-kld84"
Oct 30 21:44:27.071750 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:27.071718    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w7jvq\" (UniqueName: \"kubernetes.io/projected/99506ac5-5ea3-4889-8486-b0c05f375235-kube-api-access-w7jvq\") pod \"korrel8r-5cbcc89b8f-t59pj\" (UID: \"99506ac5-5ea3-4889-8486-b0c05f375235\") " pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-t59pj"
Oct 30 21:44:27.125864 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:27.125837    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-t59pj"
Oct 30 21:44:27.449512 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:27.449243    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-kld84"]
Oct 30 21:44:27.451077 ip-10-0-142-4 kubenswrapper[4060]: W1030 21:44:27.451052    4060 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d0bf513_04a6_4525_b66f_0e3f8b79a0f5.slice/crio-93da6caa364861e5c5a84de4fd39f0bcdce160623adcca76abe0169747d01788 WatchSource:0}: Error finding container 93da6caa364861e5c5a84de4fd39f0bcdce160623adcca76abe0169747d01788: Status 404 returned error can't find the container with id 93da6caa364861e5c5a84de4fd39f0bcdce160623adcca76abe0169747d01788
Oct 30 21:44:27.562686 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:27.562666    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/korrel8r-5cbcc89b8f-t59pj"]
Oct 30 21:44:27.564364 ip-10-0-142-4 kubenswrapper[4060]: W1030 21:44:27.564343    4060 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99506ac5_5ea3_4889_8486_b0c05f375235.slice/crio-2e939c14dcf151b0be5ee835ee1506b1e038b271d24239b6e2b651389c9ff7c4 WatchSource:0}: Error finding container 2e939c14dcf151b0be5ee835ee1506b1e038b271d24239b6e2b651389c9ff7c4: Status 404 returned error can't find the container with id 2e939c14dcf151b0be5ee835ee1506b1e038b271d24239b6e2b651389c9ff7c4
Oct 30 21:44:27.822064 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:27.822024    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-t59pj" event={"ID":"99506ac5-5ea3-4889-8486-b0c05f375235","Type":"ContainerStarted","Data":"0bc27eebeb01c849d9b3d4d8d1e946dc9ac20c83e7efcf8424a55cfec4626318"}
Oct 30 21:44:27.822250 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:27.822083    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-t59pj" event={"ID":"99506ac5-5ea3-4889-8486-b0c05f375235","Type":"ContainerStarted","Data":"2e939c14dcf151b0be5ee835ee1506b1e038b271d24239b6e2b651389c9ff7c4"}
Oct 30 21:44:27.822250 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:27.822111    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-t59pj"
Oct 30 21:44:27.823362 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:27.823330    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-kld84" event={"ID":"6d0bf513-04a6-4525-b66f-0e3f8b79a0f5","Type":"ContainerStarted","Data":"93da6caa364861e5c5a84de4fd39f0bcdce160623adcca76abe0169747d01788"}
Oct 30 21:44:27.945244 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:27.945195    4060 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-t59pj" podStartSLOduration=1.945180915 podStartE2EDuration="1.945180915s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:44:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:44:27.944721759 +0000 UTC m=+4086.701720056" watchObservedRunningTime="2026-10-30 21:44:27.945180915 +0000 UTC m=+4086.702179213"
Oct 30 21:44:28.828852 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:28.828811    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-kld84" event={"ID":"6d0bf513-04a6-4525-b66f-0e3f8b79a0f5","Type":"ContainerStarted","Data":"bc470a2aa64eebe5f2cda00a7d28d72516f3a411aaf6eafc04bf58260384f867"}
Oct 30 21:44:28.829299 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:28.829152    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-kld84"
Oct 30 21:44:28.950392 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:28.950342    4060 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-kld84" podStartSLOduration=2.950325588 podStartE2EDuration="2.950325588s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:44:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:44:28.949353707 +0000 UTC m=+4087.706352004" watchObservedRunningTime="2026-10-30 21:44:28.950325588 +0000 UTC m=+4087.707323888"
Oct 30 21:44:31.518165 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:31.518128    4060 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:44:31.521944 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:31.521925    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:44:31.574891 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:31.574858    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-a0f9182a\""
Oct 30 21:44:31.624274 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:31.624244    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-monitoring-tls\""
Oct 30 21:44:31.624274 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:31.624262    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-tls\""
Oct 30 21:44:31.624274 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:31.624273    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-ta-client-cert\""
Oct 30 21:44:31.624535 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:31.624250    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-headless-tls\""
Oct 30 21:44:31.626219 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:31.626201    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:44:31.657331 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:31.657305    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/6160038e-a2c6-4e8b-b03b-1cc3c2b76a40-otc-internal\") pod \"data-science-collector-collector-0\" (UID: \"6160038e-a2c6-4e8b-b03b-1cc3c2b76a40\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:44:31.657529 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:31.657348    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/6160038e-a2c6-4e8b-b03b-1cc3c2b76a40-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-0\" (UID: \"6160038e-a2c6-4e8b-b03b-1cc3c2b76a40\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:44:31.657529 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:31.657369    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/6160038e-a2c6-4e8b-b03b-1cc3c2b76a40-otlp-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"6160038e-a2c6-4e8b-b03b-1cc3c2b76a40\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:44:31.657529 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:31.657520    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6160038e-a2c6-4e8b-b03b-1cc3c2b76a40-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"6160038e-a2c6-4e8b-b03b-1cc3c2b76a40\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:44:31.657685 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:31.657554    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/6160038e-a2c6-4e8b-b03b-1cc3c2b76a40-monitoring-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"6160038e-a2c6-4e8b-b03b-1cc3c2b76a40\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:44:31.657685 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:31.657584    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9sz8w\" (UniqueName: \"kubernetes.io/projected/6160038e-a2c6-4e8b-b03b-1cc3c2b76a40-kube-api-access-9sz8w\") pod \"data-science-collector-collector-0\" (UID: \"6160038e-a2c6-4e8b-b03b-1cc3c2b76a40\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:44:31.758579 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:31.758543    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6160038e-a2c6-4e8b-b03b-1cc3c2b76a40-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"6160038e-a2c6-4e8b-b03b-1cc3c2b76a40\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:44:31.758797 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:31.758595    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/6160038e-a2c6-4e8b-b03b-1cc3c2b76a40-monitoring-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"6160038e-a2c6-4e8b-b03b-1cc3c2b76a40\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:44:31.758797 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:31.758639    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9sz8w\" (UniqueName: \"kubernetes.io/projected/6160038e-a2c6-4e8b-b03b-1cc3c2b76a40-kube-api-access-9sz8w\") pod \"data-science-collector-collector-0\" (UID: \"6160038e-a2c6-4e8b-b03b-1cc3c2b76a40\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:44:31.758797 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:31.758682    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/6160038e-a2c6-4e8b-b03b-1cc3c2b76a40-otc-internal\") pod \"data-science-collector-collector-0\" (UID: \"6160038e-a2c6-4e8b-b03b-1cc3c2b76a40\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:44:31.758797 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:31.758721    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/6160038e-a2c6-4e8b-b03b-1cc3c2b76a40-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-0\" (UID: \"6160038e-a2c6-4e8b-b03b-1cc3c2b76a40\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:44:31.758797 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:31.758750    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/6160038e-a2c6-4e8b-b03b-1cc3c2b76a40-otlp-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"6160038e-a2c6-4e8b-b03b-1cc3c2b76a40\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:44:31.759116 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:44:31.758854    4060 secret.go:189] Couldn't get secret redhat-ods-monitoring/data-science-collector-collector-headless-tls: secret "data-science-collector-collector-headless-tls" not found
Oct 30 21:44:31.759116 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:44:31.758923    4060 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6160038e-a2c6-4e8b-b03b-1cc3c2b76a40-otlp-tls-certs podName:6160038e-a2c6-4e8b-b03b-1cc3c2b76a40 nodeName:}" failed. No retries permitted until 2026-10-30 21:44:32.258896699 +0000 UTC m=+4091.015894977 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "otlp-tls-certs" (UniqueName: "kubernetes.io/secret/6160038e-a2c6-4e8b-b03b-1cc3c2b76a40-otlp-tls-certs") pod "data-science-collector-collector-0" (UID: "6160038e-a2c6-4e8b-b03b-1cc3c2b76a40") : secret "data-science-collector-collector-headless-tls" not found
Oct 30 21:44:31.759549 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:31.759524    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/6160038e-a2c6-4e8b-b03b-1cc3c2b76a40-otc-internal\") pod \"data-science-collector-collector-0\" (UID: \"6160038e-a2c6-4e8b-b03b-1cc3c2b76a40\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:44:31.761424 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:31.761402    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/6160038e-a2c6-4e8b-b03b-1cc3c2b76a40-monitoring-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"6160038e-a2c6-4e8b-b03b-1cc3c2b76a40\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:44:31.761533 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:31.761450    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/6160038e-a2c6-4e8b-b03b-1cc3c2b76a40-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-0\" (UID: \"6160038e-a2c6-4e8b-b03b-1cc3c2b76a40\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:44:31.761963 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:31.761947    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6160038e-a2c6-4e8b-b03b-1cc3c2b76a40-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"6160038e-a2c6-4e8b-b03b-1cc3c2b76a40\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:44:31.826546 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:31.826434    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9sz8w\" (UniqueName: \"kubernetes.io/projected/6160038e-a2c6-4e8b-b03b-1cc3c2b76a40-kube-api-access-9sz8w\") pod \"data-science-collector-collector-0\" (UID: \"6160038e-a2c6-4e8b-b03b-1cc3c2b76a40\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:44:32.262926 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:32.262886    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/6160038e-a2c6-4e8b-b03b-1cc3c2b76a40-otlp-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"6160038e-a2c6-4e8b-b03b-1cc3c2b76a40\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:44:32.265458 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:32.265433    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/6160038e-a2c6-4e8b-b03b-1cc3c2b76a40-otlp-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"6160038e-a2c6-4e8b-b03b-1cc3c2b76a40\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:44:32.434713 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:32.434676    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:44:32.809102 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:32.809069    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:44:32.840472 ip-10-0-142-4 kubenswrapper[4060]: W1030 21:44:32.840431    4060 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6160038e_a2c6_4e8b_b03b_1cc3c2b76a40.slice/crio-1d6e4b35a63a09c04228ff38c2917f9760988caee8b63aa6e00eba59a776d2fb WatchSource:0}: Error finding container 1d6e4b35a63a09c04228ff38c2917f9760988caee8b63aa6e00eba59a776d2fb: Status 404 returned error can't find the container with id 1d6e4b35a63a09c04228ff38c2917f9760988caee8b63aa6e00eba59a776d2fb
Oct 30 21:44:32.842616 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:32.842583    4060 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 21:44:32.842718 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:32.842643    4060 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 21:44:32.848753 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:32.848722    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"6160038e-a2c6-4e8b-b03b-1cc3c2b76a40","Type":"ContainerStarted","Data":"1d6e4b35a63a09c04228ff38c2917f9760988caee8b63aa6e00eba59a776d2fb"}
Oct 30 21:44:33.857673 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:33.857643    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"6160038e-a2c6-4e8b-b03b-1cc3c2b76a40","Type":"ContainerStarted","Data":"e69bd0b6dc335716b9c7ca97d555a60617f6fd2ac549e792cf281698f290c778"}
Oct 30 21:44:33.980114 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:33.980062    4060 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-collector-0" podStartSLOduration=2.98004808 podStartE2EDuration="2.98004808s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:44:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:44:33.977992113 +0000 UTC m=+4092.734990421" watchObservedRunningTime="2026-10-30 21:44:33.98004808 +0000 UTC m=+4092.737046379"
Oct 30 21:44:34.837151 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:34.837123    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-kld84"
Oct 30 21:44:38.831670 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:38.831637    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-t59pj"
Oct 30 21:44:42.150081 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:44:42.150036    4060 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v2f4x" containerName="extractor"
Oct 30 21:44:45.940786 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:45.940753    4060 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"]
Oct 30 21:44:45.944423 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:45.944406    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:44:45.951279 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:45.951052    4060 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"]
Oct 30 21:44:45.954968 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:45.954947    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:44:45.961475 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:45.961451    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5d6efefd-cfdb-487f-901a-5b2e88ccd1bb-tls-assets\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"5d6efefd-cfdb-487f-901a-5b2e88ccd1bb\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:44:45.961586 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:45.961517    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5d6efefd-cfdb-487f-901a-5b2e88ccd1bb-config-volume\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"5d6efefd-cfdb-487f-901a-5b2e88ccd1bb\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:44:45.961647 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:45.961583    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5d6efefd-cfdb-487f-901a-5b2e88ccd1bb-web-config\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"5d6efefd-cfdb-487f-901a-5b2e88ccd1bb\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:44:45.961647 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:45.961603    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5d6efefd-cfdb-487f-901a-5b2e88ccd1bb-config-out\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"5d6efefd-cfdb-487f-901a-5b2e88ccd1bb\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:44:45.961647 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:45.961624    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fwcvt\" (UniqueName: \"kubernetes.io/projected/5d6efefd-cfdb-487f-901a-5b2e88ccd1bb-kube-api-access-fwcvt\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"5d6efefd-cfdb-487f-901a-5b2e88ccd1bb\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:44:45.961775 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:45.961709    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5d6efefd-cfdb-487f-901a-5b2e88ccd1bb-cluster-tls-config\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"5d6efefd-cfdb-487f-901a-5b2e88ccd1bb\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:44:45.961775 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:45.961732    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-data-science-monitoringstack-db\" (UniqueName: \"kubernetes.io/empty-dir/5d6efefd-cfdb-487f-901a-5b2e88ccd1bb-alertmanager-data-science-monitoringstack-db\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"5d6efefd-cfdb-487f-901a-5b2e88ccd1bb\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:44:45.999203 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:45.999170    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"prometheus-data-science-monitoringstack-rulefiles-1\""
Oct 30 21:44:45.999350 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:45.999255    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"prometheus-data-science-monitoringstack-thanos-prometheus-http-client-file\""
Oct 30 21:44:45.999786 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:45.999767    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"prometheus-data-science-monitoringstack-rulefiles-2\""
Oct 30 21:44:45.999899 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:45.999828    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"prometheus-web-tls-ca\""
Oct 30 21:44:45.999899 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:45.999890    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"prometheus-data-science-monitoringstack-tls-assets-0\""
Oct 30 21:44:46.000016 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:45.999953    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"prometheus-data-science-monitoringstack\""
Oct 30 21:44:46.000016 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:45.999993    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-monitoringstack-prometheus-dockercfg-fq8lz\""
Oct 30 21:44:46.047936 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:46.047901    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"prometheus-data-science-monitoringstack-rulefiles-0\""
Oct 30 21:44:46.047936 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:46.047901    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"prometheus-data-science-monitoringstack-web-config\""
Oct 30 21:44:46.050084 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:46.050064    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"]
Oct 30 21:44:46.053920 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:46.053898    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"]
Oct 30 21:44:46.062959 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:46.062936    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5d6efefd-cfdb-487f-901a-5b2e88ccd1bb-config-out\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"5d6efefd-cfdb-487f-901a-5b2e88ccd1bb\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:44:46.063108 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:46.062969    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fwcvt\" (UniqueName: \"kubernetes.io/projected/5d6efefd-cfdb-487f-901a-5b2e88ccd1bb-kube-api-access-fwcvt\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"5d6efefd-cfdb-487f-901a-5b2e88ccd1bb\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:44:46.063108 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:46.062986    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5d6efefd-cfdb-487f-901a-5b2e88ccd1bb-cluster-tls-config\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"5d6efefd-cfdb-487f-901a-5b2e88ccd1bb\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:44:46.063108 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:46.063006    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-data-science-monitoringstack-db\" (UniqueName: \"kubernetes.io/empty-dir/5d6efefd-cfdb-487f-901a-5b2e88ccd1bb-alertmanager-data-science-monitoringstack-db\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"5d6efefd-cfdb-487f-901a-5b2e88ccd1bb\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:44:46.063108 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:46.063062    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5d6efefd-cfdb-487f-901a-5b2e88ccd1bb-tls-assets\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"5d6efefd-cfdb-487f-901a-5b2e88ccd1bb\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:44:46.063313 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:46.063128    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5d6efefd-cfdb-487f-901a-5b2e88ccd1bb-config-volume\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"5d6efefd-cfdb-487f-901a-5b2e88ccd1bb\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:44:46.063313 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:46.063150    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5d6efefd-cfdb-487f-901a-5b2e88ccd1bb-web-config\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"5d6efefd-cfdb-487f-901a-5b2e88ccd1bb\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:44:46.063471 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:46.063448    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-data-science-monitoringstack-db\" (UniqueName: \"kubernetes.io/empty-dir/5d6efefd-cfdb-487f-901a-5b2e88ccd1bb-alertmanager-data-science-monitoringstack-db\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"5d6efefd-cfdb-487f-901a-5b2e88ccd1bb\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:44:46.065224 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:46.065208    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5d6efefd-cfdb-487f-901a-5b2e88ccd1bb-config-out\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"5d6efefd-cfdb-487f-901a-5b2e88ccd1bb\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:44:46.099001 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:46.098973    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"alertmanager-data-science-monitoringstack-cluster-tls-config\""
Oct 30 21:44:46.099001 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:46.098975    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"alertmanager-data-science-monitoringstack-web-config\""
Oct 30 21:44:46.099001 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:46.099007    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"alertmanager-data-science-monitoringstack-generated\""
Oct 30 21:44:46.099223 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:46.099029    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-monitoringstack-alertmanager-dockercfg-lr9wm\""
Oct 30 21:44:46.099223 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:46.099032    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"alertmanager-data-science-monitoringstack-tls-assets-0\""
Oct 30 21:44:46.106235 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:46.106205    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5d6efefd-cfdb-487f-901a-5b2e88ccd1bb-web-config\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"5d6efefd-cfdb-487f-901a-5b2e88ccd1bb\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:44:46.106393 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:46.106344    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5d6efefd-cfdb-487f-901a-5b2e88ccd1bb-cluster-tls-config\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"5d6efefd-cfdb-487f-901a-5b2e88ccd1bb\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:44:46.106393 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:46.106360    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5d6efefd-cfdb-487f-901a-5b2e88ccd1bb-config-volume\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"5d6efefd-cfdb-487f-901a-5b2e88ccd1bb\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:44:46.107470 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:46.107443    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5d6efefd-cfdb-487f-901a-5b2e88ccd1bb-tls-assets\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"5d6efefd-cfdb-487f-901a-5b2e88ccd1bb\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:44:46.124217 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:46.124198    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fwcvt\" (UniqueName: \"kubernetes.io/projected/5d6efefd-cfdb-487f-901a-5b2e88ccd1bb-kube-api-access-fwcvt\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"5d6efefd-cfdb-487f-901a-5b2e88ccd1bb\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:44:46.164585 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:46.164556    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config-tls-secret-key-prometheus-operated-tls-f3457c70\" (UniqueName: \"kubernetes.io/secret/f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b-web-config-tls-secret-key-prometheus-operated-tls-f3457c70\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:44:46.164741 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:46.164598    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b-config\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:44:46.164741 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:46.164624    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b-thanos-prometheus-http-client-file\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:44:46.164819 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:46.164768    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-data-science-monitoringstack-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b-prometheus-data-science-monitoringstack-rulefiles-0\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:44:46.164819 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:46.164805    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-data-science-monitoringstack-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b-prometheus-data-science-monitoringstack-rulefiles-1\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:44:46.164888 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:46.164826    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config-tls-secret-cert-prometheus-operated-tls-f3457c70\" (UniqueName: \"kubernetes.io/secret/f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b-web-config-tls-secret-cert-prometheus-operated-tls-f3457c70\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:44:46.164888 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:46.164844    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b-config-out\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:44:46.164993 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:46.164969    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-web-tls-ca\" (UniqueName: \"kubernetes.io/secret/f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b-secret-prometheus-web-tls-ca\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:44:46.165027 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:46.165005    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hscv2\" (UniqueName: \"kubernetes.io/projected/f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b-kube-api-access-hscv2\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:44:46.165061 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:46.165028    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-data-science-monitoringstack-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b-prometheus-data-science-monitoringstack-rulefiles-2\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:44:46.165109 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:46.165094    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b-web-config\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:44:46.165146 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:46.165137    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b-tls-assets\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:44:46.265626 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:46.265593    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config-tls-secret-key-prometheus-operated-tls-f3457c70\" (UniqueName: \"kubernetes.io/secret/f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b-web-config-tls-secret-key-prometheus-operated-tls-f3457c70\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:44:46.265811 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:46.265635    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b-config\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:44:46.265811 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:46.265658    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b-thanos-prometheus-http-client-file\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:44:46.265811 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:46.265688    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-data-science-monitoringstack-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b-prometheus-data-science-monitoringstack-rulefiles-0\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:44:46.265811 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:46.265718    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-data-science-monitoringstack-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b-prometheus-data-science-monitoringstack-rulefiles-1\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:44:46.265811 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:46.265737    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config-tls-secret-cert-prometheus-operated-tls-f3457c70\" (UniqueName: \"kubernetes.io/secret/f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b-web-config-tls-secret-cert-prometheus-operated-tls-f3457c70\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:44:46.265811 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:46.265753    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b-config-out\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:44:46.266136 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:46.266041    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-web-tls-ca\" (UniqueName: \"kubernetes.io/secret/f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b-secret-prometheus-web-tls-ca\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:44:46.266136 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:46.266081    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hscv2\" (UniqueName: \"kubernetes.io/projected/f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b-kube-api-access-hscv2\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:44:46.266136 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:46.266118    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-data-science-monitoringstack-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b-prometheus-data-science-monitoringstack-rulefiles-2\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:44:46.266310 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:46.266148    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b-web-config\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:44:46.266310 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:46.266196    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b-tls-assets\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:44:46.266467 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:46.266446    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-data-science-monitoringstack-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b-prometheus-data-science-monitoringstack-rulefiles-1\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:44:46.266775 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:46.266743    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-data-science-monitoringstack-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b-prometheus-data-science-monitoringstack-rulefiles-0\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:44:46.267150 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:46.267120    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-data-science-monitoringstack-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b-prometheus-data-science-monitoringstack-rulefiles-2\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:44:46.268893 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:46.268867    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b-config-out\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:44:46.268893 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:46.268873    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config-tls-secret-cert-prometheus-operated-tls-f3457c70\" (UniqueName: \"kubernetes.io/secret/f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b-web-config-tls-secret-cert-prometheus-operated-tls-f3457c70\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:44:46.269019 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:46.268875    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b-config\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:44:46.269152 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:46.269131    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-web-tls-ca\" (UniqueName: \"kubernetes.io/secret/f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b-secret-prometheus-web-tls-ca\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:44:46.269678 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:46.269651    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config-tls-secret-key-prometheus-operated-tls-f3457c70\" (UniqueName: \"kubernetes.io/secret/f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b-web-config-tls-secret-key-prometheus-operated-tls-f3457c70\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:44:46.269791 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:46.269738    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b-thanos-prometheus-http-client-file\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:44:46.269791 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:46.269756    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b-tls-assets\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:44:46.269915 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:46.269872    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b-web-config\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:44:46.271739 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:46.271721    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:44:46.329477 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:46.329418    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hscv2\" (UniqueName: \"kubernetes.io/projected/f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b-kube-api-access-hscv2\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:44:46.704782 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:46.704752    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"]
Oct 30 21:44:46.706407 ip-10-0-142-4 kubenswrapper[4060]: W1030 21:44:46.706383    4060 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d6efefd_cfdb_487f_901a_5b2e88ccd1bb.slice/crio-1adecb0fd3cc84e010bcc2bbdf40769d297e72999749b1374e052db1e5feab8c WatchSource:0}: Error finding container 1adecb0fd3cc84e010bcc2bbdf40769d297e72999749b1374e052db1e5feab8c: Status 404 returned error can't find the container with id 1adecb0fd3cc84e010bcc2bbdf40769d297e72999749b1374e052db1e5feab8c
Oct 30 21:44:46.922036 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:46.921994    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0" event={"ID":"5d6efefd-cfdb-487f-901a-5b2e88ccd1bb","Type":"ContainerStarted","Data":"1adecb0fd3cc84e010bcc2bbdf40769d297e72999749b1374e052db1e5feab8c"}
Oct 30 21:44:47.928479 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:47.928443    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0" event={"ID":"5d6efefd-cfdb-487f-901a-5b2e88ccd1bb","Type":"ContainerStarted","Data":"7ebce93b2f1a6d5355859257070e8bdea68294af219cb101713934a4095f50b8"}
Oct 30 21:44:50.943219 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:50.943139    4060 generic.go:356] "Generic (PLEG): container finished" podID="5d6efefd-cfdb-487f-901a-5b2e88ccd1bb" containerID="7ebce93b2f1a6d5355859257070e8bdea68294af219cb101713934a4095f50b8" exitCode=0
Oct 30 21:44:50.943219 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:50.943211    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0" event={"ID":"5d6efefd-cfdb-487f-901a-5b2e88ccd1bb","Type":"ContainerDied","Data":"7ebce93b2f1a6d5355859257070e8bdea68294af219cb101713934a4095f50b8"}
Oct 30 21:44:51.950115 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:51.950080    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0" event={"ID":"5d6efefd-cfdb-487f-901a-5b2e88ccd1bb","Type":"ContainerStarted","Data":"d65ae6b7925c45f27cdb827bacb712b4da6437b757dced6718c8d4833dde9913"}
Oct 30 21:44:51.950555 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:51.950141    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0" event={"ID":"5d6efefd-cfdb-487f-901a-5b2e88ccd1bb","Type":"ContainerStarted","Data":"ac8228efd3fe866285126e289604f3c5448b5459c6a84d6b87784ac1044df0c9"}
Oct 30 21:44:51.950555 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:51.950327    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:44:52.124642 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:52.124551    4060 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0" podStartSLOduration=3.5379544259999998 podStartE2EDuration="7.124533481s" totalImagesPullingTime="0s" totalInitContainerRuntime="3.586579055s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:44:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:44:52.122651499 +0000 UTC m=+4110.879649796" watchObservedRunningTime="2026-10-30 21:44:52.124533481 +0000 UTC m=+4110.881531780"
Oct 30 21:44:55.350321 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:55.350286    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-e73afc79-aa37-49a0-8744-633c03cad1f4\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a155a55c1ce0e65b\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:44:55.454742 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:55.454712    4060 operation_generator.go:1464] "Controller attach succeeded for volume \"pvc-e73afc79-aa37-49a0-8744-633c03cad1f4\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a155a55c1ce0e65b\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b\") device path: \"\"" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:44:55.552443 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:55.552408    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"pvc-e73afc79-aa37-49a0-8744-633c03cad1f4\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a155a55c1ce0e65b\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:44:55.552631 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:55.552537    4060 operation_generator.go:515] "MountVolume.WaitForAttach entering for volume \"pvc-e73afc79-aa37-49a0-8744-633c03cad1f4\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a155a55c1ce0e65b\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b\") DevicePath \"\"" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:44:55.604542 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:55.604475    4060 operation_generator.go:525] "MountVolume.WaitForAttach succeeded for volume \"pvc-e73afc79-aa37-49a0-8744-633c03cad1f4\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a155a55c1ce0e65b\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b\") DevicePath \"csi-7011c01335d2502f76be252f9498c79824668beecf30ee8f6a7191145201ca4c\"" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:44:55.743671 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:55.743639    4060 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"pvc-e73afc79-aa37-49a0-8744-633c03cad1f4\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a155a55c1ce0e65b\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b\") device mount path \"/var/lib/kubelet/plugins/kubernetes.io/csi/ebs.csi.aws.com/fb02f91ab75afdcfd8c2ac3eaeb0ba7303c67490d38fe3164f5fc7856f2f1875/globalmount\"" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:44:55.807786 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:55.807760    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pvc-e73afc79-aa37-49a0-8744-633c03cad1f4\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a155a55c1ce0e65b\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:44:55.865694 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:55.865633    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:44:56.347080 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:56.347041    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"]
Oct 30 21:44:56.355195 ip-10-0-142-4 kubenswrapper[4060]: W1030 21:44:56.355164    4060 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf60ebc1e_0ad0_4b08_b9b2_ce9705a9b36b.slice/crio-5b0e56eeedccba1ff894b0393eee8dba94531a9914504af12adf9510f449d3f5 WatchSource:0}: Error finding container 5b0e56eeedccba1ff894b0393eee8dba94531a9914504af12adf9510f449d3f5: Status 404 returned error can't find the container with id 5b0e56eeedccba1ff894b0393eee8dba94531a9914504af12adf9510f449d3f5
Oct 30 21:44:56.977988 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:56.977957    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0" event={"ID":"f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b","Type":"ContainerStarted","Data":"d692c692a93808a1580c56381a4c7f593e1eb91cd93a1a6e0b71e26982145be9"}
Oct 30 21:44:56.978152 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:56.978030    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0" event={"ID":"f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b","Type":"ContainerStarted","Data":"5b0e56eeedccba1ff894b0393eee8dba94531a9914504af12adf9510f449d3f5"}
Oct 30 21:44:57.955579 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:44:57.955552    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:45:00.998986 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:45:00.998958    4060 generic.go:356] "Generic (PLEG): container finished" podID="f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b" containerID="d692c692a93808a1580c56381a4c7f593e1eb91cd93a1a6e0b71e26982145be9" exitCode=0
Oct 30 21:45:00.999377 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:45:00.999037    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0" event={"ID":"f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b","Type":"ContainerDied","Data":"d692c692a93808a1580c56381a4c7f593e1eb91cd93a1a6e0b71e26982145be9"}
Oct 30 21:45:02.006264 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:45:02.006224    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0" event={"ID":"f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b","Type":"ContainerStarted","Data":"dd0e0525ee574cc0416b965c2bf4ee19cc2328823862203453c942abf12ff966"}
Oct 30 21:45:02.006670 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:45:02.006298    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0" event={"ID":"f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b","Type":"ContainerStarted","Data":"dab7e653a9bd207f87fea5ff89cf64b4d5b056f92190f6d27eb1dff13b363c5d"}
Oct 30 21:45:02.006670 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:45:02.006323    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0" event={"ID":"f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b","Type":"ContainerStarted","Data":"8470b21921fe7301c97e5df6255323e445aadb05282104b7bb3e692edea86108"}
Oct 30 21:45:02.136138 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:45:02.136080    4060 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0" podStartSLOduration=13.350168992 podStartE2EDuration="17.136066629s" totalImagesPullingTime="0s" totalInitContainerRuntime="3.785897637s" isStatefulPod=true podCreationTimestamp="2026-10-30 21:44:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:45:02.134074763 +0000 UTC m=+4120.891073094" watchObservedRunningTime="2026-10-30 21:45:02.136066629 +0000 UTC m=+4120.893064926"
Oct 30 21:45:05.865972 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:45:05.865916    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:45:10.866040 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:45:10.865996    4060 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:45:10.871688 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:45:10.871665    4060 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:45:11.058940 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:45:11.058914    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:45:12.151579 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:45:12.151544    4060 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v2f4x" containerName="extractor"
Oct 30 21:45:23.557945 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:45:23.557913    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:45:23.558571 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:45:23.558134    4060 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-collector-0" podUID="6160038e-a2c6-4e8b-b03b-1cc3c2b76a40" containerName="otc-container" containerID="cri-o://e69bd0b6dc335716b9c7ca97d555a60617f6fd2ac549e792cf281698f290c778" gracePeriod=30
Oct 30 21:45:25.908977 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:45:25.908954    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:45:26.017505 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:45:26.017455    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/6160038e-a2c6-4e8b-b03b-1cc3c2b76a40-otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/6160038e-a2c6-4e8b-b03b-1cc3c2b76a40-otlp-tls-certs\") pod \"6160038e-a2c6-4e8b-b03b-1cc3c2b76a40\" (UID: \"6160038e-a2c6-4e8b-b03b-1cc3c2b76a40\") "
Oct 30 21:45:26.017666 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:45:26.017514    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/6160038e-a2c6-4e8b-b03b-1cc3c2b76a40-tls-certs\" (UniqueName: \"kubernetes.io/secret/6160038e-a2c6-4e8b-b03b-1cc3c2b76a40-tls-certs\") pod \"6160038e-a2c6-4e8b-b03b-1cc3c2b76a40\" (UID: \"6160038e-a2c6-4e8b-b03b-1cc3c2b76a40\") "
Oct 30 21:45:26.017666 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:45:26.017626    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/6160038e-a2c6-4e8b-b03b-1cc3c2b76a40-otc-internal\" (UniqueName: \"kubernetes.io/configmap/6160038e-a2c6-4e8b-b03b-1cc3c2b76a40-otc-internal\") pod \"6160038e-a2c6-4e8b-b03b-1cc3c2b76a40\" (UID: \"6160038e-a2c6-4e8b-b03b-1cc3c2b76a40\") "
Oct 30 21:45:26.017745 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:45:26.017699    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/6160038e-a2c6-4e8b-b03b-1cc3c2b76a40-data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/6160038e-a2c6-4e8b-b03b-1cc3c2b76a40-data-science-collector-ta-client-cert\") pod \"6160038e-a2c6-4e8b-b03b-1cc3c2b76a40\" (UID: \"6160038e-a2c6-4e8b-b03b-1cc3c2b76a40\") "
Oct 30 21:45:26.017782 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:45:26.017749    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6160038e-a2c6-4e8b-b03b-1cc3c2b76a40-kube-api-access-9sz8w\" (UniqueName: \"kubernetes.io/projected/6160038e-a2c6-4e8b-b03b-1cc3c2b76a40-kube-api-access-9sz8w\") pod \"6160038e-a2c6-4e8b-b03b-1cc3c2b76a40\" (UID: \"6160038e-a2c6-4e8b-b03b-1cc3c2b76a40\") "
Oct 30 21:45:26.017838 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:45:26.017782    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/6160038e-a2c6-4e8b-b03b-1cc3c2b76a40-monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/6160038e-a2c6-4e8b-b03b-1cc3c2b76a40-monitoring-tls-certs\") pod \"6160038e-a2c6-4e8b-b03b-1cc3c2b76a40\" (UID: \"6160038e-a2c6-4e8b-b03b-1cc3c2b76a40\") "
Oct 30 21:45:26.018013 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:45:26.017984    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6160038e-a2c6-4e8b-b03b-1cc3c2b76a40-otc-internal" pod "6160038e-a2c6-4e8b-b03b-1cc3c2b76a40" (UID: "6160038e-a2c6-4e8b-b03b-1cc3c2b76a40"). InnerVolumeSpecName "otc-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:45:26.019806 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:45:26.019779    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6160038e-a2c6-4e8b-b03b-1cc3c2b76a40-tls-certs" pod "6160038e-a2c6-4e8b-b03b-1cc3c2b76a40" (UID: "6160038e-a2c6-4e8b-b03b-1cc3c2b76a40"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:45:26.019806 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:45:26.019796    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6160038e-a2c6-4e8b-b03b-1cc3c2b76a40-otlp-tls-certs" pod "6160038e-a2c6-4e8b-b03b-1cc3c2b76a40" (UID: "6160038e-a2c6-4e8b-b03b-1cc3c2b76a40"). InnerVolumeSpecName "otlp-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:45:26.019933 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:45:26.019830    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6160038e-a2c6-4e8b-b03b-1cc3c2b76a40-data-science-collector-ta-client-cert" pod "6160038e-a2c6-4e8b-b03b-1cc3c2b76a40" (UID: "6160038e-a2c6-4e8b-b03b-1cc3c2b76a40"). InnerVolumeSpecName "data-science-collector-ta-client-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:45:26.020218 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:45:26.020203    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6160038e-a2c6-4e8b-b03b-1cc3c2b76a40-monitoring-tls-certs" pod "6160038e-a2c6-4e8b-b03b-1cc3c2b76a40" (UID: "6160038e-a2c6-4e8b-b03b-1cc3c2b76a40"). InnerVolumeSpecName "monitoring-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:45:26.020275 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:45:26.020251    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6160038e-a2c6-4e8b-b03b-1cc3c2b76a40-kube-api-access-9sz8w" pod "6160038e-a2c6-4e8b-b03b-1cc3c2b76a40" (UID: "6160038e-a2c6-4e8b-b03b-1cc3c2b76a40"). InnerVolumeSpecName "kube-api-access-9sz8w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:45:26.118841 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:45:26.118809    4060 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9sz8w\" (UniqueName: \"kubernetes.io/projected/6160038e-a2c6-4e8b-b03b-1cc3c2b76a40-kube-api-access-9sz8w\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:45:26.118841 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:45:26.118836    4060 reconciler_common.go:299] "Volume detached for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/6160038e-a2c6-4e8b-b03b-1cc3c2b76a40-monitoring-tls-certs\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:45:26.118841 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:45:26.118847    4060 reconciler_common.go:299] "Volume detached for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/6160038e-a2c6-4e8b-b03b-1cc3c2b76a40-otlp-tls-certs\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:45:26.119087 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:45:26.118856    4060 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6160038e-a2c6-4e8b-b03b-1cc3c2b76a40-tls-certs\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:45:26.119087 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:45:26.118872    4060 reconciler_common.go:299] "Volume detached for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/6160038e-a2c6-4e8b-b03b-1cc3c2b76a40-otc-internal\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:45:26.119087 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:45:26.118883    4060 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/6160038e-a2c6-4e8b-b03b-1cc3c2b76a40-data-science-collector-ta-client-cert\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:45:26.127222 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:45:26.127190    4060 generic.go:356] "Generic (PLEG): container finished" podID="6160038e-a2c6-4e8b-b03b-1cc3c2b76a40" containerID="e69bd0b6dc335716b9c7ca97d555a60617f6fd2ac549e792cf281698f290c778" exitCode=0
Oct 30 21:45:26.127362 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:45:26.127253    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:45:26.127362 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:45:26.127263    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"6160038e-a2c6-4e8b-b03b-1cc3c2b76a40","Type":"ContainerDied","Data":"e69bd0b6dc335716b9c7ca97d555a60617f6fd2ac549e792cf281698f290c778"}
Oct 30 21:45:26.127362 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:45:26.127310    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"6160038e-a2c6-4e8b-b03b-1cc3c2b76a40","Type":"ContainerDied","Data":"1d6e4b35a63a09c04228ff38c2917f9760988caee8b63aa6e00eba59a776d2fb"}
Oct 30 21:45:26.127518 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:45:26.127343    4060 scope.go:122] "RemoveContainer" containerID="e69bd0b6dc335716b9c7ca97d555a60617f6fd2ac549e792cf281698f290c778"
Oct 30 21:45:26.136435 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:45:26.136419    4060 scope.go:122] "RemoveContainer" containerID="e69bd0b6dc335716b9c7ca97d555a60617f6fd2ac549e792cf281698f290c778"
Oct 30 21:45:26.136722 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:45:26.136704    4060 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e69bd0b6dc335716b9c7ca97d555a60617f6fd2ac549e792cf281698f290c778\": container with ID starting with e69bd0b6dc335716b9c7ca97d555a60617f6fd2ac549e792cf281698f290c778 not found: ID does not exist" containerID="e69bd0b6dc335716b9c7ca97d555a60617f6fd2ac549e792cf281698f290c778"
Oct 30 21:45:26.136777 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:45:26.136728    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e69bd0b6dc335716b9c7ca97d555a60617f6fd2ac549e792cf281698f290c778"} err="failed to get container status \"e69bd0b6dc335716b9c7ca97d555a60617f6fd2ac549e792cf281698f290c778\": rpc error: code = NotFound desc = could not find container \"e69bd0b6dc335716b9c7ca97d555a60617f6fd2ac549e792cf281698f290c778\": container with ID starting with e69bd0b6dc335716b9c7ca97d555a60617f6fd2ac549e792cf281698f290c778 not found: ID does not exist"
Oct 30 21:45:26.296661 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:45:26.296592    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:45:26.302299 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:45:26.302273    4060 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:45:26.387813 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:45:26.387779    4060 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:45:26.388188 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:45:26.388171    4060 cpu_manager.go:414] "containerMap: removing container" podUID="6160038e-a2c6-4e8b-b03b-1cc3c2b76a40" containerName="otc-container"
Oct 30 21:45:26.388276 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:45:26.388191    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6160038e-a2c6-4e8b-b03b-1cc3c2b76a40" containerName="otc-container"
Oct 30 21:45:26.388329 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:45:26.388293    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="6160038e-a2c6-4e8b-b03b-1cc3c2b76a40" containerName="otc-container"
Oct 30 21:45:26.392515 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:45:26.392471    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:45:26.446437 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:45:26.446408    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-a0f9182a\""
Oct 30 21:45:26.449174 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:45:26.449154    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-tls\""
Oct 30 21:45:26.449335 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:45:26.449318    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-ta-client-cert\""
Oct 30 21:45:26.449409 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:45:26.449350    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-dockercfg-7bnjl\""
Oct 30 21:45:26.449409 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:45:26.449381    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-headless-tls\""
Oct 30 21:45:26.449518 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:45:26.449420    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-monitoring-tls\""
Oct 30 21:45:26.464750 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:45:26.464725    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:45:26.522388 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:45:26.522361    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/58f2205b-ef44-4e0e-ab55-2dbdb302dbfb-monitoring-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"58f2205b-ef44-4e0e-ab55-2dbdb302dbfb\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:45:26.522572 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:45:26.522401    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/58f2205b-ef44-4e0e-ab55-2dbdb302dbfb-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-0\" (UID: \"58f2205b-ef44-4e0e-ab55-2dbdb302dbfb\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:45:26.522572 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:45:26.522420    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/58f2205b-ef44-4e0e-ab55-2dbdb302dbfb-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"58f2205b-ef44-4e0e-ab55-2dbdb302dbfb\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:45:26.522572 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:45:26.522484    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/58f2205b-ef44-4e0e-ab55-2dbdb302dbfb-otlp-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"58f2205b-ef44-4e0e-ab55-2dbdb302dbfb\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:45:26.522716 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:45:26.522638    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/58f2205b-ef44-4e0e-ab55-2dbdb302dbfb-otc-internal\") pod \"data-science-collector-collector-0\" (UID: \"58f2205b-ef44-4e0e-ab55-2dbdb302dbfb\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:45:26.522716 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:45:26.522681    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7wmx6\" (UniqueName: \"kubernetes.io/projected/58f2205b-ef44-4e0e-ab55-2dbdb302dbfb-kube-api-access-7wmx6\") pod \"data-science-collector-collector-0\" (UID: \"58f2205b-ef44-4e0e-ab55-2dbdb302dbfb\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:45:26.624009 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:45:26.623916    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/58f2205b-ef44-4e0e-ab55-2dbdb302dbfb-otlp-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"58f2205b-ef44-4e0e-ab55-2dbdb302dbfb\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:45:26.624009 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:45:26.623955    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/58f2205b-ef44-4e0e-ab55-2dbdb302dbfb-otc-internal\") pod \"data-science-collector-collector-0\" (UID: \"58f2205b-ef44-4e0e-ab55-2dbdb302dbfb\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:45:26.624009 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:45:26.623987    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7wmx6\" (UniqueName: \"kubernetes.io/projected/58f2205b-ef44-4e0e-ab55-2dbdb302dbfb-kube-api-access-7wmx6\") pod \"data-science-collector-collector-0\" (UID: \"58f2205b-ef44-4e0e-ab55-2dbdb302dbfb\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:45:26.624337 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:45:26.624028    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/58f2205b-ef44-4e0e-ab55-2dbdb302dbfb-monitoring-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"58f2205b-ef44-4e0e-ab55-2dbdb302dbfb\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:45:26.624337 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:45:26.624052    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/58f2205b-ef44-4e0e-ab55-2dbdb302dbfb-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-0\" (UID: \"58f2205b-ef44-4e0e-ab55-2dbdb302dbfb\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:45:26.624337 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:45:26.624067    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/58f2205b-ef44-4e0e-ab55-2dbdb302dbfb-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"58f2205b-ef44-4e0e-ab55-2dbdb302dbfb\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:45:26.624862 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:45:26.624838    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/58f2205b-ef44-4e0e-ab55-2dbdb302dbfb-otc-internal\") pod \"data-science-collector-collector-0\" (UID: \"58f2205b-ef44-4e0e-ab55-2dbdb302dbfb\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:45:26.627125 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:45:26.627095    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/58f2205b-ef44-4e0e-ab55-2dbdb302dbfb-monitoring-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"58f2205b-ef44-4e0e-ab55-2dbdb302dbfb\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:45:26.627225 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:45:26.627110    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/58f2205b-ef44-4e0e-ab55-2dbdb302dbfb-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"58f2205b-ef44-4e0e-ab55-2dbdb302dbfb\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:45:26.627225 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:45:26.627170    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/58f2205b-ef44-4e0e-ab55-2dbdb302dbfb-otlp-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"58f2205b-ef44-4e0e-ab55-2dbdb302dbfb\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:45:26.627304 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:45:26.627237    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/58f2205b-ef44-4e0e-ab55-2dbdb302dbfb-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-0\" (UID: \"58f2205b-ef44-4e0e-ab55-2dbdb302dbfb\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:45:26.685613 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:45:26.685577    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7wmx6\" (UniqueName: \"kubernetes.io/projected/58f2205b-ef44-4e0e-ab55-2dbdb302dbfb-kube-api-access-7wmx6\") pod \"data-science-collector-collector-0\" (UID: \"58f2205b-ef44-4e0e-ab55-2dbdb302dbfb\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:45:26.705440 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:45:26.705407    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:45:27.081158 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:45:27.081123    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:45:27.085249 ip-10-0-142-4 kubenswrapper[4060]: W1030 21:45:27.085217    4060 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58f2205b_ef44_4e0e_ab55_2dbdb302dbfb.slice/crio-92be62543e073e4121624f0b75fb74965053b3287eed513cd1aa0b863fbabad3 WatchSource:0}: Error finding container 92be62543e073e4121624f0b75fb74965053b3287eed513cd1aa0b863fbabad3: Status 404 returned error can't find the container with id 92be62543e073e4121624f0b75fb74965053b3287eed513cd1aa0b863fbabad3
Oct 30 21:45:27.087622 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:45:27.087580    4060 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 21:45:27.087702 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:45:27.087659    4060 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 21:45:27.134822 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:45:27.134791    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"58f2205b-ef44-4e0e-ab55-2dbdb302dbfb","Type":"ContainerStarted","Data":"92be62543e073e4121624f0b75fb74965053b3287eed513cd1aa0b863fbabad3"}
Oct 30 21:45:27.426922 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:45:27.426842    4060 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="6160038e-a2c6-4e8b-b03b-1cc3c2b76a40" path="/var/lib/kubelet/pods/6160038e-a2c6-4e8b-b03b-1cc3c2b76a40/volumes"
Oct 30 21:45:28.147267 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:45:28.147231    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"58f2205b-ef44-4e0e-ab55-2dbdb302dbfb","Type":"ContainerStarted","Data":"0e923303a3aa82d5cbc5c4ecccb4892cf241651ccafb054a5afeb7aed5c0c623"}
Oct 30 21:45:28.268882 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:45:28.268831    4060 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-collector-0" podStartSLOduration=2.2688187969999998 podStartE2EDuration="2.268818797s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:45:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:45:28.265068141 +0000 UTC m=+4147.022066441" watchObservedRunningTime="2026-10-30 21:45:28.268818797 +0000 UTC m=+4147.025817094"
Oct 30 21:45:42.150517 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:45:42.150461    4060 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v2f4x" containerName="extractor"
Oct 30 21:45:54.720510 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:45:54.720462    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:45:54.721019 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:45:54.720688    4060 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-collector-0" podUID="58f2205b-ef44-4e0e-ab55-2dbdb302dbfb" containerName="otc-container" containerID="cri-o://0e923303a3aa82d5cbc5c4ecccb4892cf241651ccafb054a5afeb7aed5c0c623" gracePeriod=30
Oct 30 21:45:57.065463 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:45:57.065434    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:45:57.193717 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:45:57.193633    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/58f2205b-ef44-4e0e-ab55-2dbdb302dbfb-otc-internal\" (UniqueName: \"kubernetes.io/configmap/58f2205b-ef44-4e0e-ab55-2dbdb302dbfb-otc-internal\") pod \"58f2205b-ef44-4e0e-ab55-2dbdb302dbfb\" (UID: \"58f2205b-ef44-4e0e-ab55-2dbdb302dbfb\") "
Oct 30 21:45:57.193890 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:45:57.193722    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/58f2205b-ef44-4e0e-ab55-2dbdb302dbfb-tls-certs\" (UniqueName: \"kubernetes.io/secret/58f2205b-ef44-4e0e-ab55-2dbdb302dbfb-tls-certs\") pod \"58f2205b-ef44-4e0e-ab55-2dbdb302dbfb\" (UID: \"58f2205b-ef44-4e0e-ab55-2dbdb302dbfb\") "
Oct 30 21:45:57.193890 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:45:57.193756    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/58f2205b-ef44-4e0e-ab55-2dbdb302dbfb-kube-api-access-7wmx6\" (UniqueName: \"kubernetes.io/projected/58f2205b-ef44-4e0e-ab55-2dbdb302dbfb-kube-api-access-7wmx6\") pod \"58f2205b-ef44-4e0e-ab55-2dbdb302dbfb\" (UID: \"58f2205b-ef44-4e0e-ab55-2dbdb302dbfb\") "
Oct 30 21:45:57.193890 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:45:57.193817    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/58f2205b-ef44-4e0e-ab55-2dbdb302dbfb-otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/58f2205b-ef44-4e0e-ab55-2dbdb302dbfb-otlp-tls-certs\") pod \"58f2205b-ef44-4e0e-ab55-2dbdb302dbfb\" (UID: \"58f2205b-ef44-4e0e-ab55-2dbdb302dbfb\") "
Oct 30 21:45:57.193890 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:45:57.193877    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/58f2205b-ef44-4e0e-ab55-2dbdb302dbfb-monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/58f2205b-ef44-4e0e-ab55-2dbdb302dbfb-monitoring-tls-certs\") pod \"58f2205b-ef44-4e0e-ab55-2dbdb302dbfb\" (UID: \"58f2205b-ef44-4e0e-ab55-2dbdb302dbfb\") "
Oct 30 21:45:57.194136 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:45:57.193963    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/58f2205b-ef44-4e0e-ab55-2dbdb302dbfb-data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/58f2205b-ef44-4e0e-ab55-2dbdb302dbfb-data-science-collector-ta-client-cert\") pod \"58f2205b-ef44-4e0e-ab55-2dbdb302dbfb\" (UID: \"58f2205b-ef44-4e0e-ab55-2dbdb302dbfb\") "
Oct 30 21:45:57.194136 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:45:57.194072    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/58f2205b-ef44-4e0e-ab55-2dbdb302dbfb-otc-internal" pod "58f2205b-ef44-4e0e-ab55-2dbdb302dbfb" (UID: "58f2205b-ef44-4e0e-ab55-2dbdb302dbfb"). InnerVolumeSpecName "otc-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:45:57.194276 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:45:57.194248    4060 reconciler_common.go:299] "Volume detached for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/58f2205b-ef44-4e0e-ab55-2dbdb302dbfb-otc-internal\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:45:57.196355 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:45:57.196307    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/58f2205b-ef44-4e0e-ab55-2dbdb302dbfb-otlp-tls-certs" pod "58f2205b-ef44-4e0e-ab55-2dbdb302dbfb" (UID: "58f2205b-ef44-4e0e-ab55-2dbdb302dbfb"). InnerVolumeSpecName "otlp-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:45:57.196485 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:45:57.196430    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/58f2205b-ef44-4e0e-ab55-2dbdb302dbfb-data-science-collector-ta-client-cert" pod "58f2205b-ef44-4e0e-ab55-2dbdb302dbfb" (UID: "58f2205b-ef44-4e0e-ab55-2dbdb302dbfb"). InnerVolumeSpecName "data-science-collector-ta-client-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:45:57.196578 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:45:57.196531    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/58f2205b-ef44-4e0e-ab55-2dbdb302dbfb-tls-certs" pod "58f2205b-ef44-4e0e-ab55-2dbdb302dbfb" (UID: "58f2205b-ef44-4e0e-ab55-2dbdb302dbfb"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:45:57.196753 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:45:57.196730    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/58f2205b-ef44-4e0e-ab55-2dbdb302dbfb-monitoring-tls-certs" pod "58f2205b-ef44-4e0e-ab55-2dbdb302dbfb" (UID: "58f2205b-ef44-4e0e-ab55-2dbdb302dbfb"). InnerVolumeSpecName "monitoring-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:45:57.196831 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:45:57.196732    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/58f2205b-ef44-4e0e-ab55-2dbdb302dbfb-kube-api-access-7wmx6" pod "58f2205b-ef44-4e0e-ab55-2dbdb302dbfb" (UID: "58f2205b-ef44-4e0e-ab55-2dbdb302dbfb"). InnerVolumeSpecName "kube-api-access-7wmx6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:45:57.290736 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:45:57.290702    4060 generic.go:356] "Generic (PLEG): container finished" podID="58f2205b-ef44-4e0e-ab55-2dbdb302dbfb" containerID="0e923303a3aa82d5cbc5c4ecccb4892cf241651ccafb054a5afeb7aed5c0c623" exitCode=0
Oct 30 21:45:57.290938 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:45:57.290755    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:45:57.290938 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:45:57.290781    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"58f2205b-ef44-4e0e-ab55-2dbdb302dbfb","Type":"ContainerDied","Data":"0e923303a3aa82d5cbc5c4ecccb4892cf241651ccafb054a5afeb7aed5c0c623"}
Oct 30 21:45:57.290938 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:45:57.290833    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"58f2205b-ef44-4e0e-ab55-2dbdb302dbfb","Type":"ContainerDied","Data":"92be62543e073e4121624f0b75fb74965053b3287eed513cd1aa0b863fbabad3"}
Oct 30 21:45:57.290938 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:45:57.290862    4060 scope.go:122] "RemoveContainer" containerID="0e923303a3aa82d5cbc5c4ecccb4892cf241651ccafb054a5afeb7aed5c0c623"
Oct 30 21:45:57.295023 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:45:57.294996    4060 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/58f2205b-ef44-4e0e-ab55-2dbdb302dbfb-data-science-collector-ta-client-cert\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:45:57.295219 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:45:57.295025    4060 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/58f2205b-ef44-4e0e-ab55-2dbdb302dbfb-tls-certs\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:45:57.295219 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:45:57.295043    4060 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7wmx6\" (UniqueName: \"kubernetes.io/projected/58f2205b-ef44-4e0e-ab55-2dbdb302dbfb-kube-api-access-7wmx6\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:45:57.295219 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:45:57.295060    4060 reconciler_common.go:299] "Volume detached for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/58f2205b-ef44-4e0e-ab55-2dbdb302dbfb-otlp-tls-certs\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:45:57.295219 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:45:57.295074    4060 reconciler_common.go:299] "Volume detached for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/58f2205b-ef44-4e0e-ab55-2dbdb302dbfb-monitoring-tls-certs\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:45:57.300311 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:45:57.300295    4060 scope.go:122] "RemoveContainer" containerID="0e923303a3aa82d5cbc5c4ecccb4892cf241651ccafb054a5afeb7aed5c0c623"
Oct 30 21:45:57.300574 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:45:57.300557    4060 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0e923303a3aa82d5cbc5c4ecccb4892cf241651ccafb054a5afeb7aed5c0c623\": container with ID starting with 0e923303a3aa82d5cbc5c4ecccb4892cf241651ccafb054a5afeb7aed5c0c623 not found: ID does not exist" containerID="0e923303a3aa82d5cbc5c4ecccb4892cf241651ccafb054a5afeb7aed5c0c623"
Oct 30 21:45:57.300635 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:45:57.300583    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0e923303a3aa82d5cbc5c4ecccb4892cf241651ccafb054a5afeb7aed5c0c623"} err="failed to get container status \"0e923303a3aa82d5cbc5c4ecccb4892cf241651ccafb054a5afeb7aed5c0c623\": rpc error: code = NotFound desc = could not find container \"0e923303a3aa82d5cbc5c4ecccb4892cf241651ccafb054a5afeb7aed5c0c623\": container with ID starting with 0e923303a3aa82d5cbc5c4ecccb4892cf241651ccafb054a5afeb7aed5c0c623 not found: ID does not exist"
Oct 30 21:45:57.458289 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:45:57.458251    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:45:57.463648 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:45:57.463621    4060 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:45:57.550734 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:45:57.550699    4060 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:45:57.551054 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:45:57.551033    4060 cpu_manager.go:414] "containerMap: removing container" podUID="58f2205b-ef44-4e0e-ab55-2dbdb302dbfb" containerName="otc-container"
Oct 30 21:45:57.551054 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:45:57.551047    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="58f2205b-ef44-4e0e-ab55-2dbdb302dbfb" containerName="otc-container"
Oct 30 21:45:57.551208 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:45:57.551120    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="58f2205b-ef44-4e0e-ab55-2dbdb302dbfb" containerName="otc-container"
Oct 30 21:45:57.555418 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:45:57.555399    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:45:57.608609 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:45:57.608582    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-dockercfg-7bnjl\""
Oct 30 21:45:57.608764 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:45:57.608708    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-headless-tls\""
Oct 30 21:45:57.608916 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:45:57.608905    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-tls\""
Oct 30 21:45:57.609080 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:45:57.609070    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-ta-client-cert\""
Oct 30 21:45:57.609116 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:45:57.609082    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-a0f9182a\""
Oct 30 21:45:57.609340 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:45:57.609328    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-monitoring-tls\""
Oct 30 21:45:57.616362 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:45:57.616335    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:45:57.699127 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:45:57.699095    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/98a7a4c0-7848-4c42-a377-3aa6aadb77b6-monitoring-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"98a7a4c0-7848-4c42-a377-3aa6aadb77b6\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:45:57.699127 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:45:57.699129    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jtxx6\" (UniqueName: \"kubernetes.io/projected/98a7a4c0-7848-4c42-a377-3aa6aadb77b6-kube-api-access-jtxx6\") pod \"data-science-collector-collector-0\" (UID: \"98a7a4c0-7848-4c42-a377-3aa6aadb77b6\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:45:57.699379 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:45:57.699163    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/98a7a4c0-7848-4c42-a377-3aa6aadb77b6-otlp-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"98a7a4c0-7848-4c42-a377-3aa6aadb77b6\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:45:57.699379 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:45:57.699276    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/98a7a4c0-7848-4c42-a377-3aa6aadb77b6-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"98a7a4c0-7848-4c42-a377-3aa6aadb77b6\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:45:57.699379 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:45:57.699331    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/98a7a4c0-7848-4c42-a377-3aa6aadb77b6-otc-internal\") pod \"data-science-collector-collector-0\" (UID: \"98a7a4c0-7848-4c42-a377-3aa6aadb77b6\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:45:57.699538 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:45:57.699433    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/98a7a4c0-7848-4c42-a377-3aa6aadb77b6-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-0\" (UID: \"98a7a4c0-7848-4c42-a377-3aa6aadb77b6\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:45:57.800246 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:45:57.800146    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/98a7a4c0-7848-4c42-a377-3aa6aadb77b6-monitoring-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"98a7a4c0-7848-4c42-a377-3aa6aadb77b6\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:45:57.800246 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:45:57.800190    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jtxx6\" (UniqueName: \"kubernetes.io/projected/98a7a4c0-7848-4c42-a377-3aa6aadb77b6-kube-api-access-jtxx6\") pod \"data-science-collector-collector-0\" (UID: \"98a7a4c0-7848-4c42-a377-3aa6aadb77b6\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:45:57.800246 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:45:57.800236    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/98a7a4c0-7848-4c42-a377-3aa6aadb77b6-otlp-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"98a7a4c0-7848-4c42-a377-3aa6aadb77b6\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:45:57.800596 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:45:57.800282    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/98a7a4c0-7848-4c42-a377-3aa6aadb77b6-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"98a7a4c0-7848-4c42-a377-3aa6aadb77b6\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:45:57.800596 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:45:57.800323    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/98a7a4c0-7848-4c42-a377-3aa6aadb77b6-otc-internal\") pod \"data-science-collector-collector-0\" (UID: \"98a7a4c0-7848-4c42-a377-3aa6aadb77b6\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:45:57.800596 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:45:57.800371    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/98a7a4c0-7848-4c42-a377-3aa6aadb77b6-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-0\" (UID: \"98a7a4c0-7848-4c42-a377-3aa6aadb77b6\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:45:57.801196 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:45:57.801164    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/98a7a4c0-7848-4c42-a377-3aa6aadb77b6-otc-internal\") pod \"data-science-collector-collector-0\" (UID: \"98a7a4c0-7848-4c42-a377-3aa6aadb77b6\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:45:57.803062 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:45:57.803033    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/98a7a4c0-7848-4c42-a377-3aa6aadb77b6-monitoring-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"98a7a4c0-7848-4c42-a377-3aa6aadb77b6\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:45:57.803211 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:45:57.803173    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/98a7a4c0-7848-4c42-a377-3aa6aadb77b6-otlp-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"98a7a4c0-7848-4c42-a377-3aa6aadb77b6\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:45:57.803211 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:45:57.803189    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/98a7a4c0-7848-4c42-a377-3aa6aadb77b6-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-0\" (UID: \"98a7a4c0-7848-4c42-a377-3aa6aadb77b6\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:45:57.803586 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:45:57.803567    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/98a7a4c0-7848-4c42-a377-3aa6aadb77b6-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"98a7a4c0-7848-4c42-a377-3aa6aadb77b6\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:45:57.861837 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:45:57.861807    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jtxx6\" (UniqueName: \"kubernetes.io/projected/98a7a4c0-7848-4c42-a377-3aa6aadb77b6-kube-api-access-jtxx6\") pod \"data-science-collector-collector-0\" (UID: \"98a7a4c0-7848-4c42-a377-3aa6aadb77b6\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:45:57.880310 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:45:57.880275    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:45:58.258103 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:45:58.258084    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:45:58.260385 ip-10-0-142-4 kubenswrapper[4060]: W1030 21:45:58.260354    4060 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98a7a4c0_7848_4c42_a377_3aa6aadb77b6.slice/crio-c4c9632ce2be798dd3c25d1b4daebc62f8d1c0560e6d4f83c0f963d69a8ce751 WatchSource:0}: Error finding container c4c9632ce2be798dd3c25d1b4daebc62f8d1c0560e6d4f83c0f963d69a8ce751: Status 404 returned error can't find the container with id c4c9632ce2be798dd3c25d1b4daebc62f8d1c0560e6d4f83c0f963d69a8ce751
Oct 30 21:45:58.262891 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:45:58.262840    4060 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 21:45:58.262988 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:45:58.262935    4060 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 21:45:58.299311 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:45:58.299279    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"98a7a4c0-7848-4c42-a377-3aa6aadb77b6","Type":"ContainerStarted","Data":"c4c9632ce2be798dd3c25d1b4daebc62f8d1c0560e6d4f83c0f963d69a8ce751"}
Oct 30 21:45:59.305454 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:45:59.305419    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"98a7a4c0-7848-4c42-a377-3aa6aadb77b6","Type":"ContainerStarted","Data":"e7f01da8031c3d7763ddce6989f1f2eac171835a256db7d3cb49d59c77a07d74"}
Oct 30 21:45:59.428610 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:45:59.428575    4060 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="58f2205b-ef44-4e0e-ab55-2dbdb302dbfb" path="/var/lib/kubelet/pods/58f2205b-ef44-4e0e-ab55-2dbdb302dbfb/volumes"
Oct 30 21:45:59.474006 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:45:59.473959    4060 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-collector-0" podStartSLOduration=2.473940584 podStartE2EDuration="2.473940584s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:45:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:45:59.423886223 +0000 UTC m=+4178.180884521" watchObservedRunningTime="2026-10-30 21:45:59.473940584 +0000 UTC m=+4178.230938948"
Oct 30 21:46:07.904832 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:07.904748    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-kld84"]
Oct 30 21:46:07.905304 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:07.905009    4060 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-kld84" podUID="6d0bf513-04a6-4525-b66f-0e3f8b79a0f5" containerName="kube-rbac-proxy" containerID="cri-o://bc470a2aa64eebe5f2cda00a7d28d72516f3a411aaf6eafc04bf58260384f867" gracePeriod=30
Oct 30 21:46:08.060106 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:08.060073    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/korrel8r-5cbcc89b8f-t59pj"]
Oct 30 21:46:08.060312 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:08.060276    4060 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-t59pj" podUID="99506ac5-5ea3-4889-8486-b0c05f375235" containerName="korrel8r" containerID="cri-o://0bc27eebeb01c849d9b3d4d8d1e946dc9ac20c83e7efcf8424a55cfec4626318" gracePeriod=30
Oct 30 21:46:08.185364 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:08.185332    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-kld84"
Oct 30 21:46:08.290836 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:08.290801    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/6d0bf513-04a6-4525-b66f-0e3f8b79a0f5-prometheus-ca\" (UniqueName: \"kubernetes.io/configmap/6d0bf513-04a6-4525-b66f-0e3f8b79a0f5-prometheus-ca\") pod \"6d0bf513-04a6-4525-b66f-0e3f8b79a0f5\" (UID: \"6d0bf513-04a6-4525-b66f-0e3f8b79a0f5\") "
Oct 30 21:46:08.291021 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:08.290858    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/6d0bf513-04a6-4525-b66f-0e3f8b79a0f5-prometheus-client-cert\" (UniqueName: \"kubernetes.io/secret/6d0bf513-04a6-4525-b66f-0e3f8b79a0f5-prometheus-client-cert\") pod \"6d0bf513-04a6-4525-b66f-0e3f8b79a0f5\" (UID: \"6d0bf513-04a6-4525-b66f-0e3f8b79a0f5\") "
Oct 30 21:46:08.291021 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:08.290937    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6d0bf513-04a6-4525-b66f-0e3f8b79a0f5-kube-api-access-2gc4d\" (UniqueName: \"kubernetes.io/projected/6d0bf513-04a6-4525-b66f-0e3f8b79a0f5-kube-api-access-2gc4d\") pod \"6d0bf513-04a6-4525-b66f-0e3f8b79a0f5\" (UID: \"6d0bf513-04a6-4525-b66f-0e3f8b79a0f5\") "
Oct 30 21:46:08.291250 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:08.291103    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/6d0bf513-04a6-4525-b66f-0e3f8b79a0f5-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6d0bf513-04a6-4525-b66f-0e3f8b79a0f5-kube-rbac-proxy-config\") pod \"6d0bf513-04a6-4525-b66f-0e3f8b79a0f5\" (UID: \"6d0bf513-04a6-4525-b66f-0e3f8b79a0f5\") "
Oct 30 21:46:08.291250 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:08.291178    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/6d0bf513-04a6-4525-b66f-0e3f8b79a0f5-tls\" (UniqueName: \"kubernetes.io/secret/6d0bf513-04a6-4525-b66f-0e3f8b79a0f5-tls\") pod \"6d0bf513-04a6-4525-b66f-0e3f8b79a0f5\" (UID: \"6d0bf513-04a6-4525-b66f-0e3f8b79a0f5\") "
Oct 30 21:46:08.291250 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:08.291183    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6d0bf513-04a6-4525-b66f-0e3f8b79a0f5-prometheus-ca" pod "6d0bf513-04a6-4525-b66f-0e3f8b79a0f5" (UID: "6d0bf513-04a6-4525-b66f-0e3f8b79a0f5"). InnerVolumeSpecName "prometheus-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:46:08.291551 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:08.291456    4060 reconciler_common.go:299] "Volume detached for volume \"prometheus-ca\" (UniqueName: \"kubernetes.io/configmap/6d0bf513-04a6-4525-b66f-0e3f8b79a0f5-prometheus-ca\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:46:08.293053 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:08.293026    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6d0bf513-04a6-4525-b66f-0e3f8b79a0f5-prometheus-client-cert" pod "6d0bf513-04a6-4525-b66f-0e3f8b79a0f5" (UID: "6d0bf513-04a6-4525-b66f-0e3f8b79a0f5"). InnerVolumeSpecName "prometheus-client-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:46:08.293301 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:08.293285    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6d0bf513-04a6-4525-b66f-0e3f8b79a0f5-kube-rbac-proxy-config" pod "6d0bf513-04a6-4525-b66f-0e3f8b79a0f5" (UID: "6d0bf513-04a6-4525-b66f-0e3f8b79a0f5"). InnerVolumeSpecName "kube-rbac-proxy-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:46:08.293507 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:08.293474    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6d0bf513-04a6-4525-b66f-0e3f8b79a0f5-kube-api-access-2gc4d" pod "6d0bf513-04a6-4525-b66f-0e3f8b79a0f5" (UID: "6d0bf513-04a6-4525-b66f-0e3f8b79a0f5"). InnerVolumeSpecName "kube-api-access-2gc4d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:46:08.293564 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:08.293470    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6d0bf513-04a6-4525-b66f-0e3f8b79a0f5-tls" pod "6d0bf513-04a6-4525-b66f-0e3f8b79a0f5" (UID: "6d0bf513-04a6-4525-b66f-0e3f8b79a0f5"). InnerVolumeSpecName "tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:46:08.299659 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:08.299640    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-t59pj"
Oct 30 21:46:08.350199 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:08.350168    4060 generic.go:356] "Generic (PLEG): container finished" podID="99506ac5-5ea3-4889-8486-b0c05f375235" containerID="0bc27eebeb01c849d9b3d4d8d1e946dc9ac20c83e7efcf8424a55cfec4626318" exitCode=0
Oct 30 21:46:08.350374 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:08.350211    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-t59pj"
Oct 30 21:46:08.350374 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:08.350254    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-t59pj" event={"ID":"99506ac5-5ea3-4889-8486-b0c05f375235","Type":"ContainerDied","Data":"0bc27eebeb01c849d9b3d4d8d1e946dc9ac20c83e7efcf8424a55cfec4626318"}
Oct 30 21:46:08.350374 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:08.350324    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-t59pj" event={"ID":"99506ac5-5ea3-4889-8486-b0c05f375235","Type":"ContainerDied","Data":"2e939c14dcf151b0be5ee835ee1506b1e038b271d24239b6e2b651389c9ff7c4"}
Oct 30 21:46:08.350374 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:08.350356    4060 scope.go:122] "RemoveContainer" containerID="0bc27eebeb01c849d9b3d4d8d1e946dc9ac20c83e7efcf8424a55cfec4626318"
Oct 30 21:46:08.351598 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:08.351578    4060 generic.go:356] "Generic (PLEG): container finished" podID="6d0bf513-04a6-4525-b66f-0e3f8b79a0f5" containerID="bc470a2aa64eebe5f2cda00a7d28d72516f3a411aaf6eafc04bf58260384f867" exitCode=0
Oct 30 21:46:08.351689 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:08.351611    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-kld84" event={"ID":"6d0bf513-04a6-4525-b66f-0e3f8b79a0f5","Type":"ContainerDied","Data":"bc470a2aa64eebe5f2cda00a7d28d72516f3a411aaf6eafc04bf58260384f867"}
Oct 30 21:46:08.351689 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:08.351628    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-kld84"
Oct 30 21:46:08.351689 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:08.351649    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-kld84" event={"ID":"6d0bf513-04a6-4525-b66f-0e3f8b79a0f5","Type":"ContainerDied","Data":"93da6caa364861e5c5a84de4fd39f0bcdce160623adcca76abe0169747d01788"}
Oct 30 21:46:08.359565 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:08.359539    4060 scope.go:122] "RemoveContainer" containerID="0bc27eebeb01c849d9b3d4d8d1e946dc9ac20c83e7efcf8424a55cfec4626318"
Oct 30 21:46:08.359896 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:46:08.359874    4060 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0bc27eebeb01c849d9b3d4d8d1e946dc9ac20c83e7efcf8424a55cfec4626318\": container with ID starting with 0bc27eebeb01c849d9b3d4d8d1e946dc9ac20c83e7efcf8424a55cfec4626318 not found: ID does not exist" containerID="0bc27eebeb01c849d9b3d4d8d1e946dc9ac20c83e7efcf8424a55cfec4626318"
Oct 30 21:46:08.360106 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:08.360063    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0bc27eebeb01c849d9b3d4d8d1e946dc9ac20c83e7efcf8424a55cfec4626318"} err="failed to get container status \"0bc27eebeb01c849d9b3d4d8d1e946dc9ac20c83e7efcf8424a55cfec4626318\": rpc error: code = NotFound desc = could not find container \"0bc27eebeb01c849d9b3d4d8d1e946dc9ac20c83e7efcf8424a55cfec4626318\": container with ID starting with 0bc27eebeb01c849d9b3d4d8d1e946dc9ac20c83e7efcf8424a55cfec4626318 not found: ID does not exist"
Oct 30 21:46:08.360106 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:08.360093    4060 scope.go:122] "RemoveContainer" containerID="bc470a2aa64eebe5f2cda00a7d28d72516f3a411aaf6eafc04bf58260384f867"
Oct 30 21:46:08.369474 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:08.369457    4060 scope.go:122] "RemoveContainer" containerID="bc470a2aa64eebe5f2cda00a7d28d72516f3a411aaf6eafc04bf58260384f867"
Oct 30 21:46:08.369775 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:46:08.369757    4060 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bc470a2aa64eebe5f2cda00a7d28d72516f3a411aaf6eafc04bf58260384f867\": container with ID starting with bc470a2aa64eebe5f2cda00a7d28d72516f3a411aaf6eafc04bf58260384f867 not found: ID does not exist" containerID="bc470a2aa64eebe5f2cda00a7d28d72516f3a411aaf6eafc04bf58260384f867"
Oct 30 21:46:08.369830 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:08.369781    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bc470a2aa64eebe5f2cda00a7d28d72516f3a411aaf6eafc04bf58260384f867"} err="failed to get container status \"bc470a2aa64eebe5f2cda00a7d28d72516f3a411aaf6eafc04bf58260384f867\": rpc error: code = NotFound desc = could not find container \"bc470a2aa64eebe5f2cda00a7d28d72516f3a411aaf6eafc04bf58260384f867\": container with ID starting with bc470a2aa64eebe5f2cda00a7d28d72516f3a411aaf6eafc04bf58260384f867 not found: ID does not exist"
Oct 30 21:46:08.392634 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:08.392609    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/99506ac5-5ea3-4889-8486-b0c05f375235-kube-api-access-w7jvq\" (UniqueName: \"kubernetes.io/projected/99506ac5-5ea3-4889-8486-b0c05f375235-kube-api-access-w7jvq\") pod \"99506ac5-5ea3-4889-8486-b0c05f375235\" (UID: \"99506ac5-5ea3-4889-8486-b0c05f375235\") "
Oct 30 21:46:08.392780 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:08.392646    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/99506ac5-5ea3-4889-8486-b0c05f375235-config\" (UniqueName: \"kubernetes.io/configmap/99506ac5-5ea3-4889-8486-b0c05f375235-config\") pod \"99506ac5-5ea3-4889-8486-b0c05f375235\" (UID: \"99506ac5-5ea3-4889-8486-b0c05f375235\") "
Oct 30 21:46:08.392780 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:08.392670    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/99506ac5-5ea3-4889-8486-b0c05f375235-tls\" (UniqueName: \"kubernetes.io/secret/99506ac5-5ea3-4889-8486-b0c05f375235-tls\") pod \"99506ac5-5ea3-4889-8486-b0c05f375235\" (UID: \"99506ac5-5ea3-4889-8486-b0c05f375235\") "
Oct 30 21:46:08.392907 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:08.392873    4060 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6d0bf513-04a6-4525-b66f-0e3f8b79a0f5-kube-rbac-proxy-config\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:46:08.392907 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:08.392891    4060 reconciler_common.go:299] "Volume detached for volume \"tls\" (UniqueName: \"kubernetes.io/secret/6d0bf513-04a6-4525-b66f-0e3f8b79a0f5-tls\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:46:08.392907 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:08.392906    4060 reconciler_common.go:299] "Volume detached for volume \"prometheus-client-cert\" (UniqueName: \"kubernetes.io/secret/6d0bf513-04a6-4525-b66f-0e3f8b79a0f5-prometheus-client-cert\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:46:08.393087 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:08.392919    4060 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2gc4d\" (UniqueName: \"kubernetes.io/projected/6d0bf513-04a6-4525-b66f-0e3f8b79a0f5-kube-api-access-2gc4d\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:46:08.393087 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:08.393069    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/99506ac5-5ea3-4889-8486-b0c05f375235-config" pod "99506ac5-5ea3-4889-8486-b0c05f375235" (UID: "99506ac5-5ea3-4889-8486-b0c05f375235"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:46:08.394733 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:08.394706    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/99506ac5-5ea3-4889-8486-b0c05f375235-kube-api-access-w7jvq" pod "99506ac5-5ea3-4889-8486-b0c05f375235" (UID: "99506ac5-5ea3-4889-8486-b0c05f375235"). InnerVolumeSpecName "kube-api-access-w7jvq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:46:08.394862 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:08.394745    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/99506ac5-5ea3-4889-8486-b0c05f375235-tls" pod "99506ac5-5ea3-4889-8486-b0c05f375235" (UID: "99506ac5-5ea3-4889-8486-b0c05f375235"). InnerVolumeSpecName "tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:46:08.494337 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:08.494311    4060 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/99506ac5-5ea3-4889-8486-b0c05f375235-config\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:46:08.494337 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:08.494335    4060 reconciler_common.go:299] "Volume detached for volume \"tls\" (UniqueName: \"kubernetes.io/secret/99506ac5-5ea3-4889-8486-b0c05f375235-tls\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:46:08.494337 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:08.494345    4060 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w7jvq\" (UniqueName: \"kubernetes.io/projected/99506ac5-5ea3-4889-8486-b0c05f375235-kube-api-access-w7jvq\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:46:08.531554 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:08.531515    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-kld84"]
Oct 30 21:46:08.536138 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:08.536108    4060 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-kld84"]
Oct 30 21:46:08.772708 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:08.772632    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/korrel8r-5cbcc89b8f-t59pj"]
Oct 30 21:46:08.776781 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:08.776755    4060 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/korrel8r-5cbcc89b8f-t59pj"]
Oct 30 21:46:09.347883 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:09.347853    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"]
Oct 30 21:46:09.348341 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:09.348128    4060 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0" podUID="5d6efefd-cfdb-487f-901a-5b2e88ccd1bb" containerName="alertmanager" containerID="cri-o://ac8228efd3fe866285126e289604f3c5448b5459c6a84d6b87784ac1044df0c9" gracePeriod=120
Oct 30 21:46:09.348341 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:09.348174    4060 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0" podUID="5d6efefd-cfdb-487f-901a-5b2e88ccd1bb" containerName="config-reloader" containerID="cri-o://d65ae6b7925c45f27cdb827bacb712b4da6437b757dced6718c8d4833dde9913" gracePeriod=120
Oct 30 21:46:09.366158 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:09.366131    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"]
Oct 30 21:46:09.366403 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:09.366368    4060 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0" podUID="f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b" containerName="prometheus" containerID="cri-o://8470b21921fe7301c97e5df6255323e445aadb05282104b7bb3e692edea86108" gracePeriod=600
Oct 30 21:46:09.366518 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:09.366391    4060 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0" podUID="f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b" containerName="thanos-sidecar" containerID="cri-o://dd0e0525ee574cc0416b965c2bf4ee19cc2328823862203453c942abf12ff966" gracePeriod=600
Oct 30 21:46:09.366518 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:09.366405    4060 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0" podUID="f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b" containerName="config-reloader" containerID="cri-o://dab7e653a9bd207f87fea5ff89cf64b4d5b056f92190f6d27eb1dff13b363c5d" gracePeriod=600
Oct 30 21:46:09.426537 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:09.426488    4060 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="6d0bf513-04a6-4525-b66f-0e3f8b79a0f5" path="/var/lib/kubelet/pods/6d0bf513-04a6-4525-b66f-0e3f8b79a0f5/volumes"
Oct 30 21:46:09.426927 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:09.426912    4060 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="99506ac5-5ea3-4889-8486-b0c05f375235" path="/var/lib/kubelet/pods/99506ac5-5ea3-4889-8486-b0c05f375235/volumes"
Oct 30 21:46:09.704255 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:09.704229    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:46:09.804970 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:09.804940    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b-secret-prometheus-web-tls-ca\" (UniqueName: \"kubernetes.io/secret/f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b-secret-prometheus-web-tls-ca\") pod \"f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b\" (UID: \"f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b\") "
Oct 30 21:46:09.805142 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:09.805049    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a155a55c1ce0e65b\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a155a55c1ce0e65b\") pod \"f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b\" (UID: \"f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b\") "
Oct 30 21:46:09.805142 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:09.805081    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b-thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b-thanos-prometheus-http-client-file\") pod \"f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b\" (UID: \"f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b\") "
Oct 30 21:46:09.805142 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:09.805104    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b-prometheus-data-science-monitoringstack-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b-prometheus-data-science-monitoringstack-rulefiles-2\") pod \"f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b\" (UID: \"f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b\") "
Oct 30 21:46:09.805142 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:09.805141    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b-web-config-tls-secret-key-prometheus-operated-tls-f3457c70\" (UniqueName: \"kubernetes.io/secret/f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b-web-config-tls-secret-key-prometheus-operated-tls-f3457c70\") pod \"f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b\" (UID: \"f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b\") "
Oct 30 21:46:09.805368 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:09.805164    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b-config-out\" (UniqueName: \"kubernetes.io/empty-dir/f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b-config-out\") pod \"f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b\" (UID: \"f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b\") "
Oct 30 21:46:09.805368 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:09.805218    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b-tls-assets\" (UniqueName: \"kubernetes.io/projected/f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b-tls-assets\") pod \"f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b\" (UID: \"f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b\") "
Oct 30 21:46:09.805368 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:09.805253    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b-config\" (UniqueName: \"kubernetes.io/secret/f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b-config\") pod \"f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b\" (UID: \"f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b\") "
Oct 30 21:46:09.805368 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:09.805293    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b-kube-api-access-hscv2\" (UniqueName: \"kubernetes.io/projected/f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b-kube-api-access-hscv2\") pod \"f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b\" (UID: \"f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b\") "
Oct 30 21:46:09.805368 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:09.805351    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b-prometheus-data-science-monitoringstack-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b-prometheus-data-science-monitoringstack-rulefiles-1\") pod \"f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b\" (UID: \"f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b\") "
Oct 30 21:46:09.805678 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:09.805378    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b-prometheus-data-science-monitoringstack-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b-prometheus-data-science-monitoringstack-rulefiles-0\") pod \"f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b\" (UID: \"f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b\") "
Oct 30 21:46:09.805678 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:09.805411    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b-web-config\" (UniqueName: \"kubernetes.io/secret/f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b-web-config\") pod \"f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b\" (UID: \"f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b\") "
Oct 30 21:46:09.805678 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:09.805449    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b-web-config-tls-secret-cert-prometheus-operated-tls-f3457c70\" (UniqueName: \"kubernetes.io/secret/f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b-web-config-tls-secret-cert-prometheus-operated-tls-f3457c70\") pod \"f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b\" (UID: \"f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b\") "
Oct 30 21:46:09.805678 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:09.805538    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b-prometheus-data-science-monitoringstack-rulefiles-2" pod "f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b" (UID: "f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b"). InnerVolumeSpecName "prometheus-data-science-monitoringstack-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:46:09.805884 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:09.805757    4060 reconciler_common.go:299] "Volume detached for volume \"prometheus-data-science-monitoringstack-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b-prometheus-data-science-monitoringstack-rulefiles-2\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:46:09.806193 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:09.806133    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b-prometheus-data-science-monitoringstack-rulefiles-1" pod "f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b" (UID: "f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b"). InnerVolumeSpecName "prometheus-data-science-monitoringstack-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:46:09.806673 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:09.806630    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b-prometheus-data-science-monitoringstack-rulefiles-0" pod "f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b" (UID: "f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b"). InnerVolumeSpecName "prometheus-data-science-monitoringstack-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:46:09.808100 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:09.808071    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b-thanos-prometheus-http-client-file" pod "f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b" (UID: "f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:46:09.808322 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:09.808298    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b-web-config-tls-secret-cert-prometheus-operated-tls-f3457c70" pod "f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b" (UID: "f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b"). InnerVolumeSpecName "web-config-tls-secret-cert-prometheus-operated-tls-f3457c70". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:46:09.808422 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:09.808384    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b-config-out" pod "f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b" (UID: "f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:46:09.808651 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:09.808200    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b-secret-prometheus-web-tls-ca" pod "f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b" (UID: "f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b"). InnerVolumeSpecName "secret-prometheus-web-tls-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:46:09.808840 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:09.808805    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b-kube-api-access-hscv2" pod "f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b" (UID: "f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b"). InnerVolumeSpecName "kube-api-access-hscv2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:46:09.809212 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:09.809191    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b-web-config-tls-secret-key-prometheus-operated-tls-f3457c70" pod "f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b" (UID: "f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b"). InnerVolumeSpecName "web-config-tls-secret-key-prometheus-operated-tls-f3457c70". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:46:09.809387 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:09.809369    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b-config" pod "f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b" (UID: "f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:46:09.809460 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:09.809408    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b-tls-assets" pod "f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b" (UID: "f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:46:09.810694 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:09.810671    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/csi/ebs.csi.aws.com^vol-0a155a55c1ce0e65b" pod "f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b" (UID: "f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b"). InnerVolumeSpecName "pvc-e73afc79-aa37-49a0-8744-633c03cad1f4". PluginName "kubernetes.io/csi", VolumeGIDValue ""
Oct 30 21:46:09.819404 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:09.819383    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b-web-config" pod "f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b" (UID: "f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:46:09.907205 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:09.907127    4060 reconciler_common.go:299] "Volume detached for volume \"web-config-tls-secret-key-prometheus-operated-tls-f3457c70\" (UniqueName: \"kubernetes.io/secret/f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b-web-config-tls-secret-key-prometheus-operated-tls-f3457c70\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:46:09.907205 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:09.907157    4060 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b-config-out\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:46:09.907205 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:09.907168    4060 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b-tls-assets\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:46:09.907205 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:09.907176    4060 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b-config\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:46:09.907205 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:09.907186    4060 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hscv2\" (UniqueName: \"kubernetes.io/projected/f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b-kube-api-access-hscv2\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:46:09.907205 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:09.907195    4060 reconciler_common.go:299] "Volume detached for volume \"prometheus-data-science-monitoringstack-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b-prometheus-data-science-monitoringstack-rulefiles-1\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:46:09.907205 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:09.907205    4060 reconciler_common.go:299] "Volume detached for volume \"prometheus-data-science-monitoringstack-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b-prometheus-data-science-monitoringstack-rulefiles-0\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:46:09.907579 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:09.907214    4060 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b-web-config\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:46:09.907579 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:09.907222    4060 reconciler_common.go:299] "Volume detached for volume \"web-config-tls-secret-cert-prometheus-operated-tls-f3457c70\" (UniqueName: \"kubernetes.io/secret/f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b-web-config-tls-secret-cert-prometheus-operated-tls-f3457c70\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:46:09.907579 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:09.907232    4060 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-web-tls-ca\" (UniqueName: \"kubernetes.io/secret/f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b-secret-prometheus-web-tls-ca\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:46:09.907579 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:09.907262    4060 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"pvc-e73afc79-aa37-49a0-8744-633c03cad1f4\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a155a55c1ce0e65b\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" "
Oct 30 21:46:09.907579 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:09.907271    4060 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b-thanos-prometheus-http-client-file\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:46:09.918275 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:09.918250    4060 operation_generator.go:893] UnmountDevice succeeded for volume "pvc-e73afc79-aa37-49a0-8744-633c03cad1f4" (UniqueName: "kubernetes.io/csi/ebs.csi.aws.com^vol-0a155a55c1ce0e65b") on node "ip-10-0-142-4.us-west-1.compute.internal"
Oct 30 21:46:10.007756 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:10.007721    4060 reconciler_common.go:299] "Volume detached for volume \"pvc-e73afc79-aa37-49a0-8744-633c03cad1f4\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a155a55c1ce0e65b\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"csi-7011c01335d2502f76be252f9498c79824668beecf30ee8f6a7191145201ca4c\""
Oct 30 21:46:10.300134 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:10.300112    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:46:10.366486 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:10.366455    4060 generic.go:356] "Generic (PLEG): container finished" podID="5d6efefd-cfdb-487f-901a-5b2e88ccd1bb" containerID="d65ae6b7925c45f27cdb827bacb712b4da6437b757dced6718c8d4833dde9913" exitCode=0
Oct 30 21:46:10.366486 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:10.366480    4060 generic.go:356] "Generic (PLEG): container finished" podID="5d6efefd-cfdb-487f-901a-5b2e88ccd1bb" containerID="ac8228efd3fe866285126e289604f3c5448b5459c6a84d6b87784ac1044df0c9" exitCode=0
Oct 30 21:46:10.367002 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:10.366533    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:46:10.367002 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:10.366539    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0" event={"ID":"5d6efefd-cfdb-487f-901a-5b2e88ccd1bb","Type":"ContainerDied","Data":"d65ae6b7925c45f27cdb827bacb712b4da6437b757dced6718c8d4833dde9913"}
Oct 30 21:46:10.367002 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:10.366605    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0" event={"ID":"5d6efefd-cfdb-487f-901a-5b2e88ccd1bb","Type":"ContainerDied","Data":"ac8228efd3fe866285126e289604f3c5448b5459c6a84d6b87784ac1044df0c9"}
Oct 30 21:46:10.367002 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:10.366641    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0" event={"ID":"5d6efefd-cfdb-487f-901a-5b2e88ccd1bb","Type":"ContainerDied","Data":"1adecb0fd3cc84e010bcc2bbdf40769d297e72999749b1374e052db1e5feab8c"}
Oct 30 21:46:10.367002 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:10.366676    4060 scope.go:122] "RemoveContainer" containerID="d65ae6b7925c45f27cdb827bacb712b4da6437b757dced6718c8d4833dde9913"
Oct 30 21:46:10.368970 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:10.368948    4060 generic.go:356] "Generic (PLEG): container finished" podID="f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b" containerID="dd0e0525ee574cc0416b965c2bf4ee19cc2328823862203453c942abf12ff966" exitCode=0
Oct 30 21:46:10.369088 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:10.368973    4060 generic.go:356] "Generic (PLEG): container finished" podID="f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b" containerID="dab7e653a9bd207f87fea5ff89cf64b4d5b056f92190f6d27eb1dff13b363c5d" exitCode=0
Oct 30 21:46:10.369088 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:10.368983    4060 generic.go:356] "Generic (PLEG): container finished" podID="f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b" containerID="8470b21921fe7301c97e5df6255323e445aadb05282104b7bb3e692edea86108" exitCode=0
Oct 30 21:46:10.369088 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:10.369010    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:46:10.369088 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:10.369028    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0" event={"ID":"f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b","Type":"ContainerDied","Data":"dd0e0525ee574cc0416b965c2bf4ee19cc2328823862203453c942abf12ff966"}
Oct 30 21:46:10.369330 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:10.369096    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0" event={"ID":"f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b","Type":"ContainerDied","Data":"dab7e653a9bd207f87fea5ff89cf64b4d5b056f92190f6d27eb1dff13b363c5d"}
Oct 30 21:46:10.369330 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:10.369141    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0" event={"ID":"f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b","Type":"ContainerDied","Data":"8470b21921fe7301c97e5df6255323e445aadb05282104b7bb3e692edea86108"}
Oct 30 21:46:10.369330 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:10.369180    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0" event={"ID":"f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b","Type":"ContainerDied","Data":"5b0e56eeedccba1ff894b0393eee8dba94531a9914504af12adf9510f449d3f5"}
Oct 30 21:46:10.376783 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:10.376765    4060 scope.go:122] "RemoveContainer" containerID="ac8228efd3fe866285126e289604f3c5448b5459c6a84d6b87784ac1044df0c9"
Oct 30 21:46:10.384471 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:10.384453    4060 scope.go:122] "RemoveContainer" containerID="7ebce93b2f1a6d5355859257070e8bdea68294af219cb101713934a4095f50b8"
Oct 30 21:46:10.391627 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:10.391608    4060 scope.go:122] "RemoveContainer" containerID="d65ae6b7925c45f27cdb827bacb712b4da6437b757dced6718c8d4833dde9913"
Oct 30 21:46:10.391879 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:46:10.391863    4060 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d65ae6b7925c45f27cdb827bacb712b4da6437b757dced6718c8d4833dde9913\": container with ID starting with d65ae6b7925c45f27cdb827bacb712b4da6437b757dced6718c8d4833dde9913 not found: ID does not exist" containerID="d65ae6b7925c45f27cdb827bacb712b4da6437b757dced6718c8d4833dde9913"
Oct 30 21:46:10.391926 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:10.391885    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d65ae6b7925c45f27cdb827bacb712b4da6437b757dced6718c8d4833dde9913"} err="failed to get container status \"d65ae6b7925c45f27cdb827bacb712b4da6437b757dced6718c8d4833dde9913\": rpc error: code = NotFound desc = could not find container \"d65ae6b7925c45f27cdb827bacb712b4da6437b757dced6718c8d4833dde9913\": container with ID starting with d65ae6b7925c45f27cdb827bacb712b4da6437b757dced6718c8d4833dde9913 not found: ID does not exist"
Oct 30 21:46:10.391926 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:10.391901    4060 scope.go:122] "RemoveContainer" containerID="ac8228efd3fe866285126e289604f3c5448b5459c6a84d6b87784ac1044df0c9"
Oct 30 21:46:10.392127 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:46:10.392107    4060 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ac8228efd3fe866285126e289604f3c5448b5459c6a84d6b87784ac1044df0c9\": container with ID starting with ac8228efd3fe866285126e289604f3c5448b5459c6a84d6b87784ac1044df0c9 not found: ID does not exist" containerID="ac8228efd3fe866285126e289604f3c5448b5459c6a84d6b87784ac1044df0c9"
Oct 30 21:46:10.392170 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:10.392133    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac8228efd3fe866285126e289604f3c5448b5459c6a84d6b87784ac1044df0c9"} err="failed to get container status \"ac8228efd3fe866285126e289604f3c5448b5459c6a84d6b87784ac1044df0c9\": rpc error: code = NotFound desc = could not find container \"ac8228efd3fe866285126e289604f3c5448b5459c6a84d6b87784ac1044df0c9\": container with ID starting with ac8228efd3fe866285126e289604f3c5448b5459c6a84d6b87784ac1044df0c9 not found: ID does not exist"
Oct 30 21:46:10.392170 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:10.392149    4060 scope.go:122] "RemoveContainer" containerID="7ebce93b2f1a6d5355859257070e8bdea68294af219cb101713934a4095f50b8"
Oct 30 21:46:10.392365 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:46:10.392350    4060 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7ebce93b2f1a6d5355859257070e8bdea68294af219cb101713934a4095f50b8\": container with ID starting with 7ebce93b2f1a6d5355859257070e8bdea68294af219cb101713934a4095f50b8 not found: ID does not exist" containerID="7ebce93b2f1a6d5355859257070e8bdea68294af219cb101713934a4095f50b8"
Oct 30 21:46:10.392411 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:10.392369    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ebce93b2f1a6d5355859257070e8bdea68294af219cb101713934a4095f50b8"} err="failed to get container status \"7ebce93b2f1a6d5355859257070e8bdea68294af219cb101713934a4095f50b8\": rpc error: code = NotFound desc = could not find container \"7ebce93b2f1a6d5355859257070e8bdea68294af219cb101713934a4095f50b8\": container with ID starting with 7ebce93b2f1a6d5355859257070e8bdea68294af219cb101713934a4095f50b8 not found: ID does not exist"
Oct 30 21:46:10.392411 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:10.392381    4060 scope.go:122] "RemoveContainer" containerID="d65ae6b7925c45f27cdb827bacb712b4da6437b757dced6718c8d4833dde9913"
Oct 30 21:46:10.392588 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:10.392573    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d65ae6b7925c45f27cdb827bacb712b4da6437b757dced6718c8d4833dde9913"} err="failed to get container status \"d65ae6b7925c45f27cdb827bacb712b4da6437b757dced6718c8d4833dde9913\": rpc error: code = NotFound desc = could not find container \"d65ae6b7925c45f27cdb827bacb712b4da6437b757dced6718c8d4833dde9913\": container with ID starting with d65ae6b7925c45f27cdb827bacb712b4da6437b757dced6718c8d4833dde9913 not found: ID does not exist"
Oct 30 21:46:10.392638 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:10.392588    4060 scope.go:122] "RemoveContainer" containerID="ac8228efd3fe866285126e289604f3c5448b5459c6a84d6b87784ac1044df0c9"
Oct 30 21:46:10.392816 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:10.392798    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac8228efd3fe866285126e289604f3c5448b5459c6a84d6b87784ac1044df0c9"} err="failed to get container status \"ac8228efd3fe866285126e289604f3c5448b5459c6a84d6b87784ac1044df0c9\": rpc error: code = NotFound desc = could not find container \"ac8228efd3fe866285126e289604f3c5448b5459c6a84d6b87784ac1044df0c9\": container with ID starting with ac8228efd3fe866285126e289604f3c5448b5459c6a84d6b87784ac1044df0c9 not found: ID does not exist"
Oct 30 21:46:10.392873 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:10.392816    4060 scope.go:122] "RemoveContainer" containerID="7ebce93b2f1a6d5355859257070e8bdea68294af219cb101713934a4095f50b8"
Oct 30 21:46:10.392995 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:10.392980    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ebce93b2f1a6d5355859257070e8bdea68294af219cb101713934a4095f50b8"} err="failed to get container status \"7ebce93b2f1a6d5355859257070e8bdea68294af219cb101713934a4095f50b8\": rpc error: code = NotFound desc = could not find container \"7ebce93b2f1a6d5355859257070e8bdea68294af219cb101713934a4095f50b8\": container with ID starting with 7ebce93b2f1a6d5355859257070e8bdea68294af219cb101713934a4095f50b8 not found: ID does not exist"
Oct 30 21:46:10.393041 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:10.392995    4060 scope.go:122] "RemoveContainer" containerID="dd0e0525ee574cc0416b965c2bf4ee19cc2328823862203453c942abf12ff966"
Oct 30 21:46:10.400204 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:10.400187    4060 scope.go:122] "RemoveContainer" containerID="dab7e653a9bd207f87fea5ff89cf64b4d5b056f92190f6d27eb1dff13b363c5d"
Oct 30 21:46:10.407673 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:10.407650    4060 scope.go:122] "RemoveContainer" containerID="8470b21921fe7301c97e5df6255323e445aadb05282104b7bb3e692edea86108"
Oct 30 21:46:10.410795 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:10.410773    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/5d6efefd-cfdb-487f-901a-5b2e88ccd1bb-web-config\" (UniqueName: \"kubernetes.io/secret/5d6efefd-cfdb-487f-901a-5b2e88ccd1bb-web-config\") pod \"5d6efefd-cfdb-487f-901a-5b2e88ccd1bb\" (UID: \"5d6efefd-cfdb-487f-901a-5b2e88ccd1bb\") "
Oct 30 21:46:10.410891 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:10.410815    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5d6efefd-cfdb-487f-901a-5b2e88ccd1bb-kube-api-access-fwcvt\" (UniqueName: \"kubernetes.io/projected/5d6efefd-cfdb-487f-901a-5b2e88ccd1bb-kube-api-access-fwcvt\") pod \"5d6efefd-cfdb-487f-901a-5b2e88ccd1bb\" (UID: \"5d6efefd-cfdb-487f-901a-5b2e88ccd1bb\") "
Oct 30 21:46:10.410891 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:10.410849    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5d6efefd-cfdb-487f-901a-5b2e88ccd1bb-tls-assets\" (UniqueName: \"kubernetes.io/projected/5d6efefd-cfdb-487f-901a-5b2e88ccd1bb-tls-assets\") pod \"5d6efefd-cfdb-487f-901a-5b2e88ccd1bb\" (UID: \"5d6efefd-cfdb-487f-901a-5b2e88ccd1bb\") "
Oct 30 21:46:10.411005 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:10.410901    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5d6efefd-cfdb-487f-901a-5b2e88ccd1bb-alertmanager-data-science-monitoringstack-db\" (UniqueName: \"kubernetes.io/empty-dir/5d6efefd-cfdb-487f-901a-5b2e88ccd1bb-alertmanager-data-science-monitoringstack-db\") pod \"5d6efefd-cfdb-487f-901a-5b2e88ccd1bb\" (UID: \"5d6efefd-cfdb-487f-901a-5b2e88ccd1bb\") "
Oct 30 21:46:10.411005 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:10.410931    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/5d6efefd-cfdb-487f-901a-5b2e88ccd1bb-cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5d6efefd-cfdb-487f-901a-5b2e88ccd1bb-cluster-tls-config\") pod \"5d6efefd-cfdb-487f-901a-5b2e88ccd1bb\" (UID: \"5d6efefd-cfdb-487f-901a-5b2e88ccd1bb\") "
Oct 30 21:46:10.411005 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:10.410969    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/5d6efefd-cfdb-487f-901a-5b2e88ccd1bb-config-volume\" (UniqueName: \"kubernetes.io/secret/5d6efefd-cfdb-487f-901a-5b2e88ccd1bb-config-volume\") pod \"5d6efefd-cfdb-487f-901a-5b2e88ccd1bb\" (UID: \"5d6efefd-cfdb-487f-901a-5b2e88ccd1bb\") "
Oct 30 21:46:10.411182 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:10.411010    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5d6efefd-cfdb-487f-901a-5b2e88ccd1bb-config-out\" (UniqueName: \"kubernetes.io/empty-dir/5d6efefd-cfdb-487f-901a-5b2e88ccd1bb-config-out\") pod \"5d6efefd-cfdb-487f-901a-5b2e88ccd1bb\" (UID: \"5d6efefd-cfdb-487f-901a-5b2e88ccd1bb\") "
Oct 30 21:46:10.411238 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:10.411199    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d6efefd-cfdb-487f-901a-5b2e88ccd1bb-alertmanager-data-science-monitoringstack-db" pod "5d6efefd-cfdb-487f-901a-5b2e88ccd1bb" (UID: "5d6efefd-cfdb-487f-901a-5b2e88ccd1bb"). InnerVolumeSpecName "alertmanager-data-science-monitoringstack-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:46:10.411311 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:10.411291    4060 reconciler_common.go:299] "Volume detached for volume \"alertmanager-data-science-monitoringstack-db\" (UniqueName: \"kubernetes.io/empty-dir/5d6efefd-cfdb-487f-901a-5b2e88ccd1bb-alertmanager-data-science-monitoringstack-db\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:46:10.413171 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:10.413148    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5d6efefd-cfdb-487f-901a-5b2e88ccd1bb-config-volume" pod "5d6efefd-cfdb-487f-901a-5b2e88ccd1bb" (UID: "5d6efefd-cfdb-487f-901a-5b2e88ccd1bb"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:46:10.413345 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:10.413330    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5d6efefd-cfdb-487f-901a-5b2e88ccd1bb-tls-assets" pod "5d6efefd-cfdb-487f-901a-5b2e88ccd1bb" (UID: "5d6efefd-cfdb-487f-901a-5b2e88ccd1bb"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:46:10.413594 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:10.413560    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d6efefd-cfdb-487f-901a-5b2e88ccd1bb-config-out" pod "5d6efefd-cfdb-487f-901a-5b2e88ccd1bb" (UID: "5d6efefd-cfdb-487f-901a-5b2e88ccd1bb"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:46:10.415571 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:10.415482    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5d6efefd-cfdb-487f-901a-5b2e88ccd1bb-kube-api-access-fwcvt" pod "5d6efefd-cfdb-487f-901a-5b2e88ccd1bb" (UID: "5d6efefd-cfdb-487f-901a-5b2e88ccd1bb"). InnerVolumeSpecName "kube-api-access-fwcvt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:46:10.416744 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:10.416724    4060 scope.go:122] "RemoveContainer" containerID="d692c692a93808a1580c56381a4c7f593e1eb91cd93a1a6e0b71e26982145be9"
Oct 30 21:46:10.416947 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:10.416920    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5d6efefd-cfdb-487f-901a-5b2e88ccd1bb-cluster-tls-config" pod "5d6efefd-cfdb-487f-901a-5b2e88ccd1bb" (UID: "5d6efefd-cfdb-487f-901a-5b2e88ccd1bb"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:46:10.425145 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:10.425124    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5d6efefd-cfdb-487f-901a-5b2e88ccd1bb-web-config" pod "5d6efefd-cfdb-487f-901a-5b2e88ccd1bb" (UID: "5d6efefd-cfdb-487f-901a-5b2e88ccd1bb"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:46:10.425224 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:10.425146    4060 scope.go:122] "RemoveContainer" containerID="dd0e0525ee574cc0416b965c2bf4ee19cc2328823862203453c942abf12ff966"
Oct 30 21:46:10.425448 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:46:10.425426    4060 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dd0e0525ee574cc0416b965c2bf4ee19cc2328823862203453c942abf12ff966\": container with ID starting with dd0e0525ee574cc0416b965c2bf4ee19cc2328823862203453c942abf12ff966 not found: ID does not exist" containerID="dd0e0525ee574cc0416b965c2bf4ee19cc2328823862203453c942abf12ff966"
Oct 30 21:46:10.425532 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:10.425454    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dd0e0525ee574cc0416b965c2bf4ee19cc2328823862203453c942abf12ff966"} err="failed to get container status \"dd0e0525ee574cc0416b965c2bf4ee19cc2328823862203453c942abf12ff966\": rpc error: code = NotFound desc = could not find container \"dd0e0525ee574cc0416b965c2bf4ee19cc2328823862203453c942abf12ff966\": container with ID starting with dd0e0525ee574cc0416b965c2bf4ee19cc2328823862203453c942abf12ff966 not found: ID does not exist"
Oct 30 21:46:10.425532 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:10.425470    4060 scope.go:122] "RemoveContainer" containerID="dab7e653a9bd207f87fea5ff89cf64b4d5b056f92190f6d27eb1dff13b363c5d"
Oct 30 21:46:10.425774 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:46:10.425756    4060 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dab7e653a9bd207f87fea5ff89cf64b4d5b056f92190f6d27eb1dff13b363c5d\": container with ID starting with dab7e653a9bd207f87fea5ff89cf64b4d5b056f92190f6d27eb1dff13b363c5d not found: ID does not exist" containerID="dab7e653a9bd207f87fea5ff89cf64b4d5b056f92190f6d27eb1dff13b363c5d"
Oct 30 21:46:10.425855 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:10.425780    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dab7e653a9bd207f87fea5ff89cf64b4d5b056f92190f6d27eb1dff13b363c5d"} err="failed to get container status \"dab7e653a9bd207f87fea5ff89cf64b4d5b056f92190f6d27eb1dff13b363c5d\": rpc error: code = NotFound desc = could not find container \"dab7e653a9bd207f87fea5ff89cf64b4d5b056f92190f6d27eb1dff13b363c5d\": container with ID starting with dab7e653a9bd207f87fea5ff89cf64b4d5b056f92190f6d27eb1dff13b363c5d not found: ID does not exist"
Oct 30 21:46:10.425855 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:10.425795    4060 scope.go:122] "RemoveContainer" containerID="8470b21921fe7301c97e5df6255323e445aadb05282104b7bb3e692edea86108"
Oct 30 21:46:10.426060 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:46:10.426041    4060 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8470b21921fe7301c97e5df6255323e445aadb05282104b7bb3e692edea86108\": container with ID starting with 8470b21921fe7301c97e5df6255323e445aadb05282104b7bb3e692edea86108 not found: ID does not exist" containerID="8470b21921fe7301c97e5df6255323e445aadb05282104b7bb3e692edea86108"
Oct 30 21:46:10.426121 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:10.426067    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8470b21921fe7301c97e5df6255323e445aadb05282104b7bb3e692edea86108"} err="failed to get container status \"8470b21921fe7301c97e5df6255323e445aadb05282104b7bb3e692edea86108\": rpc error: code = NotFound desc = could not find container \"8470b21921fe7301c97e5df6255323e445aadb05282104b7bb3e692edea86108\": container with ID starting with 8470b21921fe7301c97e5df6255323e445aadb05282104b7bb3e692edea86108 not found: ID does not exist"
Oct 30 21:46:10.426121 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:10.426082    4060 scope.go:122] "RemoveContainer" containerID="d692c692a93808a1580c56381a4c7f593e1eb91cd93a1a6e0b71e26982145be9"
Oct 30 21:46:10.426354 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:46:10.426330    4060 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d692c692a93808a1580c56381a4c7f593e1eb91cd93a1a6e0b71e26982145be9\": container with ID starting with d692c692a93808a1580c56381a4c7f593e1eb91cd93a1a6e0b71e26982145be9 not found: ID does not exist" containerID="d692c692a93808a1580c56381a4c7f593e1eb91cd93a1a6e0b71e26982145be9"
Oct 30 21:46:10.426451 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:10.426359    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d692c692a93808a1580c56381a4c7f593e1eb91cd93a1a6e0b71e26982145be9"} err="failed to get container status \"d692c692a93808a1580c56381a4c7f593e1eb91cd93a1a6e0b71e26982145be9\": rpc error: code = NotFound desc = could not find container \"d692c692a93808a1580c56381a4c7f593e1eb91cd93a1a6e0b71e26982145be9\": container with ID starting with d692c692a93808a1580c56381a4c7f593e1eb91cd93a1a6e0b71e26982145be9 not found: ID does not exist"
Oct 30 21:46:10.426451 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:10.426376    4060 scope.go:122] "RemoveContainer" containerID="dd0e0525ee574cc0416b965c2bf4ee19cc2328823862203453c942abf12ff966"
Oct 30 21:46:10.426668 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:10.426647    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dd0e0525ee574cc0416b965c2bf4ee19cc2328823862203453c942abf12ff966"} err="failed to get container status \"dd0e0525ee574cc0416b965c2bf4ee19cc2328823862203453c942abf12ff966\": rpc error: code = NotFound desc = could not find container \"dd0e0525ee574cc0416b965c2bf4ee19cc2328823862203453c942abf12ff966\": container with ID starting with dd0e0525ee574cc0416b965c2bf4ee19cc2328823862203453c942abf12ff966 not found: ID does not exist"
Oct 30 21:46:10.426754 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:10.426670    4060 scope.go:122] "RemoveContainer" containerID="dab7e653a9bd207f87fea5ff89cf64b4d5b056f92190f6d27eb1dff13b363c5d"
Oct 30 21:46:10.426968 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:10.426945    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dab7e653a9bd207f87fea5ff89cf64b4d5b056f92190f6d27eb1dff13b363c5d"} err="failed to get container status \"dab7e653a9bd207f87fea5ff89cf64b4d5b056f92190f6d27eb1dff13b363c5d\": rpc error: code = NotFound desc = could not find container \"dab7e653a9bd207f87fea5ff89cf64b4d5b056f92190f6d27eb1dff13b363c5d\": container with ID starting with dab7e653a9bd207f87fea5ff89cf64b4d5b056f92190f6d27eb1dff13b363c5d not found: ID does not exist"
Oct 30 21:46:10.426968 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:10.426968    4060 scope.go:122] "RemoveContainer" containerID="8470b21921fe7301c97e5df6255323e445aadb05282104b7bb3e692edea86108"
Oct 30 21:46:10.427224 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:10.427208    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8470b21921fe7301c97e5df6255323e445aadb05282104b7bb3e692edea86108"} err="failed to get container status \"8470b21921fe7301c97e5df6255323e445aadb05282104b7bb3e692edea86108\": rpc error: code = NotFound desc = could not find container \"8470b21921fe7301c97e5df6255323e445aadb05282104b7bb3e692edea86108\": container with ID starting with 8470b21921fe7301c97e5df6255323e445aadb05282104b7bb3e692edea86108 not found: ID does not exist"
Oct 30 21:46:10.427300 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:10.427225    4060 scope.go:122] "RemoveContainer" containerID="d692c692a93808a1580c56381a4c7f593e1eb91cd93a1a6e0b71e26982145be9"
Oct 30 21:46:10.427473 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:10.427454    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d692c692a93808a1580c56381a4c7f593e1eb91cd93a1a6e0b71e26982145be9"} err="failed to get container status \"d692c692a93808a1580c56381a4c7f593e1eb91cd93a1a6e0b71e26982145be9\": rpc error: code = NotFound desc = could not find container \"d692c692a93808a1580c56381a4c7f593e1eb91cd93a1a6e0b71e26982145be9\": container with ID starting with d692c692a93808a1580c56381a4c7f593e1eb91cd93a1a6e0b71e26982145be9 not found: ID does not exist"
Oct 30 21:46:10.427555 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:10.427474    4060 scope.go:122] "RemoveContainer" containerID="dd0e0525ee574cc0416b965c2bf4ee19cc2328823862203453c942abf12ff966"
Oct 30 21:46:10.427751 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:10.427733    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dd0e0525ee574cc0416b965c2bf4ee19cc2328823862203453c942abf12ff966"} err="failed to get container status \"dd0e0525ee574cc0416b965c2bf4ee19cc2328823862203453c942abf12ff966\": rpc error: code = NotFound desc = could not find container \"dd0e0525ee574cc0416b965c2bf4ee19cc2328823862203453c942abf12ff966\": container with ID starting with dd0e0525ee574cc0416b965c2bf4ee19cc2328823862203453c942abf12ff966 not found: ID does not exist"
Oct 30 21:46:10.427832 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:10.427752    4060 scope.go:122] "RemoveContainer" containerID="dab7e653a9bd207f87fea5ff89cf64b4d5b056f92190f6d27eb1dff13b363c5d"
Oct 30 21:46:10.428016 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:10.427997    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dab7e653a9bd207f87fea5ff89cf64b4d5b056f92190f6d27eb1dff13b363c5d"} err="failed to get container status \"dab7e653a9bd207f87fea5ff89cf64b4d5b056f92190f6d27eb1dff13b363c5d\": rpc error: code = NotFound desc = could not find container \"dab7e653a9bd207f87fea5ff89cf64b4d5b056f92190f6d27eb1dff13b363c5d\": container with ID starting with dab7e653a9bd207f87fea5ff89cf64b4d5b056f92190f6d27eb1dff13b363c5d not found: ID does not exist"
Oct 30 21:46:10.428072 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:10.428016    4060 scope.go:122] "RemoveContainer" containerID="8470b21921fe7301c97e5df6255323e445aadb05282104b7bb3e692edea86108"
Oct 30 21:46:10.428266 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:10.428248    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8470b21921fe7301c97e5df6255323e445aadb05282104b7bb3e692edea86108"} err="failed to get container status \"8470b21921fe7301c97e5df6255323e445aadb05282104b7bb3e692edea86108\": rpc error: code = NotFound desc = could not find container \"8470b21921fe7301c97e5df6255323e445aadb05282104b7bb3e692edea86108\": container with ID starting with 8470b21921fe7301c97e5df6255323e445aadb05282104b7bb3e692edea86108 not found: ID does not exist"
Oct 30 21:46:10.428343 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:10.428267    4060 scope.go:122] "RemoveContainer" containerID="d692c692a93808a1580c56381a4c7f593e1eb91cd93a1a6e0b71e26982145be9"
Oct 30 21:46:10.428522 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:10.428481    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d692c692a93808a1580c56381a4c7f593e1eb91cd93a1a6e0b71e26982145be9"} err="failed to get container status \"d692c692a93808a1580c56381a4c7f593e1eb91cd93a1a6e0b71e26982145be9\": rpc error: code = NotFound desc = could not find container \"d692c692a93808a1580c56381a4c7f593e1eb91cd93a1a6e0b71e26982145be9\": container with ID starting with d692c692a93808a1580c56381a4c7f593e1eb91cd93a1a6e0b71e26982145be9 not found: ID does not exist"
Oct 30 21:46:10.512170 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:10.512140    4060 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5d6efefd-cfdb-487f-901a-5b2e88ccd1bb-web-config\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:46:10.512170 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:10.512171    4060 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fwcvt\" (UniqueName: \"kubernetes.io/projected/5d6efefd-cfdb-487f-901a-5b2e88ccd1bb-kube-api-access-fwcvt\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:46:10.512401 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:10.512186    4060 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5d6efefd-cfdb-487f-901a-5b2e88ccd1bb-tls-assets\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:46:10.512401 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:10.512197    4060 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5d6efefd-cfdb-487f-901a-5b2e88ccd1bb-cluster-tls-config\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:46:10.512401 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:10.512206    4060 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5d6efefd-cfdb-487f-901a-5b2e88ccd1bb-config-volume\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:46:10.512401 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:10.512216    4060 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5d6efefd-cfdb-487f-901a-5b2e88ccd1bb-config-out\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:46:10.537863 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:10.537831    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"]
Oct 30 21:46:10.586685 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:10.586649    4060 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"]
Oct 30 21:46:10.789075 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:10.789042    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"]
Oct 30 21:46:10.817885 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:10.817858    4060 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"]
Oct 30 21:46:11.427930 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:11.427895    4060 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="5d6efefd-cfdb-487f-901a-5b2e88ccd1bb" path="/var/lib/kubelet/pods/5d6efefd-cfdb-487f-901a-5b2e88ccd1bb/volumes"
Oct 30 21:46:11.428430 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:11.428417    4060 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b" path="/var/lib/kubelet/pods/f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b/volumes"
Oct 30 21:46:11.657313 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:11.657284    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:46:11.657563 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:11.657538    4060 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-collector-0" podUID="98a7a4c0-7848-4c42-a377-3aa6aadb77b6" containerName="otc-container" containerID="cri-o://e7f01da8031c3d7763ddce6989f1f2eac171835a256db7d3cb49d59c77a07d74" gracePeriod=30
Oct 30 21:46:11.902720 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:11.902695    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:46:12.023958 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:12.023861    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/98a7a4c0-7848-4c42-a377-3aa6aadb77b6-kube-api-access-jtxx6\" (UniqueName: \"kubernetes.io/projected/98a7a4c0-7848-4c42-a377-3aa6aadb77b6-kube-api-access-jtxx6\") pod \"98a7a4c0-7848-4c42-a377-3aa6aadb77b6\" (UID: \"98a7a4c0-7848-4c42-a377-3aa6aadb77b6\") "
Oct 30 21:46:12.023958 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:12.023944    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/98a7a4c0-7848-4c42-a377-3aa6aadb77b6-data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/98a7a4c0-7848-4c42-a377-3aa6aadb77b6-data-science-collector-ta-client-cert\") pod \"98a7a4c0-7848-4c42-a377-3aa6aadb77b6\" (UID: \"98a7a4c0-7848-4c42-a377-3aa6aadb77b6\") "
Oct 30 21:46:12.024211 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:12.024006    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/98a7a4c0-7848-4c42-a377-3aa6aadb77b6-otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/98a7a4c0-7848-4c42-a377-3aa6aadb77b6-otlp-tls-certs\") pod \"98a7a4c0-7848-4c42-a377-3aa6aadb77b6\" (UID: \"98a7a4c0-7848-4c42-a377-3aa6aadb77b6\") "
Oct 30 21:46:12.024211 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:12.024041    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/98a7a4c0-7848-4c42-a377-3aa6aadb77b6-otc-internal\" (UniqueName: \"kubernetes.io/configmap/98a7a4c0-7848-4c42-a377-3aa6aadb77b6-otc-internal\") pod \"98a7a4c0-7848-4c42-a377-3aa6aadb77b6\" (UID: \"98a7a4c0-7848-4c42-a377-3aa6aadb77b6\") "
Oct 30 21:46:12.024211 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:12.024081    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/98a7a4c0-7848-4c42-a377-3aa6aadb77b6-tls-certs\" (UniqueName: \"kubernetes.io/secret/98a7a4c0-7848-4c42-a377-3aa6aadb77b6-tls-certs\") pod \"98a7a4c0-7848-4c42-a377-3aa6aadb77b6\" (UID: \"98a7a4c0-7848-4c42-a377-3aa6aadb77b6\") "
Oct 30 21:46:12.024211 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:12.024124    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/98a7a4c0-7848-4c42-a377-3aa6aadb77b6-monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/98a7a4c0-7848-4c42-a377-3aa6aadb77b6-monitoring-tls-certs\") pod \"98a7a4c0-7848-4c42-a377-3aa6aadb77b6\" (UID: \"98a7a4c0-7848-4c42-a377-3aa6aadb77b6\") "
Oct 30 21:46:12.024952 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:12.024766    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/98a7a4c0-7848-4c42-a377-3aa6aadb77b6-otc-internal" pod "98a7a4c0-7848-4c42-a377-3aa6aadb77b6" (UID: "98a7a4c0-7848-4c42-a377-3aa6aadb77b6"). InnerVolumeSpecName "otc-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:46:12.034090 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:12.032929    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/98a7a4c0-7848-4c42-a377-3aa6aadb77b6-monitoring-tls-certs" pod "98a7a4c0-7848-4c42-a377-3aa6aadb77b6" (UID: "98a7a4c0-7848-4c42-a377-3aa6aadb77b6"). InnerVolumeSpecName "monitoring-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:46:12.036551 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:12.035137    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/98a7a4c0-7848-4c42-a377-3aa6aadb77b6-otlp-tls-certs" pod "98a7a4c0-7848-4c42-a377-3aa6aadb77b6" (UID: "98a7a4c0-7848-4c42-a377-3aa6aadb77b6"). InnerVolumeSpecName "otlp-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:46:12.040097 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:12.040069    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/98a7a4c0-7848-4c42-a377-3aa6aadb77b6-tls-certs" pod "98a7a4c0-7848-4c42-a377-3aa6aadb77b6" (UID: "98a7a4c0-7848-4c42-a377-3aa6aadb77b6"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:46:12.047273 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:12.047245    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/98a7a4c0-7848-4c42-a377-3aa6aadb77b6-data-science-collector-ta-client-cert" pod "98a7a4c0-7848-4c42-a377-3aa6aadb77b6" (UID: "98a7a4c0-7848-4c42-a377-3aa6aadb77b6"). InnerVolumeSpecName "data-science-collector-ta-client-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:46:12.047724 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:12.047694    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/98a7a4c0-7848-4c42-a377-3aa6aadb77b6-kube-api-access-jtxx6" pod "98a7a4c0-7848-4c42-a377-3aa6aadb77b6" (UID: "98a7a4c0-7848-4c42-a377-3aa6aadb77b6"). InnerVolumeSpecName "kube-api-access-jtxx6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:46:12.124807 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:12.124766    4060 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jtxx6\" (UniqueName: \"kubernetes.io/projected/98a7a4c0-7848-4c42-a377-3aa6aadb77b6-kube-api-access-jtxx6\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:46:12.124807 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:12.124800    4060 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/98a7a4c0-7848-4c42-a377-3aa6aadb77b6-data-science-collector-ta-client-cert\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:46:12.125002 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:12.124817    4060 reconciler_common.go:299] "Volume detached for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/98a7a4c0-7848-4c42-a377-3aa6aadb77b6-otlp-tls-certs\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:46:12.125002 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:12.124830    4060 reconciler_common.go:299] "Volume detached for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/98a7a4c0-7848-4c42-a377-3aa6aadb77b6-otc-internal\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:46:12.125002 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:12.124843    4060 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/98a7a4c0-7848-4c42-a377-3aa6aadb77b6-tls-certs\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:46:12.125002 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:12.124854    4060 reconciler_common.go:299] "Volume detached for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/98a7a4c0-7848-4c42-a377-3aa6aadb77b6-monitoring-tls-certs\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:46:12.149458 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:46:12.149422    4060 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v2f4x" containerName="extractor"
Oct 30 21:46:12.381331 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:12.381245    4060 generic.go:356] "Generic (PLEG): container finished" podID="98a7a4c0-7848-4c42-a377-3aa6aadb77b6" containerID="e7f01da8031c3d7763ddce6989f1f2eac171835a256db7d3cb49d59c77a07d74" exitCode=0
Oct 30 21:46:12.381331 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:12.381310    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:46:12.381331 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:12.381324    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"98a7a4c0-7848-4c42-a377-3aa6aadb77b6","Type":"ContainerDied","Data":"e7f01da8031c3d7763ddce6989f1f2eac171835a256db7d3cb49d59c77a07d74"}
Oct 30 21:46:12.381696 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:12.381395    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"98a7a4c0-7848-4c42-a377-3aa6aadb77b6","Type":"ContainerDied","Data":"c4c9632ce2be798dd3c25d1b4daebc62f8d1c0560e6d4f83c0f963d69a8ce751"}
Oct 30 21:46:12.381696 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:12.381417    4060 scope.go:122] "RemoveContainer" containerID="e7f01da8031c3d7763ddce6989f1f2eac171835a256db7d3cb49d59c77a07d74"
Oct 30 21:46:12.390181 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:12.390163    4060 scope.go:122] "RemoveContainer" containerID="e7f01da8031c3d7763ddce6989f1f2eac171835a256db7d3cb49d59c77a07d74"
Oct 30 21:46:12.390434 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:46:12.390414    4060 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e7f01da8031c3d7763ddce6989f1f2eac171835a256db7d3cb49d59c77a07d74\": container with ID starting with e7f01da8031c3d7763ddce6989f1f2eac171835a256db7d3cb49d59c77a07d74 not found: ID does not exist" containerID="e7f01da8031c3d7763ddce6989f1f2eac171835a256db7d3cb49d59c77a07d74"
Oct 30 21:46:12.390527 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:12.390447    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e7f01da8031c3d7763ddce6989f1f2eac171835a256db7d3cb49d59c77a07d74"} err="failed to get container status \"e7f01da8031c3d7763ddce6989f1f2eac171835a256db7d3cb49d59c77a07d74\": rpc error: code = NotFound desc = could not find container \"e7f01da8031c3d7763ddce6989f1f2eac171835a256db7d3cb49d59c77a07d74\": container with ID starting with e7f01da8031c3d7763ddce6989f1f2eac171835a256db7d3cb49d59c77a07d74 not found: ID does not exist"
Oct 30 21:46:12.555338 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:12.555300    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:46:12.557450 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:12.557429    4060 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:46:13.426076 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:13.426044    4060 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="98a7a4c0-7848-4c42-a377-3aa6aadb77b6" path="/var/lib/kubelet/pods/98a7a4c0-7848-4c42-a377-3aa6aadb77b6/volumes"
Oct 30 21:46:28.033552 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:28.033514    4060 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-zkc8n"]
Oct 30 21:46:28.034003 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:28.033806    4060 cpu_manager.go:414] "containerMap: removing container" podUID="99506ac5-5ea3-4889-8486-b0c05f375235" containerName="korrel8r"
Oct 30 21:46:28.034003 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:28.033817    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="99506ac5-5ea3-4889-8486-b0c05f375235" containerName="korrel8r"
Oct 30 21:46:28.034003 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:28.033826    4060 cpu_manager.go:414] "containerMap: removing container" podUID="5d6efefd-cfdb-487f-901a-5b2e88ccd1bb" containerName="config-reloader"
Oct 30 21:46:28.034003 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:28.033831    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5d6efefd-cfdb-487f-901a-5b2e88ccd1bb" containerName="config-reloader"
Oct 30 21:46:28.034003 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:28.033839    4060 cpu_manager.go:414] "containerMap: removing container" podUID="5d6efefd-cfdb-487f-901a-5b2e88ccd1bb" containerName="alertmanager"
Oct 30 21:46:28.034003 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:28.033844    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5d6efefd-cfdb-487f-901a-5b2e88ccd1bb" containerName="alertmanager"
Oct 30 21:46:28.034003 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:28.033850    4060 cpu_manager.go:414] "containerMap: removing container" podUID="98a7a4c0-7848-4c42-a377-3aa6aadb77b6" containerName="otc-container"
Oct 30 21:46:28.034003 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:28.033854    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="98a7a4c0-7848-4c42-a377-3aa6aadb77b6" containerName="otc-container"
Oct 30 21:46:28.034003 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:28.033861    4060 cpu_manager.go:414] "containerMap: removing container" podUID="f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b" containerName="init-config-reloader"
Oct 30 21:46:28.034003 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:28.033865    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b" containerName="init-config-reloader"
Oct 30 21:46:28.034003 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:28.033883    4060 cpu_manager.go:414] "containerMap: removing container" podUID="5d6efefd-cfdb-487f-901a-5b2e88ccd1bb" containerName="init-config-reloader"
Oct 30 21:46:28.034003 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:28.033887    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5d6efefd-cfdb-487f-901a-5b2e88ccd1bb" containerName="init-config-reloader"
Oct 30 21:46:28.034003 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:28.033894    4060 cpu_manager.go:414] "containerMap: removing container" podUID="f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b" containerName="prometheus"
Oct 30 21:46:28.034003 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:28.033899    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b" containerName="prometheus"
Oct 30 21:46:28.034003 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:28.033908    4060 cpu_manager.go:414] "containerMap: removing container" podUID="6d0bf513-04a6-4525-b66f-0e3f8b79a0f5" containerName="kube-rbac-proxy"
Oct 30 21:46:28.034003 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:28.033914    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6d0bf513-04a6-4525-b66f-0e3f8b79a0f5" containerName="kube-rbac-proxy"
Oct 30 21:46:28.034003 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:28.033921    4060 cpu_manager.go:414] "containerMap: removing container" podUID="f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b" containerName="config-reloader"
Oct 30 21:46:28.034003 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:28.033926    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b" containerName="config-reloader"
Oct 30 21:46:28.034003 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:28.033932    4060 cpu_manager.go:414] "containerMap: removing container" podUID="f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b" containerName="thanos-sidecar"
Oct 30 21:46:28.034003 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:28.033936    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b" containerName="thanos-sidecar"
Oct 30 21:46:28.034003 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:28.033979    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="6d0bf513-04a6-4525-b66f-0e3f8b79a0f5" containerName="kube-rbac-proxy"
Oct 30 21:46:28.034003 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:28.033989    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b" containerName="config-reloader"
Oct 30 21:46:28.034003 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:28.033994    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b" containerName="thanos-sidecar"
Oct 30 21:46:28.034003 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:28.034001    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="99506ac5-5ea3-4889-8486-b0c05f375235" containerName="korrel8r"
Oct 30 21:46:28.034003 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:28.034005    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="5d6efefd-cfdb-487f-901a-5b2e88ccd1bb" containerName="config-reloader"
Oct 30 21:46:28.034003 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:28.034010    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="5d6efefd-cfdb-487f-901a-5b2e88ccd1bb" containerName="alertmanager"
Oct 30 21:46:28.034003 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:28.034016    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="98a7a4c0-7848-4c42-a377-3aa6aadb77b6" containerName="otc-container"
Oct 30 21:46:28.034853 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:28.034023    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="f60ebc1e-0ad0-4b08-b9b2-ce9705a9b36b" containerName="prometheus"
Oct 30 21:46:28.038111 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:28.038090    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-zkc8n"
Oct 30 21:46:28.070723 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:28.070692    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v6z6z\" (UniqueName: \"kubernetes.io/projected/414766a3-ef7e-4f4b-8056-42ae2e2abd98-kube-api-access-v6z6z\") pod \"data-science-prometheus-cluster-proxy-545f759f7c-zkc8n\" (UID: \"414766a3-ef7e-4f4b-8056-42ae2e2abd98\") " pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-zkc8n"
Oct 30 21:46:28.070907 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:28.070739    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-client-cert\" (UniqueName: \"kubernetes.io/secret/414766a3-ef7e-4f4b-8056-42ae2e2abd98-prometheus-client-cert\") pod \"data-science-prometheus-cluster-proxy-545f759f7c-zkc8n\" (UID: \"414766a3-ef7e-4f4b-8056-42ae2e2abd98\") " pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-zkc8n"
Oct 30 21:46:28.070907 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:28.070819    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-ca\" (UniqueName: \"kubernetes.io/configmap/414766a3-ef7e-4f4b-8056-42ae2e2abd98-prometheus-ca\") pod \"data-science-prometheus-cluster-proxy-545f759f7c-zkc8n\" (UID: \"414766a3-ef7e-4f4b-8056-42ae2e2abd98\") " pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-zkc8n"
Oct 30 21:46:28.071046 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:28.070954    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/414766a3-ef7e-4f4b-8056-42ae2e2abd98-kube-rbac-proxy-config\") pod \"data-science-prometheus-cluster-proxy-545f759f7c-zkc8n\" (UID: \"414766a3-ef7e-4f4b-8056-42ae2e2abd98\") " pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-zkc8n"
Oct 30 21:46:28.071046 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:28.070990    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/414766a3-ef7e-4f4b-8056-42ae2e2abd98-tls\") pod \"data-science-prometheus-cluster-proxy-545f759f7c-zkc8n\" (UID: \"414766a3-ef7e-4f4b-8056-42ae2e2abd98\") " pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-zkc8n"
Oct 30 21:46:28.090482 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:28.090456    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"prometheus-operated-tls\""
Oct 30 21:46:28.090832 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:28.090810    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-prometheus-cluster-proxy-tls\""
Oct 30 21:46:28.140094 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:28.140056    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"openshift-service-ca.crt\""
Oct 30 21:46:28.140266 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:28.140111    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"kube-root-ca.crt\""
Oct 30 21:46:28.140334 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:28.140314    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"prometheus-web-tls-ca\""
Oct 30 21:46:28.140389 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:28.140361    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-prometheus-cluster-proxy-dockercfg-g5mwj\""
Oct 30 21:46:28.140484 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:28.140468    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-prometheus-cluster-proxy-kube-rbac-proxy\""
Oct 30 21:46:28.142222 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:28.142203    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-zkc8n"]
Oct 30 21:46:28.172130 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:28.172104    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-ca\" (UniqueName: \"kubernetes.io/configmap/414766a3-ef7e-4f4b-8056-42ae2e2abd98-prometheus-ca\") pod \"data-science-prometheus-cluster-proxy-545f759f7c-zkc8n\" (UID: \"414766a3-ef7e-4f4b-8056-42ae2e2abd98\") " pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-zkc8n"
Oct 30 21:46:28.172293 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:28.172139    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/414766a3-ef7e-4f4b-8056-42ae2e2abd98-kube-rbac-proxy-config\") pod \"data-science-prometheus-cluster-proxy-545f759f7c-zkc8n\" (UID: \"414766a3-ef7e-4f4b-8056-42ae2e2abd98\") " pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-zkc8n"
Oct 30 21:46:28.172293 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:28.172159    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/414766a3-ef7e-4f4b-8056-42ae2e2abd98-tls\") pod \"data-science-prometheus-cluster-proxy-545f759f7c-zkc8n\" (UID: \"414766a3-ef7e-4f4b-8056-42ae2e2abd98\") " pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-zkc8n"
Oct 30 21:46:28.172293 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:28.172189    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v6z6z\" (UniqueName: \"kubernetes.io/projected/414766a3-ef7e-4f4b-8056-42ae2e2abd98-kube-api-access-v6z6z\") pod \"data-science-prometheus-cluster-proxy-545f759f7c-zkc8n\" (UID: \"414766a3-ef7e-4f4b-8056-42ae2e2abd98\") " pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-zkc8n"
Oct 30 21:46:28.172293 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:28.172226    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-client-cert\" (UniqueName: \"kubernetes.io/secret/414766a3-ef7e-4f4b-8056-42ae2e2abd98-prometheus-client-cert\") pod \"data-science-prometheus-cluster-proxy-545f759f7c-zkc8n\" (UID: \"414766a3-ef7e-4f4b-8056-42ae2e2abd98\") " pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-zkc8n"
Oct 30 21:46:28.172811 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:28.172781    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-ca\" (UniqueName: \"kubernetes.io/configmap/414766a3-ef7e-4f4b-8056-42ae2e2abd98-prometheus-ca\") pod \"data-science-prometheus-cluster-proxy-545f759f7c-zkc8n\" (UID: \"414766a3-ef7e-4f4b-8056-42ae2e2abd98\") " pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-zkc8n"
Oct 30 21:46:28.174689 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:28.174666    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls\" (UniqueName: \"kubernetes.io/secret/414766a3-ef7e-4f4b-8056-42ae2e2abd98-tls\") pod \"data-science-prometheus-cluster-proxy-545f759f7c-zkc8n\" (UID: \"414766a3-ef7e-4f4b-8056-42ae2e2abd98\") " pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-zkc8n"
Oct 30 21:46:28.174783 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:28.174670    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/414766a3-ef7e-4f4b-8056-42ae2e2abd98-kube-rbac-proxy-config\") pod \"data-science-prometheus-cluster-proxy-545f759f7c-zkc8n\" (UID: \"414766a3-ef7e-4f4b-8056-42ae2e2abd98\") " pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-zkc8n"
Oct 30 21:46:28.174844 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:28.174824    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-client-cert\" (UniqueName: \"kubernetes.io/secret/414766a3-ef7e-4f4b-8056-42ae2e2abd98-prometheus-client-cert\") pod \"data-science-prometheus-cluster-proxy-545f759f7c-zkc8n\" (UID: \"414766a3-ef7e-4f4b-8056-42ae2e2abd98\") " pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-zkc8n"
Oct 30 21:46:28.235542 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:28.235487    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v6z6z\" (UniqueName: \"kubernetes.io/projected/414766a3-ef7e-4f4b-8056-42ae2e2abd98-kube-api-access-v6z6z\") pod \"data-science-prometheus-cluster-proxy-545f759f7c-zkc8n\" (UID: \"414766a3-ef7e-4f4b-8056-42ae2e2abd98\") " pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-zkc8n"
Oct 30 21:46:28.350679 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:28.350602    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-zkc8n"
Oct 30 21:46:28.398931 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:28.397235    4060 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/korrel8r-5cbcc89b8f-5zj6h"]
Oct 30 21:46:28.402280 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:28.402228    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-5zj6h"
Oct 30 21:46:28.459675 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:28.459645    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/korrel8r-5cbcc89b8f-5zj6h"]
Oct 30 21:46:28.474843 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:28.474818    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ace3afef-a91a-4d3c-a1df-835d94f6c0c7-config\") pod \"korrel8r-5cbcc89b8f-5zj6h\" (UID: \"ace3afef-a91a-4d3c-a1df-835d94f6c0c7\") " pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-5zj6h"
Oct 30 21:46:28.475017 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:28.474853    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dmnlx\" (UniqueName: \"kubernetes.io/projected/ace3afef-a91a-4d3c-a1df-835d94f6c0c7-kube-api-access-dmnlx\") pod \"korrel8r-5cbcc89b8f-5zj6h\" (UID: \"ace3afef-a91a-4d3c-a1df-835d94f6c0c7\") " pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-5zj6h"
Oct 30 21:46:28.475017 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:28.474874    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/ace3afef-a91a-4d3c-a1df-835d94f6c0c7-tls\") pod \"korrel8r-5cbcc89b8f-5zj6h\" (UID: \"ace3afef-a91a-4d3c-a1df-835d94f6c0c7\") " pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-5zj6h"
Oct 30 21:46:28.500366 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:28.500343    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"korrel8r-config\""
Oct 30 21:46:28.515370 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:28.515344    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"korrel8r-dockercfg-sf2h4\""
Oct 30 21:46:28.515370 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:28.515343    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"korrel8r-tls\""
Oct 30 21:46:28.575799 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:28.575770    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ace3afef-a91a-4d3c-a1df-835d94f6c0c7-config\") pod \"korrel8r-5cbcc89b8f-5zj6h\" (UID: \"ace3afef-a91a-4d3c-a1df-835d94f6c0c7\") " pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-5zj6h"
Oct 30 21:46:28.575799 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:28.575802    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dmnlx\" (UniqueName: \"kubernetes.io/projected/ace3afef-a91a-4d3c-a1df-835d94f6c0c7-kube-api-access-dmnlx\") pod \"korrel8r-5cbcc89b8f-5zj6h\" (UID: \"ace3afef-a91a-4d3c-a1df-835d94f6c0c7\") " pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-5zj6h"
Oct 30 21:46:28.575984 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:28.575822    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/ace3afef-a91a-4d3c-a1df-835d94f6c0c7-tls\") pod \"korrel8r-5cbcc89b8f-5zj6h\" (UID: \"ace3afef-a91a-4d3c-a1df-835d94f6c0c7\") " pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-5zj6h"
Oct 30 21:46:28.576638 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:28.576620    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ace3afef-a91a-4d3c-a1df-835d94f6c0c7-config\") pod \"korrel8r-5cbcc89b8f-5zj6h\" (UID: \"ace3afef-a91a-4d3c-a1df-835d94f6c0c7\") " pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-5zj6h"
Oct 30 21:46:28.578129 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:28.578113    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls\" (UniqueName: \"kubernetes.io/secret/ace3afef-a91a-4d3c-a1df-835d94f6c0c7-tls\") pod \"korrel8r-5cbcc89b8f-5zj6h\" (UID: \"ace3afef-a91a-4d3c-a1df-835d94f6c0c7\") " pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-5zj6h"
Oct 30 21:46:28.638435 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:28.638369    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dmnlx\" (UniqueName: \"kubernetes.io/projected/ace3afef-a91a-4d3c-a1df-835d94f6c0c7-kube-api-access-dmnlx\") pod \"korrel8r-5cbcc89b8f-5zj6h\" (UID: \"ace3afef-a91a-4d3c-a1df-835d94f6c0c7\") " pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-5zj6h"
Oct 30 21:46:28.721249 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:28.721054    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-zkc8n"]
Oct 30 21:46:28.723298 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:28.723278    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-5zj6h"
Oct 30 21:46:28.723774 ip-10-0-142-4 kubenswrapper[4060]: W1030 21:46:28.723751    4060 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod414766a3_ef7e_4f4b_8056_42ae2e2abd98.slice/crio-20d21fe31b5a1b4e66bff1da3e2d828078b5f439dce6f88e9f2bb3e33d46963a WatchSource:0}: Error finding container 20d21fe31b5a1b4e66bff1da3e2d828078b5f439dce6f88e9f2bb3e33d46963a: Status 404 returned error can't find the container with id 20d21fe31b5a1b4e66bff1da3e2d828078b5f439dce6f88e9f2bb3e33d46963a
Oct 30 21:46:29.098111 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:29.098087    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/korrel8r-5cbcc89b8f-5zj6h"]
Oct 30 21:46:29.100277 ip-10-0-142-4 kubenswrapper[4060]: W1030 21:46:29.100255    4060 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podace3afef_a91a_4d3c_a1df_835d94f6c0c7.slice/crio-5ca8eb8f9a652d3817c816efbccec66a5f0087cf24884cfce700d61f2221d942 WatchSource:0}: Error finding container 5ca8eb8f9a652d3817c816efbccec66a5f0087cf24884cfce700d61f2221d942: Status 404 returned error can't find the container with id 5ca8eb8f9a652d3817c816efbccec66a5f0087cf24884cfce700d61f2221d942
Oct 30 21:46:29.467616 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:29.467583    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-5zj6h" event={"ID":"ace3afef-a91a-4d3c-a1df-835d94f6c0c7","Type":"ContainerStarted","Data":"29a2f7ce7e971f6adbce8033fb59a6839acc3c224641aa6522f0c0b93a109874"}
Oct 30 21:46:29.467870 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:29.467644    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-5zj6h" event={"ID":"ace3afef-a91a-4d3c-a1df-835d94f6c0c7","Type":"ContainerStarted","Data":"5ca8eb8f9a652d3817c816efbccec66a5f0087cf24884cfce700d61f2221d942"}
Oct 30 21:46:29.467870 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:29.467672    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-5zj6h"
Oct 30 21:46:29.469108 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:29.469084    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-zkc8n" event={"ID":"414766a3-ef7e-4f4b-8056-42ae2e2abd98","Type":"ContainerStarted","Data":"380c34aff41d39575db0ab47e9f8be3b92316fee9f5c077877cc51943b3efdf4"}
Oct 30 21:46:29.469255 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:29.469122    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-zkc8n" event={"ID":"414766a3-ef7e-4f4b-8056-42ae2e2abd98","Type":"ContainerStarted","Data":"20d21fe31b5a1b4e66bff1da3e2d828078b5f439dce6f88e9f2bb3e33d46963a"}
Oct 30 21:46:29.469255 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:29.469206    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-zkc8n"
Oct 30 21:46:29.583519 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:29.583445    4060 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-5zj6h" podStartSLOduration=1.583429759 podStartE2EDuration="1.583429759s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:46:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:46:29.582805424 +0000 UTC m=+4208.339803722" watchObservedRunningTime="2026-10-30 21:46:29.583429759 +0000 UTC m=+4208.340428060"
Oct 30 21:46:29.700714 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:29.700666    4060 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-zkc8n" podStartSLOduration=2.700652506 podStartE2EDuration="2.700652506s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:46:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:46:29.699833901 +0000 UTC m=+4208.456832200" watchObservedRunningTime="2026-10-30 21:46:29.700652506 +0000 UTC m=+4208.457650838"
Oct 30 21:46:32.887503 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:32.887464    4060 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:46:32.890867 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:32.890846    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:46:32.944801 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:32.944771    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-headless-tls\""
Oct 30 21:46:32.993673 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:32.993639    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-a0f9182a\""
Oct 30 21:46:32.993903 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:32.993688    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-tls\""
Oct 30 21:46:32.993993 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:32.993700    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-monitoring-tls\""
Oct 30 21:46:32.993993 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:32.993735    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-dockercfg-dczck\""
Oct 30 21:46:32.993993 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:32.993843    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-ta-client-cert\""
Oct 30 21:46:32.995817 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:32.995796    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:46:33.013711 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:33.013683    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/b2304f17-6858-42f3-bd4b-c47b2745ff2c-otlp-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"b2304f17-6858-42f3-bd4b-c47b2745ff2c\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:46:33.013861 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:33.013717    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kcdg9\" (UniqueName: \"kubernetes.io/projected/b2304f17-6858-42f3-bd4b-c47b2745ff2c-kube-api-access-kcdg9\") pod \"data-science-collector-collector-0\" (UID: \"b2304f17-6858-42f3-bd4b-c47b2745ff2c\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:46:33.013861 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:33.013790    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/b2304f17-6858-42f3-bd4b-c47b2745ff2c-monitoring-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"b2304f17-6858-42f3-bd4b-c47b2745ff2c\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:46:33.013861 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:33.013833    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/b2304f17-6858-42f3-bd4b-c47b2745ff2c-otc-internal\") pod \"data-science-collector-collector-0\" (UID: \"b2304f17-6858-42f3-bd4b-c47b2745ff2c\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:46:33.013861 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:33.013848    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/b2304f17-6858-42f3-bd4b-c47b2745ff2c-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-0\" (UID: \"b2304f17-6858-42f3-bd4b-c47b2745ff2c\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:46:33.014005 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:33.013869    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b2304f17-6858-42f3-bd4b-c47b2745ff2c-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"b2304f17-6858-42f3-bd4b-c47b2745ff2c\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:46:33.114646 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:33.114607    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kcdg9\" (UniqueName: \"kubernetes.io/projected/b2304f17-6858-42f3-bd4b-c47b2745ff2c-kube-api-access-kcdg9\") pod \"data-science-collector-collector-0\" (UID: \"b2304f17-6858-42f3-bd4b-c47b2745ff2c\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:46:33.114846 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:33.114656    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/b2304f17-6858-42f3-bd4b-c47b2745ff2c-monitoring-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"b2304f17-6858-42f3-bd4b-c47b2745ff2c\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:46:33.114846 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:33.114702    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/b2304f17-6858-42f3-bd4b-c47b2745ff2c-otc-internal\") pod \"data-science-collector-collector-0\" (UID: \"b2304f17-6858-42f3-bd4b-c47b2745ff2c\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:46:33.114846 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:33.114721    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/b2304f17-6858-42f3-bd4b-c47b2745ff2c-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-0\" (UID: \"b2304f17-6858-42f3-bd4b-c47b2745ff2c\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:46:33.114846 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:33.114742    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b2304f17-6858-42f3-bd4b-c47b2745ff2c-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"b2304f17-6858-42f3-bd4b-c47b2745ff2c\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:46:33.114846 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:33.114783    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/b2304f17-6858-42f3-bd4b-c47b2745ff2c-otlp-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"b2304f17-6858-42f3-bd4b-c47b2745ff2c\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:46:33.115564 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:33.115538    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/b2304f17-6858-42f3-bd4b-c47b2745ff2c-otc-internal\") pod \"data-science-collector-collector-0\" (UID: \"b2304f17-6858-42f3-bd4b-c47b2745ff2c\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:46:33.117621 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:33.117599    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/b2304f17-6858-42f3-bd4b-c47b2745ff2c-monitoring-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"b2304f17-6858-42f3-bd4b-c47b2745ff2c\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:46:33.117713 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:33.117630    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/b2304f17-6858-42f3-bd4b-c47b2745ff2c-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-0\" (UID: \"b2304f17-6858-42f3-bd4b-c47b2745ff2c\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:46:33.118222 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:33.118198    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/b2304f17-6858-42f3-bd4b-c47b2745ff2c-otlp-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"b2304f17-6858-42f3-bd4b-c47b2745ff2c\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:46:33.118298 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:33.118232    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b2304f17-6858-42f3-bd4b-c47b2745ff2c-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"b2304f17-6858-42f3-bd4b-c47b2745ff2c\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:46:33.177547 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:33.177462    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kcdg9\" (UniqueName: \"kubernetes.io/projected/b2304f17-6858-42f3-bd4b-c47b2745ff2c-kube-api-access-kcdg9\") pod \"data-science-collector-collector-0\" (UID: \"b2304f17-6858-42f3-bd4b-c47b2745ff2c\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:46:33.205434 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:33.205402    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:46:33.585058 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:33.585032    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:46:33.586988 ip-10-0-142-4 kubenswrapper[4060]: W1030 21:46:33.586951    4060 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2304f17_6858_42f3_bd4b_c47b2745ff2c.slice/crio-ed1c6fd7a8b333b64b58302f896696df90c9557b4ed25d9fcc46cb9b0f3287bd WatchSource:0}: Error finding container ed1c6fd7a8b333b64b58302f896696df90c9557b4ed25d9fcc46cb9b0f3287bd: Status 404 returned error can't find the container with id ed1c6fd7a8b333b64b58302f896696df90c9557b4ed25d9fcc46cb9b0f3287bd
Oct 30 21:46:33.589138 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:33.589106    4060 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 21:46:33.589238 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:33.589174    4060 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 21:46:34.494137 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:34.494101    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"b2304f17-6858-42f3-bd4b-c47b2745ff2c","Type":"ContainerStarted","Data":"404ba827eea0ea81e8b951333d70731a42ee9593684bc61ad2f0d8f4d124a327"}
Oct 30 21:46:34.494676 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:34.494154    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"b2304f17-6858-42f3-bd4b-c47b2745ff2c","Type":"ContainerStarted","Data":"ed1c6fd7a8b333b64b58302f896696df90c9557b4ed25d9fcc46cb9b0f3287bd"}
Oct 30 21:46:34.613623 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:34.613568    4060 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-collector-0" podStartSLOduration=2.613549998 podStartE2EDuration="2.613549998s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:46:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:46:34.612778071 +0000 UTC m=+4213.369776371" watchObservedRunningTime="2026-10-30 21:46:34.613549998 +0000 UTC m=+4213.370548311"
Oct 30 21:46:35.476148 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:35.476114    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-zkc8n"
Oct 30 21:46:40.475272 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:40.475236    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-5zj6h"
Oct 30 21:46:42.150380 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:46:42.150338    4060 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v2f4x" containerName="extractor"
Oct 30 21:46:46.976567 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:46.976526    4060 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"]
Oct 30 21:46:46.980565 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:46.980541    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:46:47.026467 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:47.026437    4060 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"]
Oct 30 21:46:47.030239 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:47.030218    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:46:47.074037 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:47.074001    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"alertmanager-data-science-monitoringstack-tls-assets-0\""
Oct 30 21:46:47.074037 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:47.074018    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"alertmanager-data-science-monitoringstack-web-config\""
Oct 30 21:46:47.074252 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:47.074160    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"alertmanager-data-science-monitoringstack-cluster-tls-config\""
Oct 30 21:46:47.074252 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:47.074169    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-monitoringstack-alertmanager-dockercfg-6xrfq\""
Oct 30 21:46:47.074345 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:47.074253    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"alertmanager-data-science-monitoringstack-generated\""
Oct 30 21:46:47.075847 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:47.075821    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"]
Oct 30 21:46:47.085480 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:47.085451    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"prometheus-data-science-monitoringstack-rulefiles-1\""
Oct 30 21:46:47.085611 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:47.085505    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"prometheus-data-science-monitoringstack-rulefiles-2\""
Oct 30 21:46:47.085699 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:47.085682    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"prometheus-data-science-monitoringstack-rulefiles-0\""
Oct 30 21:46:47.099997 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:47.099942    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"]
Oct 30 21:46:47.135479 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:47.135452    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5023ba3e-8997-481f-a8d7-3a925f14fc08-tls-assets\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"5023ba3e-8997-481f-a8d7-3a925f14fc08\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:46:47.135640 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:47.135503    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-data-science-monitoringstack-db\" (UniqueName: \"kubernetes.io/empty-dir/5023ba3e-8997-481f-a8d7-3a925f14fc08-alertmanager-data-science-monitoringstack-db\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"5023ba3e-8997-481f-a8d7-3a925f14fc08\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:46:47.135687 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:47.135649    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5023ba3e-8997-481f-a8d7-3a925f14fc08-cluster-tls-config\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"5023ba3e-8997-481f-a8d7-3a925f14fc08\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:46:47.135728 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:47.135692    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2k2qh\" (UniqueName: \"kubernetes.io/projected/5023ba3e-8997-481f-a8d7-3a925f14fc08-kube-api-access-2k2qh\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"5023ba3e-8997-481f-a8d7-3a925f14fc08\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:46:47.135804 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:47.135789    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5023ba3e-8997-481f-a8d7-3a925f14fc08-web-config\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"5023ba3e-8997-481f-a8d7-3a925f14fc08\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:46:47.135843 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:47.135812    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5023ba3e-8997-481f-a8d7-3a925f14fc08-config-volume\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"5023ba3e-8997-481f-a8d7-3a925f14fc08\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:46:47.135843 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:47.135830    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5023ba3e-8997-481f-a8d7-3a925f14fc08-config-out\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"5023ba3e-8997-481f-a8d7-3a925f14fc08\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:46:47.138048 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:47.138027    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"prometheus-data-science-monitoringstack-web-config\""
Oct 30 21:46:47.138155 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:47.138055    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"prometheus-web-tls-ca\""
Oct 30 21:46:47.138155 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:47.138055    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"prometheus-data-science-monitoringstack\""
Oct 30 21:46:47.138155 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:47.138103    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"prometheus-data-science-monitoringstack-thanos-prometheus-http-client-file\""
Oct 30 21:46:47.138155 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:47.138110    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-monitoringstack-prometheus-dockercfg-vfzqg\""
Oct 30 21:46:47.138306 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:47.138160    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"prometheus-data-science-monitoringstack-tls-assets-0\""
Oct 30 21:46:47.236760 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:47.236672    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-data-science-monitoringstack-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/adf9d81d-984a-44d1-b477-80ef0891e9c8-prometheus-data-science-monitoringstack-rulefiles-2\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"adf9d81d-984a-44d1-b477-80ef0891e9c8\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:46:47.236760 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:47.236708    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5023ba3e-8997-481f-a8d7-3a925f14fc08-tls-assets\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"5023ba3e-8997-481f-a8d7-3a925f14fc08\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:46:47.236760 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:47.236726    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/adf9d81d-984a-44d1-b477-80ef0891e9c8-thanos-prometheus-http-client-file\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"adf9d81d-984a-44d1-b477-80ef0891e9c8\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:46:47.237021 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:47.236843    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vk4l7\" (UniqueName: \"kubernetes.io/projected/adf9d81d-984a-44d1-b477-80ef0891e9c8-kube-api-access-vk4l7\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"adf9d81d-984a-44d1-b477-80ef0891e9c8\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:46:47.237021 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:47.236886    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-web-tls-ca\" (UniqueName: \"kubernetes.io/secret/adf9d81d-984a-44d1-b477-80ef0891e9c8-secret-prometheus-web-tls-ca\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"adf9d81d-984a-44d1-b477-80ef0891e9c8\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:46:47.237021 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:47.236930    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-data-science-monitoringstack-db\" (UniqueName: \"kubernetes.io/empty-dir/5023ba3e-8997-481f-a8d7-3a925f14fc08-alertmanager-data-science-monitoringstack-db\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"5023ba3e-8997-481f-a8d7-3a925f14fc08\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:46:47.237021 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:47.236982    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5023ba3e-8997-481f-a8d7-3a925f14fc08-cluster-tls-config\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"5023ba3e-8997-481f-a8d7-3a925f14fc08\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:46:47.237021 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:47.237001    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2k2qh\" (UniqueName: \"kubernetes.io/projected/5023ba3e-8997-481f-a8d7-3a925f14fc08-kube-api-access-2k2qh\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"5023ba3e-8997-481f-a8d7-3a925f14fc08\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:46:47.237021 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:47.237020    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/adf9d81d-984a-44d1-b477-80ef0891e9c8-web-config\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"adf9d81d-984a-44d1-b477-80ef0891e9c8\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:46:47.237324 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:47.237053    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config-tls-secret-key-prometheus-operated-tls-f3457c70\" (UniqueName: \"kubernetes.io/secret/adf9d81d-984a-44d1-b477-80ef0891e9c8-web-config-tls-secret-key-prometheus-operated-tls-f3457c70\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"adf9d81d-984a-44d1-b477-80ef0891e9c8\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:46:47.237324 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:47.237076    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config-tls-secret-cert-prometheus-operated-tls-f3457c70\" (UniqueName: \"kubernetes.io/secret/adf9d81d-984a-44d1-b477-80ef0891e9c8-web-config-tls-secret-cert-prometheus-operated-tls-f3457c70\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"adf9d81d-984a-44d1-b477-80ef0891e9c8\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:46:47.237324 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:47.237096    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/adf9d81d-984a-44d1-b477-80ef0891e9c8-config-out\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"adf9d81d-984a-44d1-b477-80ef0891e9c8\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:46:47.237324 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:47.237150    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-data-science-monitoringstack-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/adf9d81d-984a-44d1-b477-80ef0891e9c8-prometheus-data-science-monitoringstack-rulefiles-1\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"adf9d81d-984a-44d1-b477-80ef0891e9c8\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:46:47.237324 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:47.237230    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/adf9d81d-984a-44d1-b477-80ef0891e9c8-tls-assets\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"adf9d81d-984a-44d1-b477-80ef0891e9c8\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:46:47.237324 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:47.237276    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-data-science-monitoringstack-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/adf9d81d-984a-44d1-b477-80ef0891e9c8-prometheus-data-science-monitoringstack-rulefiles-0\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"adf9d81d-984a-44d1-b477-80ef0891e9c8\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:46:47.237689 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:47.237342    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-data-science-monitoringstack-db\" (UniqueName: \"kubernetes.io/empty-dir/5023ba3e-8997-481f-a8d7-3a925f14fc08-alertmanager-data-science-monitoringstack-db\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"5023ba3e-8997-481f-a8d7-3a925f14fc08\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:46:47.237689 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:47.237390    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5023ba3e-8997-481f-a8d7-3a925f14fc08-web-config\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"5023ba3e-8997-481f-a8d7-3a925f14fc08\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:46:47.237689 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:47.237429    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5023ba3e-8997-481f-a8d7-3a925f14fc08-config-volume\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"5023ba3e-8997-481f-a8d7-3a925f14fc08\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:46:47.237689 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:47.237454    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5023ba3e-8997-481f-a8d7-3a925f14fc08-config-out\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"5023ba3e-8997-481f-a8d7-3a925f14fc08\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:46:47.237689 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:47.237513    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/adf9d81d-984a-44d1-b477-80ef0891e9c8-config\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"adf9d81d-984a-44d1-b477-80ef0891e9c8\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:46:47.239529 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:47.239505    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5023ba3e-8997-481f-a8d7-3a925f14fc08-tls-assets\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"5023ba3e-8997-481f-a8d7-3a925f14fc08\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:46:47.239663 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:47.239575    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5023ba3e-8997-481f-a8d7-3a925f14fc08-config-out\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"5023ba3e-8997-481f-a8d7-3a925f14fc08\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:46:47.239853 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:47.239829    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5023ba3e-8997-481f-a8d7-3a925f14fc08-config-volume\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"5023ba3e-8997-481f-a8d7-3a925f14fc08\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:46:47.239917 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:47.239849    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5023ba3e-8997-481f-a8d7-3a925f14fc08-cluster-tls-config\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"5023ba3e-8997-481f-a8d7-3a925f14fc08\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:46:47.239917 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:47.239901    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5023ba3e-8997-481f-a8d7-3a925f14fc08-web-config\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"5023ba3e-8997-481f-a8d7-3a925f14fc08\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:46:47.301633 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:47.301599    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2k2qh\" (UniqueName: \"kubernetes.io/projected/5023ba3e-8997-481f-a8d7-3a925f14fc08-kube-api-access-2k2qh\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"5023ba3e-8997-481f-a8d7-3a925f14fc08\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:46:47.338317 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:47.338283    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/adf9d81d-984a-44d1-b477-80ef0891e9c8-thanos-prometheus-http-client-file\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"adf9d81d-984a-44d1-b477-80ef0891e9c8\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:46:47.338317 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:47.338319    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vk4l7\" (UniqueName: \"kubernetes.io/projected/adf9d81d-984a-44d1-b477-80ef0891e9c8-kube-api-access-vk4l7\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"adf9d81d-984a-44d1-b477-80ef0891e9c8\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:46:47.338585 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:47.338337    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-web-tls-ca\" (UniqueName: \"kubernetes.io/secret/adf9d81d-984a-44d1-b477-80ef0891e9c8-secret-prometheus-web-tls-ca\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"adf9d81d-984a-44d1-b477-80ef0891e9c8\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:46:47.338585 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:47.338441    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/adf9d81d-984a-44d1-b477-80ef0891e9c8-web-config\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"adf9d81d-984a-44d1-b477-80ef0891e9c8\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:46:47.338585 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:47.338476    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config-tls-secret-key-prometheus-operated-tls-f3457c70\" (UniqueName: \"kubernetes.io/secret/adf9d81d-984a-44d1-b477-80ef0891e9c8-web-config-tls-secret-key-prometheus-operated-tls-f3457c70\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"adf9d81d-984a-44d1-b477-80ef0891e9c8\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:46:47.338585 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:47.338515    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config-tls-secret-cert-prometheus-operated-tls-f3457c70\" (UniqueName: \"kubernetes.io/secret/adf9d81d-984a-44d1-b477-80ef0891e9c8-web-config-tls-secret-cert-prometheus-operated-tls-f3457c70\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"adf9d81d-984a-44d1-b477-80ef0891e9c8\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:46:47.338585 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:47.338541    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/adf9d81d-984a-44d1-b477-80ef0891e9c8-config-out\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"adf9d81d-984a-44d1-b477-80ef0891e9c8\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:46:47.338585 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:47.338567    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-data-science-monitoringstack-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/adf9d81d-984a-44d1-b477-80ef0891e9c8-prometheus-data-science-monitoringstack-rulefiles-1\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"adf9d81d-984a-44d1-b477-80ef0891e9c8\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:46:47.338900 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:47.338596    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/adf9d81d-984a-44d1-b477-80ef0891e9c8-tls-assets\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"adf9d81d-984a-44d1-b477-80ef0891e9c8\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:46:47.338900 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:47.338622    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-data-science-monitoringstack-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/adf9d81d-984a-44d1-b477-80ef0891e9c8-prometheus-data-science-monitoringstack-rulefiles-0\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"adf9d81d-984a-44d1-b477-80ef0891e9c8\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:46:47.338900 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:47.338681    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/adf9d81d-984a-44d1-b477-80ef0891e9c8-config\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"adf9d81d-984a-44d1-b477-80ef0891e9c8\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:46:47.338900 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:47.338733    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-data-science-monitoringstack-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/adf9d81d-984a-44d1-b477-80ef0891e9c8-prometheus-data-science-monitoringstack-rulefiles-2\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"adf9d81d-984a-44d1-b477-80ef0891e9c8\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:46:47.339376 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:47.339345    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-data-science-monitoringstack-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/adf9d81d-984a-44d1-b477-80ef0891e9c8-prometheus-data-science-monitoringstack-rulefiles-2\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"adf9d81d-984a-44d1-b477-80ef0891e9c8\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:46:47.339575 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:47.339400    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-data-science-monitoringstack-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/adf9d81d-984a-44d1-b477-80ef0891e9c8-prometheus-data-science-monitoringstack-rulefiles-1\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"adf9d81d-984a-44d1-b477-80ef0891e9c8\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:46:47.340282 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:47.340251    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-data-science-monitoringstack-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/adf9d81d-984a-44d1-b477-80ef0891e9c8-prometheus-data-science-monitoringstack-rulefiles-0\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"adf9d81d-984a-44d1-b477-80ef0891e9c8\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:46:47.341394 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:47.341367    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/adf9d81d-984a-44d1-b477-80ef0891e9c8-web-config\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"adf9d81d-984a-44d1-b477-80ef0891e9c8\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:46:47.341524 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:47.341462    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/adf9d81d-984a-44d1-b477-80ef0891e9c8-thanos-prometheus-http-client-file\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"adf9d81d-984a-44d1-b477-80ef0891e9c8\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:46:47.341596 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:47.341559    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config-tls-secret-cert-prometheus-operated-tls-f3457c70\" (UniqueName: \"kubernetes.io/secret/adf9d81d-984a-44d1-b477-80ef0891e9c8-web-config-tls-secret-cert-prometheus-operated-tls-f3457c70\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"adf9d81d-984a-44d1-b477-80ef0891e9c8\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:46:47.341728 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:47.341703    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-web-tls-ca\" (UniqueName: \"kubernetes.io/secret/adf9d81d-984a-44d1-b477-80ef0891e9c8-secret-prometheus-web-tls-ca\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"adf9d81d-984a-44d1-b477-80ef0891e9c8\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:46:47.342008 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:47.341984    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/adf9d81d-984a-44d1-b477-80ef0891e9c8-config-out\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"adf9d81d-984a-44d1-b477-80ef0891e9c8\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:46:47.342008 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:47.342000    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config-tls-secret-key-prometheus-operated-tls-f3457c70\" (UniqueName: \"kubernetes.io/secret/adf9d81d-984a-44d1-b477-80ef0891e9c8-web-config-tls-secret-key-prometheus-operated-tls-f3457c70\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"adf9d81d-984a-44d1-b477-80ef0891e9c8\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:46:47.342133 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:47.342117    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/adf9d81d-984a-44d1-b477-80ef0891e9c8-config\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"adf9d81d-984a-44d1-b477-80ef0891e9c8\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:46:47.343377 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:47.343361    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/adf9d81d-984a-44d1-b477-80ef0891e9c8-tls-assets\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"adf9d81d-984a-44d1-b477-80ef0891e9c8\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:46:47.399646 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:47.399615    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vk4l7\" (UniqueName: \"kubernetes.io/projected/adf9d81d-984a-44d1-b477-80ef0891e9c8-kube-api-access-vk4l7\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"adf9d81d-984a-44d1-b477-80ef0891e9c8\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:46:47.598313 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:47.598231    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:46:48.083229 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:48.083197    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"]
Oct 30 21:46:48.133928 ip-10-0-142-4 kubenswrapper[4060]: W1030 21:46:48.133897    4060 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5023ba3e_8997_481f_a8d7_3a925f14fc08.slice/crio-f57f4cfa1f11022dbc7651226e209dc7768c37332881863a5bd8b880aaf05891 WatchSource:0}: Error finding container f57f4cfa1f11022dbc7651226e209dc7768c37332881863a5bd8b880aaf05891: Status 404 returned error can't find the container with id f57f4cfa1f11022dbc7651226e209dc7768c37332881863a5bd8b880aaf05891
Oct 30 21:46:48.561359 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:48.561178    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0" event={"ID":"5023ba3e-8997-481f-a8d7-3a925f14fc08","Type":"ContainerStarted","Data":"f57f4cfa1f11022dbc7651226e209dc7768c37332881863a5bd8b880aaf05891"}
Oct 30 21:46:49.457023 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:49.456985    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-e73afc79-aa37-49a0-8744-633c03cad1f4\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a155a55c1ce0e65b\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"adf9d81d-984a-44d1-b477-80ef0891e9c8\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:46:49.561125 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:49.561087    4060 operation_generator.go:1464] "Controller attach succeeded for volume \"pvc-e73afc79-aa37-49a0-8744-633c03cad1f4\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a155a55c1ce0e65b\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"adf9d81d-984a-44d1-b477-80ef0891e9c8\") device path: \"\"" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:46:49.567402 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:49.567368    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0" event={"ID":"5023ba3e-8997-481f-a8d7-3a925f14fc08","Type":"ContainerStarted","Data":"641e7f30b3babf1d82d5cd4ed08b427967abba23669c4c71846916e31dc54f7f"}
Oct 30 21:46:49.658911 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:49.658851    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"pvc-e73afc79-aa37-49a0-8744-633c03cad1f4\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a155a55c1ce0e65b\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"adf9d81d-984a-44d1-b477-80ef0891e9c8\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:46:49.659116 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:49.658994    4060 operation_generator.go:515] "MountVolume.WaitForAttach entering for volume \"pvc-e73afc79-aa37-49a0-8744-633c03cad1f4\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a155a55c1ce0e65b\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"adf9d81d-984a-44d1-b477-80ef0891e9c8\") DevicePath \"\"" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:46:49.710972 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:49.710901    4060 operation_generator.go:525] "MountVolume.WaitForAttach succeeded for volume \"pvc-e73afc79-aa37-49a0-8744-633c03cad1f4\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a155a55c1ce0e65b\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"adf9d81d-984a-44d1-b477-80ef0891e9c8\") DevicePath \"csi-7011c01335d2502f76be252f9498c79824668beecf30ee8f6a7191145201ca4c\"" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:46:49.848751 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:49.848717    4060 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"pvc-e73afc79-aa37-49a0-8744-633c03cad1f4\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a155a55c1ce0e65b\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"adf9d81d-984a-44d1-b477-80ef0891e9c8\") device mount path \"/var/lib/kubelet/plugins/kubernetes.io/csi/ebs.csi.aws.com/fb02f91ab75afdcfd8c2ac3eaeb0ba7303c67490d38fe3164f5fc7856f2f1875/globalmount\"" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:46:49.913561 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:49.913534    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pvc-e73afc79-aa37-49a0-8744-633c03cad1f4\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a155a55c1ce0e65b\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"adf9d81d-984a-44d1-b477-80ef0891e9c8\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:46:50.049068 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:50.048984    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:46:50.561430 ip-10-0-142-4 kubenswrapper[4060]: W1030 21:46:50.561399    4060 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podadf9d81d_984a_44d1_b477_80ef0891e9c8.slice/crio-c1ff53f95d1b6fc0d954bdebdf027eb2c5248c5ad9603429e393c0aee8309ced WatchSource:0}: Error finding container c1ff53f95d1b6fc0d954bdebdf027eb2c5248c5ad9603429e393c0aee8309ced: Status 404 returned error can't find the container with id c1ff53f95d1b6fc0d954bdebdf027eb2c5248c5ad9603429e393c0aee8309ced
Oct 30 21:46:50.573218 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:50.573184    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0" event={"ID":"adf9d81d-984a-44d1-b477-80ef0891e9c8","Type":"ContainerStarted","Data":"c1ff53f95d1b6fc0d954bdebdf027eb2c5248c5ad9603429e393c0aee8309ced"}
Oct 30 21:46:50.580137 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:50.580111    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"]
Oct 30 21:46:51.579649 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:51.579617    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0" event={"ID":"adf9d81d-984a-44d1-b477-80ef0891e9c8","Type":"ContainerStarted","Data":"c581da73ebf899e49931f4635d4666058078dbf92c9b99064a42c70efd15f4c9"}
Oct 30 21:46:52.586650 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:52.586620    4060 generic.go:356] "Generic (PLEG): container finished" podID="5023ba3e-8997-481f-a8d7-3a925f14fc08" containerID="641e7f30b3babf1d82d5cd4ed08b427967abba23669c4c71846916e31dc54f7f" exitCode=0
Oct 30 21:46:52.587045 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:52.586694    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0" event={"ID":"5023ba3e-8997-481f-a8d7-3a925f14fc08","Type":"ContainerDied","Data":"641e7f30b3babf1d82d5cd4ed08b427967abba23669c4c71846916e31dc54f7f"}
Oct 30 21:46:53.593480 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:53.593395    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0" event={"ID":"5023ba3e-8997-481f-a8d7-3a925f14fc08","Type":"ContainerStarted","Data":"98db57dbad2967b89acbfa2b66f1b2e0c7ec95e0e14b4d4d15de1d5e75a40713"}
Oct 30 21:46:53.593480 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:53.593458    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0" event={"ID":"5023ba3e-8997-481f-a8d7-3a925f14fc08","Type":"ContainerStarted","Data":"7b21b9a7608aad2a01a02f984e0fabe8169a30c85c2362278106cea9c2e76c1d"}
Oct 30 21:46:53.594043 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:53.593681    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:46:53.718383 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:53.718335    4060 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0" podStartSLOduration=4.1312743 podStartE2EDuration="7.718317839s" totalImagesPullingTime="0s" totalInitContainerRuntime="3.587043539s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:46:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:46:53.716521777 +0000 UTC m=+4232.473520071" watchObservedRunningTime="2026-10-30 21:46:53.718317839 +0000 UTC m=+4232.475316136"
Oct 30 21:46:55.603919 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:55.603886    4060 generic.go:356] "Generic (PLEG): container finished" podID="adf9d81d-984a-44d1-b477-80ef0891e9c8" containerID="c581da73ebf899e49931f4635d4666058078dbf92c9b99064a42c70efd15f4c9" exitCode=0
Oct 30 21:46:55.604417 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:55.603928    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0" event={"ID":"adf9d81d-984a-44d1-b477-80ef0891e9c8","Type":"ContainerDied","Data":"c581da73ebf899e49931f4635d4666058078dbf92c9b99064a42c70efd15f4c9"}
Oct 30 21:46:56.614035 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:56.614003    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0" event={"ID":"adf9d81d-984a-44d1-b477-80ef0891e9c8","Type":"ContainerStarted","Data":"4d4cd27f6fcad343c5fdfffec50ef50e994a9aba5a9e9153d28ac86ebd57abc6"}
Oct 30 21:46:56.614422 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:56.614069    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0" event={"ID":"adf9d81d-984a-44d1-b477-80ef0891e9c8","Type":"ContainerStarted","Data":"a7c1b75adc3428e15ddb8d8fcd234040844fe0f7ed0c379d01e54d0d2841c290"}
Oct 30 21:46:56.614422 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:56.614095    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0" event={"ID":"adf9d81d-984a-44d1-b477-80ef0891e9c8","Type":"ContainerStarted","Data":"51d848c2cfac08d104e2e0db0b2b05ec64cf7510cf147a60dfa8943854405441"}
Oct 30 21:46:56.744443 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:56.744358    4060 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0" podStartSLOduration=7.058963317 podStartE2EDuration="10.744342402s" totalImagesPullingTime="0s" totalInitContainerRuntime="3.685379085s" isStatefulPod=true podCreationTimestamp="2026-10-30 21:46:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:46:56.743699625 +0000 UTC m=+4235.500697944" watchObservedRunningTime="2026-10-30 21:46:56.744342402 +0000 UTC m=+4235.501340701"
Oct 30 21:46:59.599807 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:46:59.599779    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:47:00.049605 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:47:00.049567    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:47:05.049682 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:47:05.049641    4060 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:47:05.055471 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:47:05.055449    4060 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:47:05.663114 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:47:05.663088    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:47:12.150375 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:47:12.150339    4060 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v2f4x" containerName="extractor"
Oct 30 21:47:25.174448 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:47:25.174406    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:47:25.175462 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:47:25.174689    4060 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-collector-0" podUID="b2304f17-6858-42f3-bd4b-c47b2745ff2c" containerName="otc-container" containerID="cri-o://404ba827eea0ea81e8b951333d70731a42ee9593684bc61ad2f0d8f4d124a327" gracePeriod=30
Oct 30 21:47:27.520186 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:47:27.520160    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:47:27.569877 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:47:27.569810    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b2304f17-6858-42f3-bd4b-c47b2745ff2c-data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/b2304f17-6858-42f3-bd4b-c47b2745ff2c-data-science-collector-ta-client-cert\") pod \"b2304f17-6858-42f3-bd4b-c47b2745ff2c\" (UID: \"b2304f17-6858-42f3-bd4b-c47b2745ff2c\") "
Oct 30 21:47:27.569877 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:47:27.569852    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b2304f17-6858-42f3-bd4b-c47b2745ff2c-otc-internal\" (UniqueName: \"kubernetes.io/configmap/b2304f17-6858-42f3-bd4b-c47b2745ff2c-otc-internal\") pod \"b2304f17-6858-42f3-bd4b-c47b2745ff2c\" (UID: \"b2304f17-6858-42f3-bd4b-c47b2745ff2c\") "
Oct 30 21:47:27.570080 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:47:27.569890    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b2304f17-6858-42f3-bd4b-c47b2745ff2c-monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/b2304f17-6858-42f3-bd4b-c47b2745ff2c-monitoring-tls-certs\") pod \"b2304f17-6858-42f3-bd4b-c47b2745ff2c\" (UID: \"b2304f17-6858-42f3-bd4b-c47b2745ff2c\") "
Oct 30 21:47:27.570080 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:47:27.569935    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b2304f17-6858-42f3-bd4b-c47b2745ff2c-kube-api-access-kcdg9\" (UniqueName: \"kubernetes.io/projected/b2304f17-6858-42f3-bd4b-c47b2745ff2c-kube-api-access-kcdg9\") pod \"b2304f17-6858-42f3-bd4b-c47b2745ff2c\" (UID: \"b2304f17-6858-42f3-bd4b-c47b2745ff2c\") "
Oct 30 21:47:27.570080 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:47:27.569988    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b2304f17-6858-42f3-bd4b-c47b2745ff2c-tls-certs\" (UniqueName: \"kubernetes.io/secret/b2304f17-6858-42f3-bd4b-c47b2745ff2c-tls-certs\") pod \"b2304f17-6858-42f3-bd4b-c47b2745ff2c\" (UID: \"b2304f17-6858-42f3-bd4b-c47b2745ff2c\") "
Oct 30 21:47:27.570080 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:47:27.570020    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b2304f17-6858-42f3-bd4b-c47b2745ff2c-otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/b2304f17-6858-42f3-bd4b-c47b2745ff2c-otlp-tls-certs\") pod \"b2304f17-6858-42f3-bd4b-c47b2745ff2c\" (UID: \"b2304f17-6858-42f3-bd4b-c47b2745ff2c\") "
Oct 30 21:47:27.570538 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:47:27.570510    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b2304f17-6858-42f3-bd4b-c47b2745ff2c-otc-internal" pod "b2304f17-6858-42f3-bd4b-c47b2745ff2c" (UID: "b2304f17-6858-42f3-bd4b-c47b2745ff2c"). InnerVolumeSpecName "otc-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:47:27.572435 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:47:27.572408    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b2304f17-6858-42f3-bd4b-c47b2745ff2c-otlp-tls-certs" pod "b2304f17-6858-42f3-bd4b-c47b2745ff2c" (UID: "b2304f17-6858-42f3-bd4b-c47b2745ff2c"). InnerVolumeSpecName "otlp-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:47:27.572628 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:47:27.572614    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b2304f17-6858-42f3-bd4b-c47b2745ff2c-tls-certs" pod "b2304f17-6858-42f3-bd4b-c47b2745ff2c" (UID: "b2304f17-6858-42f3-bd4b-c47b2745ff2c"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:47:27.572713 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:47:27.572656    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b2304f17-6858-42f3-bd4b-c47b2745ff2c-monitoring-tls-certs" pod "b2304f17-6858-42f3-bd4b-c47b2745ff2c" (UID: "b2304f17-6858-42f3-bd4b-c47b2745ff2c"). InnerVolumeSpecName "monitoring-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:47:27.572780 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:47:27.572738    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b2304f17-6858-42f3-bd4b-c47b2745ff2c-kube-api-access-kcdg9" pod "b2304f17-6858-42f3-bd4b-c47b2745ff2c" (UID: "b2304f17-6858-42f3-bd4b-c47b2745ff2c"). InnerVolumeSpecName "kube-api-access-kcdg9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:47:27.572839 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:47:27.572801    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b2304f17-6858-42f3-bd4b-c47b2745ff2c-data-science-collector-ta-client-cert" pod "b2304f17-6858-42f3-bd4b-c47b2745ff2c" (UID: "b2304f17-6858-42f3-bd4b-c47b2745ff2c"). InnerVolumeSpecName "data-science-collector-ta-client-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:47:27.671391 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:47:27.671360    4060 reconciler_common.go:299] "Volume detached for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/b2304f17-6858-42f3-bd4b-c47b2745ff2c-otlp-tls-certs\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:47:27.671391 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:47:27.671389    4060 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/b2304f17-6858-42f3-bd4b-c47b2745ff2c-data-science-collector-ta-client-cert\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:47:27.671391 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:47:27.671400    4060 reconciler_common.go:299] "Volume detached for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/b2304f17-6858-42f3-bd4b-c47b2745ff2c-otc-internal\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:47:27.671391 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:47:27.671409    4060 reconciler_common.go:299] "Volume detached for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/b2304f17-6858-42f3-bd4b-c47b2745ff2c-monitoring-tls-certs\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:47:27.671697 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:47:27.671419    4060 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kcdg9\" (UniqueName: \"kubernetes.io/projected/b2304f17-6858-42f3-bd4b-c47b2745ff2c-kube-api-access-kcdg9\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:47:27.671697 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:47:27.671428    4060 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b2304f17-6858-42f3-bd4b-c47b2745ff2c-tls-certs\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:47:27.763486 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:47:27.763452    4060 generic.go:356] "Generic (PLEG): container finished" podID="b2304f17-6858-42f3-bd4b-c47b2745ff2c" containerID="404ba827eea0ea81e8b951333d70731a42ee9593684bc61ad2f0d8f4d124a327" exitCode=0
Oct 30 21:47:27.763698 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:47:27.763531    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:47:27.763698 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:47:27.763554    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"b2304f17-6858-42f3-bd4b-c47b2745ff2c","Type":"ContainerDied","Data":"404ba827eea0ea81e8b951333d70731a42ee9593684bc61ad2f0d8f4d124a327"}
Oct 30 21:47:27.763698 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:47:27.763620    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"b2304f17-6858-42f3-bd4b-c47b2745ff2c","Type":"ContainerDied","Data":"ed1c6fd7a8b333b64b58302f896696df90c9557b4ed25d9fcc46cb9b0f3287bd"}
Oct 30 21:47:27.763698 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:47:27.763650    4060 scope.go:122] "RemoveContainer" containerID="404ba827eea0ea81e8b951333d70731a42ee9593684bc61ad2f0d8f4d124a327"
Oct 30 21:47:27.773151 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:47:27.773136    4060 scope.go:122] "RemoveContainer" containerID="404ba827eea0ea81e8b951333d70731a42ee9593684bc61ad2f0d8f4d124a327"
Oct 30 21:47:27.773444 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:47:27.773425    4060 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"404ba827eea0ea81e8b951333d70731a42ee9593684bc61ad2f0d8f4d124a327\": container with ID starting with 404ba827eea0ea81e8b951333d70731a42ee9593684bc61ad2f0d8f4d124a327 not found: ID does not exist" containerID="404ba827eea0ea81e8b951333d70731a42ee9593684bc61ad2f0d8f4d124a327"
Oct 30 21:47:27.773536 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:47:27.773456    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"404ba827eea0ea81e8b951333d70731a42ee9593684bc61ad2f0d8f4d124a327"} err="failed to get container status \"404ba827eea0ea81e8b951333d70731a42ee9593684bc61ad2f0d8f4d124a327\": rpc error: code = NotFound desc = could not find container \"404ba827eea0ea81e8b951333d70731a42ee9593684bc61ad2f0d8f4d124a327\": container with ID starting with 404ba827eea0ea81e8b951333d70731a42ee9593684bc61ad2f0d8f4d124a327 not found: ID does not exist"
Oct 30 21:47:27.928604 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:47:27.928511    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:47:27.935755 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:47:27.935713    4060 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:47:28.008480 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:47:28.008450    4060 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:47:28.008821 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:47:28.008808    4060 cpu_manager.go:414] "containerMap: removing container" podUID="b2304f17-6858-42f3-bd4b-c47b2745ff2c" containerName="otc-container"
Oct 30 21:47:28.008870 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:47:28.008822    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b2304f17-6858-42f3-bd4b-c47b2745ff2c" containerName="otc-container"
Oct 30 21:47:28.008924 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:47:28.008914    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="b2304f17-6858-42f3-bd4b-c47b2745ff2c" containerName="otc-container"
Oct 30 21:47:28.013289 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:47:28.013269    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:47:28.065910 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:47:28.065877    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-tls\""
Oct 30 21:47:28.066091 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:47:28.065929    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-ta-client-cert\""
Oct 30 21:47:28.066091 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:47:28.066008    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-headless-tls\""
Oct 30 21:47:28.066091 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:47:28.066074    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-dockercfg-dczck\""
Oct 30 21:47:28.066267 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:47:28.066154    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-a0f9182a\""
Oct 30 21:47:28.066267 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:47:28.066171    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-monitoring-tls\""
Oct 30 21:47:28.072198 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:47:28.072170    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:47:28.074358 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:47:28.074335    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c45jv\" (UniqueName: \"kubernetes.io/projected/212c52c1-d9ef-4fe3-a35d-e130f4d0c455-kube-api-access-c45jv\") pod \"data-science-collector-collector-0\" (UID: \"212c52c1-d9ef-4fe3-a35d-e130f4d0c455\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:47:28.074518 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:47:28.074366    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/212c52c1-d9ef-4fe3-a35d-e130f4d0c455-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"212c52c1-d9ef-4fe3-a35d-e130f4d0c455\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:47:28.074518 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:47:28.074449    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/212c52c1-d9ef-4fe3-a35d-e130f4d0c455-otc-internal\") pod \"data-science-collector-collector-0\" (UID: \"212c52c1-d9ef-4fe3-a35d-e130f4d0c455\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:47:28.074518 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:47:28.074470    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/212c52c1-d9ef-4fe3-a35d-e130f4d0c455-monitoring-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"212c52c1-d9ef-4fe3-a35d-e130f4d0c455\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:47:28.074644 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:47:28.074525    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/212c52c1-d9ef-4fe3-a35d-e130f4d0c455-otlp-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"212c52c1-d9ef-4fe3-a35d-e130f4d0c455\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:47:28.074644 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:47:28.074600    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/212c52c1-d9ef-4fe3-a35d-e130f4d0c455-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-0\" (UID: \"212c52c1-d9ef-4fe3-a35d-e130f4d0c455\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:47:28.175783 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:47:28.175746    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c45jv\" (UniqueName: \"kubernetes.io/projected/212c52c1-d9ef-4fe3-a35d-e130f4d0c455-kube-api-access-c45jv\") pod \"data-science-collector-collector-0\" (UID: \"212c52c1-d9ef-4fe3-a35d-e130f4d0c455\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:47:28.175783 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:47:28.175787    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/212c52c1-d9ef-4fe3-a35d-e130f4d0c455-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"212c52c1-d9ef-4fe3-a35d-e130f4d0c455\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:47:28.176031 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:47:28.175820    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/212c52c1-d9ef-4fe3-a35d-e130f4d0c455-otc-internal\") pod \"data-science-collector-collector-0\" (UID: \"212c52c1-d9ef-4fe3-a35d-e130f4d0c455\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:47:28.176031 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:47:28.175858    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/212c52c1-d9ef-4fe3-a35d-e130f4d0c455-monitoring-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"212c52c1-d9ef-4fe3-a35d-e130f4d0c455\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:47:28.176031 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:47:28.175895    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/212c52c1-d9ef-4fe3-a35d-e130f4d0c455-otlp-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"212c52c1-d9ef-4fe3-a35d-e130f4d0c455\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:47:28.176031 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:47:28.175935    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/212c52c1-d9ef-4fe3-a35d-e130f4d0c455-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-0\" (UID: \"212c52c1-d9ef-4fe3-a35d-e130f4d0c455\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:47:28.176892 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:47:28.176861    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/212c52c1-d9ef-4fe3-a35d-e130f4d0c455-otc-internal\") pod \"data-science-collector-collector-0\" (UID: \"212c52c1-d9ef-4fe3-a35d-e130f4d0c455\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:47:28.178388 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:47:28.178348    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/212c52c1-d9ef-4fe3-a35d-e130f4d0c455-monitoring-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"212c52c1-d9ef-4fe3-a35d-e130f4d0c455\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:47:28.178548 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:47:28.178473    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/212c52c1-d9ef-4fe3-a35d-e130f4d0c455-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"212c52c1-d9ef-4fe3-a35d-e130f4d0c455\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:47:28.178672 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:47:28.178629    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/212c52c1-d9ef-4fe3-a35d-e130f4d0c455-otlp-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"212c52c1-d9ef-4fe3-a35d-e130f4d0c455\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:47:28.178672 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:47:28.178651    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/212c52c1-d9ef-4fe3-a35d-e130f4d0c455-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-0\" (UID: \"212c52c1-d9ef-4fe3-a35d-e130f4d0c455\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:47:28.237250 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:47:28.237218    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c45jv\" (UniqueName: \"kubernetes.io/projected/212c52c1-d9ef-4fe3-a35d-e130f4d0c455-kube-api-access-c45jv\") pod \"data-science-collector-collector-0\" (UID: \"212c52c1-d9ef-4fe3-a35d-e130f4d0c455\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:47:28.325934 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:47:28.325901    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:47:28.705843 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:47:28.705815    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:47:28.707147 ip-10-0-142-4 kubenswrapper[4060]: W1030 21:47:28.707123    4060 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod212c52c1_d9ef_4fe3_a35d_e130f4d0c455.slice/crio-5695e25f19f1d7d73f2129ba7bed68c22f0d7860d0d90a2f6a3ebb78912c0110 WatchSource:0}: Error finding container 5695e25f19f1d7d73f2129ba7bed68c22f0d7860d0d90a2f6a3ebb78912c0110: Status 404 returned error can't find the container with id 5695e25f19f1d7d73f2129ba7bed68c22f0d7860d0d90a2f6a3ebb78912c0110
Oct 30 21:47:28.709361 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:47:28.709325    4060 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 21:47:28.709429 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:47:28.709408    4060 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 21:47:28.771791 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:47:28.771753    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"212c52c1-d9ef-4fe3-a35d-e130f4d0c455","Type":"ContainerStarted","Data":"514fa09c88516e12d0d9ab14a6ef2d0a25420cbcbefc7f37e7c6c568f253ec86"}
Oct 30 21:47:28.771953 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:47:28.771817    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"212c52c1-d9ef-4fe3-a35d-e130f4d0c455","Type":"ContainerStarted","Data":"5695e25f19f1d7d73f2129ba7bed68c22f0d7860d0d90a2f6a3ebb78912c0110"}
Oct 30 21:47:28.891608 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:47:28.891554    4060 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-collector-0" podStartSLOduration=1.891539649 podStartE2EDuration="1.891539649s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:47:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:47:28.889999921 +0000 UTC m=+4267.646998221" watchObservedRunningTime="2026-10-30 21:47:28.891539649 +0000 UTC m=+4267.648537947"
Oct 30 21:47:29.426828 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:47:29.426786    4060 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b2304f17-6858-42f3-bd4b-c47b2745ff2c" path="/var/lib/kubelet/pods/b2304f17-6858-42f3-bd4b-c47b2745ff2c/volumes"
Oct 30 21:47:42.151083 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:47:42.150996    4060 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v2f4x" containerName="extractor"
Oct 30 21:47:56.337788 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:47:56.337757    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:47:56.338201 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:47:56.337961    4060 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-collector-0" podUID="212c52c1-d9ef-4fe3-a35d-e130f4d0c455" containerName="otc-container" containerID="cri-o://514fa09c88516e12d0d9ab14a6ef2d0a25420cbcbefc7f37e7c6c568f253ec86" gracePeriod=30
Oct 30 21:47:58.692348 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:47:58.692319    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:47:58.846312 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:47:58.846225    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/212c52c1-d9ef-4fe3-a35d-e130f4d0c455-data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/212c52c1-d9ef-4fe3-a35d-e130f4d0c455-data-science-collector-ta-client-cert\") pod \"212c52c1-d9ef-4fe3-a35d-e130f4d0c455\" (UID: \"212c52c1-d9ef-4fe3-a35d-e130f4d0c455\") "
Oct 30 21:47:58.846312 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:47:58.846271    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/212c52c1-d9ef-4fe3-a35d-e130f4d0c455-tls-certs\" (UniqueName: \"kubernetes.io/secret/212c52c1-d9ef-4fe3-a35d-e130f4d0c455-tls-certs\") pod \"212c52c1-d9ef-4fe3-a35d-e130f4d0c455\" (UID: \"212c52c1-d9ef-4fe3-a35d-e130f4d0c455\") "
Oct 30 21:47:58.846593 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:47:58.846347    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/212c52c1-d9ef-4fe3-a35d-e130f4d0c455-kube-api-access-c45jv\" (UniqueName: \"kubernetes.io/projected/212c52c1-d9ef-4fe3-a35d-e130f4d0c455-kube-api-access-c45jv\") pod \"212c52c1-d9ef-4fe3-a35d-e130f4d0c455\" (UID: \"212c52c1-d9ef-4fe3-a35d-e130f4d0c455\") "
Oct 30 21:47:58.846593 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:47:58.846364    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/212c52c1-d9ef-4fe3-a35d-e130f4d0c455-otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/212c52c1-d9ef-4fe3-a35d-e130f4d0c455-otlp-tls-certs\") pod \"212c52c1-d9ef-4fe3-a35d-e130f4d0c455\" (UID: \"212c52c1-d9ef-4fe3-a35d-e130f4d0c455\") "
Oct 30 21:47:58.846593 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:47:58.846420    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/212c52c1-d9ef-4fe3-a35d-e130f4d0c455-otc-internal\" (UniqueName: \"kubernetes.io/configmap/212c52c1-d9ef-4fe3-a35d-e130f4d0c455-otc-internal\") pod \"212c52c1-d9ef-4fe3-a35d-e130f4d0c455\" (UID: \"212c52c1-d9ef-4fe3-a35d-e130f4d0c455\") "
Oct 30 21:47:58.846593 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:47:58.846437    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/212c52c1-d9ef-4fe3-a35d-e130f4d0c455-monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/212c52c1-d9ef-4fe3-a35d-e130f4d0c455-monitoring-tls-certs\") pod \"212c52c1-d9ef-4fe3-a35d-e130f4d0c455\" (UID: \"212c52c1-d9ef-4fe3-a35d-e130f4d0c455\") "
Oct 30 21:47:58.846879 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:47:58.846853    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/212c52c1-d9ef-4fe3-a35d-e130f4d0c455-otc-internal" pod "212c52c1-d9ef-4fe3-a35d-e130f4d0c455" (UID: "212c52c1-d9ef-4fe3-a35d-e130f4d0c455"). InnerVolumeSpecName "otc-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:47:58.848642 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:47:58.848601    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/212c52c1-d9ef-4fe3-a35d-e130f4d0c455-tls-certs" pod "212c52c1-d9ef-4fe3-a35d-e130f4d0c455" (UID: "212c52c1-d9ef-4fe3-a35d-e130f4d0c455"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:47:58.848754 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:47:58.848645    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/212c52c1-d9ef-4fe3-a35d-e130f4d0c455-data-science-collector-ta-client-cert" pod "212c52c1-d9ef-4fe3-a35d-e130f4d0c455" (UID: "212c52c1-d9ef-4fe3-a35d-e130f4d0c455"). InnerVolumeSpecName "data-science-collector-ta-client-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:47:58.848754 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:47:58.848688    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/212c52c1-d9ef-4fe3-a35d-e130f4d0c455-kube-api-access-c45jv" pod "212c52c1-d9ef-4fe3-a35d-e130f4d0c455" (UID: "212c52c1-d9ef-4fe3-a35d-e130f4d0c455"). InnerVolumeSpecName "kube-api-access-c45jv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:47:58.848896 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:47:58.848870    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/212c52c1-d9ef-4fe3-a35d-e130f4d0c455-otlp-tls-certs" pod "212c52c1-d9ef-4fe3-a35d-e130f4d0c455" (UID: "212c52c1-d9ef-4fe3-a35d-e130f4d0c455"). InnerVolumeSpecName "otlp-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:47:58.849004 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:47:58.848927    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/212c52c1-d9ef-4fe3-a35d-e130f4d0c455-monitoring-tls-certs" pod "212c52c1-d9ef-4fe3-a35d-e130f4d0c455" (UID: "212c52c1-d9ef-4fe3-a35d-e130f4d0c455"). InnerVolumeSpecName "monitoring-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:47:58.920108 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:47:58.920078    4060 generic.go:356] "Generic (PLEG): container finished" podID="212c52c1-d9ef-4fe3-a35d-e130f4d0c455" containerID="514fa09c88516e12d0d9ab14a6ef2d0a25420cbcbefc7f37e7c6c568f253ec86" exitCode=0
Oct 30 21:47:58.920288 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:47:58.920121    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:47:58.920288 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:47:58.920149    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"212c52c1-d9ef-4fe3-a35d-e130f4d0c455","Type":"ContainerDied","Data":"514fa09c88516e12d0d9ab14a6ef2d0a25420cbcbefc7f37e7c6c568f253ec86"}
Oct 30 21:47:58.920288 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:47:58.920191    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"212c52c1-d9ef-4fe3-a35d-e130f4d0c455","Type":"ContainerDied","Data":"5695e25f19f1d7d73f2129ba7bed68c22f0d7860d0d90a2f6a3ebb78912c0110"}
Oct 30 21:47:58.920288 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:47:58.920212    4060 scope.go:122] "RemoveContainer" containerID="514fa09c88516e12d0d9ab14a6ef2d0a25420cbcbefc7f37e7c6c568f253ec86"
Oct 30 21:47:58.929368 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:47:58.929350    4060 scope.go:122] "RemoveContainer" containerID="514fa09c88516e12d0d9ab14a6ef2d0a25420cbcbefc7f37e7c6c568f253ec86"
Oct 30 21:47:58.929632 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:47:58.929612    4060 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"514fa09c88516e12d0d9ab14a6ef2d0a25420cbcbefc7f37e7c6c568f253ec86\": container with ID starting with 514fa09c88516e12d0d9ab14a6ef2d0a25420cbcbefc7f37e7c6c568f253ec86 not found: ID does not exist" containerID="514fa09c88516e12d0d9ab14a6ef2d0a25420cbcbefc7f37e7c6c568f253ec86"
Oct 30 21:47:58.929685 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:47:58.929641    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"514fa09c88516e12d0d9ab14a6ef2d0a25420cbcbefc7f37e7c6c568f253ec86"} err="failed to get container status \"514fa09c88516e12d0d9ab14a6ef2d0a25420cbcbefc7f37e7c6c568f253ec86\": rpc error: code = NotFound desc = could not find container \"514fa09c88516e12d0d9ab14a6ef2d0a25420cbcbefc7f37e7c6c568f253ec86\": container with ID starting with 514fa09c88516e12d0d9ab14a6ef2d0a25420cbcbefc7f37e7c6c568f253ec86 not found: ID does not exist"
Oct 30 21:47:58.948058 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:47:58.948032    4060 reconciler_common.go:299] "Volume detached for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/212c52c1-d9ef-4fe3-a35d-e130f4d0c455-otc-internal\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:47:58.948058 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:47:58.948056    4060 reconciler_common.go:299] "Volume detached for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/212c52c1-d9ef-4fe3-a35d-e130f4d0c455-monitoring-tls-certs\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:47:58.948202 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:47:58.948066    4060 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/212c52c1-d9ef-4fe3-a35d-e130f4d0c455-data-science-collector-ta-client-cert\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:47:58.948202 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:47:58.948075    4060 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/212c52c1-d9ef-4fe3-a35d-e130f4d0c455-tls-certs\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:47:58.948202 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:47:58.948084    4060 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c45jv\" (UniqueName: \"kubernetes.io/projected/212c52c1-d9ef-4fe3-a35d-e130f4d0c455-kube-api-access-c45jv\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:47:58.948202 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:47:58.948092    4060 reconciler_common.go:299] "Volume detached for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/212c52c1-d9ef-4fe3-a35d-e130f4d0c455-otlp-tls-certs\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:47:59.085611 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:47:59.085578    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:47:59.087406 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:47:59.087380    4060 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:47:59.164364 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:47:59.164286    4060 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:47:59.164674 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:47:59.164661    4060 cpu_manager.go:414] "containerMap: removing container" podUID="212c52c1-d9ef-4fe3-a35d-e130f4d0c455" containerName="otc-container"
Oct 30 21:47:59.164766 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:47:59.164680    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="212c52c1-d9ef-4fe3-a35d-e130f4d0c455" containerName="otc-container"
Oct 30 21:47:59.164766 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:47:59.164737    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="212c52c1-d9ef-4fe3-a35d-e130f4d0c455" containerName="otc-container"
Oct 30 21:47:59.169170 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:47:59.169154    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:47:59.221897 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:47:59.221858    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-headless-tls\""
Oct 30 21:47:59.222084 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:47:59.221914    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-a0f9182a\""
Oct 30 21:47:59.222084 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:47:59.221962    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-ta-client-cert\""
Oct 30 21:47:59.222084 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:47:59.221970    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-tls\""
Oct 30 21:47:59.222084 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:47:59.222010    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-dockercfg-dczck\""
Oct 30 21:47:59.222084 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:47:59.222054    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-monitoring-tls\""
Oct 30 21:47:59.229954 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:47:59.229929    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:47:59.249672 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:47:59.249647    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/44bdb219-b9f3-40ab-b2e6-4212dc0bedc7-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-0\" (UID: \"44bdb219-b9f3-40ab-b2e6-4212dc0bedc7\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:47:59.249811 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:47:59.249702    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/44bdb219-b9f3-40ab-b2e6-4212dc0bedc7-monitoring-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"44bdb219-b9f3-40ab-b2e6-4212dc0bedc7\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:47:59.249811 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:47:59.249721    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/44bdb219-b9f3-40ab-b2e6-4212dc0bedc7-otlp-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"44bdb219-b9f3-40ab-b2e6-4212dc0bedc7\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:47:59.249894 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:47:59.249844    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/44bdb219-b9f3-40ab-b2e6-4212dc0bedc7-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"44bdb219-b9f3-40ab-b2e6-4212dc0bedc7\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:47:59.249894 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:47:59.249877    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x5g79\" (UniqueName: \"kubernetes.io/projected/44bdb219-b9f3-40ab-b2e6-4212dc0bedc7-kube-api-access-x5g79\") pod \"data-science-collector-collector-0\" (UID: \"44bdb219-b9f3-40ab-b2e6-4212dc0bedc7\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:47:59.249972 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:47:59.249895    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/44bdb219-b9f3-40ab-b2e6-4212dc0bedc7-otc-internal\") pod \"data-science-collector-collector-0\" (UID: \"44bdb219-b9f3-40ab-b2e6-4212dc0bedc7\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:47:59.350315 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:47:59.350279    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/44bdb219-b9f3-40ab-b2e6-4212dc0bedc7-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"44bdb219-b9f3-40ab-b2e6-4212dc0bedc7\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:47:59.350563 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:47:59.350326    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x5g79\" (UniqueName: \"kubernetes.io/projected/44bdb219-b9f3-40ab-b2e6-4212dc0bedc7-kube-api-access-x5g79\") pod \"data-science-collector-collector-0\" (UID: \"44bdb219-b9f3-40ab-b2e6-4212dc0bedc7\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:47:59.350563 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:47:59.350344    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/44bdb219-b9f3-40ab-b2e6-4212dc0bedc7-otc-internal\") pod \"data-science-collector-collector-0\" (UID: \"44bdb219-b9f3-40ab-b2e6-4212dc0bedc7\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:47:59.350563 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:47:59.350468    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/44bdb219-b9f3-40ab-b2e6-4212dc0bedc7-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-0\" (UID: \"44bdb219-b9f3-40ab-b2e6-4212dc0bedc7\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:47:59.350783 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:47:59.350588    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/44bdb219-b9f3-40ab-b2e6-4212dc0bedc7-monitoring-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"44bdb219-b9f3-40ab-b2e6-4212dc0bedc7\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:47:59.350783 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:47:59.350610    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/44bdb219-b9f3-40ab-b2e6-4212dc0bedc7-otlp-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"44bdb219-b9f3-40ab-b2e6-4212dc0bedc7\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:47:59.351025 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:47:59.351002    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/44bdb219-b9f3-40ab-b2e6-4212dc0bedc7-otc-internal\") pod \"data-science-collector-collector-0\" (UID: \"44bdb219-b9f3-40ab-b2e6-4212dc0bedc7\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:47:59.353067 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:47:59.353037    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/44bdb219-b9f3-40ab-b2e6-4212dc0bedc7-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"44bdb219-b9f3-40ab-b2e6-4212dc0bedc7\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:47:59.353162 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:47:59.353075    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/44bdb219-b9f3-40ab-b2e6-4212dc0bedc7-monitoring-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"44bdb219-b9f3-40ab-b2e6-4212dc0bedc7\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:47:59.353162 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:47:59.353095    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/44bdb219-b9f3-40ab-b2e6-4212dc0bedc7-otlp-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"44bdb219-b9f3-40ab-b2e6-4212dc0bedc7\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:47:59.353162 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:47:59.353105    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/44bdb219-b9f3-40ab-b2e6-4212dc0bedc7-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-0\" (UID: \"44bdb219-b9f3-40ab-b2e6-4212dc0bedc7\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:47:59.411580 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:47:59.411552    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x5g79\" (UniqueName: \"kubernetes.io/projected/44bdb219-b9f3-40ab-b2e6-4212dc0bedc7-kube-api-access-x5g79\") pod \"data-science-collector-collector-0\" (UID: \"44bdb219-b9f3-40ab-b2e6-4212dc0bedc7\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:47:59.426831 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:47:59.426770    4060 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="212c52c1-d9ef-4fe3-a35d-e130f4d0c455" path="/var/lib/kubelet/pods/212c52c1-d9ef-4fe3-a35d-e130f4d0c455/volumes"
Oct 30 21:47:59.482561 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:47:59.482533    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:47:59.859824 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:47:59.859798    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:47:59.862284 ip-10-0-142-4 kubenswrapper[4060]: W1030 21:47:59.862258    4060 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44bdb219_b9f3_40ab_b2e6_4212dc0bedc7.slice/crio-ac51374294fdef1360ff3660445388161e73f2992e9171eb2e8a7175864d9bae WatchSource:0}: Error finding container ac51374294fdef1360ff3660445388161e73f2992e9171eb2e8a7175864d9bae: Status 404 returned error can't find the container with id ac51374294fdef1360ff3660445388161e73f2992e9171eb2e8a7175864d9bae
Oct 30 21:47:59.864399 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:47:59.864364    4060 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 21:47:59.864546 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:47:59.864426    4060 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 21:47:59.926425 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:47:59.926390    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"44bdb219-b9f3-40ab-b2e6-4212dc0bedc7","Type":"ContainerStarted","Data":"39e4f2bb34f81db52226e7a906360ec17ce3ba10029dddb8a9efc3c185b66300"}
Oct 30 21:47:59.926668 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:47:59.926447    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"44bdb219-b9f3-40ab-b2e6-4212dc0bedc7","Type":"ContainerStarted","Data":"ac51374294fdef1360ff3660445388161e73f2992e9171eb2e8a7175864d9bae"}
Oct 30 21:48:08.608126 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:08.608070    4060 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-collector-0" podStartSLOduration=9.608054331 podStartE2EDuration="9.608054331s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:47:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:48:00.050765185 +0000 UTC m=+4298.807763482" watchObservedRunningTime="2026-10-30 21:48:08.608054331 +0000 UTC m=+4307.365052628"
Oct 30 21:48:08.608552 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:08.608333    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-zkc8n"]
Oct 30 21:48:08.608552 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:08.608530    4060 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-zkc8n" podUID="414766a3-ef7e-4f4b-8056-42ae2e2abd98" containerName="kube-rbac-proxy" containerID="cri-o://380c34aff41d39575db0ab47e9f8be3b92316fee9f5c077877cc51943b3efdf4" gracePeriod=30
Oct 30 21:48:08.770149 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:08.770113    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/korrel8r-5cbcc89b8f-5zj6h"]
Oct 30 21:48:08.770341 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:08.770314    4060 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-5zj6h" podUID="ace3afef-a91a-4d3c-a1df-835d94f6c0c7" containerName="korrel8r" containerID="cri-o://29a2f7ce7e971f6adbce8033fb59a6839acc3c224641aa6522f0c0b93a109874" gracePeriod=30
Oct 30 21:48:08.895058 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:08.895033    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-zkc8n"
Oct 30 21:48:08.974341 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:08.974301    4060 generic.go:356] "Generic (PLEG): container finished" podID="ace3afef-a91a-4d3c-a1df-835d94f6c0c7" containerID="29a2f7ce7e971f6adbce8033fb59a6839acc3c224641aa6522f0c0b93a109874" exitCode=0
Oct 30 21:48:08.974552 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:08.974371    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-5zj6h" event={"ID":"ace3afef-a91a-4d3c-a1df-835d94f6c0c7","Type":"ContainerDied","Data":"29a2f7ce7e971f6adbce8033fb59a6839acc3c224641aa6522f0c0b93a109874"}
Oct 30 21:48:08.976038 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:08.976015    4060 generic.go:356] "Generic (PLEG): container finished" podID="414766a3-ef7e-4f4b-8056-42ae2e2abd98" containerID="380c34aff41d39575db0ab47e9f8be3b92316fee9f5c077877cc51943b3efdf4" exitCode=0
Oct 30 21:48:08.976168 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:08.976046    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-zkc8n" event={"ID":"414766a3-ef7e-4f4b-8056-42ae2e2abd98","Type":"ContainerDied","Data":"380c34aff41d39575db0ab47e9f8be3b92316fee9f5c077877cc51943b3efdf4"}
Oct 30 21:48:08.976168 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:08.976065    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-zkc8n"
Oct 30 21:48:08.976168 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:08.976088    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-zkc8n" event={"ID":"414766a3-ef7e-4f4b-8056-42ae2e2abd98","Type":"ContainerDied","Data":"20d21fe31b5a1b4e66bff1da3e2d828078b5f439dce6f88e9f2bb3e33d46963a"}
Oct 30 21:48:08.976168 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:08.976100    4060 scope.go:122] "RemoveContainer" containerID="380c34aff41d39575db0ab47e9f8be3b92316fee9f5c077877cc51943b3efdf4"
Oct 30 21:48:08.984516 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:08.984451    4060 scope.go:122] "RemoveContainer" containerID="380c34aff41d39575db0ab47e9f8be3b92316fee9f5c077877cc51943b3efdf4"
Oct 30 21:48:08.984763 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:48:08.984745    4060 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"380c34aff41d39575db0ab47e9f8be3b92316fee9f5c077877cc51943b3efdf4\": container with ID starting with 380c34aff41d39575db0ab47e9f8be3b92316fee9f5c077877cc51943b3efdf4 not found: ID does not exist" containerID="380c34aff41d39575db0ab47e9f8be3b92316fee9f5c077877cc51943b3efdf4"
Oct 30 21:48:08.984825 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:08.984774    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"380c34aff41d39575db0ab47e9f8be3b92316fee9f5c077877cc51943b3efdf4"} err="failed to get container status \"380c34aff41d39575db0ab47e9f8be3b92316fee9f5c077877cc51943b3efdf4\": rpc error: code = NotFound desc = could not find container \"380c34aff41d39575db0ab47e9f8be3b92316fee9f5c077877cc51943b3efdf4\": container with ID starting with 380c34aff41d39575db0ab47e9f8be3b92316fee9f5c077877cc51943b3efdf4 not found: ID does not exist"
Oct 30 21:48:09.007297 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:09.007278    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-5zj6h"
Oct 30 21:48:09.037303 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:09.037276    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/414766a3-ef7e-4f4b-8056-42ae2e2abd98-tls\" (UniqueName: \"kubernetes.io/secret/414766a3-ef7e-4f4b-8056-42ae2e2abd98-tls\") pod \"414766a3-ef7e-4f4b-8056-42ae2e2abd98\" (UID: \"414766a3-ef7e-4f4b-8056-42ae2e2abd98\") "
Oct 30 21:48:09.037481 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:09.037351    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/414766a3-ef7e-4f4b-8056-42ae2e2abd98-prometheus-ca\" (UniqueName: \"kubernetes.io/configmap/414766a3-ef7e-4f4b-8056-42ae2e2abd98-prometheus-ca\") pod \"414766a3-ef7e-4f4b-8056-42ae2e2abd98\" (UID: \"414766a3-ef7e-4f4b-8056-42ae2e2abd98\") "
Oct 30 21:48:09.037481 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:09.037389    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/414766a3-ef7e-4f4b-8056-42ae2e2abd98-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/414766a3-ef7e-4f4b-8056-42ae2e2abd98-kube-rbac-proxy-config\") pod \"414766a3-ef7e-4f4b-8056-42ae2e2abd98\" (UID: \"414766a3-ef7e-4f4b-8056-42ae2e2abd98\") "
Oct 30 21:48:09.037481 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:09.037414    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/414766a3-ef7e-4f4b-8056-42ae2e2abd98-kube-api-access-v6z6z\" (UniqueName: \"kubernetes.io/projected/414766a3-ef7e-4f4b-8056-42ae2e2abd98-kube-api-access-v6z6z\") pod \"414766a3-ef7e-4f4b-8056-42ae2e2abd98\" (UID: \"414766a3-ef7e-4f4b-8056-42ae2e2abd98\") "
Oct 30 21:48:09.037481 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:09.037437    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/414766a3-ef7e-4f4b-8056-42ae2e2abd98-prometheus-client-cert\" (UniqueName: \"kubernetes.io/secret/414766a3-ef7e-4f4b-8056-42ae2e2abd98-prometheus-client-cert\") pod \"414766a3-ef7e-4f4b-8056-42ae2e2abd98\" (UID: \"414766a3-ef7e-4f4b-8056-42ae2e2abd98\") "
Oct 30 21:48:09.038077 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:09.037794    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/414766a3-ef7e-4f4b-8056-42ae2e2abd98-prometheus-ca" pod "414766a3-ef7e-4f4b-8056-42ae2e2abd98" (UID: "414766a3-ef7e-4f4b-8056-42ae2e2abd98"). InnerVolumeSpecName "prometheus-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:48:09.040013 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:09.039977    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/414766a3-ef7e-4f4b-8056-42ae2e2abd98-tls" pod "414766a3-ef7e-4f4b-8056-42ae2e2abd98" (UID: "414766a3-ef7e-4f4b-8056-42ae2e2abd98"). InnerVolumeSpecName "tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:48:09.040128 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:09.040027    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/414766a3-ef7e-4f4b-8056-42ae2e2abd98-kube-rbac-proxy-config" pod "414766a3-ef7e-4f4b-8056-42ae2e2abd98" (UID: "414766a3-ef7e-4f4b-8056-42ae2e2abd98"). InnerVolumeSpecName "kube-rbac-proxy-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:48:09.040128 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:09.040062    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/414766a3-ef7e-4f4b-8056-42ae2e2abd98-kube-api-access-v6z6z" pod "414766a3-ef7e-4f4b-8056-42ae2e2abd98" (UID: "414766a3-ef7e-4f4b-8056-42ae2e2abd98"). InnerVolumeSpecName "kube-api-access-v6z6z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:48:09.040317 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:09.040203    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/414766a3-ef7e-4f4b-8056-42ae2e2abd98-prometheus-client-cert" pod "414766a3-ef7e-4f4b-8056-42ae2e2abd98" (UID: "414766a3-ef7e-4f4b-8056-42ae2e2abd98"). InnerVolumeSpecName "prometheus-client-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:48:09.138195 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:09.138118    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ace3afef-a91a-4d3c-a1df-835d94f6c0c7-tls\" (UniqueName: \"kubernetes.io/secret/ace3afef-a91a-4d3c-a1df-835d94f6c0c7-tls\") pod \"ace3afef-a91a-4d3c-a1df-835d94f6c0c7\" (UID: \"ace3afef-a91a-4d3c-a1df-835d94f6c0c7\") "
Oct 30 21:48:09.138353 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:09.138235    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ace3afef-a91a-4d3c-a1df-835d94f6c0c7-kube-api-access-dmnlx\" (UniqueName: \"kubernetes.io/projected/ace3afef-a91a-4d3c-a1df-835d94f6c0c7-kube-api-access-dmnlx\") pod \"ace3afef-a91a-4d3c-a1df-835d94f6c0c7\" (UID: \"ace3afef-a91a-4d3c-a1df-835d94f6c0c7\") "
Oct 30 21:48:09.138353 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:09.138284    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ace3afef-a91a-4d3c-a1df-835d94f6c0c7-config\" (UniqueName: \"kubernetes.io/configmap/ace3afef-a91a-4d3c-a1df-835d94f6c0c7-config\") pod \"ace3afef-a91a-4d3c-a1df-835d94f6c0c7\" (UID: \"ace3afef-a91a-4d3c-a1df-835d94f6c0c7\") "
Oct 30 21:48:09.138541 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:09.138526    4060 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/414766a3-ef7e-4f4b-8056-42ae2e2abd98-kube-rbac-proxy-config\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:48:09.138616 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:09.138546    4060 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v6z6z\" (UniqueName: \"kubernetes.io/projected/414766a3-ef7e-4f4b-8056-42ae2e2abd98-kube-api-access-v6z6z\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:48:09.138616 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:09.138560    4060 reconciler_common.go:299] "Volume detached for volume \"prometheus-client-cert\" (UniqueName: \"kubernetes.io/secret/414766a3-ef7e-4f4b-8056-42ae2e2abd98-prometheus-client-cert\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:48:09.138616 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:09.138574    4060 reconciler_common.go:299] "Volume detached for volume \"tls\" (UniqueName: \"kubernetes.io/secret/414766a3-ef7e-4f4b-8056-42ae2e2abd98-tls\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:48:09.138616 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:09.138588    4060 reconciler_common.go:299] "Volume detached for volume \"prometheus-ca\" (UniqueName: \"kubernetes.io/configmap/414766a3-ef7e-4f4b-8056-42ae2e2abd98-prometheus-ca\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:48:09.138777 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:09.138735    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ace3afef-a91a-4d3c-a1df-835d94f6c0c7-config" pod "ace3afef-a91a-4d3c-a1df-835d94f6c0c7" (UID: "ace3afef-a91a-4d3c-a1df-835d94f6c0c7"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:48:09.140714 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:09.140688    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ace3afef-a91a-4d3c-a1df-835d94f6c0c7-tls" pod "ace3afef-a91a-4d3c-a1df-835d94f6c0c7" (UID: "ace3afef-a91a-4d3c-a1df-835d94f6c0c7"). InnerVolumeSpecName "tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:48:09.140828 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:09.140718    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ace3afef-a91a-4d3c-a1df-835d94f6c0c7-kube-api-access-dmnlx" pod "ace3afef-a91a-4d3c-a1df-835d94f6c0c7" (UID: "ace3afef-a91a-4d3c-a1df-835d94f6c0c7"). InnerVolumeSpecName "kube-api-access-dmnlx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:48:09.239557 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:09.239528    4060 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dmnlx\" (UniqueName: \"kubernetes.io/projected/ace3afef-a91a-4d3c-a1df-835d94f6c0c7-kube-api-access-dmnlx\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:48:09.239557 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:09.239555    4060 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ace3afef-a91a-4d3c-a1df-835d94f6c0c7-config\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:48:09.239557 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:09.239564    4060 reconciler_common.go:299] "Volume detached for volume \"tls\" (UniqueName: \"kubernetes.io/secret/ace3afef-a91a-4d3c-a1df-835d94f6c0c7-tls\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:48:09.395942 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:09.395859    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-zkc8n"]
Oct 30 21:48:09.401918 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:09.401887    4060 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-zkc8n"]
Oct 30 21:48:09.426928 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:09.426899    4060 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="414766a3-ef7e-4f4b-8056-42ae2e2abd98" path="/var/lib/kubelet/pods/414766a3-ef7e-4f4b-8056-42ae2e2abd98/volumes"
Oct 30 21:48:09.986419 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:09.986383    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-5zj6h" event={"ID":"ace3afef-a91a-4d3c-a1df-835d94f6c0c7","Type":"ContainerDied","Data":"5ca8eb8f9a652d3817c816efbccec66a5f0087cf24884cfce700d61f2221d942"}
Oct 30 21:48:09.987221 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:09.986434    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-5zj6h"
Oct 30 21:48:09.987221 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:09.986455    4060 scope.go:122] "RemoveContainer" containerID="29a2f7ce7e971f6adbce8033fb59a6839acc3c224641aa6522f0c0b93a109874"
Oct 30 21:48:10.040363 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:10.040331    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"]
Oct 30 21:48:10.040646 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:10.040621    4060 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0" podUID="adf9d81d-984a-44d1-b477-80ef0891e9c8" containerName="prometheus" containerID="cri-o://51d848c2cfac08d104e2e0db0b2b05ec64cf7510cf147a60dfa8943854405441" gracePeriod=600
Oct 30 21:48:10.040764 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:10.040627    4060 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0" podUID="adf9d81d-984a-44d1-b477-80ef0891e9c8" containerName="config-reloader" containerID="cri-o://a7c1b75adc3428e15ddb8d8fcd234040844fe0f7ed0c379d01e54d0d2841c290" gracePeriod=600
Oct 30 21:48:10.040764 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:10.040705    4060 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0" podUID="adf9d81d-984a-44d1-b477-80ef0891e9c8" containerName="thanos-sidecar" containerID="cri-o://4d4cd27f6fcad343c5fdfffec50ef50e994a9aba5a9e9153d28ac86ebd57abc6" gracePeriod=600
Oct 30 21:48:10.056642 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:10.056613    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"]
Oct 30 21:48:10.056898 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:10.056854    4060 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0" podUID="5023ba3e-8997-481f-a8d7-3a925f14fc08" containerName="alertmanager" containerID="cri-o://7b21b9a7608aad2a01a02f984e0fabe8169a30c85c2362278106cea9c2e76c1d" gracePeriod=120
Oct 30 21:48:10.057020 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:10.056936    4060 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0" podUID="5023ba3e-8997-481f-a8d7-3a925f14fc08" containerName="config-reloader" containerID="cri-o://98db57dbad2967b89acbfa2b66f1b2e0c7ec95e0e14b4d4d15de1d5e75a40713" gracePeriod=120
Oct 30 21:48:10.286109 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:10.286030    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/korrel8r-5cbcc89b8f-5zj6h"]
Oct 30 21:48:10.293143 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:10.293117    4060 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/korrel8r-5cbcc89b8f-5zj6h"]
Oct 30 21:48:10.663067 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:10.662981    4060 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0" podUID="adf9d81d-984a-44d1-b477-80ef0891e9c8" containerName="prometheus" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 21:48:10.915012 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:10.914951    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:48:10.992740 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:10.992707    4060 generic.go:356] "Generic (PLEG): container finished" podID="5023ba3e-8997-481f-a8d7-3a925f14fc08" containerID="98db57dbad2967b89acbfa2b66f1b2e0c7ec95e0e14b4d4d15de1d5e75a40713" exitCode=0
Oct 30 21:48:10.992740 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:10.992730    4060 generic.go:356] "Generic (PLEG): container finished" podID="5023ba3e-8997-481f-a8d7-3a925f14fc08" containerID="7b21b9a7608aad2a01a02f984e0fabe8169a30c85c2362278106cea9c2e76c1d" exitCode=0
Oct 30 21:48:10.993215 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:10.992768    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:48:10.993215 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:10.992792    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0" event={"ID":"5023ba3e-8997-481f-a8d7-3a925f14fc08","Type":"ContainerDied","Data":"98db57dbad2967b89acbfa2b66f1b2e0c7ec95e0e14b4d4d15de1d5e75a40713"}
Oct 30 21:48:10.993215 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:10.992859    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0" event={"ID":"5023ba3e-8997-481f-a8d7-3a925f14fc08","Type":"ContainerDied","Data":"7b21b9a7608aad2a01a02f984e0fabe8169a30c85c2362278106cea9c2e76c1d"}
Oct 30 21:48:10.993215 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:10.992894    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0" event={"ID":"5023ba3e-8997-481f-a8d7-3a925f14fc08","Type":"ContainerDied","Data":"f57f4cfa1f11022dbc7651226e209dc7768c37332881863a5bd8b880aaf05891"}
Oct 30 21:48:10.993215 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:10.992926    4060 scope.go:122] "RemoveContainer" containerID="98db57dbad2967b89acbfa2b66f1b2e0c7ec95e0e14b4d4d15de1d5e75a40713"
Oct 30 21:48:10.995422 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:10.995401    4060 generic.go:356] "Generic (PLEG): container finished" podID="adf9d81d-984a-44d1-b477-80ef0891e9c8" containerID="4d4cd27f6fcad343c5fdfffec50ef50e994a9aba5a9e9153d28ac86ebd57abc6" exitCode=0
Oct 30 21:48:10.995422 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:10.995421    4060 generic.go:356] "Generic (PLEG): container finished" podID="adf9d81d-984a-44d1-b477-80ef0891e9c8" containerID="a7c1b75adc3428e15ddb8d8fcd234040844fe0f7ed0c379d01e54d0d2841c290" exitCode=0
Oct 30 21:48:10.995614 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:10.995473    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0" event={"ID":"adf9d81d-984a-44d1-b477-80ef0891e9c8","Type":"ContainerDied","Data":"4d4cd27f6fcad343c5fdfffec50ef50e994a9aba5a9e9153d28ac86ebd57abc6"}
Oct 30 21:48:10.995614 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:10.995557    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0" event={"ID":"adf9d81d-984a-44d1-b477-80ef0891e9c8","Type":"ContainerDied","Data":"a7c1b75adc3428e15ddb8d8fcd234040844fe0f7ed0c379d01e54d0d2841c290"}
Oct 30 21:48:11.001283 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:11.001254    4060 scope.go:122] "RemoveContainer" containerID="7b21b9a7608aad2a01a02f984e0fabe8169a30c85c2362278106cea9c2e76c1d"
Oct 30 21:48:11.008746 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:11.008729    4060 scope.go:122] "RemoveContainer" containerID="641e7f30b3babf1d82d5cd4ed08b427967abba23669c4c71846916e31dc54f7f"
Oct 30 21:48:11.016014 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:11.016000    4060 scope.go:122] "RemoveContainer" containerID="98db57dbad2967b89acbfa2b66f1b2e0c7ec95e0e14b4d4d15de1d5e75a40713"
Oct 30 21:48:11.016285 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:48:11.016267    4060 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"98db57dbad2967b89acbfa2b66f1b2e0c7ec95e0e14b4d4d15de1d5e75a40713\": container with ID starting with 98db57dbad2967b89acbfa2b66f1b2e0c7ec95e0e14b4d4d15de1d5e75a40713 not found: ID does not exist" containerID="98db57dbad2967b89acbfa2b66f1b2e0c7ec95e0e14b4d4d15de1d5e75a40713"
Oct 30 21:48:11.016336 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:11.016293    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"98db57dbad2967b89acbfa2b66f1b2e0c7ec95e0e14b4d4d15de1d5e75a40713"} err="failed to get container status \"98db57dbad2967b89acbfa2b66f1b2e0c7ec95e0e14b4d4d15de1d5e75a40713\": rpc error: code = NotFound desc = could not find container \"98db57dbad2967b89acbfa2b66f1b2e0c7ec95e0e14b4d4d15de1d5e75a40713\": container with ID starting with 98db57dbad2967b89acbfa2b66f1b2e0c7ec95e0e14b4d4d15de1d5e75a40713 not found: ID does not exist"
Oct 30 21:48:11.016336 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:11.016310    4060 scope.go:122] "RemoveContainer" containerID="7b21b9a7608aad2a01a02f984e0fabe8169a30c85c2362278106cea9c2e76c1d"
Oct 30 21:48:11.016587 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:48:11.016561    4060 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7b21b9a7608aad2a01a02f984e0fabe8169a30c85c2362278106cea9c2e76c1d\": container with ID starting with 7b21b9a7608aad2a01a02f984e0fabe8169a30c85c2362278106cea9c2e76c1d not found: ID does not exist" containerID="7b21b9a7608aad2a01a02f984e0fabe8169a30c85c2362278106cea9c2e76c1d"
Oct 30 21:48:11.016676 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:11.016594    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7b21b9a7608aad2a01a02f984e0fabe8169a30c85c2362278106cea9c2e76c1d"} err="failed to get container status \"7b21b9a7608aad2a01a02f984e0fabe8169a30c85c2362278106cea9c2e76c1d\": rpc error: code = NotFound desc = could not find container \"7b21b9a7608aad2a01a02f984e0fabe8169a30c85c2362278106cea9c2e76c1d\": container with ID starting with 7b21b9a7608aad2a01a02f984e0fabe8169a30c85c2362278106cea9c2e76c1d not found: ID does not exist"
Oct 30 21:48:11.016676 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:11.016616    4060 scope.go:122] "RemoveContainer" containerID="641e7f30b3babf1d82d5cd4ed08b427967abba23669c4c71846916e31dc54f7f"
Oct 30 21:48:11.016844 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:48:11.016828    4060 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"641e7f30b3babf1d82d5cd4ed08b427967abba23669c4c71846916e31dc54f7f\": container with ID starting with 641e7f30b3babf1d82d5cd4ed08b427967abba23669c4c71846916e31dc54f7f not found: ID does not exist" containerID="641e7f30b3babf1d82d5cd4ed08b427967abba23669c4c71846916e31dc54f7f"
Oct 30 21:48:11.016887 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:11.016848    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"641e7f30b3babf1d82d5cd4ed08b427967abba23669c4c71846916e31dc54f7f"} err="failed to get container status \"641e7f30b3babf1d82d5cd4ed08b427967abba23669c4c71846916e31dc54f7f\": rpc error: code = NotFound desc = could not find container \"641e7f30b3babf1d82d5cd4ed08b427967abba23669c4c71846916e31dc54f7f\": container with ID starting with 641e7f30b3babf1d82d5cd4ed08b427967abba23669c4c71846916e31dc54f7f not found: ID does not exist"
Oct 30 21:48:11.016887 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:11.016861    4060 scope.go:122] "RemoveContainer" containerID="98db57dbad2967b89acbfa2b66f1b2e0c7ec95e0e14b4d4d15de1d5e75a40713"
Oct 30 21:48:11.017083 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:11.017063    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"98db57dbad2967b89acbfa2b66f1b2e0c7ec95e0e14b4d4d15de1d5e75a40713"} err="failed to get container status \"98db57dbad2967b89acbfa2b66f1b2e0c7ec95e0e14b4d4d15de1d5e75a40713\": rpc error: code = NotFound desc = could not find container \"98db57dbad2967b89acbfa2b66f1b2e0c7ec95e0e14b4d4d15de1d5e75a40713\": container with ID starting with 98db57dbad2967b89acbfa2b66f1b2e0c7ec95e0e14b4d4d15de1d5e75a40713 not found: ID does not exist"
Oct 30 21:48:11.017123 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:11.017084    4060 scope.go:122] "RemoveContainer" containerID="7b21b9a7608aad2a01a02f984e0fabe8169a30c85c2362278106cea9c2e76c1d"
Oct 30 21:48:11.017314 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:11.017297    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7b21b9a7608aad2a01a02f984e0fabe8169a30c85c2362278106cea9c2e76c1d"} err="failed to get container status \"7b21b9a7608aad2a01a02f984e0fabe8169a30c85c2362278106cea9c2e76c1d\": rpc error: code = NotFound desc = could not find container \"7b21b9a7608aad2a01a02f984e0fabe8169a30c85c2362278106cea9c2e76c1d\": container with ID starting with 7b21b9a7608aad2a01a02f984e0fabe8169a30c85c2362278106cea9c2e76c1d not found: ID does not exist"
Oct 30 21:48:11.017377 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:11.017315    4060 scope.go:122] "RemoveContainer" containerID="641e7f30b3babf1d82d5cd4ed08b427967abba23669c4c71846916e31dc54f7f"
Oct 30 21:48:11.017538 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:11.017522    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"641e7f30b3babf1d82d5cd4ed08b427967abba23669c4c71846916e31dc54f7f"} err="failed to get container status \"641e7f30b3babf1d82d5cd4ed08b427967abba23669c4c71846916e31dc54f7f\": rpc error: code = NotFound desc = could not find container \"641e7f30b3babf1d82d5cd4ed08b427967abba23669c4c71846916e31dc54f7f\": container with ID starting with 641e7f30b3babf1d82d5cd4ed08b427967abba23669c4c71846916e31dc54f7f not found: ID does not exist"
Oct 30 21:48:11.054017 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:11.053994    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5023ba3e-8997-481f-a8d7-3a925f14fc08-tls-assets\" (UniqueName: \"kubernetes.io/projected/5023ba3e-8997-481f-a8d7-3a925f14fc08-tls-assets\") pod \"5023ba3e-8997-481f-a8d7-3a925f14fc08\" (UID: \"5023ba3e-8997-481f-a8d7-3a925f14fc08\") "
Oct 30 21:48:11.054128 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:11.054040    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/5023ba3e-8997-481f-a8d7-3a925f14fc08-cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5023ba3e-8997-481f-a8d7-3a925f14fc08-cluster-tls-config\") pod \"5023ba3e-8997-481f-a8d7-3a925f14fc08\" (UID: \"5023ba3e-8997-481f-a8d7-3a925f14fc08\") "
Oct 30 21:48:11.054128 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:11.054081    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/5023ba3e-8997-481f-a8d7-3a925f14fc08-config-volume\" (UniqueName: \"kubernetes.io/secret/5023ba3e-8997-481f-a8d7-3a925f14fc08-config-volume\") pod \"5023ba3e-8997-481f-a8d7-3a925f14fc08\" (UID: \"5023ba3e-8997-481f-a8d7-3a925f14fc08\") "
Oct 30 21:48:11.054128 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:11.054109    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5023ba3e-8997-481f-a8d7-3a925f14fc08-alertmanager-data-science-monitoringstack-db\" (UniqueName: \"kubernetes.io/empty-dir/5023ba3e-8997-481f-a8d7-3a925f14fc08-alertmanager-data-science-monitoringstack-db\") pod \"5023ba3e-8997-481f-a8d7-3a925f14fc08\" (UID: \"5023ba3e-8997-481f-a8d7-3a925f14fc08\") "
Oct 30 21:48:11.054302 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:11.054143    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5023ba3e-8997-481f-a8d7-3a925f14fc08-kube-api-access-2k2qh\" (UniqueName: \"kubernetes.io/projected/5023ba3e-8997-481f-a8d7-3a925f14fc08-kube-api-access-2k2qh\") pod \"5023ba3e-8997-481f-a8d7-3a925f14fc08\" (UID: \"5023ba3e-8997-481f-a8d7-3a925f14fc08\") "
Oct 30 21:48:11.054302 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:11.054173    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/5023ba3e-8997-481f-a8d7-3a925f14fc08-web-config\" (UniqueName: \"kubernetes.io/secret/5023ba3e-8997-481f-a8d7-3a925f14fc08-web-config\") pod \"5023ba3e-8997-481f-a8d7-3a925f14fc08\" (UID: \"5023ba3e-8997-481f-a8d7-3a925f14fc08\") "
Oct 30 21:48:11.054302 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:11.054215    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5023ba3e-8997-481f-a8d7-3a925f14fc08-config-out\" (UniqueName: \"kubernetes.io/empty-dir/5023ba3e-8997-481f-a8d7-3a925f14fc08-config-out\") pod \"5023ba3e-8997-481f-a8d7-3a925f14fc08\" (UID: \"5023ba3e-8997-481f-a8d7-3a925f14fc08\") "
Oct 30 21:48:11.054813 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:11.054774    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5023ba3e-8997-481f-a8d7-3a925f14fc08-alertmanager-data-science-monitoringstack-db" pod "5023ba3e-8997-481f-a8d7-3a925f14fc08" (UID: "5023ba3e-8997-481f-a8d7-3a925f14fc08"). InnerVolumeSpecName "alertmanager-data-science-monitoringstack-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:48:11.056807 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:11.056781    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5023ba3e-8997-481f-a8d7-3a925f14fc08-config-out" pod "5023ba3e-8997-481f-a8d7-3a925f14fc08" (UID: "5023ba3e-8997-481f-a8d7-3a925f14fc08"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:48:11.056927 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:11.056910    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5023ba3e-8997-481f-a8d7-3a925f14fc08-tls-assets" pod "5023ba3e-8997-481f-a8d7-3a925f14fc08" (UID: "5023ba3e-8997-481f-a8d7-3a925f14fc08"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:48:11.056985 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:11.056958    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5023ba3e-8997-481f-a8d7-3a925f14fc08-kube-api-access-2k2qh" pod "5023ba3e-8997-481f-a8d7-3a925f14fc08" (UID: "5023ba3e-8997-481f-a8d7-3a925f14fc08"). InnerVolumeSpecName "kube-api-access-2k2qh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:48:11.057620 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:11.057597    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5023ba3e-8997-481f-a8d7-3a925f14fc08-config-volume" pod "5023ba3e-8997-481f-a8d7-3a925f14fc08" (UID: "5023ba3e-8997-481f-a8d7-3a925f14fc08"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:48:11.060627 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:11.060598    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5023ba3e-8997-481f-a8d7-3a925f14fc08-cluster-tls-config" pod "5023ba3e-8997-481f-a8d7-3a925f14fc08" (UID: "5023ba3e-8997-481f-a8d7-3a925f14fc08"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:48:11.068903 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:11.068873    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5023ba3e-8997-481f-a8d7-3a925f14fc08-web-config" pod "5023ba3e-8997-481f-a8d7-3a925f14fc08" (UID: "5023ba3e-8997-481f-a8d7-3a925f14fc08"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:48:11.155171 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:11.155138    4060 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2k2qh\" (UniqueName: \"kubernetes.io/projected/5023ba3e-8997-481f-a8d7-3a925f14fc08-kube-api-access-2k2qh\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:48:11.155171 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:11.155164    4060 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5023ba3e-8997-481f-a8d7-3a925f14fc08-web-config\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:48:11.155171 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:11.155174    4060 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5023ba3e-8997-481f-a8d7-3a925f14fc08-config-out\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:48:11.155411 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:11.155182    4060 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5023ba3e-8997-481f-a8d7-3a925f14fc08-tls-assets\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:48:11.155411 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:11.155190    4060 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5023ba3e-8997-481f-a8d7-3a925f14fc08-cluster-tls-config\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:48:11.155411 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:11.155201    4060 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5023ba3e-8997-481f-a8d7-3a925f14fc08-config-volume\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:48:11.155411 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:11.155210    4060 reconciler_common.go:299] "Volume detached for volume \"alertmanager-data-science-monitoringstack-db\" (UniqueName: \"kubernetes.io/empty-dir/5023ba3e-8997-481f-a8d7-3a925f14fc08-alertmanager-data-science-monitoringstack-db\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:48:11.415883 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:11.415850    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"]
Oct 30 21:48:11.420518 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:11.420473    4060 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"]
Oct 30 21:48:11.427090 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:11.427067    4060 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="5023ba3e-8997-481f-a8d7-3a925f14fc08" path="/var/lib/kubelet/pods/5023ba3e-8997-481f-a8d7-3a925f14fc08/volumes"
Oct 30 21:48:11.427542 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:11.427528    4060 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ace3afef-a91a-4d3c-a1df-835d94f6c0c7" path="/var/lib/kubelet/pods/ace3afef-a91a-4d3c-a1df-835d94f6c0c7/volumes"
Oct 30 21:48:12.149898 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:48:12.149865    4060 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v2f4x" containerName="extractor"
Oct 30 21:48:12.396011 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:12.395978    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:48:12.396230 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:12.396206    4060 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-collector-0" podUID="44bdb219-b9f3-40ab-b2e6-4212dc0bedc7" containerName="otc-container" containerID="cri-o://39e4f2bb34f81db52226e7a906360ec17ce3ba10029dddb8a9efc3c185b66300" gracePeriod=30
Oct 30 21:48:12.641664 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:12.641640    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:48:12.769825 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:12.769793    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/44bdb219-b9f3-40ab-b2e6-4212dc0bedc7-otc-internal\" (UniqueName: \"kubernetes.io/configmap/44bdb219-b9f3-40ab-b2e6-4212dc0bedc7-otc-internal\") pod \"44bdb219-b9f3-40ab-b2e6-4212dc0bedc7\" (UID: \"44bdb219-b9f3-40ab-b2e6-4212dc0bedc7\") "
Oct 30 21:48:12.770028 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:12.769834    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/44bdb219-b9f3-40ab-b2e6-4212dc0bedc7-monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/44bdb219-b9f3-40ab-b2e6-4212dc0bedc7-monitoring-tls-certs\") pod \"44bdb219-b9f3-40ab-b2e6-4212dc0bedc7\" (UID: \"44bdb219-b9f3-40ab-b2e6-4212dc0bedc7\") "
Oct 30 21:48:12.770028 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:12.769882    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/44bdb219-b9f3-40ab-b2e6-4212dc0bedc7-tls-certs\" (UniqueName: \"kubernetes.io/secret/44bdb219-b9f3-40ab-b2e6-4212dc0bedc7-tls-certs\") pod \"44bdb219-b9f3-40ab-b2e6-4212dc0bedc7\" (UID: \"44bdb219-b9f3-40ab-b2e6-4212dc0bedc7\") "
Oct 30 21:48:12.770028 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:12.769926    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/44bdb219-b9f3-40ab-b2e6-4212dc0bedc7-otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/44bdb219-b9f3-40ab-b2e6-4212dc0bedc7-otlp-tls-certs\") pod \"44bdb219-b9f3-40ab-b2e6-4212dc0bedc7\" (UID: \"44bdb219-b9f3-40ab-b2e6-4212dc0bedc7\") "
Oct 30 21:48:12.770028 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:12.769960    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/44bdb219-b9f3-40ab-b2e6-4212dc0bedc7-kube-api-access-x5g79\" (UniqueName: \"kubernetes.io/projected/44bdb219-b9f3-40ab-b2e6-4212dc0bedc7-kube-api-access-x5g79\") pod \"44bdb219-b9f3-40ab-b2e6-4212dc0bedc7\" (UID: \"44bdb219-b9f3-40ab-b2e6-4212dc0bedc7\") "
Oct 30 21:48:12.770028 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:12.770010    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/44bdb219-b9f3-40ab-b2e6-4212dc0bedc7-data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/44bdb219-b9f3-40ab-b2e6-4212dc0bedc7-data-science-collector-ta-client-cert\") pod \"44bdb219-b9f3-40ab-b2e6-4212dc0bedc7\" (UID: \"44bdb219-b9f3-40ab-b2e6-4212dc0bedc7\") "
Oct 30 21:48:12.770366 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:12.770340    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/44bdb219-b9f3-40ab-b2e6-4212dc0bedc7-otc-internal" pod "44bdb219-b9f3-40ab-b2e6-4212dc0bedc7" (UID: "44bdb219-b9f3-40ab-b2e6-4212dc0bedc7"). InnerVolumeSpecName "otc-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:48:12.772969 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:12.772934    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/44bdb219-b9f3-40ab-b2e6-4212dc0bedc7-data-science-collector-ta-client-cert" pod "44bdb219-b9f3-40ab-b2e6-4212dc0bedc7" (UID: "44bdb219-b9f3-40ab-b2e6-4212dc0bedc7"). InnerVolumeSpecName "data-science-collector-ta-client-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:48:12.773571 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:12.773530    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/44bdb219-b9f3-40ab-b2e6-4212dc0bedc7-monitoring-tls-certs" pod "44bdb219-b9f3-40ab-b2e6-4212dc0bedc7" (UID: "44bdb219-b9f3-40ab-b2e6-4212dc0bedc7"). InnerVolumeSpecName "monitoring-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:48:12.773840 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:12.773801    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/44bdb219-b9f3-40ab-b2e6-4212dc0bedc7-kube-api-access-x5g79" pod "44bdb219-b9f3-40ab-b2e6-4212dc0bedc7" (UID: "44bdb219-b9f3-40ab-b2e6-4212dc0bedc7"). InnerVolumeSpecName "kube-api-access-x5g79". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:48:12.774172 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:12.774143    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/44bdb219-b9f3-40ab-b2e6-4212dc0bedc7-tls-certs" pod "44bdb219-b9f3-40ab-b2e6-4212dc0bedc7" (UID: "44bdb219-b9f3-40ab-b2e6-4212dc0bedc7"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:48:12.774285 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:12.774167    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/44bdb219-b9f3-40ab-b2e6-4212dc0bedc7-otlp-tls-certs" pod "44bdb219-b9f3-40ab-b2e6-4212dc0bedc7" (UID: "44bdb219-b9f3-40ab-b2e6-4212dc0bedc7"). InnerVolumeSpecName "otlp-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:48:12.870948 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:12.870899    4060 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/44bdb219-b9f3-40ab-b2e6-4212dc0bedc7-data-science-collector-ta-client-cert\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:48:12.870948 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:12.870943    4060 reconciler_common.go:299] "Volume detached for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/44bdb219-b9f3-40ab-b2e6-4212dc0bedc7-otc-internal\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:48:12.870948 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:12.870955    4060 reconciler_common.go:299] "Volume detached for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/44bdb219-b9f3-40ab-b2e6-4212dc0bedc7-monitoring-tls-certs\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:48:12.870948 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:12.870967    4060 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/44bdb219-b9f3-40ab-b2e6-4212dc0bedc7-tls-certs\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:48:12.871223 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:12.870976    4060 reconciler_common.go:299] "Volume detached for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/44bdb219-b9f3-40ab-b2e6-4212dc0bedc7-otlp-tls-certs\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:48:12.871223 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:12.870984    4060 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x5g79\" (UniqueName: \"kubernetes.io/projected/44bdb219-b9f3-40ab-b2e6-4212dc0bedc7-kube-api-access-x5g79\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:48:13.007842 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:13.007806    4060 generic.go:356] "Generic (PLEG): container finished" podID="44bdb219-b9f3-40ab-b2e6-4212dc0bedc7" containerID="39e4f2bb34f81db52226e7a906360ec17ce3ba10029dddb8a9efc3c185b66300" exitCode=0
Oct 30 21:48:13.007992 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:13.007857    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:48:13.007992 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:13.007876    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"44bdb219-b9f3-40ab-b2e6-4212dc0bedc7","Type":"ContainerDied","Data":"39e4f2bb34f81db52226e7a906360ec17ce3ba10029dddb8a9efc3c185b66300"}
Oct 30 21:48:13.007992 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:13.007919    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"44bdb219-b9f3-40ab-b2e6-4212dc0bedc7","Type":"ContainerDied","Data":"ac51374294fdef1360ff3660445388161e73f2992e9171eb2e8a7175864d9bae"}
Oct 30 21:48:13.007992 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:13.007940    4060 scope.go:122] "RemoveContainer" containerID="39e4f2bb34f81db52226e7a906360ec17ce3ba10029dddb8a9efc3c185b66300"
Oct 30 21:48:13.016825 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:13.016807    4060 scope.go:122] "RemoveContainer" containerID="39e4f2bb34f81db52226e7a906360ec17ce3ba10029dddb8a9efc3c185b66300"
Oct 30 21:48:13.017111 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:48:13.017093    4060 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"39e4f2bb34f81db52226e7a906360ec17ce3ba10029dddb8a9efc3c185b66300\": container with ID starting with 39e4f2bb34f81db52226e7a906360ec17ce3ba10029dddb8a9efc3c185b66300 not found: ID does not exist" containerID="39e4f2bb34f81db52226e7a906360ec17ce3ba10029dddb8a9efc3c185b66300"
Oct 30 21:48:13.017166 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:13.017120    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"39e4f2bb34f81db52226e7a906360ec17ce3ba10029dddb8a9efc3c185b66300"} err="failed to get container status \"39e4f2bb34f81db52226e7a906360ec17ce3ba10029dddb8a9efc3c185b66300\": rpc error: code = NotFound desc = could not find container \"39e4f2bb34f81db52226e7a906360ec17ce3ba10029dddb8a9efc3c185b66300\": container with ID starting with 39e4f2bb34f81db52226e7a906360ec17ce3ba10029dddb8a9efc3c185b66300 not found: ID does not exist"
Oct 30 21:48:13.172204 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:13.172177    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:48:13.174415 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:13.174391    4060 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:48:13.295169 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:13.295146    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:48:13.434768 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:13.432836    4060 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="44bdb219-b9f3-40ab-b2e6-4212dc0bedc7" path="/var/lib/kubelet/pods/44bdb219-b9f3-40ab-b2e6-4212dc0bedc7/volumes"
Oct 30 21:48:13.476348 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:13.476313    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/adf9d81d-984a-44d1-b477-80ef0891e9c8-prometheus-data-science-monitoringstack-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/adf9d81d-984a-44d1-b477-80ef0891e9c8-prometheus-data-science-monitoringstack-rulefiles-2\") pod \"adf9d81d-984a-44d1-b477-80ef0891e9c8\" (UID: \"adf9d81d-984a-44d1-b477-80ef0891e9c8\") "
Oct 30 21:48:13.476534 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:13.476363    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/adf9d81d-984a-44d1-b477-80ef0891e9c8-web-config-tls-secret-cert-prometheus-operated-tls-f3457c70\" (UniqueName: \"kubernetes.io/secret/adf9d81d-984a-44d1-b477-80ef0891e9c8-web-config-tls-secret-cert-prometheus-operated-tls-f3457c70\") pod \"adf9d81d-984a-44d1-b477-80ef0891e9c8\" (UID: \"adf9d81d-984a-44d1-b477-80ef0891e9c8\") "
Oct 30 21:48:13.476534 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:13.476400    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/adf9d81d-984a-44d1-b477-80ef0891e9c8-kube-api-access-vk4l7\" (UniqueName: \"kubernetes.io/projected/adf9d81d-984a-44d1-b477-80ef0891e9c8-kube-api-access-vk4l7\") pod \"adf9d81d-984a-44d1-b477-80ef0891e9c8\" (UID: \"adf9d81d-984a-44d1-b477-80ef0891e9c8\") "
Oct 30 21:48:13.476534 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:13.476464    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/adf9d81d-984a-44d1-b477-80ef0891e9c8-tls-assets\" (UniqueName: \"kubernetes.io/projected/adf9d81d-984a-44d1-b477-80ef0891e9c8-tls-assets\") pod \"adf9d81d-984a-44d1-b477-80ef0891e9c8\" (UID: \"adf9d81d-984a-44d1-b477-80ef0891e9c8\") "
Oct 30 21:48:13.476723 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:13.476594    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/adf9d81d-984a-44d1-b477-80ef0891e9c8-web-config\" (UniqueName: \"kubernetes.io/secret/adf9d81d-984a-44d1-b477-80ef0891e9c8-web-config\") pod \"adf9d81d-984a-44d1-b477-80ef0891e9c8\" (UID: \"adf9d81d-984a-44d1-b477-80ef0891e9c8\") "
Oct 30 21:48:13.476723 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:13.476633    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/adf9d81d-984a-44d1-b477-80ef0891e9c8-secret-prometheus-web-tls-ca\" (UniqueName: \"kubernetes.io/secret/adf9d81d-984a-44d1-b477-80ef0891e9c8-secret-prometheus-web-tls-ca\") pod \"adf9d81d-984a-44d1-b477-80ef0891e9c8\" (UID: \"adf9d81d-984a-44d1-b477-80ef0891e9c8\") "
Oct 30 21:48:13.476723 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:13.476664    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/adf9d81d-984a-44d1-b477-80ef0891e9c8-web-config-tls-secret-key-prometheus-operated-tls-f3457c70\" (UniqueName: \"kubernetes.io/secret/adf9d81d-984a-44d1-b477-80ef0891e9c8-web-config-tls-secret-key-prometheus-operated-tls-f3457c70\") pod \"adf9d81d-984a-44d1-b477-80ef0891e9c8\" (UID: \"adf9d81d-984a-44d1-b477-80ef0891e9c8\") "
Oct 30 21:48:13.476723 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:13.476692    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/adf9d81d-984a-44d1-b477-80ef0891e9c8-config-out\" (UniqueName: \"kubernetes.io/empty-dir/adf9d81d-984a-44d1-b477-80ef0891e9c8-config-out\") pod \"adf9d81d-984a-44d1-b477-80ef0891e9c8\" (UID: \"adf9d81d-984a-44d1-b477-80ef0891e9c8\") "
Oct 30 21:48:13.476723 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:13.476700    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/adf9d81d-984a-44d1-b477-80ef0891e9c8-prometheus-data-science-monitoringstack-rulefiles-2" pod "adf9d81d-984a-44d1-b477-80ef0891e9c8" (UID: "adf9d81d-984a-44d1-b477-80ef0891e9c8"). InnerVolumeSpecName "prometheus-data-science-monitoringstack-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:48:13.477005 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:13.476727    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/adf9d81d-984a-44d1-b477-80ef0891e9c8-prometheus-data-science-monitoringstack-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/adf9d81d-984a-44d1-b477-80ef0891e9c8-prometheus-data-science-monitoringstack-rulefiles-1\") pod \"adf9d81d-984a-44d1-b477-80ef0891e9c8\" (UID: \"adf9d81d-984a-44d1-b477-80ef0891e9c8\") "
Oct 30 21:48:13.477005 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:13.476758    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/adf9d81d-984a-44d1-b477-80ef0891e9c8-prometheus-data-science-monitoringstack-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/adf9d81d-984a-44d1-b477-80ef0891e9c8-prometheus-data-science-monitoringstack-rulefiles-0\") pod \"adf9d81d-984a-44d1-b477-80ef0891e9c8\" (UID: \"adf9d81d-984a-44d1-b477-80ef0891e9c8\") "
Oct 30 21:48:13.477005 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:13.476791    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/adf9d81d-984a-44d1-b477-80ef0891e9c8-config\" (UniqueName: \"kubernetes.io/secret/adf9d81d-984a-44d1-b477-80ef0891e9c8-config\") pod \"adf9d81d-984a-44d1-b477-80ef0891e9c8\" (UID: \"adf9d81d-984a-44d1-b477-80ef0891e9c8\") "
Oct 30 21:48:13.477005 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:13.476897    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a155a55c1ce0e65b\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a155a55c1ce0e65b\") pod \"adf9d81d-984a-44d1-b477-80ef0891e9c8\" (UID: \"adf9d81d-984a-44d1-b477-80ef0891e9c8\") "
Oct 30 21:48:13.477005 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:13.476938    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/adf9d81d-984a-44d1-b477-80ef0891e9c8-thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/adf9d81d-984a-44d1-b477-80ef0891e9c8-thanos-prometheus-http-client-file\") pod \"adf9d81d-984a-44d1-b477-80ef0891e9c8\" (UID: \"adf9d81d-984a-44d1-b477-80ef0891e9c8\") "
Oct 30 21:48:13.477281 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:13.477167    4060 reconciler_common.go:299] "Volume detached for volume \"prometheus-data-science-monitoringstack-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/adf9d81d-984a-44d1-b477-80ef0891e9c8-prometheus-data-science-monitoringstack-rulefiles-2\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:48:13.479225 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:13.479191    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/adf9d81d-984a-44d1-b477-80ef0891e9c8-secret-prometheus-web-tls-ca" pod "adf9d81d-984a-44d1-b477-80ef0891e9c8" (UID: "adf9d81d-984a-44d1-b477-80ef0891e9c8"). InnerVolumeSpecName "secret-prometheus-web-tls-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:48:13.479542 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:13.479515    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/adf9d81d-984a-44d1-b477-80ef0891e9c8-tls-assets" pod "adf9d81d-984a-44d1-b477-80ef0891e9c8" (UID: "adf9d81d-984a-44d1-b477-80ef0891e9c8"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:48:13.479640 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:13.479610    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/adf9d81d-984a-44d1-b477-80ef0891e9c8-thanos-prometheus-http-client-file" pod "adf9d81d-984a-44d1-b477-80ef0891e9c8" (UID: "adf9d81d-984a-44d1-b477-80ef0891e9c8"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:48:13.479706 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:13.479690    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/adf9d81d-984a-44d1-b477-80ef0891e9c8-prometheus-data-science-monitoringstack-rulefiles-0" pod "adf9d81d-984a-44d1-b477-80ef0891e9c8" (UID: "adf9d81d-984a-44d1-b477-80ef0891e9c8"). InnerVolumeSpecName "prometheus-data-science-monitoringstack-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:48:13.479791 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:13.479766    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/adf9d81d-984a-44d1-b477-80ef0891e9c8-kube-api-access-vk4l7" pod "adf9d81d-984a-44d1-b477-80ef0891e9c8" (UID: "adf9d81d-984a-44d1-b477-80ef0891e9c8"). InnerVolumeSpecName "kube-api-access-vk4l7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:48:13.479909 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:13.479886    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/adf9d81d-984a-44d1-b477-80ef0891e9c8-web-config-tls-secret-cert-prometheus-operated-tls-f3457c70" pod "adf9d81d-984a-44d1-b477-80ef0891e9c8" (UID: "adf9d81d-984a-44d1-b477-80ef0891e9c8"). InnerVolumeSpecName "web-config-tls-secret-cert-prometheus-operated-tls-f3457c70". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:48:13.480027 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:13.480006    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/adf9d81d-984a-44d1-b477-80ef0891e9c8-prometheus-data-science-monitoringstack-rulefiles-1" pod "adf9d81d-984a-44d1-b477-80ef0891e9c8" (UID: "adf9d81d-984a-44d1-b477-80ef0891e9c8"). InnerVolumeSpecName "prometheus-data-science-monitoringstack-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:48:13.480239 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:13.480218    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/adf9d81d-984a-44d1-b477-80ef0891e9c8-web-config-tls-secret-key-prometheus-operated-tls-f3457c70" pod "adf9d81d-984a-44d1-b477-80ef0891e9c8" (UID: "adf9d81d-984a-44d1-b477-80ef0891e9c8"). InnerVolumeSpecName "web-config-tls-secret-key-prometheus-operated-tls-f3457c70". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:48:13.480693 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:13.480655    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/adf9d81d-984a-44d1-b477-80ef0891e9c8-config-out" pod "adf9d81d-984a-44d1-b477-80ef0891e9c8" (UID: "adf9d81d-984a-44d1-b477-80ef0891e9c8"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:48:13.481627 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:13.481605    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/adf9d81d-984a-44d1-b477-80ef0891e9c8-config" pod "adf9d81d-984a-44d1-b477-80ef0891e9c8" (UID: "adf9d81d-984a-44d1-b477-80ef0891e9c8"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:48:13.484237 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:13.484218    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/csi/ebs.csi.aws.com^vol-0a155a55c1ce0e65b" pod "adf9d81d-984a-44d1-b477-80ef0891e9c8" (UID: "adf9d81d-984a-44d1-b477-80ef0891e9c8"). InnerVolumeSpecName "pvc-e73afc79-aa37-49a0-8744-633c03cad1f4". PluginName "kubernetes.io/csi", VolumeGIDValue ""
Oct 30 21:48:13.491657 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:13.491632    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/adf9d81d-984a-44d1-b477-80ef0891e9c8-web-config" pod "adf9d81d-984a-44d1-b477-80ef0891e9c8" (UID: "adf9d81d-984a-44d1-b477-80ef0891e9c8"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:48:13.578512 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:13.578467    4060 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/adf9d81d-984a-44d1-b477-80ef0891e9c8-tls-assets\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:48:13.578512 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:13.578509    4060 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/adf9d81d-984a-44d1-b477-80ef0891e9c8-web-config\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:48:13.578714 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:13.578521    4060 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-web-tls-ca\" (UniqueName: \"kubernetes.io/secret/adf9d81d-984a-44d1-b477-80ef0891e9c8-secret-prometheus-web-tls-ca\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:48:13.578714 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:13.578534    4060 reconciler_common.go:299] "Volume detached for volume \"web-config-tls-secret-key-prometheus-operated-tls-f3457c70\" (UniqueName: \"kubernetes.io/secret/adf9d81d-984a-44d1-b477-80ef0891e9c8-web-config-tls-secret-key-prometheus-operated-tls-f3457c70\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:48:13.578714 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:13.578543    4060 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/adf9d81d-984a-44d1-b477-80ef0891e9c8-config-out\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:48:13.578714 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:13.578552    4060 reconciler_common.go:299] "Volume detached for volume \"prometheus-data-science-monitoringstack-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/adf9d81d-984a-44d1-b477-80ef0891e9c8-prometheus-data-science-monitoringstack-rulefiles-1\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:48:13.578714 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:13.578563    4060 reconciler_common.go:299] "Volume detached for volume \"prometheus-data-science-monitoringstack-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/adf9d81d-984a-44d1-b477-80ef0891e9c8-prometheus-data-science-monitoringstack-rulefiles-0\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:48:13.578714 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:13.578571    4060 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/adf9d81d-984a-44d1-b477-80ef0891e9c8-config\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:48:13.578714 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:13.578600    4060 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"pvc-e73afc79-aa37-49a0-8744-633c03cad1f4\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a155a55c1ce0e65b\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" "
Oct 30 21:48:13.578714 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:13.578611    4060 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/adf9d81d-984a-44d1-b477-80ef0891e9c8-thanos-prometheus-http-client-file\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:48:13.578714 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:13.578625    4060 reconciler_common.go:299] "Volume detached for volume \"web-config-tls-secret-cert-prometheus-operated-tls-f3457c70\" (UniqueName: \"kubernetes.io/secret/adf9d81d-984a-44d1-b477-80ef0891e9c8-web-config-tls-secret-cert-prometheus-operated-tls-f3457c70\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:48:13.578714 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:13.578639    4060 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vk4l7\" (UniqueName: \"kubernetes.io/projected/adf9d81d-984a-44d1-b477-80ef0891e9c8-kube-api-access-vk4l7\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:48:13.589311 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:13.589292    4060 operation_generator.go:893] UnmountDevice succeeded for volume "pvc-e73afc79-aa37-49a0-8744-633c03cad1f4" (UniqueName: "kubernetes.io/csi/ebs.csi.aws.com^vol-0a155a55c1ce0e65b") on node "ip-10-0-142-4.us-west-1.compute.internal"
Oct 30 21:48:13.679207 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:13.679177    4060 reconciler_common.go:299] "Volume detached for volume \"pvc-e73afc79-aa37-49a0-8744-633c03cad1f4\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a155a55c1ce0e65b\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"csi-7011c01335d2502f76be252f9498c79824668beecf30ee8f6a7191145201ca4c\""
Oct 30 21:48:14.016842 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:14.016808    4060 generic.go:356] "Generic (PLEG): container finished" podID="adf9d81d-984a-44d1-b477-80ef0891e9c8" containerID="51d848c2cfac08d104e2e0db0b2b05ec64cf7510cf147a60dfa8943854405441" exitCode=0
Oct 30 21:48:14.017011 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:14.016857    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0" event={"ID":"adf9d81d-984a-44d1-b477-80ef0891e9c8","Type":"ContainerDied","Data":"51d848c2cfac08d104e2e0db0b2b05ec64cf7510cf147a60dfa8943854405441"}
Oct 30 21:48:14.017011 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:14.016900    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:48:14.017011 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:14.016924    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0" event={"ID":"adf9d81d-984a-44d1-b477-80ef0891e9c8","Type":"ContainerDied","Data":"c1ff53f95d1b6fc0d954bdebdf027eb2c5248c5ad9603429e393c0aee8309ced"}
Oct 30 21:48:14.017011 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:14.016970    4060 scope.go:122] "RemoveContainer" containerID="4d4cd27f6fcad343c5fdfffec50ef50e994a9aba5a9e9153d28ac86ebd57abc6"
Oct 30 21:48:14.026385 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:14.026362    4060 scope.go:122] "RemoveContainer" containerID="a7c1b75adc3428e15ddb8d8fcd234040844fe0f7ed0c379d01e54d0d2841c290"
Oct 30 21:48:14.034351 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:14.034331    4060 scope.go:122] "RemoveContainer" containerID="51d848c2cfac08d104e2e0db0b2b05ec64cf7510cf147a60dfa8943854405441"
Oct 30 21:48:14.041885 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:14.041861    4060 scope.go:122] "RemoveContainer" containerID="c581da73ebf899e49931f4635d4666058078dbf92c9b99064a42c70efd15f4c9"
Oct 30 21:48:14.049455 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:14.049438    4060 scope.go:122] "RemoveContainer" containerID="4d4cd27f6fcad343c5fdfffec50ef50e994a9aba5a9e9153d28ac86ebd57abc6"
Oct 30 21:48:14.049735 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:48:14.049713    4060 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4d4cd27f6fcad343c5fdfffec50ef50e994a9aba5a9e9153d28ac86ebd57abc6\": container with ID starting with 4d4cd27f6fcad343c5fdfffec50ef50e994a9aba5a9e9153d28ac86ebd57abc6 not found: ID does not exist" containerID="4d4cd27f6fcad343c5fdfffec50ef50e994a9aba5a9e9153d28ac86ebd57abc6"
Oct 30 21:48:14.049787 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:14.049740    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d4cd27f6fcad343c5fdfffec50ef50e994a9aba5a9e9153d28ac86ebd57abc6"} err="failed to get container status \"4d4cd27f6fcad343c5fdfffec50ef50e994a9aba5a9e9153d28ac86ebd57abc6\": rpc error: code = NotFound desc = could not find container \"4d4cd27f6fcad343c5fdfffec50ef50e994a9aba5a9e9153d28ac86ebd57abc6\": container with ID starting with 4d4cd27f6fcad343c5fdfffec50ef50e994a9aba5a9e9153d28ac86ebd57abc6 not found: ID does not exist"
Oct 30 21:48:14.049787 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:14.049759    4060 scope.go:122] "RemoveContainer" containerID="a7c1b75adc3428e15ddb8d8fcd234040844fe0f7ed0c379d01e54d0d2841c290"
Oct 30 21:48:14.049971 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:48:14.049957    4060 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a7c1b75adc3428e15ddb8d8fcd234040844fe0f7ed0c379d01e54d0d2841c290\": container with ID starting with a7c1b75adc3428e15ddb8d8fcd234040844fe0f7ed0c379d01e54d0d2841c290 not found: ID does not exist" containerID="a7c1b75adc3428e15ddb8d8fcd234040844fe0f7ed0c379d01e54d0d2841c290"
Oct 30 21:48:14.050009 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:14.049975    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a7c1b75adc3428e15ddb8d8fcd234040844fe0f7ed0c379d01e54d0d2841c290"} err="failed to get container status \"a7c1b75adc3428e15ddb8d8fcd234040844fe0f7ed0c379d01e54d0d2841c290\": rpc error: code = NotFound desc = could not find container \"a7c1b75adc3428e15ddb8d8fcd234040844fe0f7ed0c379d01e54d0d2841c290\": container with ID starting with a7c1b75adc3428e15ddb8d8fcd234040844fe0f7ed0c379d01e54d0d2841c290 not found: ID does not exist"
Oct 30 21:48:14.050009 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:14.049989    4060 scope.go:122] "RemoveContainer" containerID="51d848c2cfac08d104e2e0db0b2b05ec64cf7510cf147a60dfa8943854405441"
Oct 30 21:48:14.050205 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:48:14.050190    4060 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"51d848c2cfac08d104e2e0db0b2b05ec64cf7510cf147a60dfa8943854405441\": container with ID starting with 51d848c2cfac08d104e2e0db0b2b05ec64cf7510cf147a60dfa8943854405441 not found: ID does not exist" containerID="51d848c2cfac08d104e2e0db0b2b05ec64cf7510cf147a60dfa8943854405441"
Oct 30 21:48:14.050247 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:14.050210    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"51d848c2cfac08d104e2e0db0b2b05ec64cf7510cf147a60dfa8943854405441"} err="failed to get container status \"51d848c2cfac08d104e2e0db0b2b05ec64cf7510cf147a60dfa8943854405441\": rpc error: code = NotFound desc = could not find container \"51d848c2cfac08d104e2e0db0b2b05ec64cf7510cf147a60dfa8943854405441\": container with ID starting with 51d848c2cfac08d104e2e0db0b2b05ec64cf7510cf147a60dfa8943854405441 not found: ID does not exist"
Oct 30 21:48:14.050247 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:14.050222    4060 scope.go:122] "RemoveContainer" containerID="c581da73ebf899e49931f4635d4666058078dbf92c9b99064a42c70efd15f4c9"
Oct 30 21:48:14.050418 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:48:14.050403    4060 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c581da73ebf899e49931f4635d4666058078dbf92c9b99064a42c70efd15f4c9\": container with ID starting with c581da73ebf899e49931f4635d4666058078dbf92c9b99064a42c70efd15f4c9 not found: ID does not exist" containerID="c581da73ebf899e49931f4635d4666058078dbf92c9b99064a42c70efd15f4c9"
Oct 30 21:48:14.050455 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:14.050420    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c581da73ebf899e49931f4635d4666058078dbf92c9b99064a42c70efd15f4c9"} err="failed to get container status \"c581da73ebf899e49931f4635d4666058078dbf92c9b99064a42c70efd15f4c9\": rpc error: code = NotFound desc = could not find container \"c581da73ebf899e49931f4635d4666058078dbf92c9b99064a42c70efd15f4c9\": container with ID starting with c581da73ebf899e49931f4635d4666058078dbf92c9b99064a42c70efd15f4c9 not found: ID does not exist"
Oct 30 21:48:14.223836 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:14.223803    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"]
Oct 30 21:48:14.238590 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:14.238563    4060 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"]
Oct 30 21:48:15.426353 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:15.426323    4060 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="adf9d81d-984a-44d1-b477-80ef0891e9c8" path="/var/lib/kubelet/pods/adf9d81d-984a-44d1-b477-80ef0891e9c8/volumes"
Oct 30 21:48:33.710519 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:33.710474    4060 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-w5vd6"]
Oct 30 21:48:33.710981 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:33.710767    4060 cpu_manager.go:414] "containerMap: removing container" podUID="adf9d81d-984a-44d1-b477-80ef0891e9c8" containerName="config-reloader"
Oct 30 21:48:33.710981 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:33.710777    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="adf9d81d-984a-44d1-b477-80ef0891e9c8" containerName="config-reloader"
Oct 30 21:48:33.710981 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:33.710786    4060 cpu_manager.go:414] "containerMap: removing container" podUID="adf9d81d-984a-44d1-b477-80ef0891e9c8" containerName="thanos-sidecar"
Oct 30 21:48:33.710981 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:33.710791    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="adf9d81d-984a-44d1-b477-80ef0891e9c8" containerName="thanos-sidecar"
Oct 30 21:48:33.710981 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:33.710799    4060 cpu_manager.go:414] "containerMap: removing container" podUID="ace3afef-a91a-4d3c-a1df-835d94f6c0c7" containerName="korrel8r"
Oct 30 21:48:33.710981 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:33.710804    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ace3afef-a91a-4d3c-a1df-835d94f6c0c7" containerName="korrel8r"
Oct 30 21:48:33.710981 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:33.710815    4060 cpu_manager.go:414] "containerMap: removing container" podUID="414766a3-ef7e-4f4b-8056-42ae2e2abd98" containerName="kube-rbac-proxy"
Oct 30 21:48:33.710981 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:33.710820    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="414766a3-ef7e-4f4b-8056-42ae2e2abd98" containerName="kube-rbac-proxy"
Oct 30 21:48:33.710981 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:33.710826    4060 cpu_manager.go:414] "containerMap: removing container" podUID="5023ba3e-8997-481f-a8d7-3a925f14fc08" containerName="init-config-reloader"
Oct 30 21:48:33.710981 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:33.710830    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5023ba3e-8997-481f-a8d7-3a925f14fc08" containerName="init-config-reloader"
Oct 30 21:48:33.710981 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:33.710836    4060 cpu_manager.go:414] "containerMap: removing container" podUID="adf9d81d-984a-44d1-b477-80ef0891e9c8" containerName="prometheus"
Oct 30 21:48:33.710981 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:33.710840    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="adf9d81d-984a-44d1-b477-80ef0891e9c8" containerName="prometheus"
Oct 30 21:48:33.710981 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:33.710845    4060 cpu_manager.go:414] "containerMap: removing container" podUID="44bdb219-b9f3-40ab-b2e6-4212dc0bedc7" containerName="otc-container"
Oct 30 21:48:33.710981 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:33.710849    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="44bdb219-b9f3-40ab-b2e6-4212dc0bedc7" containerName="otc-container"
Oct 30 21:48:33.710981 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:33.710860    4060 cpu_manager.go:414] "containerMap: removing container" podUID="5023ba3e-8997-481f-a8d7-3a925f14fc08" containerName="alertmanager"
Oct 30 21:48:33.710981 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:33.710864    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5023ba3e-8997-481f-a8d7-3a925f14fc08" containerName="alertmanager"
Oct 30 21:48:33.710981 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:33.710871    4060 cpu_manager.go:414] "containerMap: removing container" podUID="adf9d81d-984a-44d1-b477-80ef0891e9c8" containerName="init-config-reloader"
Oct 30 21:48:33.710981 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:33.710877    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="adf9d81d-984a-44d1-b477-80ef0891e9c8" containerName="init-config-reloader"
Oct 30 21:48:33.710981 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:33.710883    4060 cpu_manager.go:414] "containerMap: removing container" podUID="5023ba3e-8997-481f-a8d7-3a925f14fc08" containerName="config-reloader"
Oct 30 21:48:33.710981 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:33.710888    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5023ba3e-8997-481f-a8d7-3a925f14fc08" containerName="config-reloader"
Oct 30 21:48:33.710981 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:33.710935    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="ace3afef-a91a-4d3c-a1df-835d94f6c0c7" containerName="korrel8r"
Oct 30 21:48:33.710981 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:33.710962    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="414766a3-ef7e-4f4b-8056-42ae2e2abd98" containerName="kube-rbac-proxy"
Oct 30 21:48:33.710981 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:33.710968    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="adf9d81d-984a-44d1-b477-80ef0891e9c8" containerName="prometheus"
Oct 30 21:48:33.710981 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:33.710973    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="44bdb219-b9f3-40ab-b2e6-4212dc0bedc7" containerName="otc-container"
Oct 30 21:48:33.710981 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:33.710979    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="5023ba3e-8997-481f-a8d7-3a925f14fc08" containerName="alertmanager"
Oct 30 21:48:33.710981 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:33.710985    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="5023ba3e-8997-481f-a8d7-3a925f14fc08" containerName="config-reloader"
Oct 30 21:48:33.710981 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:33.710995    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="adf9d81d-984a-44d1-b477-80ef0891e9c8" containerName="config-reloader"
Oct 30 21:48:33.710981 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:33.711001    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="adf9d81d-984a-44d1-b477-80ef0891e9c8" containerName="thanos-sidecar"
Oct 30 21:48:33.713755 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:33.713739    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-w5vd6"
Oct 30 21:48:33.727983 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:33.727961    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bcpxd\" (UniqueName: \"kubernetes.io/projected/798689a4-7697-4238-b20f-00c5620c5eb4-kube-api-access-bcpxd\") pod \"data-science-prometheus-cluster-proxy-545f759f7c-w5vd6\" (UID: \"798689a4-7697-4238-b20f-00c5620c5eb4\") " pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-w5vd6"
Oct 30 21:48:33.728106 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:33.727992    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-ca\" (UniqueName: \"kubernetes.io/configmap/798689a4-7697-4238-b20f-00c5620c5eb4-prometheus-ca\") pod \"data-science-prometheus-cluster-proxy-545f759f7c-w5vd6\" (UID: \"798689a4-7697-4238-b20f-00c5620c5eb4\") " pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-w5vd6"
Oct 30 21:48:33.728106 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:33.728017    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/798689a4-7697-4238-b20f-00c5620c5eb4-tls\") pod \"data-science-prometheus-cluster-proxy-545f759f7c-w5vd6\" (UID: \"798689a4-7697-4238-b20f-00c5620c5eb4\") " pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-w5vd6"
Oct 30 21:48:33.728106 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:33.728034    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/798689a4-7697-4238-b20f-00c5620c5eb4-kube-rbac-proxy-config\") pod \"data-science-prometheus-cluster-proxy-545f759f7c-w5vd6\" (UID: \"798689a4-7697-4238-b20f-00c5620c5eb4\") " pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-w5vd6"
Oct 30 21:48:33.728245 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:33.728179    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-client-cert\" (UniqueName: \"kubernetes.io/secret/798689a4-7697-4238-b20f-00c5620c5eb4-prometheus-client-cert\") pod \"data-science-prometheus-cluster-proxy-545f759f7c-w5vd6\" (UID: \"798689a4-7697-4238-b20f-00c5620c5eb4\") " pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-w5vd6"
Oct 30 21:48:33.771265 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:33.771234    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"kube-root-ca.crt\""
Oct 30 21:48:33.771432 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:33.771283    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"prometheus-web-tls-ca\""
Oct 30 21:48:33.771432 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:33.771298    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"openshift-service-ca.crt\""
Oct 30 21:48:33.773674 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:33.773648    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-prometheus-cluster-proxy-dockercfg-w2lnc\""
Oct 30 21:48:33.773674 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:33.773665    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-prometheus-cluster-proxy-kube-rbac-proxy\""
Oct 30 21:48:33.820654 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:33.820623    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"prometheus-operated-tls\""
Oct 30 21:48:33.820654 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:33.820622    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-prometheus-cluster-proxy-tls\""
Oct 30 21:48:33.822323 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:33.822297    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-w5vd6"]
Oct 30 21:48:33.829264 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:33.829241    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/798689a4-7697-4238-b20f-00c5620c5eb4-tls\") pod \"data-science-prometheus-cluster-proxy-545f759f7c-w5vd6\" (UID: \"798689a4-7697-4238-b20f-00c5620c5eb4\") " pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-w5vd6"
Oct 30 21:48:33.829375 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:33.829273    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/798689a4-7697-4238-b20f-00c5620c5eb4-kube-rbac-proxy-config\") pod \"data-science-prometheus-cluster-proxy-545f759f7c-w5vd6\" (UID: \"798689a4-7697-4238-b20f-00c5620c5eb4\") " pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-w5vd6"
Oct 30 21:48:33.829375 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:33.829327    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-client-cert\" (UniqueName: \"kubernetes.io/secret/798689a4-7697-4238-b20f-00c5620c5eb4-prometheus-client-cert\") pod \"data-science-prometheus-cluster-proxy-545f759f7c-w5vd6\" (UID: \"798689a4-7697-4238-b20f-00c5620c5eb4\") " pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-w5vd6"
Oct 30 21:48:33.829375 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:33.829369    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bcpxd\" (UniqueName: \"kubernetes.io/projected/798689a4-7697-4238-b20f-00c5620c5eb4-kube-api-access-bcpxd\") pod \"data-science-prometheus-cluster-proxy-545f759f7c-w5vd6\" (UID: \"798689a4-7697-4238-b20f-00c5620c5eb4\") " pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-w5vd6"
Oct 30 21:48:33.829536 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:33.829512    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-ca\" (UniqueName: \"kubernetes.io/configmap/798689a4-7697-4238-b20f-00c5620c5eb4-prometheus-ca\") pod \"data-science-prometheus-cluster-proxy-545f759f7c-w5vd6\" (UID: \"798689a4-7697-4238-b20f-00c5620c5eb4\") " pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-w5vd6"
Oct 30 21:48:33.830102 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:33.830082    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-ca\" (UniqueName: \"kubernetes.io/configmap/798689a4-7697-4238-b20f-00c5620c5eb4-prometheus-ca\") pod \"data-science-prometheus-cluster-proxy-545f759f7c-w5vd6\" (UID: \"798689a4-7697-4238-b20f-00c5620c5eb4\") " pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-w5vd6"
Oct 30 21:48:33.831733 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:33.831711    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/798689a4-7697-4238-b20f-00c5620c5eb4-kube-rbac-proxy-config\") pod \"data-science-prometheus-cluster-proxy-545f759f7c-w5vd6\" (UID: \"798689a4-7697-4238-b20f-00c5620c5eb4\") " pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-w5vd6"
Oct 30 21:48:33.831867 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:33.831849    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-client-cert\" (UniqueName: \"kubernetes.io/secret/798689a4-7697-4238-b20f-00c5620c5eb4-prometheus-client-cert\") pod \"data-science-prometheus-cluster-proxy-545f759f7c-w5vd6\" (UID: \"798689a4-7697-4238-b20f-00c5620c5eb4\") " pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-w5vd6"
Oct 30 21:48:33.831927 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:33.831867    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls\" (UniqueName: \"kubernetes.io/secret/798689a4-7697-4238-b20f-00c5620c5eb4-tls\") pod \"data-science-prometheus-cluster-proxy-545f759f7c-w5vd6\" (UID: \"798689a4-7697-4238-b20f-00c5620c5eb4\") " pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-w5vd6"
Oct 30 21:48:33.892182 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:33.892149    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bcpxd\" (UniqueName: \"kubernetes.io/projected/798689a4-7697-4238-b20f-00c5620c5eb4-kube-api-access-bcpxd\") pod \"data-science-prometheus-cluster-proxy-545f759f7c-w5vd6\" (UID: \"798689a4-7697-4238-b20f-00c5620c5eb4\") " pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-w5vd6"
Oct 30 21:48:34.027429 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:34.027338    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-w5vd6"
Oct 30 21:48:34.077708 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:34.077248    4060 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/korrel8r-5cbcc89b8f-96ddv"]
Oct 30 21:48:34.082461 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:34.082440    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-96ddv"
Oct 30 21:48:34.132918 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:34.132887    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nssdf\" (UniqueName: \"kubernetes.io/projected/f3df7a4d-f910-432e-ae0c-93dcbabb6313-kube-api-access-nssdf\") pod \"korrel8r-5cbcc89b8f-96ddv\" (UID: \"f3df7a4d-f910-432e-ae0c-93dcbabb6313\") " pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-96ddv"
Oct 30 21:48:34.132918 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:34.132923    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f3df7a4d-f910-432e-ae0c-93dcbabb6313-config\") pod \"korrel8r-5cbcc89b8f-96ddv\" (UID: \"f3df7a4d-f910-432e-ae0c-93dcbabb6313\") " pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-96ddv"
Oct 30 21:48:34.133118 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:34.132949    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/f3df7a4d-f910-432e-ae0c-93dcbabb6313-tls\") pod \"korrel8r-5cbcc89b8f-96ddv\" (UID: \"f3df7a4d-f910-432e-ae0c-93dcbabb6313\") " pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-96ddv"
Oct 30 21:48:34.141931 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:34.141909    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"korrel8r-tls\""
Oct 30 21:48:34.142071 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:34.142024    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"korrel8r-dockercfg-pqqdv\""
Oct 30 21:48:34.142802 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:34.142776    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/korrel8r-5cbcc89b8f-96ddv"]
Oct 30 21:48:34.203381 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:34.203348    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"korrel8r-config\""
Oct 30 21:48:34.233582 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:34.233548    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f3df7a4d-f910-432e-ae0c-93dcbabb6313-config\") pod \"korrel8r-5cbcc89b8f-96ddv\" (UID: \"f3df7a4d-f910-432e-ae0c-93dcbabb6313\") " pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-96ddv"
Oct 30 21:48:34.233745 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:34.233593    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/f3df7a4d-f910-432e-ae0c-93dcbabb6313-tls\") pod \"korrel8r-5cbcc89b8f-96ddv\" (UID: \"f3df7a4d-f910-432e-ae0c-93dcbabb6313\") " pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-96ddv"
Oct 30 21:48:34.233745 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:34.233656    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nssdf\" (UniqueName: \"kubernetes.io/projected/f3df7a4d-f910-432e-ae0c-93dcbabb6313-kube-api-access-nssdf\") pod \"korrel8r-5cbcc89b8f-96ddv\" (UID: \"f3df7a4d-f910-432e-ae0c-93dcbabb6313\") " pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-96ddv"
Oct 30 21:48:34.234375 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:34.234349    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f3df7a4d-f910-432e-ae0c-93dcbabb6313-config\") pod \"korrel8r-5cbcc89b8f-96ddv\" (UID: \"f3df7a4d-f910-432e-ae0c-93dcbabb6313\") " pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-96ddv"
Oct 30 21:48:34.236025 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:34.236002    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls\" (UniqueName: \"kubernetes.io/secret/f3df7a4d-f910-432e-ae0c-93dcbabb6313-tls\") pod \"korrel8r-5cbcc89b8f-96ddv\" (UID: \"f3df7a4d-f910-432e-ae0c-93dcbabb6313\") " pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-96ddv"
Oct 30 21:48:34.295076 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:34.295012    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nssdf\" (UniqueName: \"kubernetes.io/projected/f3df7a4d-f910-432e-ae0c-93dcbabb6313-kube-api-access-nssdf\") pod \"korrel8r-5cbcc89b8f-96ddv\" (UID: \"f3df7a4d-f910-432e-ae0c-93dcbabb6313\") " pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-96ddv"
Oct 30 21:48:34.399826 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:34.399789    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-w5vd6"]
Oct 30 21:48:34.399987 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:34.399858    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-96ddv"
Oct 30 21:48:34.402148 ip-10-0-142-4 kubenswrapper[4060]: W1030 21:48:34.402121    4060 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod798689a4_7697_4238_b20f_00c5620c5eb4.slice/crio-683dc37280c071dc55978865d46e061fc2581b28e877278514f82dae0cfeb1ba WatchSource:0}: Error finding container 683dc37280c071dc55978865d46e061fc2581b28e877278514f82dae0cfeb1ba: Status 404 returned error can't find the container with id 683dc37280c071dc55978865d46e061fc2581b28e877278514f82dae0cfeb1ba
Oct 30 21:48:34.769359 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:34.769338    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/korrel8r-5cbcc89b8f-96ddv"]
Oct 30 21:48:34.771514 ip-10-0-142-4 kubenswrapper[4060]: W1030 21:48:34.771480    4060 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3df7a4d_f910_432e_ae0c_93dcbabb6313.slice/crio-0e40f5dddf4ef0cf5513cb5152ad7b062b6ba96ea8f2335bee915660c43bfeb0 WatchSource:0}: Error finding container 0e40f5dddf4ef0cf5513cb5152ad7b062b6ba96ea8f2335bee915660c43bfeb0: Status 404 returned error can't find the container with id 0e40f5dddf4ef0cf5513cb5152ad7b062b6ba96ea8f2335bee915660c43bfeb0
Oct 30 21:48:35.114870 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:35.114457    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-96ddv" event={"ID":"f3df7a4d-f910-432e-ae0c-93dcbabb6313","Type":"ContainerStarted","Data":"5b1feeee110cff4eadd4b43c86a364625ae12315fb90a5a5a942ece62095cd3c"}
Oct 30 21:48:35.114870 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:35.114543    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-96ddv"
Oct 30 21:48:35.114870 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:35.114570    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-96ddv" event={"ID":"f3df7a4d-f910-432e-ae0c-93dcbabb6313","Type":"ContainerStarted","Data":"0e40f5dddf4ef0cf5513cb5152ad7b062b6ba96ea8f2335bee915660c43bfeb0"}
Oct 30 21:48:35.115902 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:35.115871    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-w5vd6" event={"ID":"798689a4-7697-4238-b20f-00c5620c5eb4","Type":"ContainerStarted","Data":"33d587467cadf028c1de10724069f81e615614fdddb3f98952770c9d940c3f59"}
Oct 30 21:48:35.116303 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:35.115911    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-w5vd6" event={"ID":"798689a4-7697-4238-b20f-00c5620c5eb4","Type":"ContainerStarted","Data":"683dc37280c071dc55978865d46e061fc2581b28e877278514f82dae0cfeb1ba"}
Oct 30 21:48:35.116303 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:35.115933    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-w5vd6"
Oct 30 21:48:35.230457 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:35.230409    4060 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-96ddv" podStartSLOduration=1.230396188 podStartE2EDuration="1.230396188s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:48:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:48:35.230096769 +0000 UTC m=+4333.987095066" watchObservedRunningTime="2026-10-30 21:48:35.230396188 +0000 UTC m=+4333.987394484"
Oct 30 21:48:35.347331 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:35.347215    4060 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-w5vd6" podStartSLOduration=2.34719628 podStartE2EDuration="2.34719628s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:48:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:48:35.346272254 +0000 UTC m=+4334.103270551" watchObservedRunningTime="2026-10-30 21:48:35.34719628 +0000 UTC m=+4334.104194579"
Oct 30 21:48:38.517329 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:38.517297    4060 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:48:38.520788 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:38.520765    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:48:38.571681 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:38.571650    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/1b73e782-fcb6-4bc0-87c9-f24e47a845bd-monitoring-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"1b73e782-fcb6-4bc0-87c9-f24e47a845bd\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:48:38.571852 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:38.571695    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8wk4c\" (UniqueName: \"kubernetes.io/projected/1b73e782-fcb6-4bc0-87c9-f24e47a845bd-kube-api-access-8wk4c\") pod \"data-science-collector-collector-0\" (UID: \"1b73e782-fcb6-4bc0-87c9-f24e47a845bd\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:48:38.571852 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:38.571822    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1b73e782-fcb6-4bc0-87c9-f24e47a845bd-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"1b73e782-fcb6-4bc0-87c9-f24e47a845bd\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:48:38.571961 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:38.571866    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/1b73e782-fcb6-4bc0-87c9-f24e47a845bd-otc-internal\") pod \"data-science-collector-collector-0\" (UID: \"1b73e782-fcb6-4bc0-87c9-f24e47a845bd\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:48:38.571961 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:38.571887    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/1b73e782-fcb6-4bc0-87c9-f24e47a845bd-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-0\" (UID: \"1b73e782-fcb6-4bc0-87c9-f24e47a845bd\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:48:38.571961 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:38.571902    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/1b73e782-fcb6-4bc0-87c9-f24e47a845bd-otlp-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"1b73e782-fcb6-4bc0-87c9-f24e47a845bd\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:48:38.626184 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:38.626150    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-tls\""
Oct 30 21:48:38.626569 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:38.626161    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-ta-client-cert\""
Oct 30 21:48:38.626693 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:38.626163    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-dockercfg-h8sc9\""
Oct 30 21:48:38.626693 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:38.626163    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-a0f9182a\""
Oct 30 21:48:38.626693 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:38.626212    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-monitoring-tls\""
Oct 30 21:48:38.626693 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:38.626241    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-headless-tls\""
Oct 30 21:48:38.628027 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:38.628008    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:48:38.672753 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:38.672721    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1b73e782-fcb6-4bc0-87c9-f24e47a845bd-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"1b73e782-fcb6-4bc0-87c9-f24e47a845bd\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:48:38.672922 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:38.672784    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/1b73e782-fcb6-4bc0-87c9-f24e47a845bd-otc-internal\") pod \"data-science-collector-collector-0\" (UID: \"1b73e782-fcb6-4bc0-87c9-f24e47a845bd\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:48:38.672922 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:38.672808    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/1b73e782-fcb6-4bc0-87c9-f24e47a845bd-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-0\" (UID: \"1b73e782-fcb6-4bc0-87c9-f24e47a845bd\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:48:38.672922 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:38.672824    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/1b73e782-fcb6-4bc0-87c9-f24e47a845bd-otlp-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"1b73e782-fcb6-4bc0-87c9-f24e47a845bd\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:48:38.672922 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:38.672844    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/1b73e782-fcb6-4bc0-87c9-f24e47a845bd-monitoring-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"1b73e782-fcb6-4bc0-87c9-f24e47a845bd\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:48:38.672922 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:38.672874    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8wk4c\" (UniqueName: \"kubernetes.io/projected/1b73e782-fcb6-4bc0-87c9-f24e47a845bd-kube-api-access-8wk4c\") pod \"data-science-collector-collector-0\" (UID: \"1b73e782-fcb6-4bc0-87c9-f24e47a845bd\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:48:38.673205 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:48:38.672970    4060 secret.go:189] Couldn't get secret redhat-ods-monitoring/data-science-collector-collector-headless-tls: secret "data-science-collector-collector-headless-tls" not found
Oct 30 21:48:38.673205 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:48:38.673041    4060 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b73e782-fcb6-4bc0-87c9-f24e47a845bd-otlp-tls-certs podName:1b73e782-fcb6-4bc0-87c9-f24e47a845bd nodeName:}" failed. No retries permitted until 2026-10-30 21:48:39.173019344 +0000 UTC m=+4337.930017639 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "otlp-tls-certs" (UniqueName: "kubernetes.io/secret/1b73e782-fcb6-4bc0-87c9-f24e47a845bd-otlp-tls-certs") pod "data-science-collector-collector-0" (UID: "1b73e782-fcb6-4bc0-87c9-f24e47a845bd") : secret "data-science-collector-collector-headless-tls" not found
Oct 30 21:48:38.673614 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:38.673592    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/1b73e782-fcb6-4bc0-87c9-f24e47a845bd-otc-internal\") pod \"data-science-collector-collector-0\" (UID: \"1b73e782-fcb6-4bc0-87c9-f24e47a845bd\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:48:38.675105 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:38.675080    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1b73e782-fcb6-4bc0-87c9-f24e47a845bd-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"1b73e782-fcb6-4bc0-87c9-f24e47a845bd\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:48:38.675370 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:38.675347    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/1b73e782-fcb6-4bc0-87c9-f24e47a845bd-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-0\" (UID: \"1b73e782-fcb6-4bc0-87c9-f24e47a845bd\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:48:38.675674 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:38.675655    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/1b73e782-fcb6-4bc0-87c9-f24e47a845bd-monitoring-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"1b73e782-fcb6-4bc0-87c9-f24e47a845bd\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:48:38.738299 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:38.738258    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8wk4c\" (UniqueName: \"kubernetes.io/projected/1b73e782-fcb6-4bc0-87c9-f24e47a845bd-kube-api-access-8wk4c\") pod \"data-science-collector-collector-0\" (UID: \"1b73e782-fcb6-4bc0-87c9-f24e47a845bd\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:48:39.177544 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:39.177506    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/1b73e782-fcb6-4bc0-87c9-f24e47a845bd-otlp-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"1b73e782-fcb6-4bc0-87c9-f24e47a845bd\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:48:39.179941 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:39.179920    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/1b73e782-fcb6-4bc0-87c9-f24e47a845bd-otlp-tls-certs\") pod \"data-science-collector-collector-0\" (UID: \"1b73e782-fcb6-4bc0-87c9-f24e47a845bd\") " pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:48:39.433578 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:39.433500    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:48:39.808548 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:39.808510    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:48:39.838416 ip-10-0-142-4 kubenswrapper[4060]: W1030 21:48:39.838384    4060 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b73e782_fcb6_4bc0_87c9_f24e47a845bd.slice/crio-49d763753f56b842cf3e11b3613ac48a60dd09262205351af3d8106d6f6318b6 WatchSource:0}: Error finding container 49d763753f56b842cf3e11b3613ac48a60dd09262205351af3d8106d6f6318b6: Status 404 returned error can't find the container with id 49d763753f56b842cf3e11b3613ac48a60dd09262205351af3d8106d6f6318b6
Oct 30 21:48:39.840646 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:39.840616    4060 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 21:48:39.840723 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:39.840693    4060 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236072Ki","pods":"250"}
Oct 30 21:48:40.139936 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:40.139837    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"1b73e782-fcb6-4bc0-87c9-f24e47a845bd","Type":"ContainerStarted","Data":"da856298b54452b3d56e79f51564eae5907d037e039164cc9695cbaa2b1f7843"}
Oct 30 21:48:40.139936 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:40.139906    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"1b73e782-fcb6-4bc0-87c9-f24e47a845bd","Type":"ContainerStarted","Data":"49d763753f56b842cf3e11b3613ac48a60dd09262205351af3d8106d6f6318b6"}
Oct 30 21:48:40.259371 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:40.259311    4060 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-collector-0" podStartSLOduration=2.259293123 podStartE2EDuration="2.259293123s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:48:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:48:40.258049436 +0000 UTC m=+4339.015047752" watchObservedRunningTime="2026-10-30 21:48:40.259293123 +0000 UTC m=+4339.016291423"
Oct 30 21:48:41.123267 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:41.123238    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-w5vd6"
Oct 30 21:48:42.151964 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:48:42.151927    4060 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v2f4x" containerName="extractor"
Oct 30 21:48:46.122663 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:46.122633    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-96ddv"
Oct 30 21:48:52.553953 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:52.553921    4060 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"]
Oct 30 21:48:52.557793 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:52.557770    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:48:52.608401 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:52.608363    4060 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"]
Oct 30 21:48:52.612454 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:52.612438    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:48:52.653356 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:52.653329    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"alertmanager-data-science-monitoringstack-generated\""
Oct 30 21:48:52.653580 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:52.653328    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"alertmanager-data-science-monitoringstack-cluster-tls-config\""
Oct 30 21:48:52.653580 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:52.653406    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-monitoringstack-alertmanager-dockercfg-dm52q\""
Oct 30 21:48:52.653831 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:52.653421    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"alertmanager-data-science-monitoringstack-tls-assets-0\""
Oct 30 21:48:52.653831 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:52.653425    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"alertmanager-data-science-monitoringstack-web-config\""
Oct 30 21:48:52.655869 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:52.655846    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"]
Oct 30 21:48:52.665243 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:52.665222    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"prometheus-data-science-monitoringstack-rulefiles-2\""
Oct 30 21:48:52.665403 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:52.665388    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"prometheus-data-science-monitoringstack-rulefiles-1\""
Oct 30 21:48:52.665403 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:52.665398    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"prometheus-data-science-monitoringstack-rulefiles-0\""
Oct 30 21:48:52.702585 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:52.702552    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fdb7e0b7-337e-4055-b601-386203d23d57-tls-assets\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"fdb7e0b7-337e-4055-b601-386203d23d57\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:48:52.702755 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:52.702607    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-data-science-monitoringstack-db\" (UniqueName: \"kubernetes.io/empty-dir/fdb7e0b7-337e-4055-b601-386203d23d57-alertmanager-data-science-monitoringstack-db\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"fdb7e0b7-337e-4055-b601-386203d23d57\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:48:52.702815 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:52.702788    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fdb7e0b7-337e-4055-b601-386203d23d57-web-config\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"fdb7e0b7-337e-4055-b601-386203d23d57\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:48:52.702857 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:52.702830    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/fdb7e0b7-337e-4055-b601-386203d23d57-cluster-tls-config\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"fdb7e0b7-337e-4055-b601-386203d23d57\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:48:52.702915 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:52.702876    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fdb7e0b7-337e-4055-b601-386203d23d57-config-out\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"fdb7e0b7-337e-4055-b601-386203d23d57\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:48:52.703013 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:52.702975    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/fdb7e0b7-337e-4055-b601-386203d23d57-config-volume\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"fdb7e0b7-337e-4055-b601-386203d23d57\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:48:52.703064 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:52.703022    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k4czd\" (UniqueName: \"kubernetes.io/projected/fdb7e0b7-337e-4055-b601-386203d23d57-kube-api-access-k4czd\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"fdb7e0b7-337e-4055-b601-386203d23d57\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:48:52.704940 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:52.704921    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"]
Oct 30 21:48:52.710158 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:52.710137    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"prometheus-data-science-monitoringstack-web-config\""
Oct 30 21:48:52.710283 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:52.710171    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"prometheus-data-science-monitoringstack\""
Oct 30 21:48:52.710283 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:52.710178    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"prometheus-data-science-monitoringstack-tls-assets-0\""
Oct 30 21:48:52.710283 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:52.710172    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"prometheus-web-tls-ca\""
Oct 30 21:48:52.710283 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:52.710213    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"prometheus-data-science-monitoringstack-thanos-prometheus-http-client-file\""
Oct 30 21:48:52.710283 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:52.710265    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-monitoringstack-prometheus-dockercfg-969ts\""
Oct 30 21:48:52.804418 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:52.804341    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-web-tls-ca\" (UniqueName: \"kubernetes.io/secret/f5bde344-2b50-40f6-96c9-a661322860d3-secret-prometheus-web-tls-ca\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"f5bde344-2b50-40f6-96c9-a661322860d3\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:48:52.804418 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:52.804369    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f5bde344-2b50-40f6-96c9-a661322860d3-web-config\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"f5bde344-2b50-40f6-96c9-a661322860d3\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:48:52.804418 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:52.804390    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f5bde344-2b50-40f6-96c9-a661322860d3-config\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"f5bde344-2b50-40f6-96c9-a661322860d3\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:48:52.804748 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:52.804446    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-data-science-monitoringstack-db\" (UniqueName: \"kubernetes.io/empty-dir/fdb7e0b7-337e-4055-b601-386203d23d57-alertmanager-data-science-monitoringstack-db\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"fdb7e0b7-337e-4055-b601-386203d23d57\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:48:52.804748 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:52.804562    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-data-science-monitoringstack-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f5bde344-2b50-40f6-96c9-a661322860d3-prometheus-data-science-monitoringstack-rulefiles-2\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"f5bde344-2b50-40f6-96c9-a661322860d3\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:48:52.804748 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:52.804591    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fdb7e0b7-337e-4055-b601-386203d23d57-web-config\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"fdb7e0b7-337e-4055-b601-386203d23d57\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:48:52.804748 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:52.804608    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f5bde344-2b50-40f6-96c9-a661322860d3-tls-assets\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"f5bde344-2b50-40f6-96c9-a661322860d3\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:48:52.804748 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:52.804627    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config-tls-secret-cert-prometheus-operated-tls-f3457c70\" (UniqueName: \"kubernetes.io/secret/f5bde344-2b50-40f6-96c9-a661322860d3-web-config-tls-secret-cert-prometheus-operated-tls-f3457c70\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"f5bde344-2b50-40f6-96c9-a661322860d3\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:48:52.804748 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:52.804731    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f5bde344-2b50-40f6-96c9-a661322860d3-thanos-prometheus-http-client-file\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"f5bde344-2b50-40f6-96c9-a661322860d3\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:48:52.804748 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:52.804752    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-869lj\" (UniqueName: \"kubernetes.io/projected/f5bde344-2b50-40f6-96c9-a661322860d3-kube-api-access-869lj\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"f5bde344-2b50-40f6-96c9-a661322860d3\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:48:52.805138 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:52.804758    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-data-science-monitoringstack-db\" (UniqueName: \"kubernetes.io/empty-dir/fdb7e0b7-337e-4055-b601-386203d23d57-alertmanager-data-science-monitoringstack-db\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"fdb7e0b7-337e-4055-b601-386203d23d57\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:48:52.805138 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:52.804770    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/fdb7e0b7-337e-4055-b601-386203d23d57-cluster-tls-config\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"fdb7e0b7-337e-4055-b601-386203d23d57\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:48:52.805138 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:52.804986    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fdb7e0b7-337e-4055-b601-386203d23d57-config-out\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"fdb7e0b7-337e-4055-b601-386203d23d57\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:48:52.805138 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:52.805002    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f5bde344-2b50-40f6-96c9-a661322860d3-config-out\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"f5bde344-2b50-40f6-96c9-a661322860d3\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:48:52.805138 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:52.805052    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/fdb7e0b7-337e-4055-b601-386203d23d57-config-volume\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"fdb7e0b7-337e-4055-b601-386203d23d57\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:48:52.805138 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:52.805072    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k4czd\" (UniqueName: \"kubernetes.io/projected/fdb7e0b7-337e-4055-b601-386203d23d57-kube-api-access-k4czd\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"fdb7e0b7-337e-4055-b601-386203d23d57\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:48:52.805138 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:52.805094    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config-tls-secret-key-prometheus-operated-tls-f3457c70\" (UniqueName: \"kubernetes.io/secret/f5bde344-2b50-40f6-96c9-a661322860d3-web-config-tls-secret-key-prometheus-operated-tls-f3457c70\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"f5bde344-2b50-40f6-96c9-a661322860d3\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:48:52.805539 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:52.805142    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fdb7e0b7-337e-4055-b601-386203d23d57-tls-assets\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"fdb7e0b7-337e-4055-b601-386203d23d57\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:48:52.805539 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:52.805172    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-data-science-monitoringstack-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f5bde344-2b50-40f6-96c9-a661322860d3-prometheus-data-science-monitoringstack-rulefiles-1\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"f5bde344-2b50-40f6-96c9-a661322860d3\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:48:52.805539 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:52.805201    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-data-science-monitoringstack-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f5bde344-2b50-40f6-96c9-a661322860d3-prometheus-data-science-monitoringstack-rulefiles-0\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"f5bde344-2b50-40f6-96c9-a661322860d3\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:48:52.807426 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:52.807397    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fdb7e0b7-337e-4055-b601-386203d23d57-config-out\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"fdb7e0b7-337e-4055-b601-386203d23d57\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:48:52.807553 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:52.807440    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/fdb7e0b7-337e-4055-b601-386203d23d57-config-volume\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"fdb7e0b7-337e-4055-b601-386203d23d57\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:48:52.807663 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:52.807642    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fdb7e0b7-337e-4055-b601-386203d23d57-web-config\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"fdb7e0b7-337e-4055-b601-386203d23d57\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:48:52.807931 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:52.807911    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fdb7e0b7-337e-4055-b601-386203d23d57-tls-assets\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"fdb7e0b7-337e-4055-b601-386203d23d57\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:48:52.808038 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:52.808022    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/fdb7e0b7-337e-4055-b601-386203d23d57-cluster-tls-config\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"fdb7e0b7-337e-4055-b601-386203d23d57\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:48:52.867165 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:52.867136    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k4czd\" (UniqueName: \"kubernetes.io/projected/fdb7e0b7-337e-4055-b601-386203d23d57-kube-api-access-k4czd\") pod \"alertmanager-data-science-monitoringstack-0\" (UID: \"fdb7e0b7-337e-4055-b601-386203d23d57\") " pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:48:52.874916 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:52.874886    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:48:52.906278 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:52.906248    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f5bde344-2b50-40f6-96c9-a661322860d3-tls-assets\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"f5bde344-2b50-40f6-96c9-a661322860d3\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:48:52.906435 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:52.906283    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config-tls-secret-cert-prometheus-operated-tls-f3457c70\" (UniqueName: \"kubernetes.io/secret/f5bde344-2b50-40f6-96c9-a661322860d3-web-config-tls-secret-cert-prometheus-operated-tls-f3457c70\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"f5bde344-2b50-40f6-96c9-a661322860d3\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:48:52.906435 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:52.906303    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f5bde344-2b50-40f6-96c9-a661322860d3-thanos-prometheus-http-client-file\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"f5bde344-2b50-40f6-96c9-a661322860d3\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:48:52.906435 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:52.906328    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-869lj\" (UniqueName: \"kubernetes.io/projected/f5bde344-2b50-40f6-96c9-a661322860d3-kube-api-access-869lj\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"f5bde344-2b50-40f6-96c9-a661322860d3\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:48:52.906435 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:52.906369    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f5bde344-2b50-40f6-96c9-a661322860d3-config-out\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"f5bde344-2b50-40f6-96c9-a661322860d3\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:48:52.906435 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:52.906410    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config-tls-secret-key-prometheus-operated-tls-f3457c70\" (UniqueName: \"kubernetes.io/secret/f5bde344-2b50-40f6-96c9-a661322860d3-web-config-tls-secret-key-prometheus-operated-tls-f3457c70\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"f5bde344-2b50-40f6-96c9-a661322860d3\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:48:52.906723 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:52.906468    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-data-science-monitoringstack-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f5bde344-2b50-40f6-96c9-a661322860d3-prometheus-data-science-monitoringstack-rulefiles-1\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"f5bde344-2b50-40f6-96c9-a661322860d3\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:48:52.906723 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:52.906519    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-data-science-monitoringstack-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f5bde344-2b50-40f6-96c9-a661322860d3-prometheus-data-science-monitoringstack-rulefiles-0\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"f5bde344-2b50-40f6-96c9-a661322860d3\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:48:52.906723 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:52.906563    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-web-tls-ca\" (UniqueName: \"kubernetes.io/secret/f5bde344-2b50-40f6-96c9-a661322860d3-secret-prometheus-web-tls-ca\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"f5bde344-2b50-40f6-96c9-a661322860d3\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:48:52.906723 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:52.906587    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f5bde344-2b50-40f6-96c9-a661322860d3-web-config\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"f5bde344-2b50-40f6-96c9-a661322860d3\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:48:52.906723 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:52.906615    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f5bde344-2b50-40f6-96c9-a661322860d3-config\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"f5bde344-2b50-40f6-96c9-a661322860d3\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:48:52.906723 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:52.906655    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-data-science-monitoringstack-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f5bde344-2b50-40f6-96c9-a661322860d3-prometheus-data-science-monitoringstack-rulefiles-2\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"f5bde344-2b50-40f6-96c9-a661322860d3\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:48:52.907398 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:52.907368    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-data-science-monitoringstack-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f5bde344-2b50-40f6-96c9-a661322860d3-prometheus-data-science-monitoringstack-rulefiles-2\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"f5bde344-2b50-40f6-96c9-a661322860d3\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:48:52.907823 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:52.907790    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-data-science-monitoringstack-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f5bde344-2b50-40f6-96c9-a661322860d3-prometheus-data-science-monitoringstack-rulefiles-0\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"f5bde344-2b50-40f6-96c9-a661322860d3\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:48:52.908362 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:52.908332    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-data-science-monitoringstack-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f5bde344-2b50-40f6-96c9-a661322860d3-prometheus-data-science-monitoringstack-rulefiles-1\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"f5bde344-2b50-40f6-96c9-a661322860d3\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:48:52.909477 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:52.909457    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f5bde344-2b50-40f6-96c9-a661322860d3-config-out\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"f5bde344-2b50-40f6-96c9-a661322860d3\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:48:52.909676 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:52.909648    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config-tls-secret-key-prometheus-operated-tls-f3457c70\" (UniqueName: \"kubernetes.io/secret/f5bde344-2b50-40f6-96c9-a661322860d3-web-config-tls-secret-key-prometheus-operated-tls-f3457c70\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"f5bde344-2b50-40f6-96c9-a661322860d3\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:48:52.909755 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:52.909734    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f5bde344-2b50-40f6-96c9-a661322860d3-web-config\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"f5bde344-2b50-40f6-96c9-a661322860d3\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:48:52.910232 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:52.910211    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f5bde344-2b50-40f6-96c9-a661322860d3-thanos-prometheus-http-client-file\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"f5bde344-2b50-40f6-96c9-a661322860d3\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:48:52.910562 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:52.910537    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/f5bde344-2b50-40f6-96c9-a661322860d3-config\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"f5bde344-2b50-40f6-96c9-a661322860d3\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:48:52.910711 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:52.910692    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config-tls-secret-cert-prometheus-operated-tls-f3457c70\" (UniqueName: \"kubernetes.io/secret/f5bde344-2b50-40f6-96c9-a661322860d3-web-config-tls-secret-cert-prometheus-operated-tls-f3457c70\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"f5bde344-2b50-40f6-96c9-a661322860d3\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:48:52.911546 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:52.911528    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f5bde344-2b50-40f6-96c9-a661322860d3-tls-assets\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"f5bde344-2b50-40f6-96c9-a661322860d3\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:48:52.911941 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:52.911921    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-web-tls-ca\" (UniqueName: \"kubernetes.io/secret/f5bde344-2b50-40f6-96c9-a661322860d3-secret-prometheus-web-tls-ca\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"f5bde344-2b50-40f6-96c9-a661322860d3\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:48:52.968797 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:52.968766    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-869lj\" (UniqueName: \"kubernetes.io/projected/f5bde344-2b50-40f6-96c9-a661322860d3-kube-api-access-869lj\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"f5bde344-2b50-40f6-96c9-a661322860d3\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:48:53.301666 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:53.301638    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"]
Oct 30 21:48:53.303790 ip-10-0-142-4 kubenswrapper[4060]: W1030 21:48:53.303763    4060 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfdb7e0b7_337e_4055_b601_386203d23d57.slice/crio-1ae37f59467a526689e60993ee0b2cb64c00dca51a2a3151e16f5beb70a8e374 WatchSource:0}: Error finding container 1ae37f59467a526689e60993ee0b2cb64c00dca51a2a3151e16f5beb70a8e374: Status 404 returned error can't find the container with id 1ae37f59467a526689e60993ee0b2cb64c00dca51a2a3151e16f5beb70a8e374
Oct 30 21:48:54.207033 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:54.206994    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0" event={"ID":"fdb7e0b7-337e-4055-b601-386203d23d57","Type":"ContainerStarted","Data":"bc95f9bd35ed9c22dfc6fb20c69f83e2fff69d59b0c330cf795d7b2677806ac8"}
Oct 30 21:48:54.207464 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:54.207053    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0" event={"ID":"fdb7e0b7-337e-4055-b601-386203d23d57","Type":"ContainerStarted","Data":"1ae37f59467a526689e60993ee0b2cb64c00dca51a2a3151e16f5beb70a8e374"}
Oct 30 21:48:57.222000 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:57.221966    4060 generic.go:356] "Generic (PLEG): container finished" podID="fdb7e0b7-337e-4055-b601-386203d23d57" containerID="bc95f9bd35ed9c22dfc6fb20c69f83e2fff69d59b0c330cf795d7b2677806ac8" exitCode=0
Oct 30 21:48:57.222408 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:57.222037    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0" event={"ID":"fdb7e0b7-337e-4055-b601-386203d23d57","Type":"ContainerDied","Data":"bc95f9bd35ed9c22dfc6fb20c69f83e2fff69d59b0c330cf795d7b2677806ac8"}
Oct 30 21:48:58.228509 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:58.228457    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0" event={"ID":"fdb7e0b7-337e-4055-b601-386203d23d57","Type":"ContainerStarted","Data":"3384ec5022f19b93b7a419467f2a76cb8fd99398f82039d18abdb787b8ea8044"}
Oct 30 21:48:58.228910 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:58.228533    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0" event={"ID":"fdb7e0b7-337e-4055-b601-386203d23d57","Type":"ContainerStarted","Data":"b1e98b2449ae6f7c34405eb2715a7bfa7bdab4c1adff60cb664c10743598ed6e"}
Oct 30 21:48:58.228910 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:58.228711    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:48:58.401623 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:48:58.401566    4060 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0" podStartSLOduration=3.015115698 podStartE2EDuration="6.401549118s" totalImagesPullingTime="0s" totalInitContainerRuntime="3.38643342s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:48:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:48:58.400404595 +0000 UTC m=+4357.157402924" watchObservedRunningTime="2026-10-30 21:48:58.401549118 +0000 UTC m=+4357.158547416"
Oct 30 21:49:00.470444 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:00.470408    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-e73afc79-aa37-49a0-8744-633c03cad1f4\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a155a55c1ce0e65b\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"f5bde344-2b50-40f6-96c9-a661322860d3\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:49:00.574336 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:00.574301    4060 operation_generator.go:1464] "Controller attach succeeded for volume \"pvc-e73afc79-aa37-49a0-8744-633c03cad1f4\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a155a55c1ce0e65b\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"f5bde344-2b50-40f6-96c9-a661322860d3\") device path: \"\"" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:49:00.672382 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:00.672335    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"pvc-e73afc79-aa37-49a0-8744-633c03cad1f4\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a155a55c1ce0e65b\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"f5bde344-2b50-40f6-96c9-a661322860d3\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:49:00.672623 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:00.672480    4060 operation_generator.go:515] "MountVolume.WaitForAttach entering for volume \"pvc-e73afc79-aa37-49a0-8744-633c03cad1f4\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a155a55c1ce0e65b\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"f5bde344-2b50-40f6-96c9-a661322860d3\") DevicePath \"\"" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:49:00.724050 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:00.723969    4060 operation_generator.go:525] "MountVolume.WaitForAttach succeeded for volume \"pvc-e73afc79-aa37-49a0-8744-633c03cad1f4\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a155a55c1ce0e65b\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"f5bde344-2b50-40f6-96c9-a661322860d3\") DevicePath \"csi-7011c01335d2502f76be252f9498c79824668beecf30ee8f6a7191145201ca4c\"" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:49:00.863863 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:00.863815    4060 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"pvc-e73afc79-aa37-49a0-8744-633c03cad1f4\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a155a55c1ce0e65b\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"f5bde344-2b50-40f6-96c9-a661322860d3\") device mount path \"/var/lib/kubelet/plugins/kubernetes.io/csi/ebs.csi.aws.com/fb02f91ab75afdcfd8c2ac3eaeb0ba7303c67490d38fe3164f5fc7856f2f1875/globalmount\"" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:49:00.928096 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:00.928066    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pvc-e73afc79-aa37-49a0-8744-633c03cad1f4\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a155a55c1ce0e65b\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"f5bde344-2b50-40f6-96c9-a661322860d3\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:49:01.032363 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:01.032287    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:49:01.511814 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:01.511787    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"]
Oct 30 21:49:01.543102 ip-10-0-142-4 kubenswrapper[4060]: W1030 21:49:01.543064    4060 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5bde344_2b50_40f6_96c9_a661322860d3.slice/crio-e2cb48a993c9d01748203fdf770c478f23b1230400e81d6ff2f4899bef5ffb22 WatchSource:0}: Error finding container e2cb48a993c9d01748203fdf770c478f23b1230400e81d6ff2f4899bef5ffb22: Status 404 returned error can't find the container with id e2cb48a993c9d01748203fdf770c478f23b1230400e81d6ff2f4899bef5ffb22
Oct 30 21:49:02.249382 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:02.249289    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0" event={"ID":"f5bde344-2b50-40f6-96c9-a661322860d3","Type":"ContainerStarted","Data":"df50f5143b43e442a474aabb9e83499526086d7b5d07ddb9ef7c737e277735b1"}
Oct 30 21:49:02.249382 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:02.249366    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0" event={"ID":"f5bde344-2b50-40f6-96c9-a661322860d3","Type":"ContainerStarted","Data":"e2cb48a993c9d01748203fdf770c478f23b1230400e81d6ff2f4899bef5ffb22"}
Oct 30 21:49:04.234445 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:04.234413    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:49:06.269608 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:06.269578    4060 generic.go:356] "Generic (PLEG): container finished" podID="f5bde344-2b50-40f6-96c9-a661322860d3" containerID="df50f5143b43e442a474aabb9e83499526086d7b5d07ddb9ef7c737e277735b1" exitCode=0
Oct 30 21:49:06.270037 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:06.269648    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0" event={"ID":"f5bde344-2b50-40f6-96c9-a661322860d3","Type":"ContainerDied","Data":"df50f5143b43e442a474aabb9e83499526086d7b5d07ddb9ef7c737e277735b1"}
Oct 30 21:49:07.277041 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:07.277003    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0" event={"ID":"f5bde344-2b50-40f6-96c9-a661322860d3","Type":"ContainerStarted","Data":"d4ebd97cfbb0e8fb332cf341648f859104007d001866ffe33c68222888252988"}
Oct 30 21:49:07.277453 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:07.277071    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0" event={"ID":"f5bde344-2b50-40f6-96c9-a661322860d3","Type":"ContainerStarted","Data":"725dac8cb20eb6ec45cfbfa43f491584459a8868cf1bda536e6037d41a4f2e77"}
Oct 30 21:49:07.277453 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:07.277094    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0" event={"ID":"f5bde344-2b50-40f6-96c9-a661322860d3","Type":"ContainerStarted","Data":"fcdc4e1eb583e9e4b85b70ee20ec155e75745cfd8b59310516b30cec88eabad8"}
Oct 30 21:49:07.485827 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:07.485781    4060 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0" podStartSLOduration=12.001014854 podStartE2EDuration="15.485768811s" totalImagesPullingTime="0s" totalInitContainerRuntime="3.484753957s" isStatefulPod=true podCreationTimestamp="2026-10-30 21:48:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:49:07.455637148 +0000 UTC m=+4366.212635459" watchObservedRunningTime="2026-10-30 21:49:07.485768811 +0000 UTC m=+4366.242767108"
Oct 30 21:49:11.032507 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:11.032462    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:49:12.151801 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:49:12.151764    4060 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v2f4x" containerName="extractor"
Oct 30 21:49:16.033301 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:16.033273    4060 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:49:16.038779 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:16.038757    4060 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:49:16.324186 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:16.324102    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:49:33.070816 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:33.070779    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-w5vd6"]
Oct 30 21:49:33.071260 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:33.071046    4060 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-w5vd6" podUID="798689a4-7697-4238-b20f-00c5620c5eb4" containerName="kube-rbac-proxy" containerID="cri-o://33d587467cadf028c1de10724069f81e615614fdddb3f98952770c9d940c3f59" gracePeriod=30
Oct 30 21:49:33.226156 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:33.226118    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/korrel8r-5cbcc89b8f-96ddv"]
Oct 30 21:49:33.226387 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:33.226353    4060 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-96ddv" podUID="f3df7a4d-f910-432e-ae0c-93dcbabb6313" containerName="korrel8r" containerID="cri-o://5b1feeee110cff4eadd4b43c86a364625ae12315fb90a5a5a942ece62095cd3c" gracePeriod=30
Oct 30 21:49:33.350360 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:33.350334    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-w5vd6"
Oct 30 21:49:33.400078 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:33.400046    4060 generic.go:356] "Generic (PLEG): container finished" podID="f3df7a4d-f910-432e-ae0c-93dcbabb6313" containerID="5b1feeee110cff4eadd4b43c86a364625ae12315fb90a5a5a942ece62095cd3c" exitCode=0
Oct 30 21:49:33.400253 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:33.400159    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-96ddv" event={"ID":"f3df7a4d-f910-432e-ae0c-93dcbabb6313","Type":"ContainerDied","Data":"5b1feeee110cff4eadd4b43c86a364625ae12315fb90a5a5a942ece62095cd3c"}
Oct 30 21:49:33.402201 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:33.402178    4060 generic.go:356] "Generic (PLEG): container finished" podID="798689a4-7697-4238-b20f-00c5620c5eb4" containerID="33d587467cadf028c1de10724069f81e615614fdddb3f98952770c9d940c3f59" exitCode=0
Oct 30 21:49:33.402327 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:33.402244    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-w5vd6"
Oct 30 21:49:33.402327 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:33.402250    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-w5vd6" event={"ID":"798689a4-7697-4238-b20f-00c5620c5eb4","Type":"ContainerDied","Data":"33d587467cadf028c1de10724069f81e615614fdddb3f98952770c9d940c3f59"}
Oct 30 21:49:33.402327 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:33.402291    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-w5vd6" event={"ID":"798689a4-7697-4238-b20f-00c5620c5eb4","Type":"ContainerDied","Data":"683dc37280c071dc55978865d46e061fc2581b28e877278514f82dae0cfeb1ba"}
Oct 30 21:49:33.402552 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:33.402338    4060 scope.go:122] "RemoveContainer" containerID="33d587467cadf028c1de10724069f81e615614fdddb3f98952770c9d940c3f59"
Oct 30 21:49:33.410975 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:33.410934    4060 scope.go:122] "RemoveContainer" containerID="33d587467cadf028c1de10724069f81e615614fdddb3f98952770c9d940c3f59"
Oct 30 21:49:33.411255 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:49:33.411233    4060 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"33d587467cadf028c1de10724069f81e615614fdddb3f98952770c9d940c3f59\": container with ID starting with 33d587467cadf028c1de10724069f81e615614fdddb3f98952770c9d940c3f59 not found: ID does not exist" containerID="33d587467cadf028c1de10724069f81e615614fdddb3f98952770c9d940c3f59"
Oct 30 21:49:33.411334 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:33.411268    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"33d587467cadf028c1de10724069f81e615614fdddb3f98952770c9d940c3f59"} err="failed to get container status \"33d587467cadf028c1de10724069f81e615614fdddb3f98952770c9d940c3f59\": rpc error: code = NotFound desc = could not find container \"33d587467cadf028c1de10724069f81e615614fdddb3f98952770c9d940c3f59\": container with ID starting with 33d587467cadf028c1de10724069f81e615614fdddb3f98952770c9d940c3f59 not found: ID does not exist"
Oct 30 21:49:33.442107 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:33.442077    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/798689a4-7697-4238-b20f-00c5620c5eb4-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/798689a4-7697-4238-b20f-00c5620c5eb4-kube-rbac-proxy-config\") pod \"798689a4-7697-4238-b20f-00c5620c5eb4\" (UID: \"798689a4-7697-4238-b20f-00c5620c5eb4\") "
Oct 30 21:49:33.442264 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:33.442113    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/798689a4-7697-4238-b20f-00c5620c5eb4-tls\" (UniqueName: \"kubernetes.io/secret/798689a4-7697-4238-b20f-00c5620c5eb4-tls\") pod \"798689a4-7697-4238-b20f-00c5620c5eb4\" (UID: \"798689a4-7697-4238-b20f-00c5620c5eb4\") "
Oct 30 21:49:33.442264 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:33.442148    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/798689a4-7697-4238-b20f-00c5620c5eb4-prometheus-ca\" (UniqueName: \"kubernetes.io/configmap/798689a4-7697-4238-b20f-00c5620c5eb4-prometheus-ca\") pod \"798689a4-7697-4238-b20f-00c5620c5eb4\" (UID: \"798689a4-7697-4238-b20f-00c5620c5eb4\") "
Oct 30 21:49:33.442264 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:33.442180    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/798689a4-7697-4238-b20f-00c5620c5eb4-kube-api-access-bcpxd\" (UniqueName: \"kubernetes.io/projected/798689a4-7697-4238-b20f-00c5620c5eb4-kube-api-access-bcpxd\") pod \"798689a4-7697-4238-b20f-00c5620c5eb4\" (UID: \"798689a4-7697-4238-b20f-00c5620c5eb4\") "
Oct 30 21:49:33.442264 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:33.442205    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/798689a4-7697-4238-b20f-00c5620c5eb4-prometheus-client-cert\" (UniqueName: \"kubernetes.io/secret/798689a4-7697-4238-b20f-00c5620c5eb4-prometheus-client-cert\") pod \"798689a4-7697-4238-b20f-00c5620c5eb4\" (UID: \"798689a4-7697-4238-b20f-00c5620c5eb4\") "
Oct 30 21:49:33.442580 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:33.442554    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/798689a4-7697-4238-b20f-00c5620c5eb4-prometheus-ca" pod "798689a4-7697-4238-b20f-00c5620c5eb4" (UID: "798689a4-7697-4238-b20f-00c5620c5eb4"). InnerVolumeSpecName "prometheus-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:49:33.444347 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:33.444319    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/798689a4-7697-4238-b20f-00c5620c5eb4-tls" pod "798689a4-7697-4238-b20f-00c5620c5eb4" (UID: "798689a4-7697-4238-b20f-00c5620c5eb4"). InnerVolumeSpecName "tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:49:33.444347 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:33.444334    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/798689a4-7697-4238-b20f-00c5620c5eb4-prometheus-client-cert" pod "798689a4-7697-4238-b20f-00c5620c5eb4" (UID: "798689a4-7697-4238-b20f-00c5620c5eb4"). InnerVolumeSpecName "prometheus-client-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:49:33.444509 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:33.444351    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/798689a4-7697-4238-b20f-00c5620c5eb4-kube-rbac-proxy-config" pod "798689a4-7697-4238-b20f-00c5620c5eb4" (UID: "798689a4-7697-4238-b20f-00c5620c5eb4"). InnerVolumeSpecName "kube-rbac-proxy-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:49:33.444589 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:33.444566    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/798689a4-7697-4238-b20f-00c5620c5eb4-kube-api-access-bcpxd" pod "798689a4-7697-4238-b20f-00c5620c5eb4" (UID: "798689a4-7697-4238-b20f-00c5620c5eb4"). InnerVolumeSpecName "kube-api-access-bcpxd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:49:33.459293 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:33.459272    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-96ddv"
Oct 30 21:49:33.543159 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:33.543130    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/f3df7a4d-f910-432e-ae0c-93dcbabb6313-tls\" (UniqueName: \"kubernetes.io/secret/f3df7a4d-f910-432e-ae0c-93dcbabb6313-tls\") pod \"f3df7a4d-f910-432e-ae0c-93dcbabb6313\" (UID: \"f3df7a4d-f910-432e-ae0c-93dcbabb6313\") "
Oct 30 21:49:33.543327 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:33.543175    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f3df7a4d-f910-432e-ae0c-93dcbabb6313-kube-api-access-nssdf\" (UniqueName: \"kubernetes.io/projected/f3df7a4d-f910-432e-ae0c-93dcbabb6313-kube-api-access-nssdf\") pod \"f3df7a4d-f910-432e-ae0c-93dcbabb6313\" (UID: \"f3df7a4d-f910-432e-ae0c-93dcbabb6313\") "
Oct 30 21:49:33.543327 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:33.543211    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/f3df7a4d-f910-432e-ae0c-93dcbabb6313-config\" (UniqueName: \"kubernetes.io/configmap/f3df7a4d-f910-432e-ae0c-93dcbabb6313-config\") pod \"f3df7a4d-f910-432e-ae0c-93dcbabb6313\" (UID: \"f3df7a4d-f910-432e-ae0c-93dcbabb6313\") "
Oct 30 21:49:33.543464 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:33.543399    4060 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bcpxd\" (UniqueName: \"kubernetes.io/projected/798689a4-7697-4238-b20f-00c5620c5eb4-kube-api-access-bcpxd\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:49:33.543464 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:33.543410    4060 reconciler_common.go:299] "Volume detached for volume \"prometheus-client-cert\" (UniqueName: \"kubernetes.io/secret/798689a4-7697-4238-b20f-00c5620c5eb4-prometheus-client-cert\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:49:33.543464 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:33.543420    4060 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/798689a4-7697-4238-b20f-00c5620c5eb4-kube-rbac-proxy-config\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:49:33.543464 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:33.543432    4060 reconciler_common.go:299] "Volume detached for volume \"tls\" (UniqueName: \"kubernetes.io/secret/798689a4-7697-4238-b20f-00c5620c5eb4-tls\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:49:33.543464 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:33.543441    4060 reconciler_common.go:299] "Volume detached for volume \"prometheus-ca\" (UniqueName: \"kubernetes.io/configmap/798689a4-7697-4238-b20f-00c5620c5eb4-prometheus-ca\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:49:33.543812 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:33.543727    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f3df7a4d-f910-432e-ae0c-93dcbabb6313-config" pod "f3df7a4d-f910-432e-ae0c-93dcbabb6313" (UID: "f3df7a4d-f910-432e-ae0c-93dcbabb6313"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:49:33.545335 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:33.545310    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f3df7a4d-f910-432e-ae0c-93dcbabb6313-tls" pod "f3df7a4d-f910-432e-ae0c-93dcbabb6313" (UID: "f3df7a4d-f910-432e-ae0c-93dcbabb6313"). InnerVolumeSpecName "tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:49:33.545480 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:33.545457    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f3df7a4d-f910-432e-ae0c-93dcbabb6313-kube-api-access-nssdf" pod "f3df7a4d-f910-432e-ae0c-93dcbabb6313" (UID: "f3df7a4d-f910-432e-ae0c-93dcbabb6313"). InnerVolumeSpecName "kube-api-access-nssdf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:49:33.643979 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:33.643908    4060 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nssdf\" (UniqueName: \"kubernetes.io/projected/f3df7a4d-f910-432e-ae0c-93dcbabb6313-kube-api-access-nssdf\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:49:33.643979 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:33.643932    4060 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f3df7a4d-f910-432e-ae0c-93dcbabb6313-config\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:49:33.643979 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:33.643944    4060 reconciler_common.go:299] "Volume detached for volume \"tls\" (UniqueName: \"kubernetes.io/secret/f3df7a4d-f910-432e-ae0c-93dcbabb6313-tls\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:49:33.822069 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:33.822035    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-w5vd6"]
Oct 30 21:49:33.826099 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:33.826072    4060 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-prometheus-cluster-proxy-545f759f7c-w5vd6"]
Oct 30 21:49:34.409149 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:34.409079    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-96ddv"
Oct 30 21:49:34.409586 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:34.409078    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/korrel8r-5cbcc89b8f-96ddv" event={"ID":"f3df7a4d-f910-432e-ae0c-93dcbabb6313","Type":"ContainerDied","Data":"0e40f5dddf4ef0cf5513cb5152ad7b062b6ba96ea8f2335bee915660c43bfeb0"}
Oct 30 21:49:34.409586 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:34.409249    4060 scope.go:122] "RemoveContainer" containerID="5b1feeee110cff4eadd4b43c86a364625ae12315fb90a5a5a942ece62095cd3c"
Oct 30 21:49:34.519102 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:34.519070    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"]
Oct 30 21:49:34.519347 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:34.519325    4060 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0" podUID="fdb7e0b7-337e-4055-b601-386203d23d57" containerName="alertmanager" containerID="cri-o://b1e98b2449ae6f7c34405eb2715a7bfa7bdab4c1adff60cb664c10743598ed6e" gracePeriod=120
Oct 30 21:49:34.519426 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:34.519402    4060 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0" podUID="fdb7e0b7-337e-4055-b601-386203d23d57" containerName="config-reloader" containerID="cri-o://3384ec5022f19b93b7a419467f2a76cb8fd99398f82039d18abdb787b8ea8044" gracePeriod=120
Oct 30 21:49:34.546216 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:34.546188    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"]
Oct 30 21:49:34.546465 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:34.546439    4060 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0" podUID="f5bde344-2b50-40f6-96c9-a661322860d3" containerName="prometheus" containerID="cri-o://fcdc4e1eb583e9e4b85b70ee20ec155e75745cfd8b59310516b30cec88eabad8" gracePeriod=600
Oct 30 21:49:34.546465 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:34.546454    4060 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0" podUID="f5bde344-2b50-40f6-96c9-a661322860d3" containerName="thanos-sidecar" containerID="cri-o://d4ebd97cfbb0e8fb332cf341648f859104007d001866ffe33c68222888252988" gracePeriod=600
Oct 30 21:49:34.546656 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:34.546456    4060 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0" podUID="f5bde344-2b50-40f6-96c9-a661322860d3" containerName="config-reloader" containerID="cri-o://725dac8cb20eb6ec45cfbfa43f491584459a8868cf1bda536e6037d41a4f2e77" gracePeriod=600
Oct 30 21:49:34.578189 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:34.578165    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/korrel8r-5cbcc89b8f-96ddv"]
Oct 30 21:49:34.583452 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:34.583428    4060 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/korrel8r-5cbcc89b8f-96ddv"]
Oct 30 21:49:34.797794 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:34.797771    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:49:34.853984 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:34.853956    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/f5bde344-2b50-40f6-96c9-a661322860d3-secret-prometheus-web-tls-ca\" (UniqueName: \"kubernetes.io/secret/f5bde344-2b50-40f6-96c9-a661322860d3-secret-prometheus-web-tls-ca\") pod \"f5bde344-2b50-40f6-96c9-a661322860d3\" (UID: \"f5bde344-2b50-40f6-96c9-a661322860d3\") "
Oct 30 21:49:34.854179 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:34.853992    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f5bde344-2b50-40f6-96c9-a661322860d3-kube-api-access-869lj\" (UniqueName: \"kubernetes.io/projected/f5bde344-2b50-40f6-96c9-a661322860d3-kube-api-access-869lj\") pod \"f5bde344-2b50-40f6-96c9-a661322860d3\" (UID: \"f5bde344-2b50-40f6-96c9-a661322860d3\") "
Oct 30 21:49:34.854179 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:34.854011    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/f5bde344-2b50-40f6-96c9-a661322860d3-config\" (UniqueName: \"kubernetes.io/secret/f5bde344-2b50-40f6-96c9-a661322860d3-config\") pod \"f5bde344-2b50-40f6-96c9-a661322860d3\" (UID: \"f5bde344-2b50-40f6-96c9-a661322860d3\") "
Oct 30 21:49:34.854179 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:34.854101    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a155a55c1ce0e65b\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a155a55c1ce0e65b\") pod \"f5bde344-2b50-40f6-96c9-a661322860d3\" (UID: \"f5bde344-2b50-40f6-96c9-a661322860d3\") "
Oct 30 21:49:34.854179 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:34.854164    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/f5bde344-2b50-40f6-96c9-a661322860d3-web-config-tls-secret-cert-prometheus-operated-tls-f3457c70\" (UniqueName: \"kubernetes.io/secret/f5bde344-2b50-40f6-96c9-a661322860d3-web-config-tls-secret-cert-prometheus-operated-tls-f3457c70\") pod \"f5bde344-2b50-40f6-96c9-a661322860d3\" (UID: \"f5bde344-2b50-40f6-96c9-a661322860d3\") "
Oct 30 21:49:34.854425 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:34.854195    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/f5bde344-2b50-40f6-96c9-a661322860d3-prometheus-data-science-monitoringstack-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f5bde344-2b50-40f6-96c9-a661322860d3-prometheus-data-science-monitoringstack-rulefiles-0\") pod \"f5bde344-2b50-40f6-96c9-a661322860d3\" (UID: \"f5bde344-2b50-40f6-96c9-a661322860d3\") "
Oct 30 21:49:34.854425 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:34.854221    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/f5bde344-2b50-40f6-96c9-a661322860d3-prometheus-data-science-monitoringstack-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f5bde344-2b50-40f6-96c9-a661322860d3-prometheus-data-science-monitoringstack-rulefiles-1\") pod \"f5bde344-2b50-40f6-96c9-a661322860d3\" (UID: \"f5bde344-2b50-40f6-96c9-a661322860d3\") "
Oct 30 21:49:34.854425 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:34.854276    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/f5bde344-2b50-40f6-96c9-a661322860d3-web-config\" (UniqueName: \"kubernetes.io/secret/f5bde344-2b50-40f6-96c9-a661322860d3-web-config\") pod \"f5bde344-2b50-40f6-96c9-a661322860d3\" (UID: \"f5bde344-2b50-40f6-96c9-a661322860d3\") "
Oct 30 21:49:34.854425 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:34.854322    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/f5bde344-2b50-40f6-96c9-a661322860d3-thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f5bde344-2b50-40f6-96c9-a661322860d3-thanos-prometheus-http-client-file\") pod \"f5bde344-2b50-40f6-96c9-a661322860d3\" (UID: \"f5bde344-2b50-40f6-96c9-a661322860d3\") "
Oct 30 21:49:34.854425 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:34.854353    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/f5bde344-2b50-40f6-96c9-a661322860d3-web-config-tls-secret-key-prometheus-operated-tls-f3457c70\" (UniqueName: \"kubernetes.io/secret/f5bde344-2b50-40f6-96c9-a661322860d3-web-config-tls-secret-key-prometheus-operated-tls-f3457c70\") pod \"f5bde344-2b50-40f6-96c9-a661322860d3\" (UID: \"f5bde344-2b50-40f6-96c9-a661322860d3\") "
Oct 30 21:49:34.854425 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:34.854398    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f5bde344-2b50-40f6-96c9-a661322860d3-tls-assets\" (UniqueName: \"kubernetes.io/projected/f5bde344-2b50-40f6-96c9-a661322860d3-tls-assets\") pod \"f5bde344-2b50-40f6-96c9-a661322860d3\" (UID: \"f5bde344-2b50-40f6-96c9-a661322860d3\") "
Oct 30 21:49:34.854767 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:34.854426    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/f5bde344-2b50-40f6-96c9-a661322860d3-prometheus-data-science-monitoringstack-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f5bde344-2b50-40f6-96c9-a661322860d3-prometheus-data-science-monitoringstack-rulefiles-2\") pod \"f5bde344-2b50-40f6-96c9-a661322860d3\" (UID: \"f5bde344-2b50-40f6-96c9-a661322860d3\") "
Oct 30 21:49:34.854767 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:34.854455    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f5bde344-2b50-40f6-96c9-a661322860d3-config-out\" (UniqueName: \"kubernetes.io/empty-dir/f5bde344-2b50-40f6-96c9-a661322860d3-config-out\") pod \"f5bde344-2b50-40f6-96c9-a661322860d3\" (UID: \"f5bde344-2b50-40f6-96c9-a661322860d3\") "
Oct 30 21:49:34.854767 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:34.854702    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f5bde344-2b50-40f6-96c9-a661322860d3-prometheus-data-science-monitoringstack-rulefiles-1" pod "f5bde344-2b50-40f6-96c9-a661322860d3" (UID: "f5bde344-2b50-40f6-96c9-a661322860d3"). InnerVolumeSpecName "prometheus-data-science-monitoringstack-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:49:34.855002 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:34.854977    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f5bde344-2b50-40f6-96c9-a661322860d3-prometheus-data-science-monitoringstack-rulefiles-0" pod "f5bde344-2b50-40f6-96c9-a661322860d3" (UID: "f5bde344-2b50-40f6-96c9-a661322860d3"). InnerVolumeSpecName "prometheus-data-science-monitoringstack-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:49:34.855656 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:34.855615    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f5bde344-2b50-40f6-96c9-a661322860d3-prometheus-data-science-monitoringstack-rulefiles-2" pod "f5bde344-2b50-40f6-96c9-a661322860d3" (UID: "f5bde344-2b50-40f6-96c9-a661322860d3"). InnerVolumeSpecName "prometheus-data-science-monitoringstack-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:49:34.857126 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:34.857099    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f5bde344-2b50-40f6-96c9-a661322860d3-secret-prometheus-web-tls-ca" pod "f5bde344-2b50-40f6-96c9-a661322860d3" (UID: "f5bde344-2b50-40f6-96c9-a661322860d3"). InnerVolumeSpecName "secret-prometheus-web-tls-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:49:34.857245 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:34.857123    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f5bde344-2b50-40f6-96c9-a661322860d3-kube-api-access-869lj" pod "f5bde344-2b50-40f6-96c9-a661322860d3" (UID: "f5bde344-2b50-40f6-96c9-a661322860d3"). InnerVolumeSpecName "kube-api-access-869lj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:49:34.857245 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:34.857237    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f5bde344-2b50-40f6-96c9-a661322860d3-config-out" pod "f5bde344-2b50-40f6-96c9-a661322860d3" (UID: "f5bde344-2b50-40f6-96c9-a661322860d3"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:49:34.857580 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:34.857553    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f5bde344-2b50-40f6-96c9-a661322860d3-web-config-tls-secret-key-prometheus-operated-tls-f3457c70" pod "f5bde344-2b50-40f6-96c9-a661322860d3" (UID: "f5bde344-2b50-40f6-96c9-a661322860d3"). InnerVolumeSpecName "web-config-tls-secret-key-prometheus-operated-tls-f3457c70". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:49:34.857672 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:34.857599    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f5bde344-2b50-40f6-96c9-a661322860d3-tls-assets" pod "f5bde344-2b50-40f6-96c9-a661322860d3" (UID: "f5bde344-2b50-40f6-96c9-a661322860d3"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:49:34.858546 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:34.858186    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f5bde344-2b50-40f6-96c9-a661322860d3-thanos-prometheus-http-client-file" pod "f5bde344-2b50-40f6-96c9-a661322860d3" (UID: "f5bde344-2b50-40f6-96c9-a661322860d3"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:49:34.858546 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:34.858327    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f5bde344-2b50-40f6-96c9-a661322860d3-config" pod "f5bde344-2b50-40f6-96c9-a661322860d3" (UID: "f5bde344-2b50-40f6-96c9-a661322860d3"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:49:34.858714 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:34.858576    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f5bde344-2b50-40f6-96c9-a661322860d3-web-config-tls-secret-cert-prometheus-operated-tls-f3457c70" pod "f5bde344-2b50-40f6-96c9-a661322860d3" (UID: "f5bde344-2b50-40f6-96c9-a661322860d3"). InnerVolumeSpecName "web-config-tls-secret-cert-prometheus-operated-tls-f3457c70". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:49:34.859791 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:34.859770    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/csi/ebs.csi.aws.com^vol-0a155a55c1ce0e65b" pod "f5bde344-2b50-40f6-96c9-a661322860d3" (UID: "f5bde344-2b50-40f6-96c9-a661322860d3"). InnerVolumeSpecName "pvc-e73afc79-aa37-49a0-8744-633c03cad1f4". PluginName "kubernetes.io/csi", VolumeGIDValue ""
Oct 30 21:49:34.868785 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:34.868754    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f5bde344-2b50-40f6-96c9-a661322860d3-web-config" pod "f5bde344-2b50-40f6-96c9-a661322860d3" (UID: "f5bde344-2b50-40f6-96c9-a661322860d3"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:49:34.955530 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:34.955479    4060 reconciler_common.go:299] "Volume detached for volume \"web-config-tls-secret-cert-prometheus-operated-tls-f3457c70\" (UniqueName: \"kubernetes.io/secret/f5bde344-2b50-40f6-96c9-a661322860d3-web-config-tls-secret-cert-prometheus-operated-tls-f3457c70\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:49:34.955693 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:34.955533    4060 reconciler_common.go:299] "Volume detached for volume \"prometheus-data-science-monitoringstack-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f5bde344-2b50-40f6-96c9-a661322860d3-prometheus-data-science-monitoringstack-rulefiles-0\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:49:34.955693 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:34.955546    4060 reconciler_common.go:299] "Volume detached for volume \"prometheus-data-science-monitoringstack-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f5bde344-2b50-40f6-96c9-a661322860d3-prometheus-data-science-monitoringstack-rulefiles-1\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:49:34.955693 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:34.955557    4060 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f5bde344-2b50-40f6-96c9-a661322860d3-web-config\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:49:34.955693 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:34.955566    4060 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f5bde344-2b50-40f6-96c9-a661322860d3-thanos-prometheus-http-client-file\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:49:34.955693 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:34.955577    4060 reconciler_common.go:299] "Volume detached for volume \"web-config-tls-secret-key-prometheus-operated-tls-f3457c70\" (UniqueName: \"kubernetes.io/secret/f5bde344-2b50-40f6-96c9-a661322860d3-web-config-tls-secret-key-prometheus-operated-tls-f3457c70\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:49:34.955693 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:34.955586    4060 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f5bde344-2b50-40f6-96c9-a661322860d3-tls-assets\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:49:34.955693 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:34.955595    4060 reconciler_common.go:299] "Volume detached for volume \"prometheus-data-science-monitoringstack-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f5bde344-2b50-40f6-96c9-a661322860d3-prometheus-data-science-monitoringstack-rulefiles-2\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:49:34.955693 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:34.955604    4060 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f5bde344-2b50-40f6-96c9-a661322860d3-config-out\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:49:34.955693 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:34.955612    4060 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-web-tls-ca\" (UniqueName: \"kubernetes.io/secret/f5bde344-2b50-40f6-96c9-a661322860d3-secret-prometheus-web-tls-ca\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:49:34.955693 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:34.955621    4060 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-869lj\" (UniqueName: \"kubernetes.io/projected/f5bde344-2b50-40f6-96c9-a661322860d3-kube-api-access-869lj\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:49:34.955693 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:34.955629    4060 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/f5bde344-2b50-40f6-96c9-a661322860d3-config\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:49:34.955693 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:34.955658    4060 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"pvc-e73afc79-aa37-49a0-8744-633c03cad1f4\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a155a55c1ce0e65b\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" "
Oct 30 21:49:34.973115 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:34.973091    4060 operation_generator.go:893] UnmountDevice succeeded for volume "pvc-e73afc79-aa37-49a0-8744-633c03cad1f4" (UniqueName: "kubernetes.io/csi/ebs.csi.aws.com^vol-0a155a55c1ce0e65b") on node "ip-10-0-142-4.us-west-1.compute.internal"
Oct 30 21:49:35.056517 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:35.056476    4060 reconciler_common.go:299] "Volume detached for volume \"pvc-e73afc79-aa37-49a0-8744-633c03cad1f4\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a155a55c1ce0e65b\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"csi-7011c01335d2502f76be252f9498c79824668beecf30ee8f6a7191145201ca4c\""
Oct 30 21:49:35.418541 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:35.418437    4060 generic.go:356] "Generic (PLEG): container finished" podID="fdb7e0b7-337e-4055-b601-386203d23d57" containerID="3384ec5022f19b93b7a419467f2a76cb8fd99398f82039d18abdb787b8ea8044" exitCode=0
Oct 30 21:49:35.418541 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:35.418520    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0" event={"ID":"fdb7e0b7-337e-4055-b601-386203d23d57","Type":"ContainerDied","Data":"3384ec5022f19b93b7a419467f2a76cb8fd99398f82039d18abdb787b8ea8044"}
Oct 30 21:49:35.420881 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:35.420854    4060 generic.go:356] "Generic (PLEG): container finished" podID="f5bde344-2b50-40f6-96c9-a661322860d3" containerID="d4ebd97cfbb0e8fb332cf341648f859104007d001866ffe33c68222888252988" exitCode=0
Oct 30 21:49:35.420881 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:35.420873    4060 generic.go:356] "Generic (PLEG): container finished" podID="f5bde344-2b50-40f6-96c9-a661322860d3" containerID="725dac8cb20eb6ec45cfbfa43f491584459a8868cf1bda536e6037d41a4f2e77" exitCode=0
Oct 30 21:49:35.420881 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:35.420882    4060 generic.go:356] "Generic (PLEG): container finished" podID="f5bde344-2b50-40f6-96c9-a661322860d3" containerID="fcdc4e1eb583e9e4b85b70ee20ec155e75745cfd8b59310516b30cec88eabad8" exitCode=0
Oct 30 21:49:35.421080 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:35.420979    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 21:49:35.426427 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:35.426404    4060 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="798689a4-7697-4238-b20f-00c5620c5eb4" path="/var/lib/kubelet/pods/798689a4-7697-4238-b20f-00c5620c5eb4/volumes"
Oct 30 21:49:35.426814 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:35.426802    4060 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f3df7a4d-f910-432e-ae0c-93dcbabb6313" path="/var/lib/kubelet/pods/f3df7a4d-f910-432e-ae0c-93dcbabb6313/volumes"
Oct 30 21:49:35.427181 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:35.427166    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0" event={"ID":"f5bde344-2b50-40f6-96c9-a661322860d3","Type":"ContainerDied","Data":"d4ebd97cfbb0e8fb332cf341648f859104007d001866ffe33c68222888252988"}
Oct 30 21:49:35.427240 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:35.427211    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0" event={"ID":"f5bde344-2b50-40f6-96c9-a661322860d3","Type":"ContainerDied","Data":"725dac8cb20eb6ec45cfbfa43f491584459a8868cf1bda536e6037d41a4f2e77"}
Oct 30 21:49:35.427240 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:35.427238    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0" event={"ID":"f5bde344-2b50-40f6-96c9-a661322860d3","Type":"ContainerDied","Data":"fcdc4e1eb583e9e4b85b70ee20ec155e75745cfd8b59310516b30cec88eabad8"}
Oct 30 21:49:35.427309 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:35.427261    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0" event={"ID":"f5bde344-2b50-40f6-96c9-a661322860d3","Type":"ContainerDied","Data":"e2cb48a993c9d01748203fdf770c478f23b1230400e81d6ff2f4899bef5ffb22"}
Oct 30 21:49:35.427309 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:35.427289    4060 scope.go:122] "RemoveContainer" containerID="d4ebd97cfbb0e8fb332cf341648f859104007d001866ffe33c68222888252988"
Oct 30 21:49:35.435684 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:35.435669    4060 scope.go:122] "RemoveContainer" containerID="725dac8cb20eb6ec45cfbfa43f491584459a8868cf1bda536e6037d41a4f2e77"
Oct 30 21:49:35.443343 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:35.443327    4060 scope.go:122] "RemoveContainer" containerID="fcdc4e1eb583e9e4b85b70ee20ec155e75745cfd8b59310516b30cec88eabad8"
Oct 30 21:49:35.450695 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:35.450666    4060 scope.go:122] "RemoveContainer" containerID="df50f5143b43e442a474aabb9e83499526086d7b5d07ddb9ef7c737e277735b1"
Oct 30 21:49:35.457904 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:35.457882    4060 scope.go:122] "RemoveContainer" containerID="d4ebd97cfbb0e8fb332cf341648f859104007d001866ffe33c68222888252988"
Oct 30 21:49:35.458160 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:49:35.458142    4060 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d4ebd97cfbb0e8fb332cf341648f859104007d001866ffe33c68222888252988\": container with ID starting with d4ebd97cfbb0e8fb332cf341648f859104007d001866ffe33c68222888252988 not found: ID does not exist" containerID="d4ebd97cfbb0e8fb332cf341648f859104007d001866ffe33c68222888252988"
Oct 30 21:49:35.458224 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:35.458169    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d4ebd97cfbb0e8fb332cf341648f859104007d001866ffe33c68222888252988"} err="failed to get container status \"d4ebd97cfbb0e8fb332cf341648f859104007d001866ffe33c68222888252988\": rpc error: code = NotFound desc = could not find container \"d4ebd97cfbb0e8fb332cf341648f859104007d001866ffe33c68222888252988\": container with ID starting with d4ebd97cfbb0e8fb332cf341648f859104007d001866ffe33c68222888252988 not found: ID does not exist"
Oct 30 21:49:35.458224 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:35.458188    4060 scope.go:122] "RemoveContainer" containerID="725dac8cb20eb6ec45cfbfa43f491584459a8868cf1bda536e6037d41a4f2e77"
Oct 30 21:49:35.458416 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:49:35.458396    4060 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"725dac8cb20eb6ec45cfbfa43f491584459a8868cf1bda536e6037d41a4f2e77\": container with ID starting with 725dac8cb20eb6ec45cfbfa43f491584459a8868cf1bda536e6037d41a4f2e77 not found: ID does not exist" containerID="725dac8cb20eb6ec45cfbfa43f491584459a8868cf1bda536e6037d41a4f2e77"
Oct 30 21:49:35.458518 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:35.458420    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"725dac8cb20eb6ec45cfbfa43f491584459a8868cf1bda536e6037d41a4f2e77"} err="failed to get container status \"725dac8cb20eb6ec45cfbfa43f491584459a8868cf1bda536e6037d41a4f2e77\": rpc error: code = NotFound desc = could not find container \"725dac8cb20eb6ec45cfbfa43f491584459a8868cf1bda536e6037d41a4f2e77\": container with ID starting with 725dac8cb20eb6ec45cfbfa43f491584459a8868cf1bda536e6037d41a4f2e77 not found: ID does not exist"
Oct 30 21:49:35.458518 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:35.458434    4060 scope.go:122] "RemoveContainer" containerID="fcdc4e1eb583e9e4b85b70ee20ec155e75745cfd8b59310516b30cec88eabad8"
Oct 30 21:49:35.458675 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:49:35.458658    4060 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fcdc4e1eb583e9e4b85b70ee20ec155e75745cfd8b59310516b30cec88eabad8\": container with ID starting with fcdc4e1eb583e9e4b85b70ee20ec155e75745cfd8b59310516b30cec88eabad8 not found: ID does not exist" containerID="fcdc4e1eb583e9e4b85b70ee20ec155e75745cfd8b59310516b30cec88eabad8"
Oct 30 21:49:35.458722 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:35.458681    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fcdc4e1eb583e9e4b85b70ee20ec155e75745cfd8b59310516b30cec88eabad8"} err="failed to get container status \"fcdc4e1eb583e9e4b85b70ee20ec155e75745cfd8b59310516b30cec88eabad8\": rpc error: code = NotFound desc = could not find container \"fcdc4e1eb583e9e4b85b70ee20ec155e75745cfd8b59310516b30cec88eabad8\": container with ID starting with fcdc4e1eb583e9e4b85b70ee20ec155e75745cfd8b59310516b30cec88eabad8 not found: ID does not exist"
Oct 30 21:49:35.458722 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:35.458695    4060 scope.go:122] "RemoveContainer" containerID="df50f5143b43e442a474aabb9e83499526086d7b5d07ddb9ef7c737e277735b1"
Oct 30 21:49:35.458936 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:49:35.458919    4060 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"df50f5143b43e442a474aabb9e83499526086d7b5d07ddb9ef7c737e277735b1\": container with ID starting with df50f5143b43e442a474aabb9e83499526086d7b5d07ddb9ef7c737e277735b1 not found: ID does not exist" containerID="df50f5143b43e442a474aabb9e83499526086d7b5d07ddb9ef7c737e277735b1"
Oct 30 21:49:35.459020 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:35.458958    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df50f5143b43e442a474aabb9e83499526086d7b5d07ddb9ef7c737e277735b1"} err="failed to get container status \"df50f5143b43e442a474aabb9e83499526086d7b5d07ddb9ef7c737e277735b1\": rpc error: code = NotFound desc = could not find container \"df50f5143b43e442a474aabb9e83499526086d7b5d07ddb9ef7c737e277735b1\": container with ID starting with df50f5143b43e442a474aabb9e83499526086d7b5d07ddb9ef7c737e277735b1 not found: ID does not exist"
Oct 30 21:49:35.459020 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:35.458972    4060 scope.go:122] "RemoveContainer" containerID="d4ebd97cfbb0e8fb332cf341648f859104007d001866ffe33c68222888252988"
Oct 30 21:49:35.459175 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:35.459157    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d4ebd97cfbb0e8fb332cf341648f859104007d001866ffe33c68222888252988"} err="failed to get container status \"d4ebd97cfbb0e8fb332cf341648f859104007d001866ffe33c68222888252988\": rpc error: code = NotFound desc = could not find container \"d4ebd97cfbb0e8fb332cf341648f859104007d001866ffe33c68222888252988\": container with ID starting with d4ebd97cfbb0e8fb332cf341648f859104007d001866ffe33c68222888252988 not found: ID does not exist"
Oct 30 21:49:35.459227 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:35.459176    4060 scope.go:122] "RemoveContainer" containerID="725dac8cb20eb6ec45cfbfa43f491584459a8868cf1bda536e6037d41a4f2e77"
Oct 30 21:49:35.459380 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:35.459359    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"725dac8cb20eb6ec45cfbfa43f491584459a8868cf1bda536e6037d41a4f2e77"} err="failed to get container status \"725dac8cb20eb6ec45cfbfa43f491584459a8868cf1bda536e6037d41a4f2e77\": rpc error: code = NotFound desc = could not find container \"725dac8cb20eb6ec45cfbfa43f491584459a8868cf1bda536e6037d41a4f2e77\": container with ID starting with 725dac8cb20eb6ec45cfbfa43f491584459a8868cf1bda536e6037d41a4f2e77 not found: ID does not exist"
Oct 30 21:49:35.459426 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:35.459381    4060 scope.go:122] "RemoveContainer" containerID="fcdc4e1eb583e9e4b85b70ee20ec155e75745cfd8b59310516b30cec88eabad8"
Oct 30 21:49:35.459641 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:35.459621    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fcdc4e1eb583e9e4b85b70ee20ec155e75745cfd8b59310516b30cec88eabad8"} err="failed to get container status \"fcdc4e1eb583e9e4b85b70ee20ec155e75745cfd8b59310516b30cec88eabad8\": rpc error: code = NotFound desc = could not find container \"fcdc4e1eb583e9e4b85b70ee20ec155e75745cfd8b59310516b30cec88eabad8\": container with ID starting with fcdc4e1eb583e9e4b85b70ee20ec155e75745cfd8b59310516b30cec88eabad8 not found: ID does not exist"
Oct 30 21:49:35.459724 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:35.459644    4060 scope.go:122] "RemoveContainer" containerID="df50f5143b43e442a474aabb9e83499526086d7b5d07ddb9ef7c737e277735b1"
Oct 30 21:49:35.459898 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:35.459882    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df50f5143b43e442a474aabb9e83499526086d7b5d07ddb9ef7c737e277735b1"} err="failed to get container status \"df50f5143b43e442a474aabb9e83499526086d7b5d07ddb9ef7c737e277735b1\": rpc error: code = NotFound desc = could not find container \"df50f5143b43e442a474aabb9e83499526086d7b5d07ddb9ef7c737e277735b1\": container with ID starting with df50f5143b43e442a474aabb9e83499526086d7b5d07ddb9ef7c737e277735b1 not found: ID does not exist"
Oct 30 21:49:35.459951 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:35.459898    4060 scope.go:122] "RemoveContainer" containerID="d4ebd97cfbb0e8fb332cf341648f859104007d001866ffe33c68222888252988"
Oct 30 21:49:35.460098 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:35.460080    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d4ebd97cfbb0e8fb332cf341648f859104007d001866ffe33c68222888252988"} err="failed to get container status \"d4ebd97cfbb0e8fb332cf341648f859104007d001866ffe33c68222888252988\": rpc error: code = NotFound desc = could not find container \"d4ebd97cfbb0e8fb332cf341648f859104007d001866ffe33c68222888252988\": container with ID starting with d4ebd97cfbb0e8fb332cf341648f859104007d001866ffe33c68222888252988 not found: ID does not exist"
Oct 30 21:49:35.460179 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:35.460099    4060 scope.go:122] "RemoveContainer" containerID="725dac8cb20eb6ec45cfbfa43f491584459a8868cf1bda536e6037d41a4f2e77"
Oct 30 21:49:35.460324 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:35.460306    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"725dac8cb20eb6ec45cfbfa43f491584459a8868cf1bda536e6037d41a4f2e77"} err="failed to get container status \"725dac8cb20eb6ec45cfbfa43f491584459a8868cf1bda536e6037d41a4f2e77\": rpc error: code = NotFound desc = could not find container \"725dac8cb20eb6ec45cfbfa43f491584459a8868cf1bda536e6037d41a4f2e77\": container with ID starting with 725dac8cb20eb6ec45cfbfa43f491584459a8868cf1bda536e6037d41a4f2e77 not found: ID does not exist"
Oct 30 21:49:35.460367 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:35.460325    4060 scope.go:122] "RemoveContainer" containerID="fcdc4e1eb583e9e4b85b70ee20ec155e75745cfd8b59310516b30cec88eabad8"
Oct 30 21:49:35.460529 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:35.460512    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fcdc4e1eb583e9e4b85b70ee20ec155e75745cfd8b59310516b30cec88eabad8"} err="failed to get container status \"fcdc4e1eb583e9e4b85b70ee20ec155e75745cfd8b59310516b30cec88eabad8\": rpc error: code = NotFound desc = could not find container \"fcdc4e1eb583e9e4b85b70ee20ec155e75745cfd8b59310516b30cec88eabad8\": container with ID starting with fcdc4e1eb583e9e4b85b70ee20ec155e75745cfd8b59310516b30cec88eabad8 not found: ID does not exist"
Oct 30 21:49:35.460605 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:35.460529    4060 scope.go:122] "RemoveContainer" containerID="df50f5143b43e442a474aabb9e83499526086d7b5d07ddb9ef7c737e277735b1"
Oct 30 21:49:35.460736 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:35.460719    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df50f5143b43e442a474aabb9e83499526086d7b5d07ddb9ef7c737e277735b1"} err="failed to get container status \"df50f5143b43e442a474aabb9e83499526086d7b5d07ddb9ef7c737e277735b1\": rpc error: code = NotFound desc = could not find container \"df50f5143b43e442a474aabb9e83499526086d7b5d07ddb9ef7c737e277735b1\": container with ID starting with df50f5143b43e442a474aabb9e83499526086d7b5d07ddb9ef7c737e277735b1 not found: ID does not exist"
Oct 30 21:49:35.586650 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:35.586619    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"]
Oct 30 21:49:35.636188 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:35.636143    4060 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"]
Oct 30 21:49:36.842892 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:36.842856    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:49:36.843589 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:36.843162    4060 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-collector-0" podUID="1b73e782-fcb6-4bc0-87c9-f24e47a845bd" containerName="otc-container" containerID="cri-o://da856298b54452b3d56e79f51564eae5907d037e039164cc9695cbaa2b1f7843" gracePeriod=30
Oct 30 21:49:37.082582 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:37.082554    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:49:37.171706 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:37.171632    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/1b73e782-fcb6-4bc0-87c9-f24e47a845bd-otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/1b73e782-fcb6-4bc0-87c9-f24e47a845bd-otlp-tls-certs\") pod \"1b73e782-fcb6-4bc0-87c9-f24e47a845bd\" (UID: \"1b73e782-fcb6-4bc0-87c9-f24e47a845bd\") "
Oct 30 21:49:37.171706 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:37.171705    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1b73e782-fcb6-4bc0-87c9-f24e47a845bd-kube-api-access-8wk4c\" (UniqueName: \"kubernetes.io/projected/1b73e782-fcb6-4bc0-87c9-f24e47a845bd-kube-api-access-8wk4c\") pod \"1b73e782-fcb6-4bc0-87c9-f24e47a845bd\" (UID: \"1b73e782-fcb6-4bc0-87c9-f24e47a845bd\") "
Oct 30 21:49:37.171903 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:37.171739    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/1b73e782-fcb6-4bc0-87c9-f24e47a845bd-otc-internal\" (UniqueName: \"kubernetes.io/configmap/1b73e782-fcb6-4bc0-87c9-f24e47a845bd-otc-internal\") pod \"1b73e782-fcb6-4bc0-87c9-f24e47a845bd\" (UID: \"1b73e782-fcb6-4bc0-87c9-f24e47a845bd\") "
Oct 30 21:49:37.171903 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:37.171776    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/1b73e782-fcb6-4bc0-87c9-f24e47a845bd-data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/1b73e782-fcb6-4bc0-87c9-f24e47a845bd-data-science-collector-ta-client-cert\") pod \"1b73e782-fcb6-4bc0-87c9-f24e47a845bd\" (UID: \"1b73e782-fcb6-4bc0-87c9-f24e47a845bd\") "
Oct 30 21:49:37.171903 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:37.171823    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/1b73e782-fcb6-4bc0-87c9-f24e47a845bd-tls-certs\" (UniqueName: \"kubernetes.io/secret/1b73e782-fcb6-4bc0-87c9-f24e47a845bd-tls-certs\") pod \"1b73e782-fcb6-4bc0-87c9-f24e47a845bd\" (UID: \"1b73e782-fcb6-4bc0-87c9-f24e47a845bd\") "
Oct 30 21:49:37.171903 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:37.171854    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/1b73e782-fcb6-4bc0-87c9-f24e47a845bd-monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/1b73e782-fcb6-4bc0-87c9-f24e47a845bd-monitoring-tls-certs\") pod \"1b73e782-fcb6-4bc0-87c9-f24e47a845bd\" (UID: \"1b73e782-fcb6-4bc0-87c9-f24e47a845bd\") "
Oct 30 21:49:37.172187 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:37.172146    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1b73e782-fcb6-4bc0-87c9-f24e47a845bd-otc-internal" pod "1b73e782-fcb6-4bc0-87c9-f24e47a845bd" (UID: "1b73e782-fcb6-4bc0-87c9-f24e47a845bd"). InnerVolumeSpecName "otc-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:49:37.174038 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:37.174004    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1b73e782-fcb6-4bc0-87c9-f24e47a845bd-tls-certs" pod "1b73e782-fcb6-4bc0-87c9-f24e47a845bd" (UID: "1b73e782-fcb6-4bc0-87c9-f24e47a845bd"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:49:37.174038 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:37.174020    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1b73e782-fcb6-4bc0-87c9-f24e47a845bd-data-science-collector-ta-client-cert" pod "1b73e782-fcb6-4bc0-87c9-f24e47a845bd" (UID: "1b73e782-fcb6-4bc0-87c9-f24e47a845bd"). InnerVolumeSpecName "data-science-collector-ta-client-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:49:37.174189 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:37.174063    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1b73e782-fcb6-4bc0-87c9-f24e47a845bd-otlp-tls-certs" pod "1b73e782-fcb6-4bc0-87c9-f24e47a845bd" (UID: "1b73e782-fcb6-4bc0-87c9-f24e47a845bd"). InnerVolumeSpecName "otlp-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:49:37.174277 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:37.174262    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1b73e782-fcb6-4bc0-87c9-f24e47a845bd-monitoring-tls-certs" pod "1b73e782-fcb6-4bc0-87c9-f24e47a845bd" (UID: "1b73e782-fcb6-4bc0-87c9-f24e47a845bd"). InnerVolumeSpecName "monitoring-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:49:37.174321 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:37.174299    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1b73e782-fcb6-4bc0-87c9-f24e47a845bd-kube-api-access-8wk4c" pod "1b73e782-fcb6-4bc0-87c9-f24e47a845bd" (UID: "1b73e782-fcb6-4bc0-87c9-f24e47a845bd"). InnerVolumeSpecName "kube-api-access-8wk4c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:49:37.272407 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:37.272375    4060 reconciler_common.go:299] "Volume detached for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/1b73e782-fcb6-4bc0-87c9-f24e47a845bd-otlp-tls-certs\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:49:37.272407 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:37.272407    4060 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8wk4c\" (UniqueName: \"kubernetes.io/projected/1b73e782-fcb6-4bc0-87c9-f24e47a845bd-kube-api-access-8wk4c\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:49:37.272407 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:37.272417    4060 reconciler_common.go:299] "Volume detached for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/1b73e782-fcb6-4bc0-87c9-f24e47a845bd-otc-internal\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:49:37.272651 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:37.272427    4060 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/1b73e782-fcb6-4bc0-87c9-f24e47a845bd-data-science-collector-ta-client-cert\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:49:37.272651 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:37.272436    4060 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1b73e782-fcb6-4bc0-87c9-f24e47a845bd-tls-certs\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:49:37.272651 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:37.272444    4060 reconciler_common.go:299] "Volume detached for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/1b73e782-fcb6-4bc0-87c9-f24e47a845bd-monitoring-tls-certs\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:49:37.427777 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:37.427704    4060 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f5bde344-2b50-40f6-96c9-a661322860d3" path="/var/lib/kubelet/pods/f5bde344-2b50-40f6-96c9-a661322860d3/volumes"
Oct 30 21:49:37.440589 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:37.440555    4060 generic.go:356] "Generic (PLEG): container finished" podID="1b73e782-fcb6-4bc0-87c9-f24e47a845bd" containerID="da856298b54452b3d56e79f51564eae5907d037e039164cc9695cbaa2b1f7843" exitCode=0
Oct 30 21:49:37.440744 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:37.440624    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-0"
Oct 30 21:49:37.440744 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:37.440632    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"1b73e782-fcb6-4bc0-87c9-f24e47a845bd","Type":"ContainerDied","Data":"da856298b54452b3d56e79f51564eae5907d037e039164cc9695cbaa2b1f7843"}
Oct 30 21:49:37.440744 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:37.440730    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-0" event={"ID":"1b73e782-fcb6-4bc0-87c9-f24e47a845bd","Type":"ContainerDied","Data":"49d763753f56b842cf3e11b3613ac48a60dd09262205351af3d8106d6f6318b6"}
Oct 30 21:49:37.440981 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:37.440761    4060 scope.go:122] "RemoveContainer" containerID="da856298b54452b3d56e79f51564eae5907d037e039164cc9695cbaa2b1f7843"
Oct 30 21:49:37.449219 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:37.449199    4060 scope.go:122] "RemoveContainer" containerID="da856298b54452b3d56e79f51564eae5907d037e039164cc9695cbaa2b1f7843"
Oct 30 21:49:37.449464 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:49:37.449446    4060 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"da856298b54452b3d56e79f51564eae5907d037e039164cc9695cbaa2b1f7843\": container with ID starting with da856298b54452b3d56e79f51564eae5907d037e039164cc9695cbaa2b1f7843 not found: ID does not exist" containerID="da856298b54452b3d56e79f51564eae5907d037e039164cc9695cbaa2b1f7843"
Oct 30 21:49:37.449532 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:37.449470    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da856298b54452b3d56e79f51564eae5907d037e039164cc9695cbaa2b1f7843"} err="failed to get container status \"da856298b54452b3d56e79f51564eae5907d037e039164cc9695cbaa2b1f7843\": rpc error: code = NotFound desc = could not find container \"da856298b54452b3d56e79f51564eae5907d037e039164cc9695cbaa2b1f7843\": container with ID starting with da856298b54452b3d56e79f51564eae5907d037e039164cc9695cbaa2b1f7843 not found: ID does not exist"
Oct 30 21:49:37.605258 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:37.605224    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:49:37.610175 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:37.610148    4060 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-0"]
Oct 30 21:49:39.234665 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:39.234627    4060 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0" podUID="fdb7e0b7-337e-4055-b601-386203d23d57" containerName="alertmanager" probeResult="failure" output="Get \"http://10.133.0.180:9093/-/ready\": dial tcp 10.133.0.180:9093: connect: connection refused"
Oct 30 21:49:39.426139 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:39.426105    4060 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="1b73e782-fcb6-4bc0-87c9-f24e47a845bd" path="/var/lib/kubelet/pods/1b73e782-fcb6-4bc0-87c9-f24e47a845bd/volumes"
Oct 30 21:49:42.150095 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:49:42.150060    4060 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v2f4x" containerName="extractor"
Oct 30 21:49:44.234054 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:44.234016    4060 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0" podUID="fdb7e0b7-337e-4055-b601-386203d23d57" containerName="alertmanager" probeResult="failure" output="Get \"http://10.133.0.180:9093/-/ready\": dial tcp 10.133.0.180:9093: connect: connection refused"
Oct 30 21:49:44.763722 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:44.763698    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:49:44.831357 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:44.831273    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/fdb7e0b7-337e-4055-b601-386203d23d57-kube-api-access-k4czd\" (UniqueName: \"kubernetes.io/projected/fdb7e0b7-337e-4055-b601-386203d23d57-kube-api-access-k4czd\") pod \"fdb7e0b7-337e-4055-b601-386203d23d57\" (UID: \"fdb7e0b7-337e-4055-b601-386203d23d57\") "
Oct 30 21:49:44.831357 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:44.831315    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/fdb7e0b7-337e-4055-b601-386203d23d57-config-volume\" (UniqueName: \"kubernetes.io/secret/fdb7e0b7-337e-4055-b601-386203d23d57-config-volume\") pod \"fdb7e0b7-337e-4055-b601-386203d23d57\" (UID: \"fdb7e0b7-337e-4055-b601-386203d23d57\") "
Oct 30 21:49:44.831615 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:44.831358    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/fdb7e0b7-337e-4055-b601-386203d23d57-config-out\" (UniqueName: \"kubernetes.io/empty-dir/fdb7e0b7-337e-4055-b601-386203d23d57-config-out\") pod \"fdb7e0b7-337e-4055-b601-386203d23d57\" (UID: \"fdb7e0b7-337e-4055-b601-386203d23d57\") "
Oct 30 21:49:44.831615 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:44.831394    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/fdb7e0b7-337e-4055-b601-386203d23d57-tls-assets\" (UniqueName: \"kubernetes.io/projected/fdb7e0b7-337e-4055-b601-386203d23d57-tls-assets\") pod \"fdb7e0b7-337e-4055-b601-386203d23d57\" (UID: \"fdb7e0b7-337e-4055-b601-386203d23d57\") "
Oct 30 21:49:44.831615 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:44.831436    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/fdb7e0b7-337e-4055-b601-386203d23d57-web-config\" (UniqueName: \"kubernetes.io/secret/fdb7e0b7-337e-4055-b601-386203d23d57-web-config\") pod \"fdb7e0b7-337e-4055-b601-386203d23d57\" (UID: \"fdb7e0b7-337e-4055-b601-386203d23d57\") "
Oct 30 21:49:44.831615 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:44.831474    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/fdb7e0b7-337e-4055-b601-386203d23d57-alertmanager-data-science-monitoringstack-db\" (UniqueName: \"kubernetes.io/empty-dir/fdb7e0b7-337e-4055-b601-386203d23d57-alertmanager-data-science-monitoringstack-db\") pod \"fdb7e0b7-337e-4055-b601-386203d23d57\" (UID: \"fdb7e0b7-337e-4055-b601-386203d23d57\") "
Oct 30 21:49:44.831615 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:44.831561    4060 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/fdb7e0b7-337e-4055-b601-386203d23d57-cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/fdb7e0b7-337e-4055-b601-386203d23d57-cluster-tls-config\") pod \"fdb7e0b7-337e-4055-b601-386203d23d57\" (UID: \"fdb7e0b7-337e-4055-b601-386203d23d57\") "
Oct 30 21:49:44.831948 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:44.831878    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fdb7e0b7-337e-4055-b601-386203d23d57-alertmanager-data-science-monitoringstack-db" pod "fdb7e0b7-337e-4055-b601-386203d23d57" (UID: "fdb7e0b7-337e-4055-b601-386203d23d57"). InnerVolumeSpecName "alertmanager-data-science-monitoringstack-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:49:44.833985 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:44.833953    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fdb7e0b7-337e-4055-b601-386203d23d57-config-volume" pod "fdb7e0b7-337e-4055-b601-386203d23d57" (UID: "fdb7e0b7-337e-4055-b601-386203d23d57"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:49:44.834086 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:44.833970    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fdb7e0b7-337e-4055-b601-386203d23d57-config-out" pod "fdb7e0b7-337e-4055-b601-386203d23d57" (UID: "fdb7e0b7-337e-4055-b601-386203d23d57"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:49:44.834086 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:44.834011    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fdb7e0b7-337e-4055-b601-386203d23d57-kube-api-access-k4czd" pod "fdb7e0b7-337e-4055-b601-386203d23d57" (UID: "fdb7e0b7-337e-4055-b601-386203d23d57"). InnerVolumeSpecName "kube-api-access-k4czd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:49:44.834086 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:44.834011    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fdb7e0b7-337e-4055-b601-386203d23d57-tls-assets" pod "fdb7e0b7-337e-4055-b601-386203d23d57" (UID: "fdb7e0b7-337e-4055-b601-386203d23d57"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:49:44.838345 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:44.838321    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fdb7e0b7-337e-4055-b601-386203d23d57-cluster-tls-config" pod "fdb7e0b7-337e-4055-b601-386203d23d57" (UID: "fdb7e0b7-337e-4055-b601-386203d23d57"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:49:44.843856 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:44.843832    4060 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fdb7e0b7-337e-4055-b601-386203d23d57-web-config" pod "fdb7e0b7-337e-4055-b601-386203d23d57" (UID: "fdb7e0b7-337e-4055-b601-386203d23d57"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:49:44.932329 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:44.932293    4060 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fdb7e0b7-337e-4055-b601-386203d23d57-web-config\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:49:44.932329 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:44.932324    4060 reconciler_common.go:299] "Volume detached for volume \"alertmanager-data-science-monitoringstack-db\" (UniqueName: \"kubernetes.io/empty-dir/fdb7e0b7-337e-4055-b601-386203d23d57-alertmanager-data-science-monitoringstack-db\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:49:44.932588 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:44.932338    4060 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/fdb7e0b7-337e-4055-b601-386203d23d57-cluster-tls-config\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:49:44.932588 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:44.932352    4060 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k4czd\" (UniqueName: \"kubernetes.io/projected/fdb7e0b7-337e-4055-b601-386203d23d57-kube-api-access-k4czd\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:49:44.932588 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:44.932366    4060 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/fdb7e0b7-337e-4055-b601-386203d23d57-config-volume\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:49:44.932588 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:44.932376    4060 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fdb7e0b7-337e-4055-b601-386203d23d57-config-out\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:49:44.932588 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:44.932387    4060 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fdb7e0b7-337e-4055-b601-386203d23d57-tls-assets\") on node \"ip-10-0-142-4.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:49:45.479286 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:45.479256    4060 generic.go:356] "Generic (PLEG): container finished" podID="fdb7e0b7-337e-4055-b601-386203d23d57" containerID="b1e98b2449ae6f7c34405eb2715a7bfa7bdab4c1adff60cb664c10743598ed6e" exitCode=0
Oct 30 21:49:45.479736 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:45.479302    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0" event={"ID":"fdb7e0b7-337e-4055-b601-386203d23d57","Type":"ContainerDied","Data":"b1e98b2449ae6f7c34405eb2715a7bfa7bdab4c1adff60cb664c10743598ed6e"}
Oct 30 21:49:45.479736 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:45.479324    4060 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"
Oct 30 21:49:45.479736 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:45.479347    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0" event={"ID":"fdb7e0b7-337e-4055-b601-386203d23d57","Type":"ContainerDied","Data":"1ae37f59467a526689e60993ee0b2cb64c00dca51a2a3151e16f5beb70a8e374"}
Oct 30 21:49:45.479736 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:45.479379    4060 scope.go:122] "RemoveContainer" containerID="3384ec5022f19b93b7a419467f2a76cb8fd99398f82039d18abdb787b8ea8044"
Oct 30 21:49:45.487681 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:45.487664    4060 scope.go:122] "RemoveContainer" containerID="b1e98b2449ae6f7c34405eb2715a7bfa7bdab4c1adff60cb664c10743598ed6e"
Oct 30 21:49:45.494976 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:45.494940    4060 scope.go:122] "RemoveContainer" containerID="bc95f9bd35ed9c22dfc6fb20c69f83e2fff69d59b0c330cf795d7b2677806ac8"
Oct 30 21:49:45.502258 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:45.502240    4060 scope.go:122] "RemoveContainer" containerID="3384ec5022f19b93b7a419467f2a76cb8fd99398f82039d18abdb787b8ea8044"
Oct 30 21:49:45.502534 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:49:45.502512    4060 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3384ec5022f19b93b7a419467f2a76cb8fd99398f82039d18abdb787b8ea8044\": container with ID starting with 3384ec5022f19b93b7a419467f2a76cb8fd99398f82039d18abdb787b8ea8044 not found: ID does not exist" containerID="3384ec5022f19b93b7a419467f2a76cb8fd99398f82039d18abdb787b8ea8044"
Oct 30 21:49:45.502635 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:45.502546    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3384ec5022f19b93b7a419467f2a76cb8fd99398f82039d18abdb787b8ea8044"} err="failed to get container status \"3384ec5022f19b93b7a419467f2a76cb8fd99398f82039d18abdb787b8ea8044\": rpc error: code = NotFound desc = could not find container \"3384ec5022f19b93b7a419467f2a76cb8fd99398f82039d18abdb787b8ea8044\": container with ID starting with 3384ec5022f19b93b7a419467f2a76cb8fd99398f82039d18abdb787b8ea8044 not found: ID does not exist"
Oct 30 21:49:45.502635 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:45.502571    4060 scope.go:122] "RemoveContainer" containerID="b1e98b2449ae6f7c34405eb2715a7bfa7bdab4c1adff60cb664c10743598ed6e"
Oct 30 21:49:45.502853 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:49:45.502834    4060 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b1e98b2449ae6f7c34405eb2715a7bfa7bdab4c1adff60cb664c10743598ed6e\": container with ID starting with b1e98b2449ae6f7c34405eb2715a7bfa7bdab4c1adff60cb664c10743598ed6e not found: ID does not exist" containerID="b1e98b2449ae6f7c34405eb2715a7bfa7bdab4c1adff60cb664c10743598ed6e"
Oct 30 21:49:45.502891 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:45.502859    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b1e98b2449ae6f7c34405eb2715a7bfa7bdab4c1adff60cb664c10743598ed6e"} err="failed to get container status \"b1e98b2449ae6f7c34405eb2715a7bfa7bdab4c1adff60cb664c10743598ed6e\": rpc error: code = NotFound desc = could not find container \"b1e98b2449ae6f7c34405eb2715a7bfa7bdab4c1adff60cb664c10743598ed6e\": container with ID starting with b1e98b2449ae6f7c34405eb2715a7bfa7bdab4c1adff60cb664c10743598ed6e not found: ID does not exist"
Oct 30 21:49:45.502891 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:45.502877    4060 scope.go:122] "RemoveContainer" containerID="bc95f9bd35ed9c22dfc6fb20c69f83e2fff69d59b0c330cf795d7b2677806ac8"
Oct 30 21:49:45.503165 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:49:45.503144    4060 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bc95f9bd35ed9c22dfc6fb20c69f83e2fff69d59b0c330cf795d7b2677806ac8\": container with ID starting with bc95f9bd35ed9c22dfc6fb20c69f83e2fff69d59b0c330cf795d7b2677806ac8 not found: ID does not exist" containerID="bc95f9bd35ed9c22dfc6fb20c69f83e2fff69d59b0c330cf795d7b2677806ac8"
Oct 30 21:49:45.503225 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:45.503175    4060 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bc95f9bd35ed9c22dfc6fb20c69f83e2fff69d59b0c330cf795d7b2677806ac8"} err="failed to get container status \"bc95f9bd35ed9c22dfc6fb20c69f83e2fff69d59b0c330cf795d7b2677806ac8\": rpc error: code = NotFound desc = could not find container \"bc95f9bd35ed9c22dfc6fb20c69f83e2fff69d59b0c330cf795d7b2677806ac8\": container with ID starting with bc95f9bd35ed9c22dfc6fb20c69f83e2fff69d59b0c330cf795d7b2677806ac8 not found: ID does not exist"
Oct 30 21:49:45.645415 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:45.645382    4060 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"]
Oct 30 21:49:45.694957 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:45.694849    4060 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/alertmanager-data-science-monitoringstack-0"]
Oct 30 21:49:47.426619 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:49:47.426589    4060 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="fdb7e0b7-337e-4055-b601-386203d23d57" path="/var/lib/kubelet/pods/fdb7e0b7-337e-4055-b601-386203d23d57/volumes"
Oct 30 21:50:09.173065 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:50:09.173032    4060 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-observability-system_odh-observability-6f5479fd64-7gfbz_cc6aeef9-afb1-4052-91eb-76d3d3a3427a/manager/3.log"
Oct 30 21:50:12.149979 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:50:12.149945    4060 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v2f4x" containerName="extractor"
Oct 30 21:50:21.226469 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:50:21.226433    4060 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-cfdhw_261f6884-299b-4971-b936-bbb3174f1b66/global-pull-secret-syncer/0.log"
Oct 30 21:50:23.726534 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:50:23.726509    4060 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-mlgfz_70cf9a0e-c321-438d-83a2-2034f4df9034/konnectivity-agent/0.log"
Oct 30 21:50:25.666000 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:50:25.665967    4060 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-142-4.us-west-1.compute.internal_c873d294ea5be2c96cd88ae10288f56b/haproxy/0.log"
Oct 30 21:50:29.407418 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:50:29.407382    4060 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-must-gather-dfcks/perf-node-gather-daemonset-pcsxr"]
Oct 30 21:50:29.407828 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:50:29.407700    4060 cpu_manager.go:414] "containerMap: removing container" podUID="fdb7e0b7-337e-4055-b601-386203d23d57" containerName="config-reloader"
Oct 30 21:50:29.407828 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:50:29.407714    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="fdb7e0b7-337e-4055-b601-386203d23d57" containerName="config-reloader"
Oct 30 21:50:29.407828 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:50:29.407729    4060 cpu_manager.go:414] "containerMap: removing container" podUID="fdb7e0b7-337e-4055-b601-386203d23d57" containerName="alertmanager"
Oct 30 21:50:29.407828 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:50:29.407734    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="fdb7e0b7-337e-4055-b601-386203d23d57" containerName="alertmanager"
Oct 30 21:50:29.407828 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:50:29.407740    4060 cpu_manager.go:414] "containerMap: removing container" podUID="f5bde344-2b50-40f6-96c9-a661322860d3" containerName="prometheus"
Oct 30 21:50:29.407828 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:50:29.407746    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f5bde344-2b50-40f6-96c9-a661322860d3" containerName="prometheus"
Oct 30 21:50:29.407828 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:50:29.407755    4060 cpu_manager.go:414] "containerMap: removing container" podUID="f5bde344-2b50-40f6-96c9-a661322860d3" containerName="init-config-reloader"
Oct 30 21:50:29.407828 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:50:29.407759    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f5bde344-2b50-40f6-96c9-a661322860d3" containerName="init-config-reloader"
Oct 30 21:50:29.407828 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:50:29.407774    4060 cpu_manager.go:414] "containerMap: removing container" podUID="fdb7e0b7-337e-4055-b601-386203d23d57" containerName="init-config-reloader"
Oct 30 21:50:29.407828 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:50:29.407780    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="fdb7e0b7-337e-4055-b601-386203d23d57" containerName="init-config-reloader"
Oct 30 21:50:29.407828 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:50:29.407787    4060 cpu_manager.go:414] "containerMap: removing container" podUID="798689a4-7697-4238-b20f-00c5620c5eb4" containerName="kube-rbac-proxy"
Oct 30 21:50:29.407828 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:50:29.407795    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="798689a4-7697-4238-b20f-00c5620c5eb4" containerName="kube-rbac-proxy"
Oct 30 21:50:29.407828 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:50:29.407804    4060 cpu_manager.go:414] "containerMap: removing container" podUID="f5bde344-2b50-40f6-96c9-a661322860d3" containerName="config-reloader"
Oct 30 21:50:29.407828 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:50:29.407808    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f5bde344-2b50-40f6-96c9-a661322860d3" containerName="config-reloader"
Oct 30 21:50:29.407828 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:50:29.407817    4060 cpu_manager.go:414] "containerMap: removing container" podUID="f5bde344-2b50-40f6-96c9-a661322860d3" containerName="thanos-sidecar"
Oct 30 21:50:29.407828 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:50:29.407821    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f5bde344-2b50-40f6-96c9-a661322860d3" containerName="thanos-sidecar"
Oct 30 21:50:29.407828 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:50:29.407829    4060 cpu_manager.go:414] "containerMap: removing container" podUID="f3df7a4d-f910-432e-ae0c-93dcbabb6313" containerName="korrel8r"
Oct 30 21:50:29.407828 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:50:29.407836    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f3df7a4d-f910-432e-ae0c-93dcbabb6313" containerName="korrel8r"
Oct 30 21:50:29.408390 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:50:29.407843    4060 cpu_manager.go:414] "containerMap: removing container" podUID="1b73e782-fcb6-4bc0-87c9-f24e47a845bd" containerName="otc-container"
Oct 30 21:50:29.408390 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:50:29.407847    4060 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1b73e782-fcb6-4bc0-87c9-f24e47a845bd" containerName="otc-container"
Oct 30 21:50:29.408390 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:50:29.407897    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="fdb7e0b7-337e-4055-b601-386203d23d57" containerName="config-reloader"
Oct 30 21:50:29.408390 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:50:29.407905    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="fdb7e0b7-337e-4055-b601-386203d23d57" containerName="alertmanager"
Oct 30 21:50:29.408390 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:50:29.407911    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="f5bde344-2b50-40f6-96c9-a661322860d3" containerName="prometheus"
Oct 30 21:50:29.408390 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:50:29.407921    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="798689a4-7697-4238-b20f-00c5620c5eb4" containerName="kube-rbac-proxy"
Oct 30 21:50:29.408390 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:50:29.407925    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="f5bde344-2b50-40f6-96c9-a661322860d3" containerName="config-reloader"
Oct 30 21:50:29.408390 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:50:29.407931    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="f5bde344-2b50-40f6-96c9-a661322860d3" containerName="thanos-sidecar"
Oct 30 21:50:29.408390 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:50:29.407937    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="f3df7a4d-f910-432e-ae0c-93dcbabb6313" containerName="korrel8r"
Oct 30 21:50:29.408390 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:50:29.407944    4060 memory_manager.go:365] "RemoveStaleState removing state" podUID="1b73e782-fcb6-4bc0-87c9-f24e47a845bd" containerName="otc-container"
Oct 30 21:50:29.412603 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:50:29.412583    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-dfcks/perf-node-gather-daemonset-pcsxr"
Oct 30 21:50:29.468256 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:50:29.468220    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-dfcks\"/\"kube-root-ca.crt\""
Oct 30 21:50:29.487708 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:50:29.487677    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/129c790c-b8ab-4aac-9155-5437f0764f1d-podres\") pod \"perf-node-gather-daemonset-pcsxr\" (UID: \"129c790c-b8ab-4aac-9155-5437f0764f1d\") " pod="openshift-must-gather-dfcks/perf-node-gather-daemonset-pcsxr"
Oct 30 21:50:29.487889 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:50:29.487722    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/129c790c-b8ab-4aac-9155-5437f0764f1d-lib-modules\") pod \"perf-node-gather-daemonset-pcsxr\" (UID: \"129c790c-b8ab-4aac-9155-5437f0764f1d\") " pod="openshift-must-gather-dfcks/perf-node-gather-daemonset-pcsxr"
Oct 30 21:50:29.487889 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:50:29.487815    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/129c790c-b8ab-4aac-9155-5437f0764f1d-sys\") pod \"perf-node-gather-daemonset-pcsxr\" (UID: \"129c790c-b8ab-4aac-9155-5437f0764f1d\") " pod="openshift-must-gather-dfcks/perf-node-gather-daemonset-pcsxr"
Oct 30 21:50:29.487889 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:50:29.487859    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/129c790c-b8ab-4aac-9155-5437f0764f1d-proc\") pod \"perf-node-gather-daemonset-pcsxr\" (UID: \"129c790c-b8ab-4aac-9155-5437f0764f1d\") " pod="openshift-must-gather-dfcks/perf-node-gather-daemonset-pcsxr"
Oct 30 21:50:29.488034 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:50:29.487937    4060 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7mzjg\" (UniqueName: \"kubernetes.io/projected/129c790c-b8ab-4aac-9155-5437f0764f1d-kube-api-access-7mzjg\") pod \"perf-node-gather-daemonset-pcsxr\" (UID: \"129c790c-b8ab-4aac-9155-5437f0764f1d\") " pod="openshift-must-gather-dfcks/perf-node-gather-daemonset-pcsxr"
Oct 30 21:50:29.517732 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:50:29.517710    4060 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-dfcks\"/\"default-dockercfg-k474x\""
Oct 30 21:50:29.517732 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:50:29.517713    4060 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-dfcks\"/\"openshift-service-ca.crt\""
Oct 30 21:50:29.519614 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:50:29.519588    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-dfcks/perf-node-gather-daemonset-pcsxr"]
Oct 30 21:50:29.588693 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:50:29.588662    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/129c790c-b8ab-4aac-9155-5437f0764f1d-podres\") pod \"perf-node-gather-daemonset-pcsxr\" (UID: \"129c790c-b8ab-4aac-9155-5437f0764f1d\") " pod="openshift-must-gather-dfcks/perf-node-gather-daemonset-pcsxr"
Oct 30 21:50:29.588884 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:50:29.588710    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/129c790c-b8ab-4aac-9155-5437f0764f1d-lib-modules\") pod \"perf-node-gather-daemonset-pcsxr\" (UID: \"129c790c-b8ab-4aac-9155-5437f0764f1d\") " pod="openshift-must-gather-dfcks/perf-node-gather-daemonset-pcsxr"
Oct 30 21:50:29.588884 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:50:29.588752    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/129c790c-b8ab-4aac-9155-5437f0764f1d-sys\") pod \"perf-node-gather-daemonset-pcsxr\" (UID: \"129c790c-b8ab-4aac-9155-5437f0764f1d\") " pod="openshift-must-gather-dfcks/perf-node-gather-daemonset-pcsxr"
Oct 30 21:50:29.588884 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:50:29.588780    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/129c790c-b8ab-4aac-9155-5437f0764f1d-proc\") pod \"perf-node-gather-daemonset-pcsxr\" (UID: \"129c790c-b8ab-4aac-9155-5437f0764f1d\") " pod="openshift-must-gather-dfcks/perf-node-gather-daemonset-pcsxr"
Oct 30 21:50:29.588884 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:50:29.588802    4060 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7mzjg\" (UniqueName: \"kubernetes.io/projected/129c790c-b8ab-4aac-9155-5437f0764f1d-kube-api-access-7mzjg\") pod \"perf-node-gather-daemonset-pcsxr\" (UID: \"129c790c-b8ab-4aac-9155-5437f0764f1d\") " pod="openshift-must-gather-dfcks/perf-node-gather-daemonset-pcsxr"
Oct 30 21:50:29.589089 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:50:29.588895    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/129c790c-b8ab-4aac-9155-5437f0764f1d-podres\") pod \"perf-node-gather-daemonset-pcsxr\" (UID: \"129c790c-b8ab-4aac-9155-5437f0764f1d\") " pod="openshift-must-gather-dfcks/perf-node-gather-daemonset-pcsxr"
Oct 30 21:50:29.589089 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:50:29.588963    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/129c790c-b8ab-4aac-9155-5437f0764f1d-sys\") pod \"perf-node-gather-daemonset-pcsxr\" (UID: \"129c790c-b8ab-4aac-9155-5437f0764f1d\") " pod="openshift-must-gather-dfcks/perf-node-gather-daemonset-pcsxr"
Oct 30 21:50:29.589089 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:50:29.588991    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/129c790c-b8ab-4aac-9155-5437f0764f1d-proc\") pod \"perf-node-gather-daemonset-pcsxr\" (UID: \"129c790c-b8ab-4aac-9155-5437f0764f1d\") " pod="openshift-must-gather-dfcks/perf-node-gather-daemonset-pcsxr"
Oct 30 21:50:29.589089 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:50:29.589024    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/129c790c-b8ab-4aac-9155-5437f0764f1d-lib-modules\") pod \"perf-node-gather-daemonset-pcsxr\" (UID: \"129c790c-b8ab-4aac-9155-5437f0764f1d\") " pod="openshift-must-gather-dfcks/perf-node-gather-daemonset-pcsxr"
Oct 30 21:50:29.650996 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:50:29.650966    4060 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7mzjg\" (UniqueName: \"kubernetes.io/projected/129c790c-b8ab-4aac-9155-5437f0764f1d-kube-api-access-7mzjg\") pod \"perf-node-gather-daemonset-pcsxr\" (UID: \"129c790c-b8ab-4aac-9155-5437f0764f1d\") " pod="openshift-must-gather-dfcks/perf-node-gather-daemonset-pcsxr"
Oct 30 21:50:29.725000 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:50:29.724966    4060 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-dfcks/perf-node-gather-daemonset-pcsxr"
Oct 30 21:50:30.118712 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:50:30.118688    4060 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-dfcks/perf-node-gather-daemonset-pcsxr"]
Oct 30 21:50:30.120163 ip-10-0-142-4 kubenswrapper[4060]: W1030 21:50:30.120139    4060 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod129c790c_b8ab_4aac_9155_5437f0764f1d.slice/crio-b0eb5c00e3efd200ba4ca29a99bc6c07026c6600e6f88ae8f68781282614116c WatchSource:0}: Error finding container b0eb5c00e3efd200ba4ca29a99bc6c07026c6600e6f88ae8f68781282614116c: Status 404 returned error can't find the container with id b0eb5c00e3efd200ba4ca29a99bc6c07026c6600e6f88ae8f68781282614116c
Oct 30 21:50:30.680359 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:50:30.680317    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-dfcks/perf-node-gather-daemonset-pcsxr" event={"ID":"129c790c-b8ab-4aac-9155-5437f0764f1d","Type":"ContainerStarted","Data":"0de5fa1e3a30c7a1b5d804e861275bbf1a7e9708aafbcfeb23a01206cdaa765a"}
Oct 30 21:50:30.680834 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:50:30.680405    4060 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-dfcks/perf-node-gather-daemonset-pcsxr" event={"ID":"129c790c-b8ab-4aac-9155-5437f0764f1d","Type":"ContainerStarted","Data":"b0eb5c00e3efd200ba4ca29a99bc6c07026c6600e6f88ae8f68781282614116c"}
Oct 30 21:50:30.680834 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:50:30.680460    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-dfcks/perf-node-gather-daemonset-pcsxr"
Oct 30 21:50:30.796167 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:50:30.796108    4060 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-must-gather-dfcks/perf-node-gather-daemonset-pcsxr" podStartSLOduration=1.7960903799999999 podStartE2EDuration="1.79609038s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 21:50:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:50:30.79585837 +0000 UTC m=+4449.552856694" watchObservedRunningTime="2026-10-30 21:50:30.79609038 +0000 UTC m=+4449.553088681"
Oct 30 21:50:36.542329 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:50:36.542250    4060 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bmddw_28f01de8-7376-43d8-9543-5a30d01332e7/node-exporter/0.log"
Oct 30 21:50:36.695159 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:50:36.695135    4060 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-dfcks/perf-node-gather-daemonset-pcsxr"
Oct 30 21:50:36.965503 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:50:36.965466    4060 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bmddw_28f01de8-7376-43d8-9543-5a30d01332e7/kube-rbac-proxy/0.log"
Oct 30 21:50:37.390747 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:50:37.390676    4060 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bmddw_28f01de8-7376-43d8-9543-5a30d01332e7/init-textfile/0.log"
Oct 30 21:50:42.151386 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:50:42.151350    4060 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-9cd89b74c-rgltt_a046541e-b2d8-4e1f-a0ab-b0d75e95a7fa/prometheus-operator/0.log"
Oct 30 21:50:42.151386 ip-10-0-142-4 kubenswrapper[4060]: E1030 21:50:42.151377    4060 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-v2f4x" containerName="extractor"
Oct 30 21:50:42.569100 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:50:42.569069    4060 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-9cd89b74c-rgltt_a046541e-b2d8-4e1f-a0ab-b0d75e95a7fa/kube-rbac-proxy/0.log"
Oct 30 21:50:42.997238 ip-10-0-142-4 kubenswrapper[4060]: I1030 21:50:42.997205    4060 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-6489d8bf89-wn6gs_dac1149e-df18-406d-8c47-24129245c95f/prometheus-operator-admission-webhook/0.log"