Jul 08 01:41:59.678583 ip-10-0-142-233 systemd[1]: Starting Kubernetes Kubelet... Jul 08 01:42:00.107974 ip-10-0-142-233 kubenswrapper[2563]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 08 01:42:00.107974 ip-10-0-142-233 kubenswrapper[2563]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 08 01:42:00.107974 ip-10-0-142-233 kubenswrapper[2563]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 08 01:42:00.107974 ip-10-0-142-233 kubenswrapper[2563]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 08 01:42:00.107974 ip-10-0-142-233 kubenswrapper[2563]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 08 01:42:00.108847 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.108628 2563 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 08 01:42:00.115867 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.115841 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 01:42:00.115867 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.115862 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 01:42:00.115867 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.115867 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 01:42:00.115867 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.115872 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 01:42:00.116109 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.115880 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 01:42:00.116109 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.115887 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 01:42:00.116109 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.115892 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 01:42:00.116109 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.115896 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 01:42:00.116109 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.115901 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 01:42:00.116109 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.115906 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 01:42:00.116109 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.115909 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 01:42:00.116109 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.115914 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 01:42:00.116109 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.115917 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 01:42:00.116109 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.115922 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 01:42:00.116109 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.115926 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 01:42:00.116109 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.115930 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 01:42:00.116109 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.115934 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 01:42:00.116109 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.115938 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 01:42:00.116109 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.115942 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 01:42:00.116109 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.115946 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 01:42:00.116109 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.115950 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 01:42:00.116109 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.115966 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 01:42:00.116109 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.115970 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 01:42:00.116109 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.115974 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 01:42:00.116637 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.115979 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 01:42:00.116637 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.115983 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 01:42:00.116637 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.115987 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 01:42:00.116637 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.115991 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 01:42:00.116637 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.115996 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 01:42:00.116637 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.116000 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 01:42:00.116637 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.116005 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 01:42:00.116637 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.116009 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 01:42:00.116637 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.116014 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 01:42:00.116637 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.116018 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 01:42:00.116637 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.116022 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 01:42:00.116637 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.116066 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 01:42:00.116637 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.116071 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 01:42:00.116637 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.116076 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 01:42:00.116637 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.116083 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 01:42:00.116637 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.116086 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 01:42:00.116637 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.116090 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 01:42:00.116637 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.116093 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 01:42:00.116637 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.116096 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 01:42:00.116637 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.116099 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 01:42:00.117169 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.116103 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 01:42:00.117169 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.116106 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 01:42:00.117169 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.116108 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 01:42:00.117169 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.116111 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 01:42:00.117169 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.116115 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 01:42:00.117169 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.116118 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 01:42:00.117169 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.116121 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 01:42:00.117169 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.116124 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 01:42:00.117169 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.116128 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 01:42:00.117169 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.116130 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 01:42:00.117169 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.116137 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 01:42:00.117169 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.116140 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 01:42:00.117169 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.116143 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 01:42:00.117169 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.116148 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 01:42:00.117169 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.116150 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 01:42:00.117169 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.116156 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 01:42:00.117169 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.116170 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 01:42:00.117169 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.116174 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 01:42:00.117169 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.116178 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 01:42:00.117694 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.116181 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 01:42:00.117694 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.116183 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 01:42:00.117694 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.116186 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 01:42:00.117694 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.116189 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 01:42:00.117694 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.116193 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 01:42:00.117694 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.116196 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 01:42:00.117694 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.116199 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 01:42:00.117694 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.116202 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 01:42:00.117694 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.116205 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 01:42:00.117694 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.116224 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 01:42:00.117694 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.116227 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 01:42:00.117694 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.116230 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 01:42:00.117694 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.116233 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 01:42:00.117694 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.116236 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 01:42:00.117694 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.116240 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 01:42:00.117694 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.116242 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 01:42:00.117694 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.116248 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 01:42:00.117694 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.116251 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 01:42:00.117694 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.116255 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 01:42:00.117694 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.116258 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 01:42:00.118205 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.116261 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 01:42:00.118205 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.116265 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 01:42:00.118205 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.116269 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 01:42:00.118205 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.116272 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 01:42:00.118205 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.116275 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 01:42:00.118205 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.116278 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 01:42:00.118205 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.116282 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 01:42:00.118205 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.116289 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 01:42:00.118205 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.116292 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 01:42:00.118205 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.116295 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 01:42:00.118205 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.116298 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 01:42:00.118205 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.116301 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 01:42:00.118205 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.116304 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 01:42:00.118205 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.116307 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 01:42:00.118205 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.116310 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 01:42:00.118205 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.116313 2563 feature_gate.go:328] unrecognized feature gate: Example Jul 08 01:42:00.118205 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.117145 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 01:42:00.118205 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.117154 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 01:42:00.118205 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.117157 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 01:42:00.118205 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.117160 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 01:42:00.118786 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.117163 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 01:42:00.118786 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.117166 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 01:42:00.118786 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.117169 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 01:42:00.118786 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.117172 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 01:42:00.118786 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.117176 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 01:42:00.118786 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.117179 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 01:42:00.118786 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.117182 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 01:42:00.118786 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.117185 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 01:42:00.118786 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.117188 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 01:42:00.118786 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.117190 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 01:42:00.118786 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.117194 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 01:42:00.118786 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.117197 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 01:42:00.118786 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.117200 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 01:42:00.118786 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.117203 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 01:42:00.118786 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.117205 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 01:42:00.118786 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.117208 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 01:42:00.118786 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.117211 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 01:42:00.118786 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.117214 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 01:42:00.118786 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.117217 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 01:42:00.118786 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.117220 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 01:42:00.119341 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.117223 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 01:42:00.119341 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.117226 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 01:42:00.119341 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.117229 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 01:42:00.119341 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.117232 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 01:42:00.119341 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.117235 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 01:42:00.119341 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.117238 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 01:42:00.119341 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.117241 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 01:42:00.119341 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.117243 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 01:42:00.119341 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.117247 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 01:42:00.119341 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.117250 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 01:42:00.119341 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.117253 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 01:42:00.119341 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.117258 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 01:42:00.119341 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.117262 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 01:42:00.119341 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.117267 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 01:42:00.119341 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.117270 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 01:42:00.119341 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.117273 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 01:42:00.119341 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.117293 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 01:42:00.119341 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.117297 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 01:42:00.119341 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.117300 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 01:42:00.119867 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.117303 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 01:42:00.119867 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.117306 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 01:42:00.119867 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.117309 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 01:42:00.119867 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.117312 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 01:42:00.119867 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.117315 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 01:42:00.119867 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.117318 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 01:42:00.119867 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.117321 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 01:42:00.119867 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.117323 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 01:42:00.119867 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.117326 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 01:42:00.119867 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.117329 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 01:42:00.119867 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.117333 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 01:42:00.119867 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.117336 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 01:42:00.119867 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.117339 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 01:42:00.119867 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.117342 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 01:42:00.119867 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.117346 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 01:42:00.119867 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.117349 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 01:42:00.119867 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.117352 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 01:42:00.119867 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.117355 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 01:42:00.119867 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.117358 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 01:42:00.119867 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.117360 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 01:42:00.120408 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.117363 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 01:42:00.120408 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.117366 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 01:42:00.120408 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.117369 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 01:42:00.120408 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.117373 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 01:42:00.120408 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.117376 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 01:42:00.120408 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.117378 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 01:42:00.120408 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.117382 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 01:42:00.120408 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.117384 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 01:42:00.120408 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.117387 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 01:42:00.120408 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.117390 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 01:42:00.120408 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.117393 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 01:42:00.120408 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.117396 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 01:42:00.120408 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.117398 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 01:42:00.120408 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.117401 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 01:42:00.120408 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.117404 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 01:42:00.120408 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.117407 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 01:42:00.120408 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.117410 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 01:42:00.120408 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.117415 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 01:42:00.120408 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.117420 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 01:42:00.120892 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.117424 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 01:42:00.120892 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.117427 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 01:42:00.120892 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.117430 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 01:42:00.120892 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.117433 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 01:42:00.120892 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.117437 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 01:42:00.120892 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.117440 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 01:42:00.120892 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.117443 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 01:42:00.120892 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.117447 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 01:42:00.120892 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.117452 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 01:42:00.120892 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.117455 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 01:42:00.120892 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.117458 2563 feature_gate.go:328] unrecognized feature gate: Example Jul 08 01:42:00.120892 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.117461 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 01:42:00.120892 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.117465 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 01:42:00.120892 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.117468 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 01:42:00.120892 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.117471 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 01:42:00.120892 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.117474 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 01:42:00.120892 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.117477 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 01:42:00.120892 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.117914 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 01:42:00.120892 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.117920 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 01:42:00.120892 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.117923 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 01:42:00.121418 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.117926 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 01:42:00.121418 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.117929 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 01:42:00.121418 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.117932 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 01:42:00.121418 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.117935 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 01:42:00.121418 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.117938 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 01:42:00.121418 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.117941 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 01:42:00.121418 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.117944 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 01:42:00.121418 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.117947 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 01:42:00.121418 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.117950 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 01:42:00.121418 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.117953 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 01:42:00.121418 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.117955 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 01:42:00.121418 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.117958 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 01:42:00.121418 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.117961 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 01:42:00.121418 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.117963 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 01:42:00.121418 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.117967 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 01:42:00.121418 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.117970 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 01:42:00.121418 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.117972 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 01:42:00.121418 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.117975 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 01:42:00.121418 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.117979 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 01:42:00.121918 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.117982 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 01:42:00.121918 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.117985 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 01:42:00.121918 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.117988 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 01:42:00.121918 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.117991 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 01:42:00.121918 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.117994 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 01:42:00.121918 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.117997 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 01:42:00.121918 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.118000 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 01:42:00.121918 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.118003 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 01:42:00.121918 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.118005 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 01:42:00.121918 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.118008 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 01:42:00.121918 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.118010 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 01:42:00.121918 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.118014 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 01:42:00.121918 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.118018 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 01:42:00.121918 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.118021 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 01:42:00.121918 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.118023 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 01:42:00.121918 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.118026 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 01:42:00.121918 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.118029 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 01:42:00.121918 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.118032 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 01:42:00.121918 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.118034 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 01:42:00.121918 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.118037 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 01:42:00.122458 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.118040 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 01:42:00.122458 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.118045 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 01:42:00.122458 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.118049 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 01:42:00.122458 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.118052 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 01:42:00.122458 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.118055 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 01:42:00.122458 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.118058 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 01:42:00.122458 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.118061 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 01:42:00.122458 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.118064 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 01:42:00.122458 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.118066 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 01:42:00.122458 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.118069 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 01:42:00.122458 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.118072 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 01:42:00.122458 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.118075 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 01:42:00.122458 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.118079 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 01:42:00.122458 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.118082 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 01:42:00.122458 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.118085 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 01:42:00.122458 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.118089 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 01:42:00.122458 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.118092 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 01:42:00.122458 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.118095 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 01:42:00.122458 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.118098 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 01:42:00.122976 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.118101 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 01:42:00.122976 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.118103 2563 feature_gate.go:328] unrecognized feature gate: Example Jul 08 01:42:00.122976 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.118106 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 01:42:00.122976 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.118108 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 01:42:00.122976 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.118111 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 01:42:00.122976 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.118114 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 01:42:00.122976 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.118117 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 01:42:00.122976 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.118119 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 01:42:00.122976 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.118122 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 01:42:00.122976 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.118125 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 01:42:00.122976 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.118128 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 01:42:00.122976 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.118130 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 01:42:00.122976 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.118133 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 01:42:00.122976 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.118139 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 01:42:00.122976 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.118142 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 01:42:00.122976 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.118145 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 01:42:00.122976 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.118147 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 01:42:00.122976 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.118150 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 01:42:00.122976 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.118153 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 01:42:00.122976 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.118156 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 01:42:00.123517 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.118158 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 01:42:00.123517 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.118161 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 01:42:00.123517 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.118164 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 01:42:00.123517 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.118167 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 01:42:00.123517 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.118170 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 01:42:00.123517 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.118173 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 01:42:00.123517 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.118178 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 01:42:00.123517 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.118182 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 01:42:00.123517 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.118186 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 01:42:00.123517 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.118189 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 01:42:00.123517 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.118192 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 01:42:00.123517 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.118195 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 01:42:00.123517 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.118198 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 01:42:00.123517 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.118201 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 01:42:00.123517 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.118204 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 01:42:00.123517 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.118206 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 01:42:00.123517 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.118209 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 01:42:00.123517 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.118212 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 01:42:00.123517 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.118306 2563 flags.go:64] FLAG: --address="0.0.0.0" Jul 08 01:42:00.123517 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.118324 2563 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 08 01:42:00.124024 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.118329 2563 flags.go:64] FLAG: --anonymous-auth="true" Jul 08 01:42:00.124024 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.118334 2563 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 08 01:42:00.124024 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.118339 2563 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 08 01:42:00.124024 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.118342 2563 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 08 01:42:00.124024 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.118347 2563 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 08 01:42:00.124024 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.118353 2563 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 08 01:42:00.124024 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.118357 2563 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 08 01:42:00.124024 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.118360 2563 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 08 01:42:00.124024 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.118364 2563 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 08 01:42:00.124024 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.118368 2563 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 08 01:42:00.124024 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.118372 2563 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 08 01:42:00.124024 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.118375 2563 flags.go:64] FLAG: --cgroup-root="" Jul 08 01:42:00.124024 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.118378 2563 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 08 01:42:00.124024 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.118381 2563 flags.go:64] FLAG: --client-ca-file="" Jul 08 01:42:00.124024 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.118385 2563 flags.go:64] FLAG: --cloud-provider="external" Jul 08 01:42:00.124024 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.118388 2563 flags.go:64] FLAG: --cluster-dns="[]" Jul 08 01:42:00.124024 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.118393 2563 flags.go:64] FLAG: --cluster-domain="" Jul 08 01:42:00.124024 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.118397 2563 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 08 01:42:00.124024 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.118400 2563 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 08 01:42:00.124024 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.118403 2563 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 08 01:42:00.124024 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.118407 2563 flags.go:64] FLAG: --container-log-max-files="5" Jul 08 01:42:00.124024 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.118412 2563 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 08 01:42:00.124024 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.118415 2563 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 08 01:42:00.124629 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.118419 2563 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 08 01:42:00.124629 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.118422 2563 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 08 01:42:00.124629 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.118426 2563 flags.go:64] FLAG: --contention-profiling="false" Jul 08 01:42:00.124629 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.118429 2563 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 08 01:42:00.124629 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.118433 2563 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 08 01:42:00.124629 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.118436 2563 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 08 01:42:00.124629 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.118439 2563 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 08 01:42:00.124629 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.118444 2563 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 08 01:42:00.124629 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.118447 2563 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 08 01:42:00.124629 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.118450 2563 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 08 01:42:00.124629 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.118454 2563 flags.go:64] FLAG: --enable-load-reader="false" Jul 08 01:42:00.124629 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.118457 2563 flags.go:64] FLAG: --enable-server="true" Jul 08 01:42:00.124629 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.118461 2563 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 08 01:42:00.124629 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.118464 2563 flags.go:64] FLAG: --event-burst="100" Jul 08 01:42:00.124629 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.118469 2563 flags.go:64] FLAG: --event-qps="50" Jul 08 01:42:00.124629 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.118473 2563 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 08 01:42:00.124629 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.118476 2563 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 08 01:42:00.124629 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.118479 2563 flags.go:64] FLAG: --eviction-hard="" Jul 08 01:42:00.124629 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.118484 2563 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 08 01:42:00.124629 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.118487 2563 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 08 01:42:00.124629 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.118491 2563 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 08 01:42:00.124629 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.118494 2563 flags.go:64] FLAG: --eviction-soft="" Jul 08 01:42:00.124629 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.118497 2563 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 08 01:42:00.124629 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.118503 2563 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 08 01:42:00.124629 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.118506 2563 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 08 01:42:00.125426 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.118509 2563 flags.go:64] FLAG: --experimental-mounter-path="" Jul 08 01:42:00.125426 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.118513 2563 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 08 01:42:00.125426 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.118516 2563 flags.go:64] FLAG: --fail-swap-on="true" Jul 08 01:42:00.125426 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.118520 2563 flags.go:64] FLAG: --feature-gates="" Jul 08 01:42:00.125426 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.118524 2563 flags.go:64] FLAG: --file-check-frequency="20s" Jul 08 01:42:00.125426 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.118528 2563 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 08 01:42:00.125426 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.118532 2563 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 08 01:42:00.125426 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.118536 2563 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 08 01:42:00.125426 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.118539 2563 flags.go:64] FLAG: --healthz-port="10248" Jul 08 01:42:00.125426 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.118543 2563 flags.go:64] FLAG: --help="false" Jul 08 01:42:00.125426 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.118546 2563 flags.go:64] FLAG: --hostname-override="ip-10-0-142-233.ec2.internal" Jul 08 01:42:00.125426 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.118549 2563 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 08 01:42:00.125426 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.118552 2563 flags.go:64] FLAG: --http-check-frequency="20s" Jul 08 01:42:00.125426 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.118555 2563 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 08 01:42:00.125426 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.118559 2563 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 08 01:42:00.125426 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.118563 2563 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 08 01:42:00.125426 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.118566 2563 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 08 01:42:00.125426 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.118570 2563 flags.go:64] FLAG: --image-service-endpoint="" Jul 08 01:42:00.125426 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.118573 2563 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 08 01:42:00.125426 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.118576 2563 flags.go:64] FLAG: --kube-api-burst="100" Jul 08 01:42:00.125426 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.118579 2563 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 08 01:42:00.125426 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.118584 2563 flags.go:64] FLAG: --kube-api-qps="50" Jul 08 01:42:00.125426 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.118587 2563 flags.go:64] FLAG: --kube-reserved="" Jul 08 01:42:00.125426 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.118590 2563 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 08 01:42:00.126565 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.118593 2563 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 08 01:42:00.126565 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.118597 2563 flags.go:64] FLAG: --kubelet-cgroups="" Jul 08 01:42:00.126565 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.118600 2563 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 08 01:42:00.126565 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.118603 2563 flags.go:64] FLAG: --lock-file="" Jul 08 01:42:00.126565 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.118606 2563 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 08 01:42:00.126565 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.118610 2563 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 08 01:42:00.126565 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.118614 2563 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 08 01:42:00.126565 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.118620 2563 flags.go:64] FLAG: --log-json-split-stream="false" Jul 08 01:42:00.126565 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.118623 2563 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 08 01:42:00.126565 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.118626 2563 flags.go:64] FLAG: --log-text-split-stream="false" Jul 08 01:42:00.126565 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.118629 2563 flags.go:64] FLAG: --logging-format="text" Jul 08 01:42:00.126565 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.118632 2563 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 08 01:42:00.126565 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.118636 2563 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 08 01:42:00.126565 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.118639 2563 flags.go:64] FLAG: --manifest-url="" Jul 08 01:42:00.126565 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.118642 2563 flags.go:64] FLAG: --manifest-url-header="" Jul 08 01:42:00.126565 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.118650 2563 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 08 01:42:00.126565 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.118654 2563 flags.go:64] FLAG: --max-open-files="1000000" Jul 08 01:42:00.126565 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.118658 2563 flags.go:64] FLAG: --max-pods="110" Jul 08 01:42:00.126565 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.118662 2563 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 08 01:42:00.126565 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.118665 2563 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 08 01:42:00.126565 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.118668 2563 flags.go:64] FLAG: --memory-manager-policy="None" Jul 08 01:42:00.126565 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.118672 2563 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 08 01:42:00.126565 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.118675 2563 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 08 01:42:00.126565 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.118678 2563 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 08 01:42:00.126565 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.118694 2563 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 08 01:42:00.127502 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.118703 2563 flags.go:64] FLAG: --node-status-max-images="50" Jul 08 01:42:00.127502 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.118707 2563 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 08 01:42:00.127502 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.118710 2563 flags.go:64] FLAG: --oom-score-adj="-999" Jul 08 01:42:00.127502 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.118713 2563 flags.go:64] FLAG: --pod-cidr="" Jul 08 01:42:00.127502 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.118718 2563 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 08 01:42:00.127502 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.118724 2563 flags.go:64] FLAG: --pod-manifest-path="" Jul 08 01:42:00.127502 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.118728 2563 flags.go:64] FLAG: --pod-max-pids="-1" Jul 08 01:42:00.127502 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.118731 2563 flags.go:64] FLAG: --pods-per-core="0" Jul 08 01:42:00.127502 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.118734 2563 flags.go:64] FLAG: --port="10250" Jul 08 01:42:00.127502 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.118738 2563 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 08 01:42:00.127502 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.118742 2563 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-09652cf125dc28198" Jul 08 01:42:00.127502 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.118745 2563 flags.go:64] FLAG: --qos-reserved="" Jul 08 01:42:00.127502 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.118749 2563 flags.go:64] FLAG: --read-only-port="10255" Jul 08 01:42:00.127502 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.118753 2563 flags.go:64] FLAG: --register-node="true" Jul 08 01:42:00.127502 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.118756 2563 flags.go:64] FLAG: --register-with-taints="" Jul 08 01:42:00.127502 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.118760 2563 flags.go:64] FLAG: --registry-burst="10" Jul 08 01:42:00.127502 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.118763 2563 flags.go:64] FLAG: --registry-qps="5" Jul 08 01:42:00.127502 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.118767 2563 flags.go:64] FLAG: --reserved-cpus="" Jul 08 01:42:00.127502 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.118770 2563 flags.go:64] FLAG: --reserved-memory="" Jul 08 01:42:00.127502 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.118775 2563 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 08 01:42:00.127502 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.118778 2563 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 08 01:42:00.127502 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.118782 2563 flags.go:64] FLAG: --rotate-certificates="false" Jul 08 01:42:00.127502 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.118786 2563 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 08 01:42:00.127502 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.118789 2563 flags.go:64] FLAG: --runonce="false" Jul 08 01:42:00.127502 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.118793 2563 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 08 01:42:00.128148 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.118796 2563 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 08 01:42:00.128148 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.118800 2563 flags.go:64] FLAG: --seccomp-default="false" Jul 08 01:42:00.128148 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.118803 2563 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 08 01:42:00.128148 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.118806 2563 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 08 01:42:00.128148 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.118810 2563 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 08 01:42:00.128148 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.118813 2563 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 08 01:42:00.128148 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.118816 2563 flags.go:64] FLAG: --storage-driver-password="root" Jul 08 01:42:00.128148 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.118820 2563 flags.go:64] FLAG: --storage-driver-secure="false" Jul 08 01:42:00.128148 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.118823 2563 flags.go:64] FLAG: --storage-driver-table="stats" Jul 08 01:42:00.128148 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.118826 2563 flags.go:64] FLAG: --storage-driver-user="root" Jul 08 01:42:00.128148 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.118829 2563 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 08 01:42:00.128148 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.118832 2563 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 08 01:42:00.128148 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.118837 2563 flags.go:64] FLAG: --system-cgroups="" Jul 08 01:42:00.128148 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.118840 2563 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 08 01:42:00.128148 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.118846 2563 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 08 01:42:00.128148 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.118849 2563 flags.go:64] FLAG: --tls-cert-file="" Jul 08 01:42:00.128148 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.118852 2563 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 08 01:42:00.128148 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.118856 2563 flags.go:64] FLAG: --tls-min-version="" Jul 08 01:42:00.128148 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.118859 2563 flags.go:64] FLAG: --tls-private-key-file="" Jul 08 01:42:00.128148 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.118862 2563 flags.go:64] FLAG: --topology-manager-policy="none" Jul 08 01:42:00.128148 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.118867 2563 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 08 01:42:00.128148 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.118870 2563 flags.go:64] FLAG: --topology-manager-scope="container" Jul 08 01:42:00.128148 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.118873 2563 flags.go:64] FLAG: --v="2" Jul 08 01:42:00.128148 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.118878 2563 flags.go:64] FLAG: --version="false" Jul 08 01:42:00.128148 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.118882 2563 flags.go:64] FLAG: --vmodule="" Jul 08 01:42:00.128804 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.118886 2563 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 08 01:42:00.128804 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.118890 2563 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 08 01:42:00.128804 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.119022 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 01:42:00.128804 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.119027 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 01:42:00.128804 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.119030 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 01:42:00.128804 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.119033 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 01:42:00.128804 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.119040 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 01:42:00.128804 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.119043 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 01:42:00.128804 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.119046 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 01:42:00.128804 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.119049 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 01:42:00.128804 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.119052 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 01:42:00.128804 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.119055 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 01:42:00.128804 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.119057 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 01:42:00.128804 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.119060 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 01:42:00.128804 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.119062 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 01:42:00.128804 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.119065 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 01:42:00.128804 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.119068 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 01:42:00.128804 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.119071 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 01:42:00.128804 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.119074 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 01:42:00.128804 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.119078 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 01:42:00.129340 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.119081 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 01:42:00.129340 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.119083 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 01:42:00.129340 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.119087 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 01:42:00.129340 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.119089 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 01:42:00.129340 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.119092 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 01:42:00.129340 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.119095 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 01:42:00.129340 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.119098 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 01:42:00.129340 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.119102 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 01:42:00.129340 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.119105 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 01:42:00.129340 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.119108 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 01:42:00.129340 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.119110 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 01:42:00.129340 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.119113 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 01:42:00.129340 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.119116 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 01:42:00.129340 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.119119 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 01:42:00.129340 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.119122 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 01:42:00.129340 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.119125 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 01:42:00.129340 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.119127 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 01:42:00.129340 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.119132 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 01:42:00.129340 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.119136 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 01:42:00.129832 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.119140 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 01:42:00.129832 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.119143 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 01:42:00.129832 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.119146 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 01:42:00.129832 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.119149 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 01:42:00.129832 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.119152 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 01:42:00.129832 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.119155 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 01:42:00.129832 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.119158 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 01:42:00.129832 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.119162 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 01:42:00.129832 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.119166 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 01:42:00.129832 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.119169 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 01:42:00.129832 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.119172 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 01:42:00.129832 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.119175 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 01:42:00.129832 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.119179 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 01:42:00.129832 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.119182 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 01:42:00.129832 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.119185 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 01:42:00.129832 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.119188 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 01:42:00.129832 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.119191 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 01:42:00.129832 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.119193 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 01:42:00.129832 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.119197 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 01:42:00.129832 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.119199 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 01:42:00.130407 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.119205 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 01:42:00.130407 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.119208 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 01:42:00.130407 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.119210 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 01:42:00.130407 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.119213 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 01:42:00.130407 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.119216 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 01:42:00.130407 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.119218 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 01:42:00.130407 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.119221 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 01:42:00.130407 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.119224 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 01:42:00.130407 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.119227 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 01:42:00.130407 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.119229 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 01:42:00.130407 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.119232 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 01:42:00.130407 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.119235 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 01:42:00.130407 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.119237 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 01:42:00.130407 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.119241 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 01:42:00.130407 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.119243 2563 feature_gate.go:328] unrecognized feature gate: Example Jul 08 01:42:00.130407 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.119246 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 01:42:00.130407 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.119249 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 01:42:00.130407 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.119252 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 01:42:00.130407 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.119254 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 01:42:00.130407 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.119257 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 01:42:00.130943 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.119261 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 01:42:00.130943 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.119265 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 01:42:00.130943 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.119268 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 01:42:00.130943 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.119287 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 01:42:00.130943 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.119293 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 01:42:00.130943 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.119296 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 01:42:00.130943 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.119299 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 01:42:00.130943 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.119302 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 01:42:00.130943 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.119305 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 01:42:00.130943 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.119309 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 01:42:00.130943 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.119312 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 01:42:00.130943 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.119315 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 01:42:00.130943 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.119320 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 01:42:00.130943 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.119323 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 01:42:00.130943 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.119327 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 01:42:00.130943 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.119329 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 01:42:00.130943 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.119332 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 01:42:00.130943 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.119335 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 01:42:00.130943 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.119338 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 01:42:00.131564 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.119341 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 01:42:00.131564 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.119345 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 01:42:00.131564 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.119348 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 01:42:00.131564 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.119354 2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 08 01:42:00.131564 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.128646 2563 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 08 01:42:00.131564 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.128667 2563 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 08 01:42:00.131564 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.128692 2563 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 08 01:42:00.131564 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.128698 2563 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 08 01:42:00.131564 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.128764 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 01:42:00.131564 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.128769 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 01:42:00.131564 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.128773 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 01:42:00.131564 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.128778 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 01:42:00.131564 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.128781 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 01:42:00.131564 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.128786 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 01:42:00.131930 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.128791 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 01:42:00.131930 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.128794 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 01:42:00.131930 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.128797 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 01:42:00.131930 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.128800 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 01:42:00.131930 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.128804 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 01:42:00.131930 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.128807 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 01:42:00.131930 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.128810 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 01:42:00.131930 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.128813 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 01:42:00.131930 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.128817 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 01:42:00.131930 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.128820 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 01:42:00.131930 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.128823 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 01:42:00.131930 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.128827 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 01:42:00.131930 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.128832 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 01:42:00.131930 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.128835 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 01:42:00.131930 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.128839 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 01:42:00.131930 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.128841 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 01:42:00.131930 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.128845 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 01:42:00.131930 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.128848 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 01:42:00.131930 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.128851 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 01:42:00.132483 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.128854 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 01:42:00.132483 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.128856 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 01:42:00.132483 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.128859 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 01:42:00.132483 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.128862 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 01:42:00.132483 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.128866 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 01:42:00.132483 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.128869 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 01:42:00.132483 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.128872 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 01:42:00.132483 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.128875 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 01:42:00.132483 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.128878 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 01:42:00.132483 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.128881 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 01:42:00.132483 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.128884 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 01:42:00.132483 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.128887 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 01:42:00.132483 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.128890 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 01:42:00.132483 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.128892 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 01:42:00.132483 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.128895 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 01:42:00.132483 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.128898 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 01:42:00.132483 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.128901 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 01:42:00.132483 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.128904 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 01:42:00.132483 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.128907 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 01:42:00.132483 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.128910 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 01:42:00.133023 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.128912 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 01:42:00.133023 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.128916 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 01:42:00.133023 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.128919 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 01:42:00.133023 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.128922 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 01:42:00.133023 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.128925 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 01:42:00.133023 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.128929 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 01:42:00.133023 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.128932 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 01:42:00.133023 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.128935 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 01:42:00.133023 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.128938 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 01:42:00.133023 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.128941 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 01:42:00.133023 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.128944 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 01:42:00.133023 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.128947 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 01:42:00.133023 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.128950 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 01:42:00.133023 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.128953 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 01:42:00.133023 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.128956 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 01:42:00.133023 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.128959 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 01:42:00.133023 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.128962 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 01:42:00.133023 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.128965 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 01:42:00.133023 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.128968 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 01:42:00.133023 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.128971 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 01:42:00.133739 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.128974 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 01:42:00.133739 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.128977 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 01:42:00.133739 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.128979 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 01:42:00.133739 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.128982 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 01:42:00.133739 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.128985 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 01:42:00.133739 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.128988 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 01:42:00.133739 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.128990 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 01:42:00.133739 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.128993 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 01:42:00.133739 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.128996 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 01:42:00.133739 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.128999 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 01:42:00.133739 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.129002 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 01:42:00.133739 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.129005 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 01:42:00.133739 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.129009 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 01:42:00.133739 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.129011 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 01:42:00.133739 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.129015 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 01:42:00.133739 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.129017 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 01:42:00.133739 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.129020 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 01:42:00.133739 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.129023 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 01:42:00.133739 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.129026 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 01:42:00.134297 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.129028 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 01:42:00.134297 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.129031 2563 feature_gate.go:328] unrecognized feature gate: Example Jul 08 01:42:00.134297 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.129034 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 01:42:00.134297 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.129036 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 01:42:00.134297 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.129039 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 01:42:00.134297 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.129042 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 01:42:00.134297 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.129045 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 01:42:00.134297 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.129048 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 01:42:00.134297 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.129050 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 01:42:00.134297 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.129053 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 01:42:00.134297 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.129056 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 01:42:00.134297 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.129059 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 01:42:00.134297 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.129062 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 01:42:00.134297 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.129065 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 01:42:00.134297 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.129068 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 01:42:00.134697 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.129074 2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 08 01:42:00.134697 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.129203 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 01:42:00.134697 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.129209 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 01:42:00.134697 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.129212 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 01:42:00.134697 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.129216 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 01:42:00.134697 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.129219 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 01:42:00.134697 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.129222 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 01:42:00.134697 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.129226 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 01:42:00.134697 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.129229 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 01:42:00.134697 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.129232 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 01:42:00.134697 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.129235 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 01:42:00.134697 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.129238 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 01:42:00.134697 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.129241 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 01:42:00.134697 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.129245 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 01:42:00.134697 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.129247 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 01:42:00.135156 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.129251 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 01:42:00.135156 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.129253 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 01:42:00.135156 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.129256 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 01:42:00.135156 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.129260 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 01:42:00.135156 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.129265 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 01:42:00.135156 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.129268 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 01:42:00.135156 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.129288 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 01:42:00.135156 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.129293 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 01:42:00.135156 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.129296 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 01:42:00.135156 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.129298 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 01:42:00.135156 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.129301 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 01:42:00.135156 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.129304 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 01:42:00.135156 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.129309 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 01:42:00.135156 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.129313 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 01:42:00.135156 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.129317 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 01:42:00.135156 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.129320 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 01:42:00.135156 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.129323 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 01:42:00.135156 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.129325 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 01:42:00.135156 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.129329 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 01:42:00.135705 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.129331 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 01:42:00.135705 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.129334 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 01:42:00.135705 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.129337 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 01:42:00.135705 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.129340 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 01:42:00.135705 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.129343 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 01:42:00.135705 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.129347 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 01:42:00.135705 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.129350 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 01:42:00.135705 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.129353 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 01:42:00.135705 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.129356 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 01:42:00.135705 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.129359 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 01:42:00.135705 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.129362 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 01:42:00.135705 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.129365 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 01:42:00.135705 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.129369 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 01:42:00.135705 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.129371 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 01:42:00.135705 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.129374 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 01:42:00.135705 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.129377 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 01:42:00.135705 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.129380 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 01:42:00.135705 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.129382 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 01:42:00.135705 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.129385 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 01:42:00.135705 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.129388 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 01:42:00.136496 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.129391 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 01:42:00.136496 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.129393 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 01:42:00.136496 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.129396 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 01:42:00.136496 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.129401 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 01:42:00.136496 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.129404 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 01:42:00.136496 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.129408 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 01:42:00.136496 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.129411 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 01:42:00.136496 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.129415 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 01:42:00.136496 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.129418 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 01:42:00.136496 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.129421 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 01:42:00.136496 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.129424 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 01:42:00.136496 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.129427 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 01:42:00.136496 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.129430 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 01:42:00.136496 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.129433 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 01:42:00.136496 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.129436 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 01:42:00.136496 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.129439 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 01:42:00.136496 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.129442 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 01:42:00.136496 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.129444 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 01:42:00.136496 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.129447 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 01:42:00.137225 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.129450 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 01:42:00.137225 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.129453 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 01:42:00.137225 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.129456 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 01:42:00.137225 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.129459 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 01:42:00.137225 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.129462 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 01:42:00.137225 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.129464 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 01:42:00.137225 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.129468 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 01:42:00.137225 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.129470 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 01:42:00.137225 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.129473 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 01:42:00.137225 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.129476 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 01:42:00.137225 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.129478 2563 feature_gate.go:328] unrecognized feature gate: Example Jul 08 01:42:00.137225 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.129481 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 01:42:00.137225 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.129484 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 01:42:00.137225 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.129487 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 01:42:00.137225 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.129489 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 01:42:00.137225 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.129492 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 01:42:00.137225 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.129495 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 01:42:00.137225 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.129497 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 01:42:00.137225 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.129500 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 01:42:00.137225 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.129503 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 01:42:00.137823 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.129506 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 01:42:00.137823 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.129508 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 01:42:00.137823 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.129511 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 01:42:00.137823 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.129514 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 01:42:00.137823 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.129517 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 01:42:00.137823 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.129520 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 01:42:00.137823 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:00.129523 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 01:42:00.137823 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.129529 2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 08 01:42:00.137823 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.129658 2563 server.go:962] "Client rotation is on, will bootstrap in background" Jul 08 01:42:00.137823 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.131973 2563 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 08 01:42:00.137823 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.133395 2563 server.go:1019] "Starting client certificate rotation" Jul 08 01:42:00.137823 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.133518 2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 08 01:42:00.137823 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.133562 2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 08 01:42:00.138377 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.135969 2563 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 08 01:42:00.138852 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.138837 2563 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 08 01:42:00.148260 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.148239 2563 log.go:25] "Validated CRI v1 runtime API" Jul 08 01:42:00.150385 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.150365 2563 log.go:25] "Validated CRI v1 image API" Jul 08 01:42:00.151307 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.151290 2563 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 08 01:42:00.153970 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.153946 2563 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 db72b2ea-2901-4c5f-a0d4-bae3bdb4cee6:/dev/nvme0n1p4 ec41bcf5-6fe7-4aad-81a4-8005a3eedb2d:/dev/nvme0n1p3] Jul 08 01:42:00.154038 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.153966 2563 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 08 01:42:00.161588 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.161456 2563 manager.go:216] Machine: {Timestamp:2026-07-08 01:42:00.159021606 +0000 UTC m=+0.356348454 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3101973 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec251444b4724668c083f7e8a500bf65 SystemUUID:ec251444-b472-4668-c083-f7e8a500bf65 BootID:6245b416-e23f-44d9-a817-bce11aa18492 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:e4:d8:4d:31:a1 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:e4:d8:4d:31:a1 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ae:5d:4c:b8:db:8b Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 08 01:42:00.161588 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.161579 2563 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 08 01:42:00.161711 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.161665 2563 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 08 01:42:00.165549 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.165517 2563 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 08 01:42:00.166207 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.165550 2563 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-142-233.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 08 01:42:00.166815 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.166775 2563 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 08 01:42:00.166955 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.166941 2563 topology_manager.go:138] "Creating topology manager with none policy" Jul 08 01:42:00.167076 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.167065 2563 container_manager_linux.go:309] "Creating device plugin manager" Jul 08 01:42:00.167170 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.167159 2563 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 08 01:42:00.167791 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.167760 2563 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 08 01:42:00.169221 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.169193 2563 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 08 01:42:00.173066 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.173054 2563 state_mem.go:36] "Initialized new in-memory state store" Jul 08 01:42:00.173197 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.173187 2563 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 08 01:42:00.173237 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.173220 2563 kubelet.go:486] "Attempting to sync node with API server" Jul 08 01:42:00.173237 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.173236 2563 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 08 01:42:00.173313 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.173253 2563 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 08 01:42:00.173313 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.173263 2563 kubelet.go:398] "Adding apiserver pod source" Jul 08 01:42:00.173313 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.173291 2563 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 08 01:42:00.173752 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.173738 2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 08 01:42:00.173866 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.173769 2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 08 01:42:00.176338 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.176319 2563 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 08 01:42:00.189195 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.189179 2563 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 08 01:42:00.189293 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.189281 2563 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 08 01:42:00.190443 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.190428 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 08 01:42:00.190498 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.190448 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 08 01:42:00.190498 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.190455 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 08 01:42:00.190498 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.190461 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 08 01:42:00.190498 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.190470 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 08 01:42:00.190498 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.190476 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 08 01:42:00.190498 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.190486 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 08 01:42:00.190498 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.190491 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 08 01:42:00.190498 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.190498 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 08 01:42:00.190753 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.190504 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 08 01:42:00.190753 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.190514 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 08 01:42:00.190753 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.190520 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 08 01:42:00.192024 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.192013 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 08 01:42:00.192024 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.192023 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 08 01:42:00.195821 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.195802 2563 server.go:1268] "Started kubelet" Jul 08 01:42:00.195943 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.195906 2563 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 08 01:42:00.196089 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:42:00.196066 2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-142-233.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 08 01:42:00.196152 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:42:00.196135 2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 08 01:42:00.196315 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.196294 2563 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-233.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 08 01:42:00.196542 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.196488 2563 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 08 01:42:00.196619 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.196566 2563 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 08 01:42:00.196824 ip-10-0-142-233 systemd[1]: Started Kubernetes Kubelet. Jul 08 01:42:00.198216 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.198181 2563 server.go:310] "Adding debug handlers to kubelet server" Jul 08 01:42:00.198358 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.198342 2563 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 08 01:42:00.202193 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:42:00.202162 2563 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 08 01:42:00.202462 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:42:00.201385 2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-233.ec2.internal.18c02cfd9c1649cb default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-233.ec2.internal,UID:ip-10-0-142-233.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-142-233.ec2.internal,},FirstTimestamp:2026-07-08 01:42:00.195770827 +0000 UTC m=+0.393097675,LastTimestamp:2026-07-08 01:42:00.195770827 +0000 UTC m=+0.393097675,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-233.ec2.internal,}" Jul 08 01:42:00.204632 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.204609 2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 08 01:42:00.204708 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.204616 2563 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 08 01:42:00.204779 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:42:00.204763 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-233.ec2.internal\" not found" Jul 08 01:42:00.205472 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.205317 2563 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 08 01:42:00.205472 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.205362 2563 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 08 01:42:00.205472 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.205380 2563 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 08 01:42:00.205657 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.205639 2563 factory.go:55] Registering systemd factory Jul 08 01:42:00.205711 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.205673 2563 factory.go:223] Registration of the systemd container factory successfully Jul 08 01:42:00.205891 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.205878 2563 factory.go:153] Registering CRI-O factory Jul 08 01:42:00.205891 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.205894 2563 factory.go:223] Registration of the crio container factory successfully Jul 08 01:42:00.206001 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.205942 2563 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 08 01:42:00.206001 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.205961 2563 factory.go:103] Registering Raw factory Jul 08 01:42:00.206001 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.205975 2563 manager.go:1196] Started watching for new ooms in manager Jul 08 01:42:00.206297 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.206281 2563 reconstruct.go:97] "Volume reconstruction finished" Jul 08 01:42:00.206297 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.206296 2563 reconciler.go:29] "Reconciler: start to sync state" Jul 08 01:42:00.206599 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.206583 2563 manager.go:349] Starting recovery of all containers Jul 08 01:42:00.209889 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:42:00.209852 2563 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-142-233.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 08 01:42:00.210011 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:42:00.209986 2563 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 08 01:42:00.219356 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.219326 2563 manager.go:354] Recovery completed Jul 08 01:42:00.220632 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:42:00.220615 2563 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Jul 08 01:42:00.223807 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.223794 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 01:42:00.225826 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.225809 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-233.ec2.internal" event="NodeHasSufficientMemory" Jul 08 01:42:00.225900 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.225845 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-233.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 01:42:00.225900 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.225863 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-233.ec2.internal" event="NodeHasSufficientPID" Jul 08 01:42:00.226527 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.226509 2563 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 08 01:42:00.226527 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.226524 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 01:42:00.226639 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.226525 2563 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 08 01:42:00.226639 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.226586 2563 state_mem.go:36] "Initialized new in-memory state store" Jul 08 01:42:00.227297 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.227242 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-233.ec2.internal" event="NodeHasSufficientMemory" Jul 08 01:42:00.227297 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.227295 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-233.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 01:42:00.227390 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.227307 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-233.ec2.internal" event="NodeHasSufficientPID" Jul 08 01:42:00.228062 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:42:00.227996 2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-233.ec2.internal.18c02cfd9de0e857 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-233.ec2.internal,UID:ip-10-0-142-233.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-142-233.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-142-233.ec2.internal,},FirstTimestamp:2026-07-08 01:42:00.225826903 +0000 UTC m=+0.423153755,LastTimestamp:2026-07-08 01:42:00.225826903 +0000 UTC m=+0.423153755,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-233.ec2.internal,}" Jul 08 01:42:00.228873 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.228859 2563 policy_none.go:49] "None policy: Start" Jul 08 01:42:00.228942 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.228879 2563 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 08 01:42:00.228942 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.228893 2563 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 08 01:42:00.229159 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.229141 2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-sw8g6" Jul 08 01:42:00.231044 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.231031 2563 policy_none.go:47] "Start" Jul 08 01:42:00.237130 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:42:00.237057 2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-233.ec2.internal.18c02cfd9de14db4 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-233.ec2.internal,UID:ip-10-0-142-233.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-142-233.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-142-233.ec2.internal,},FirstTimestamp:2026-07-08 01:42:00.225852852 +0000 UTC m=+0.423179701,LastTimestamp:2026-07-08 01:42:00.225852852 +0000 UTC m=+0.423179701,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-233.ec2.internal,}" Jul 08 01:42:00.237438 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.237419 2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-sw8g6" Jul 08 01:42:00.267923 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.267905 2563 manager.go:337] "Starting Device Plugin manager" Jul 08 01:42:00.268109 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:42:00.267940 2563 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 08 01:42:00.268109 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.267952 2563 server.go:87] "Starting device plugin registration server" Jul 08 01:42:00.268322 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.268307 2563 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 08 01:42:00.268363 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.268324 2563 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 08 01:42:00.268467 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.268429 2563 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 08 01:42:00.268586 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.268512 2563 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 08 01:42:00.268586 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.268521 2563 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 08 01:42:00.269085 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:42:00.269066 2563 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 08 01:42:00.269145 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:42:00.269115 2563 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-142-233.ec2.internal\" not found" Jul 08 01:42:00.368811 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.368726 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 01:42:00.371072 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.370142 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-233.ec2.internal" event="NodeHasSufficientMemory" Jul 08 01:42:00.371072 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.370182 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-233.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 01:42:00.371072 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.370199 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-233.ec2.internal" event="NodeHasSufficientPID" Jul 08 01:42:00.371072 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.370233 2563 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-142-233.ec2.internal" Jul 08 01:42:00.377298 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.377279 2563 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-142-233.ec2.internal" Jul 08 01:42:00.377393 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:42:00.377305 2563 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-142-233.ec2.internal\": node \"ip-10-0-142-233.ec2.internal\" not found" Jul 08 01:42:00.394125 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.394090 2563 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 08 01:42:00.395442 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.395423 2563 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 08 01:42:00.395567 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.395470 2563 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 08 01:42:00.395567 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.395496 2563 kubelet.go:2448] "Starting kubelet main sync loop" Jul 08 01:42:00.395567 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:42:00.395541 2563 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 08 01:42:00.397784 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:42:00.397754 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-233.ec2.internal\" not found" Jul 08 01:42:00.398462 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.398441 2563 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 01:42:00.496792 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.496736 2563 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-233.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-142-233.ec2.internal"] Jul 08 01:42:00.497009 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.496850 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 01:42:00.497888 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.497867 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-233.ec2.internal" event="NodeHasSufficientMemory" Jul 08 01:42:00.497984 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.497908 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-233.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 01:42:00.497984 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.497924 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-233.ec2.internal" event="NodeHasSufficientPID" Jul 08 01:42:00.497984 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:42:00.497868 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-233.ec2.internal\" not found" Jul 08 01:42:00.500412 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.500384 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 01:42:00.500517 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.500504 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-233.ec2.internal" Jul 08 01:42:00.500577 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.500545 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 01:42:00.501283 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.501267 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-233.ec2.internal" event="NodeHasSufficientMemory" Jul 08 01:42:00.501370 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.501297 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-233.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 01:42:00.501370 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.501269 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-233.ec2.internal" event="NodeHasSufficientMemory" Jul 08 01:42:00.501370 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.501316 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-233.ec2.internal" event="NodeHasSufficientPID" Jul 08 01:42:00.501370 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.501332 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-233.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 01:42:00.501370 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.501350 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-233.ec2.internal" event="NodeHasSufficientPID" Jul 08 01:42:00.503632 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.503615 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-233.ec2.internal" Jul 08 01:42:00.503721 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.503645 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 01:42:00.504321 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.504305 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-233.ec2.internal" event="NodeHasSufficientMemory" Jul 08 01:42:00.504416 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.504331 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-233.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 01:42:00.504416 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.504341 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-233.ec2.internal" event="NodeHasSufficientPID" Jul 08 01:42:00.507676 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.507658 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d3d20294c54eebf1cdd45bd4f32b1e5e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-233.ec2.internal\" (UID: \"d3d20294c54eebf1cdd45bd4f32b1e5e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-233.ec2.internal" Jul 08 01:42:00.507748 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.507695 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d3d20294c54eebf1cdd45bd4f32b1e5e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-233.ec2.internal\" (UID: \"d3d20294c54eebf1cdd45bd4f32b1e5e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-233.ec2.internal" Jul 08 01:42:00.507748 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.507728 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/61e1c42ac9a08ecfb3c8cc5e93139196-config\") pod \"kube-apiserver-proxy-ip-10-0-142-233.ec2.internal\" (UID: \"61e1c42ac9a08ecfb3c8cc5e93139196\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-233.ec2.internal" Jul 08 01:42:00.520942 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:42:00.520917 2563 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-233.ec2.internal\" not found" node="ip-10-0-142-233.ec2.internal" Jul 08 01:42:00.524978 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:42:00.524960 2563 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-233.ec2.internal\" not found" node="ip-10-0-142-233.ec2.internal" Jul 08 01:42:00.598287 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:42:00.598250 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-233.ec2.internal\" not found" Jul 08 01:42:00.608565 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.608537 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d3d20294c54eebf1cdd45bd4f32b1e5e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-233.ec2.internal\" (UID: \"d3d20294c54eebf1cdd45bd4f32b1e5e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-233.ec2.internal" Jul 08 01:42:00.608565 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.608570 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d3d20294c54eebf1cdd45bd4f32b1e5e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-233.ec2.internal\" (UID: \"d3d20294c54eebf1cdd45bd4f32b1e5e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-233.ec2.internal" Jul 08 01:42:00.608782 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.608588 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/61e1c42ac9a08ecfb3c8cc5e93139196-config\") pod \"kube-apiserver-proxy-ip-10-0-142-233.ec2.internal\" (UID: \"61e1c42ac9a08ecfb3c8cc5e93139196\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-233.ec2.internal" Jul 08 01:42:00.608782 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.608618 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/61e1c42ac9a08ecfb3c8cc5e93139196-config\") pod \"kube-apiserver-proxy-ip-10-0-142-233.ec2.internal\" (UID: \"61e1c42ac9a08ecfb3c8cc5e93139196\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-233.ec2.internal" Jul 08 01:42:00.608782 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.608640 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d3d20294c54eebf1cdd45bd4f32b1e5e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-233.ec2.internal\" (UID: \"d3d20294c54eebf1cdd45bd4f32b1e5e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-233.ec2.internal" Jul 08 01:42:00.608782 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.608655 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d3d20294c54eebf1cdd45bd4f32b1e5e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-233.ec2.internal\" (UID: \"d3d20294c54eebf1cdd45bd4f32b1e5e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-233.ec2.internal" Jul 08 01:42:00.698940 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:42:00.698902 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-233.ec2.internal\" not found" Jul 08 01:42:00.800208 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:42:00.800173 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-233.ec2.internal\" not found" Jul 08 01:42:00.824249 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.824193 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-233.ec2.internal" Jul 08 01:42:00.828269 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:00.828245 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-233.ec2.internal" Jul 08 01:42:00.904270 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:42:00.904217 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-233.ec2.internal\" not found" Jul 08 01:42:01.011980 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:42:01.011898 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-233.ec2.internal\" not found" Jul 08 01:42:01.112333 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:42:01.112279 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-233.ec2.internal\" not found" Jul 08 01:42:01.134082 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:01.134046 2563 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 08 01:42:01.134272 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:01.134209 2563 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 08 01:42:01.192097 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:01.192061 2563 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 01:42:01.212802 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:42:01.212765 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-233.ec2.internal\" not found" Jul 08 01:42:01.240992 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:01.240944 2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-07 01:37:00 +0000 UTC" deadline="2028-04-17 11:08:24.59731169 +0000 UTC" Jul 08 01:42:01.240992 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:01.240986 2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15585h26m23.356330169s" Jul 08 01:42:01.285409 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:01.285323 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 01:42:01.286393 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:01.286373 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-233.ec2.internal" event="NodeHasSufficientMemory" Jul 08 01:42:01.286525 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:01.286413 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-233.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 01:42:01.286525 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:01.286429 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-233.ec2.internal" event="NodeHasSufficientPID" Jul 08 01:42:01.313144 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:42:01.313087 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-233.ec2.internal\" not found" Jul 08 01:42:01.413489 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:42:01.413450 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-233.ec2.internal\" not found" Jul 08 01:42:01.509476 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:01.509438 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61e1c42ac9a08ecfb3c8cc5e93139196.slice/crio-95efdf3f201d16f632a816211a038bf7bf3407758f5008f0fbd28514f3c3b4d5 WatchSource:0}: Error finding container 95efdf3f201d16f632a816211a038bf7bf3407758f5008f0fbd28514f3c3b4d5: Status 404 returned error can't find the container with id 95efdf3f201d16f632a816211a038bf7bf3407758f5008f0fbd28514f3c3b4d5 Jul 08 01:42:01.514183 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:42:01.514159 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-233.ec2.internal\" not found" Jul 08 01:42:01.514326 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:01.514259 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 08 01:42:01.520604 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:01.520571 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3d20294c54eebf1cdd45bd4f32b1e5e.slice/crio-c86b3139528fd14bbc4230a67ddff1712e59c2acc77b73a241ba7877db6c1234 WatchSource:0}: Error finding container c86b3139528fd14bbc4230a67ddff1712e59c2acc77b73a241ba7877db6c1234: Status 404 returned error can't find the container with id c86b3139528fd14bbc4230a67ddff1712e59c2acc77b73a241ba7877db6c1234 Jul 08 01:42:01.548902 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:01.548816 2563 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 01:42:01.607634 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:01.607596 2563 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-233.ec2.internal" Jul 08 01:42:01.620587 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:01.620564 2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 08 01:42:01.622798 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:01.622780 2563 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-233.ec2.internal" Jul 08 01:42:01.631687 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:01.631663 2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 08 01:42:01.642117 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:01.641606 2563 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 01:42:02.174734 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.174701 2563 apiserver.go:52] "Watching apiserver" Jul 08 01:42:02.182550 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.182519 2563 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 08 01:42:02.182990 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.182960 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-w4psj","openshift-network-diagnostics/network-check-target-dvf9v","openshift-network-operator/iptables-alerter-srhs5","kube-system/global-pull-secret-syncer-6hr9n","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j456h","openshift-cluster-node-tuning-operator/tuned-xvdkf","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-233.ec2.internal","openshift-multus/multus-additional-cni-plugins-nkz4s","openshift-ovn-kubernetes/ovnkube-node-hgtm2","kube-system/konnectivity-agent-dj8dv","kube-system/kube-apiserver-proxy-ip-10-0-142-233.ec2.internal","openshift-dns/node-resolver-pk46r","openshift-image-registry/node-ca-xljcg","openshift-multus/multus-f4vdc"] Jul 08 01:42:02.185830 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.185794 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-dj8dv" Jul 08 01:42:02.188168 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.188135 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-xljcg" Jul 08 01:42:02.188869 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.188706 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 08 01:42:02.188869 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.188736 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-gzlsc\"" Jul 08 01:42:02.188869 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.188770 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 08 01:42:02.190316 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.190292 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 08 01:42:02.190562 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.190535 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-wp627\"" Jul 08 01:42:02.190647 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.190577 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 08 01:42:02.190647 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.190596 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 08 01:42:02.191140 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.190938 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-srhs5" Jul 08 01:42:02.193130 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.193111 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 08 01:42:02.193301 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.193130 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 08 01:42:02.193412 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.193395 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6hr9n" Jul 08 01:42:02.193494 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.193463 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 08 01:42:02.193550 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:42:02.193489 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6hr9n" podUID="87674b91-e601-4694-a3e1-bb0bd80b5c4f" Jul 08 01:42:02.193611 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.193557 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-ql857\"" Jul 08 01:42:02.195955 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.195935 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j456h" Jul 08 01:42:02.198477 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.198453 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-xvdkf" Jul 08 01:42:02.198985 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.198921 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 08 01:42:02.198985 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.198936 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 08 01:42:02.199141 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.199006 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 08 01:42:02.199348 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.199329 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-r78ch\"" Jul 08 01:42:02.200897 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.200879 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 08 01:42:02.201009 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.200982 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-dqsxt\"" Jul 08 01:42:02.201237 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.201207 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 08 01:42:02.201341 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.201239 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-hgtm2" Jul 08 01:42:02.204124 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.203703 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-f4vdc" Jul 08 01:42:02.204398 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.204372 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 08 01:42:02.204398 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.204391 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 08 01:42:02.204640 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.204619 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-cjp4f\"" Jul 08 01:42:02.204720 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.204648 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 08 01:42:02.204776 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.204749 2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 08 01:42:02.204836 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.204785 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 08 01:42:02.204933 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.204912 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 08 01:42:02.205167 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.205149 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 08 01:42:02.207163 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.206289 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dvf9v" Jul 08 01:42:02.207163 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.206362 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 08 01:42:02.207163 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:42:02.206368 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dvf9v" podUID="79d3b000-b3ab-40bd-97a1-47536d14a052" Jul 08 01:42:02.207163 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.206708 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 08 01:42:02.207163 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.206919 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 08 01:42:02.207163 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.206968 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 08 01:42:02.209294 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.209020 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-9dskx\"" Jul 08 01:42:02.210272 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.210078 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w4psj" Jul 08 01:42:02.210272 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:42:02.210168 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w4psj" podUID="c391d2cf-3212-40c8-9456-a38c24ba080d" Jul 08 01:42:02.213146 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.212411 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-nkz4s" Jul 08 01:42:02.215072 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.215047 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-pk46r" Jul 08 01:42:02.215188 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.215104 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 08 01:42:02.215188 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.215133 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-glrzv\"" Jul 08 01:42:02.215526 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.215507 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 08 01:42:02.216217 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.216166 2563 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 08 01:42:02.217577 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.217555 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 08 01:42:02.217676 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.217578 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 08 01:42:02.217676 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.217589 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-f9vlh\"" Jul 08 01:42:02.217792 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.217674 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9409c6b8-7a8b-4e5d-8b04-18b36e285356-ovn-node-metrics-cert\") pod \"ovnkube-node-hgtm2\" (UID: \"9409c6b8-7a8b-4e5d-8b04-18b36e285356\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgtm2" Jul 08 01:42:02.217792 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.217706 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b091ceff-3f95-4de4-906b-5a43e8161af3-multus-socket-dir-parent\") pod \"multus-f4vdc\" (UID: \"b091ceff-3f95-4de4-906b-5a43e8161af3\") " pod="openshift-multus/multus-f4vdc" Jul 08 01:42:02.217792 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.217734 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b091ceff-3f95-4de4-906b-5a43e8161af3-host-var-lib-cni-bin\") pod \"multus-f4vdc\" (UID: \"b091ceff-3f95-4de4-906b-5a43e8161af3\") " pod="openshift-multus/multus-f4vdc" Jul 08 01:42:02.217792 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.217759 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b091ceff-3f95-4de4-906b-5a43e8161af3-etc-kubernetes\") pod \"multus-f4vdc\" (UID: \"b091ceff-3f95-4de4-906b-5a43e8161af3\") " pod="openshift-multus/multus-f4vdc" Jul 08 01:42:02.217792 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.217785 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w2lfl\" (UniqueName: \"kubernetes.io/projected/79d3b000-b3ab-40bd-97a1-47536d14a052-kube-api-access-w2lfl\") pod \"network-check-target-dvf9v\" (UID: \"79d3b000-b3ab-40bd-97a1-47536d14a052\") " pod="openshift-network-diagnostics/network-check-target-dvf9v" Jul 08 01:42:02.218052 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.217807 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/67d33362-8538-40e2-a54c-9a4ec41504db-run\") pod \"tuned-xvdkf\" (UID: \"67d33362-8538-40e2-a54c-9a4ec41504db\") " pod="openshift-cluster-node-tuning-operator/tuned-xvdkf" Jul 08 01:42:02.218052 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.217832 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b091ceff-3f95-4de4-906b-5a43e8161af3-cni-binary-copy\") pod \"multus-f4vdc\" (UID: \"b091ceff-3f95-4de4-906b-5a43e8161af3\") " pod="openshift-multus/multus-f4vdc" Jul 08 01:42:02.218052 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.217866 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b091ceff-3f95-4de4-906b-5a43e8161af3-multus-conf-dir\") pod \"multus-f4vdc\" (UID: \"b091ceff-3f95-4de4-906b-5a43e8161af3\") " pod="openshift-multus/multus-f4vdc" Jul 08 01:42:02.218052 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.217913 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3e78b9bc-0e4e-4303-822e-7246ecedff2d-socket-dir\") pod \"aws-ebs-csi-driver-node-j456h\" (UID: \"3e78b9bc-0e4e-4303-822e-7246ecedff2d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j456h" Jul 08 01:42:02.218052 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.217943 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/67d33362-8538-40e2-a54c-9a4ec41504db-etc-kubernetes\") pod \"tuned-xvdkf\" (UID: \"67d33362-8538-40e2-a54c-9a4ec41504db\") " pod="openshift-cluster-node-tuning-operator/tuned-xvdkf" Jul 08 01:42:02.218052 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.217968 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9409c6b8-7a8b-4e5d-8b04-18b36e285356-node-log\") pod \"ovnkube-node-hgtm2\" (UID: \"9409c6b8-7a8b-4e5d-8b04-18b36e285356\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgtm2" Jul 08 01:42:02.218052 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.218010 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9409c6b8-7a8b-4e5d-8b04-18b36e285356-host-run-ovn-kubernetes\") pod \"ovnkube-node-hgtm2\" (UID: \"9409c6b8-7a8b-4e5d-8b04-18b36e285356\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgtm2" Jul 08 01:42:02.218052 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.218037 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b091ceff-3f95-4de4-906b-5a43e8161af3-os-release\") pod \"multus-f4vdc\" (UID: \"b091ceff-3f95-4de4-906b-5a43e8161af3\") " pod="openshift-multus/multus-f4vdc" Jul 08 01:42:02.218449 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.218076 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b091ceff-3f95-4de4-906b-5a43e8161af3-hostroot\") pod \"multus-f4vdc\" (UID: \"b091ceff-3f95-4de4-906b-5a43e8161af3\") " pod="openshift-multus/multus-f4vdc" Jul 08 01:42:02.218449 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.218102 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9409c6b8-7a8b-4e5d-8b04-18b36e285356-run-systemd\") pod \"ovnkube-node-hgtm2\" (UID: \"9409c6b8-7a8b-4e5d-8b04-18b36e285356\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgtm2" Jul 08 01:42:02.218449 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.218126 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/87674b91-e601-4694-a3e1-bb0bd80b5c4f-original-pull-secret\") pod \"global-pull-secret-syncer-6hr9n\" (UID: \"87674b91-e601-4694-a3e1-bb0bd80b5c4f\") " pod="kube-system/global-pull-secret-syncer-6hr9n" Jul 08 01:42:02.218449 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.218175 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3e78b9bc-0e4e-4303-822e-7246ecedff2d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-j456h\" (UID: \"3e78b9bc-0e4e-4303-822e-7246ecedff2d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j456h" Jul 08 01:42:02.218449 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.218226 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3e78b9bc-0e4e-4303-822e-7246ecedff2d-device-dir\") pod \"aws-ebs-csi-driver-node-j456h\" (UID: \"3e78b9bc-0e4e-4303-822e-7246ecedff2d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j456h" Jul 08 01:42:02.218449 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.218251 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/67d33362-8538-40e2-a54c-9a4ec41504db-sys\") pod \"tuned-xvdkf\" (UID: \"67d33362-8538-40e2-a54c-9a4ec41504db\") " pod="openshift-cluster-node-tuning-operator/tuned-xvdkf" Jul 08 01:42:02.218449 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.218277 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4979g\" (UniqueName: \"kubernetes.io/projected/67d33362-8538-40e2-a54c-9a4ec41504db-kube-api-access-4979g\") pod \"tuned-xvdkf\" (UID: \"67d33362-8538-40e2-a54c-9a4ec41504db\") " pod="openshift-cluster-node-tuning-operator/tuned-xvdkf" Jul 08 01:42:02.218449 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.218321 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3e78b9bc-0e4e-4303-822e-7246ecedff2d-etc-selinux\") pod \"aws-ebs-csi-driver-node-j456h\" (UID: \"3e78b9bc-0e4e-4303-822e-7246ecedff2d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j456h" Jul 08 01:42:02.218449 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.218359 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b091ceff-3f95-4de4-906b-5a43e8161af3-host-var-lib-cni-multus\") pod \"multus-f4vdc\" (UID: \"b091ceff-3f95-4de4-906b-5a43e8161af3\") " pod="openshift-multus/multus-f4vdc" Jul 08 01:42:02.218449 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.218384 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/87674b91-e601-4694-a3e1-bb0bd80b5c4f-kubelet-config\") pod \"global-pull-secret-syncer-6hr9n\" (UID: \"87674b91-e601-4694-a3e1-bb0bd80b5c4f\") " pod="kube-system/global-pull-secret-syncer-6hr9n" Jul 08 01:42:02.218449 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.218410 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/67d33362-8538-40e2-a54c-9a4ec41504db-etc-sysconfig\") pod \"tuned-xvdkf\" (UID: \"67d33362-8538-40e2-a54c-9a4ec41504db\") " pod="openshift-cluster-node-tuning-operator/tuned-xvdkf" Jul 08 01:42:02.218449 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.218436 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9409c6b8-7a8b-4e5d-8b04-18b36e285356-host-run-netns\") pod \"ovnkube-node-hgtm2\" (UID: \"9409c6b8-7a8b-4e5d-8b04-18b36e285356\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgtm2" Jul 08 01:42:02.218998 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.218458 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9409c6b8-7a8b-4e5d-8b04-18b36e285356-run-openvswitch\") pod \"ovnkube-node-hgtm2\" (UID: \"9409c6b8-7a8b-4e5d-8b04-18b36e285356\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgtm2" Jul 08 01:42:02.218998 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.218484 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a94ad3dd-a657-4061-82a9-ab28622ab193-agent-certs\") pod \"konnectivity-agent-dj8dv\" (UID: \"a94ad3dd-a657-4061-82a9-ab28622ab193\") " pod="kube-system/konnectivity-agent-dj8dv" Jul 08 01:42:02.218998 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.218509 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9409c6b8-7a8b-4e5d-8b04-18b36e285356-etc-openvswitch\") pod \"ovnkube-node-hgtm2\" (UID: \"9409c6b8-7a8b-4e5d-8b04-18b36e285356\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgtm2" Jul 08 01:42:02.218998 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.218530 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9409c6b8-7a8b-4e5d-8b04-18b36e285356-log-socket\") pod \"ovnkube-node-hgtm2\" (UID: \"9409c6b8-7a8b-4e5d-8b04-18b36e285356\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgtm2" Jul 08 01:42:02.218998 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.218554 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9409c6b8-7a8b-4e5d-8b04-18b36e285356-host-cni-bin\") pod \"ovnkube-node-hgtm2\" (UID: \"9409c6b8-7a8b-4e5d-8b04-18b36e285356\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgtm2" Jul 08 01:42:02.218998 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.218578 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3e78b9bc-0e4e-4303-822e-7246ecedff2d-sys-fs\") pod \"aws-ebs-csi-driver-node-j456h\" (UID: \"3e78b9bc-0e4e-4303-822e-7246ecedff2d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j456h" Jul 08 01:42:02.218998 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.218596 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5cb4d2ec-61d0-4b04-a043-39c3d834cf1a-serviceca\") pod \"node-ca-xljcg\" (UID: \"5cb4d2ec-61d0-4b04-a043-39c3d834cf1a\") " pod="openshift-image-registry/node-ca-xljcg" Jul 08 01:42:02.218998 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.218622 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9409c6b8-7a8b-4e5d-8b04-18b36e285356-host-slash\") pod \"ovnkube-node-hgtm2\" (UID: \"9409c6b8-7a8b-4e5d-8b04-18b36e285356\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgtm2" Jul 08 01:42:02.218998 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.218645 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9409c6b8-7a8b-4e5d-8b04-18b36e285356-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hgtm2\" (UID: \"9409c6b8-7a8b-4e5d-8b04-18b36e285356\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgtm2" Jul 08 01:42:02.218998 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.218719 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-585z2\" (UniqueName: \"kubernetes.io/projected/9409c6b8-7a8b-4e5d-8b04-18b36e285356-kube-api-access-585z2\") pod \"ovnkube-node-hgtm2\" (UID: \"9409c6b8-7a8b-4e5d-8b04-18b36e285356\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgtm2" Jul 08 01:42:02.218998 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.218760 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b091ceff-3f95-4de4-906b-5a43e8161af3-system-cni-dir\") pod \"multus-f4vdc\" (UID: \"b091ceff-3f95-4de4-906b-5a43e8161af3\") " pod="openshift-multus/multus-f4vdc" Jul 08 01:42:02.218998 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.218798 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kbpj8\" (UniqueName: \"kubernetes.io/projected/77d11f18-f68a-4d7c-8217-be0a83114e14-kube-api-access-kbpj8\") pod \"iptables-alerter-srhs5\" (UID: \"77d11f18-f68a-4d7c-8217-be0a83114e14\") " pod="openshift-network-operator/iptables-alerter-srhs5" Jul 08 01:42:02.218998 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.218824 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/67d33362-8538-40e2-a54c-9a4ec41504db-etc-sysctl-d\") pod \"tuned-xvdkf\" (UID: \"67d33362-8538-40e2-a54c-9a4ec41504db\") " pod="openshift-cluster-node-tuning-operator/tuned-xvdkf" Jul 08 01:42:02.218998 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.218850 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hm2b6\" (UniqueName: \"kubernetes.io/projected/5cb4d2ec-61d0-4b04-a043-39c3d834cf1a-kube-api-access-hm2b6\") pod \"node-ca-xljcg\" (UID: \"5cb4d2ec-61d0-4b04-a043-39c3d834cf1a\") " pod="openshift-image-registry/node-ca-xljcg" Jul 08 01:42:02.218998 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.218875 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9409c6b8-7a8b-4e5d-8b04-18b36e285356-host-kubelet\") pod \"ovnkube-node-hgtm2\" (UID: \"9409c6b8-7a8b-4e5d-8b04-18b36e285356\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgtm2" Jul 08 01:42:02.218998 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.218900 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9409c6b8-7a8b-4e5d-8b04-18b36e285356-ovnkube-config\") pod \"ovnkube-node-hgtm2\" (UID: \"9409c6b8-7a8b-4e5d-8b04-18b36e285356\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgtm2" Jul 08 01:42:02.219819 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.218926 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b091ceff-3f95-4de4-906b-5a43e8161af3-host-run-k8s-cni-cncf-io\") pod \"multus-f4vdc\" (UID: \"b091ceff-3f95-4de4-906b-5a43e8161af3\") " pod="openshift-multus/multus-f4vdc" Jul 08 01:42:02.219819 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.218952 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a94ad3dd-a657-4061-82a9-ab28622ab193-konnectivity-ca\") pod \"konnectivity-agent-dj8dv\" (UID: \"a94ad3dd-a657-4061-82a9-ab28622ab193\") " pod="kube-system/konnectivity-agent-dj8dv" Jul 08 01:42:02.219819 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.218977 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/87674b91-e601-4694-a3e1-bb0bd80b5c4f-dbus\") pod \"global-pull-secret-syncer-6hr9n\" (UID: \"87674b91-e601-4694-a3e1-bb0bd80b5c4f\") " pod="kube-system/global-pull-secret-syncer-6hr9n" Jul 08 01:42:02.219819 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.219000 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/67d33362-8538-40e2-a54c-9a4ec41504db-lib-modules\") pod \"tuned-xvdkf\" (UID: \"67d33362-8538-40e2-a54c-9a4ec41504db\") " pod="openshift-cluster-node-tuning-operator/tuned-xvdkf" Jul 08 01:42:02.219819 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.219036 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/67d33362-8538-40e2-a54c-9a4ec41504db-var-lib-kubelet\") pod \"tuned-xvdkf\" (UID: \"67d33362-8538-40e2-a54c-9a4ec41504db\") " pod="openshift-cluster-node-tuning-operator/tuned-xvdkf" Jul 08 01:42:02.219819 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.219062 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9409c6b8-7a8b-4e5d-8b04-18b36e285356-env-overrides\") pod \"ovnkube-node-hgtm2\" (UID: \"9409c6b8-7a8b-4e5d-8b04-18b36e285356\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgtm2" Jul 08 01:42:02.219819 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.219085 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b091ceff-3f95-4de4-906b-5a43e8161af3-multus-cni-dir\") pod \"multus-f4vdc\" (UID: \"b091ceff-3f95-4de4-906b-5a43e8161af3\") " pod="openshift-multus/multus-f4vdc" Jul 08 01:42:02.219819 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.219127 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/77d11f18-f68a-4d7c-8217-be0a83114e14-iptables-alerter-script\") pod \"iptables-alerter-srhs5\" (UID: \"77d11f18-f68a-4d7c-8217-be0a83114e14\") " pod="openshift-network-operator/iptables-alerter-srhs5" Jul 08 01:42:02.219819 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.219153 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/67d33362-8538-40e2-a54c-9a4ec41504db-etc-modprobe-d\") pod \"tuned-xvdkf\" (UID: \"67d33362-8538-40e2-a54c-9a4ec41504db\") " pod="openshift-cluster-node-tuning-operator/tuned-xvdkf" Jul 08 01:42:02.219819 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.219177 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9409c6b8-7a8b-4e5d-8b04-18b36e285356-ovnkube-script-lib\") pod \"ovnkube-node-hgtm2\" (UID: \"9409c6b8-7a8b-4e5d-8b04-18b36e285356\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgtm2" Jul 08 01:42:02.219819 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.219202 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9409c6b8-7a8b-4e5d-8b04-18b36e285356-systemd-units\") pod \"ovnkube-node-hgtm2\" (UID: \"9409c6b8-7a8b-4e5d-8b04-18b36e285356\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgtm2" Jul 08 01:42:02.219819 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.219242 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9409c6b8-7a8b-4e5d-8b04-18b36e285356-var-lib-openvswitch\") pod \"ovnkube-node-hgtm2\" (UID: \"9409c6b8-7a8b-4e5d-8b04-18b36e285356\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgtm2" Jul 08 01:42:02.219819 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.219276 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3e78b9bc-0e4e-4303-822e-7246ecedff2d-registration-dir\") pod \"aws-ebs-csi-driver-node-j456h\" (UID: \"3e78b9bc-0e4e-4303-822e-7246ecedff2d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j456h" Jul 08 01:42:02.219819 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.219309 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hrmp8\" (UniqueName: \"kubernetes.io/projected/3e78b9bc-0e4e-4303-822e-7246ecedff2d-kube-api-access-hrmp8\") pod \"aws-ebs-csi-driver-node-j456h\" (UID: \"3e78b9bc-0e4e-4303-822e-7246ecedff2d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j456h" Jul 08 01:42:02.219819 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.219333 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/67d33362-8538-40e2-a54c-9a4ec41504db-etc-sysctl-conf\") pod \"tuned-xvdkf\" (UID: \"67d33362-8538-40e2-a54c-9a4ec41504db\") " pod="openshift-cluster-node-tuning-operator/tuned-xvdkf" Jul 08 01:42:02.219819 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.219359 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b091ceff-3f95-4de4-906b-5a43e8161af3-host-run-netns\") pod \"multus-f4vdc\" (UID: \"b091ceff-3f95-4de4-906b-5a43e8161af3\") " pod="openshift-multus/multus-f4vdc" Jul 08 01:42:02.220678 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.219381 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b091ceff-3f95-4de4-906b-5a43e8161af3-host-run-multus-certs\") pod \"multus-f4vdc\" (UID: \"b091ceff-3f95-4de4-906b-5a43e8161af3\") " pod="openshift-multus/multus-f4vdc" Jul 08 01:42:02.220678 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.219409 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/77d11f18-f68a-4d7c-8217-be0a83114e14-host-slash\") pod \"iptables-alerter-srhs5\" (UID: \"77d11f18-f68a-4d7c-8217-be0a83114e14\") " pod="openshift-network-operator/iptables-alerter-srhs5" Jul 08 01:42:02.220678 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.219443 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/67d33362-8538-40e2-a54c-9a4ec41504db-etc-systemd\") pod \"tuned-xvdkf\" (UID: \"67d33362-8538-40e2-a54c-9a4ec41504db\") " pod="openshift-cluster-node-tuning-operator/tuned-xvdkf" Jul 08 01:42:02.220678 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.219468 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m66r8\" (UniqueName: \"kubernetes.io/projected/b091ceff-3f95-4de4-906b-5a43e8161af3-kube-api-access-m66r8\") pod \"multus-f4vdc\" (UID: \"b091ceff-3f95-4de4-906b-5a43e8161af3\") " pod="openshift-multus/multus-f4vdc" Jul 08 01:42:02.220678 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.219495 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b091ceff-3f95-4de4-906b-5a43e8161af3-host-var-lib-kubelet\") pod \"multus-f4vdc\" (UID: \"b091ceff-3f95-4de4-906b-5a43e8161af3\") " pod="openshift-multus/multus-f4vdc" Jul 08 01:42:02.220678 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.219519 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b091ceff-3f95-4de4-906b-5a43e8161af3-multus-daemon-config\") pod \"multus-f4vdc\" (UID: \"b091ceff-3f95-4de4-906b-5a43e8161af3\") " pod="openshift-multus/multus-f4vdc" Jul 08 01:42:02.220678 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.219543 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/67d33362-8538-40e2-a54c-9a4ec41504db-etc-tuned\") pod \"tuned-xvdkf\" (UID: \"67d33362-8538-40e2-a54c-9a4ec41504db\") " pod="openshift-cluster-node-tuning-operator/tuned-xvdkf" Jul 08 01:42:02.220678 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.219565 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5cb4d2ec-61d0-4b04-a043-39c3d834cf1a-host\") pod \"node-ca-xljcg\" (UID: \"5cb4d2ec-61d0-4b04-a043-39c3d834cf1a\") " pod="openshift-image-registry/node-ca-xljcg" Jul 08 01:42:02.220678 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.219609 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9409c6b8-7a8b-4e5d-8b04-18b36e285356-run-ovn\") pod \"ovnkube-node-hgtm2\" (UID: \"9409c6b8-7a8b-4e5d-8b04-18b36e285356\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgtm2" Jul 08 01:42:02.220678 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.219645 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9409c6b8-7a8b-4e5d-8b04-18b36e285356-host-cni-netd\") pod \"ovnkube-node-hgtm2\" (UID: \"9409c6b8-7a8b-4e5d-8b04-18b36e285356\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgtm2" Jul 08 01:42:02.220678 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.219669 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/67d33362-8538-40e2-a54c-9a4ec41504db-host\") pod \"tuned-xvdkf\" (UID: \"67d33362-8538-40e2-a54c-9a4ec41504db\") " pod="openshift-cluster-node-tuning-operator/tuned-xvdkf" Jul 08 01:42:02.220678 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.219693 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/67d33362-8538-40e2-a54c-9a4ec41504db-tmp\") pod \"tuned-xvdkf\" (UID: \"67d33362-8538-40e2-a54c-9a4ec41504db\") " pod="openshift-cluster-node-tuning-operator/tuned-xvdkf" Jul 08 01:42:02.220678 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.219715 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b091ceff-3f95-4de4-906b-5a43e8161af3-cnibin\") pod \"multus-f4vdc\" (UID: \"b091ceff-3f95-4de4-906b-5a43e8161af3\") " pod="openshift-multus/multus-f4vdc" Jul 08 01:42:02.239202 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.239172 2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-wkx9k" Jul 08 01:42:02.245170 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.245146 2563 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 01:42:02.245512 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.245490 2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-wkx9k" Jul 08 01:42:02.307048 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.307011 2563 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 08 01:42:02.320515 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.320481 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b091ceff-3f95-4de4-906b-5a43e8161af3-multus-daemon-config\") pod \"multus-f4vdc\" (UID: \"b091ceff-3f95-4de4-906b-5a43e8161af3\") " pod="openshift-multus/multus-f4vdc" Jul 08 01:42:02.320515 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.320516 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/67d33362-8538-40e2-a54c-9a4ec41504db-etc-tuned\") pod \"tuned-xvdkf\" (UID: \"67d33362-8538-40e2-a54c-9a4ec41504db\") " pod="openshift-cluster-node-tuning-operator/tuned-xvdkf" Jul 08 01:42:02.320761 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.320542 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5cb4d2ec-61d0-4b04-a043-39c3d834cf1a-host\") pod \"node-ca-xljcg\" (UID: \"5cb4d2ec-61d0-4b04-a043-39c3d834cf1a\") " pod="openshift-image-registry/node-ca-xljcg" Jul 08 01:42:02.320761 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.320594 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5cb4d2ec-61d0-4b04-a043-39c3d834cf1a-host\") pod \"node-ca-xljcg\" (UID: \"5cb4d2ec-61d0-4b04-a043-39c3d834cf1a\") " pod="openshift-image-registry/node-ca-xljcg" Jul 08 01:42:02.320931 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.320907 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9409c6b8-7a8b-4e5d-8b04-18b36e285356-run-ovn\") pod \"ovnkube-node-hgtm2\" (UID: \"9409c6b8-7a8b-4e5d-8b04-18b36e285356\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgtm2" Jul 08 01:42:02.320931 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.320900 2563 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 08 01:42:02.321067 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.320951 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9409c6b8-7a8b-4e5d-8b04-18b36e285356-host-cni-netd\") pod \"ovnkube-node-hgtm2\" (UID: \"9409c6b8-7a8b-4e5d-8b04-18b36e285356\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgtm2" Jul 08 01:42:02.321067 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.320975 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/67d33362-8538-40e2-a54c-9a4ec41504db-host\") pod \"tuned-xvdkf\" (UID: \"67d33362-8538-40e2-a54c-9a4ec41504db\") " pod="openshift-cluster-node-tuning-operator/tuned-xvdkf" Jul 08 01:42:02.321067 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.320997 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/67d33362-8538-40e2-a54c-9a4ec41504db-tmp\") pod \"tuned-xvdkf\" (UID: \"67d33362-8538-40e2-a54c-9a4ec41504db\") " pod="openshift-cluster-node-tuning-operator/tuned-xvdkf" Jul 08 01:42:02.321067 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.321016 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b091ceff-3f95-4de4-906b-5a43e8161af3-cnibin\") pod \"multus-f4vdc\" (UID: \"b091ceff-3f95-4de4-906b-5a43e8161af3\") " pod="openshift-multus/multus-f4vdc" Jul 08 01:42:02.321067 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.321031 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9409c6b8-7a8b-4e5d-8b04-18b36e285356-run-ovn\") pod \"ovnkube-node-hgtm2\" (UID: \"9409c6b8-7a8b-4e5d-8b04-18b36e285356\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgtm2" Jul 08 01:42:02.321067 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.321036 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c391d2cf-3212-40c8-9456-a38c24ba080d-metrics-certs\") pod \"network-metrics-daemon-w4psj\" (UID: \"c391d2cf-3212-40c8-9456-a38c24ba080d\") " pod="openshift-multus/network-metrics-daemon-w4psj" Jul 08 01:42:02.321384 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.321085 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9409c6b8-7a8b-4e5d-8b04-18b36e285356-host-cni-netd\") pod \"ovnkube-node-hgtm2\" (UID: \"9409c6b8-7a8b-4e5d-8b04-18b36e285356\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgtm2" Jul 08 01:42:02.321384 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.321098 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/67d33362-8538-40e2-a54c-9a4ec41504db-host\") pod \"tuned-xvdkf\" (UID: \"67d33362-8538-40e2-a54c-9a4ec41504db\") " pod="openshift-cluster-node-tuning-operator/tuned-xvdkf" Jul 08 01:42:02.321384 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.321090 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dlpb9\" (UniqueName: \"kubernetes.io/projected/c391d2cf-3212-40c8-9456-a38c24ba080d-kube-api-access-dlpb9\") pod \"network-metrics-daemon-w4psj\" (UID: \"c391d2cf-3212-40c8-9456-a38c24ba080d\") " pod="openshift-multus/network-metrics-daemon-w4psj" Jul 08 01:42:02.321384 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.321145 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b091ceff-3f95-4de4-906b-5a43e8161af3-cnibin\") pod \"multus-f4vdc\" (UID: \"b091ceff-3f95-4de4-906b-5a43e8161af3\") " pod="openshift-multus/multus-f4vdc" Jul 08 01:42:02.321384 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.321146 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/dfaa7d20-7f57-4e48-b50c-8d67d58abe22-cni-binary-copy\") pod \"multus-additional-cni-plugins-nkz4s\" (UID: \"dfaa7d20-7f57-4e48-b50c-8d67d58abe22\") " pod="openshift-multus/multus-additional-cni-plugins-nkz4s" Jul 08 01:42:02.321384 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.321189 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9409c6b8-7a8b-4e5d-8b04-18b36e285356-ovn-node-metrics-cert\") pod \"ovnkube-node-hgtm2\" (UID: \"9409c6b8-7a8b-4e5d-8b04-18b36e285356\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgtm2" Jul 08 01:42:02.321384 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.321237 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b091ceff-3f95-4de4-906b-5a43e8161af3-multus-socket-dir-parent\") pod \"multus-f4vdc\" (UID: \"b091ceff-3f95-4de4-906b-5a43e8161af3\") " pod="openshift-multus/multus-f4vdc" Jul 08 01:42:02.321384 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.321264 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b091ceff-3f95-4de4-906b-5a43e8161af3-host-var-lib-cni-bin\") pod \"multus-f4vdc\" (UID: \"b091ceff-3f95-4de4-906b-5a43e8161af3\") " pod="openshift-multus/multus-f4vdc" Jul 08 01:42:02.321384 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.321247 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b091ceff-3f95-4de4-906b-5a43e8161af3-multus-daemon-config\") pod \"multus-f4vdc\" (UID: \"b091ceff-3f95-4de4-906b-5a43e8161af3\") " pod="openshift-multus/multus-f4vdc" Jul 08 01:42:02.321384 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.321315 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b091ceff-3f95-4de4-906b-5a43e8161af3-host-var-lib-cni-bin\") pod \"multus-f4vdc\" (UID: \"b091ceff-3f95-4de4-906b-5a43e8161af3\") " pod="openshift-multus/multus-f4vdc" Jul 08 01:42:02.321384 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.321352 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b091ceff-3f95-4de4-906b-5a43e8161af3-multus-socket-dir-parent\") pod \"multus-f4vdc\" (UID: \"b091ceff-3f95-4de4-906b-5a43e8161af3\") " pod="openshift-multus/multus-f4vdc" Jul 08 01:42:02.321927 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.321390 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b091ceff-3f95-4de4-906b-5a43e8161af3-etc-kubernetes\") pod \"multus-f4vdc\" (UID: \"b091ceff-3f95-4de4-906b-5a43e8161af3\") " pod="openshift-multus/multus-f4vdc" Jul 08 01:42:02.321927 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.321417 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w2lfl\" (UniqueName: \"kubernetes.io/projected/79d3b000-b3ab-40bd-97a1-47536d14a052-kube-api-access-w2lfl\") pod \"network-check-target-dvf9v\" (UID: \"79d3b000-b3ab-40bd-97a1-47536d14a052\") " pod="openshift-network-diagnostics/network-check-target-dvf9v" Jul 08 01:42:02.321927 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.321439 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/67d33362-8538-40e2-a54c-9a4ec41504db-run\") pod \"tuned-xvdkf\" (UID: \"67d33362-8538-40e2-a54c-9a4ec41504db\") " pod="openshift-cluster-node-tuning-operator/tuned-xvdkf" Jul 08 01:42:02.321927 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.321463 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b091ceff-3f95-4de4-906b-5a43e8161af3-cni-binary-copy\") pod \"multus-f4vdc\" (UID: \"b091ceff-3f95-4de4-906b-5a43e8161af3\") " pod="openshift-multus/multus-f4vdc" Jul 08 01:42:02.321927 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.321480 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b091ceff-3f95-4de4-906b-5a43e8161af3-multus-conf-dir\") pod \"multus-f4vdc\" (UID: \"b091ceff-3f95-4de4-906b-5a43e8161af3\") " pod="openshift-multus/multus-f4vdc" Jul 08 01:42:02.321927 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.321491 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b091ceff-3f95-4de4-906b-5a43e8161af3-etc-kubernetes\") pod \"multus-f4vdc\" (UID: \"b091ceff-3f95-4de4-906b-5a43e8161af3\") " pod="openshift-multus/multus-f4vdc" Jul 08 01:42:02.321927 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.321501 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/dfaa7d20-7f57-4e48-b50c-8d67d58abe22-tuning-conf-dir\") pod \"multus-additional-cni-plugins-nkz4s\" (UID: \"dfaa7d20-7f57-4e48-b50c-8d67d58abe22\") " pod="openshift-multus/multus-additional-cni-plugins-nkz4s" Jul 08 01:42:02.321927 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.321555 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3e78b9bc-0e4e-4303-822e-7246ecedff2d-socket-dir\") pod \"aws-ebs-csi-driver-node-j456h\" (UID: \"3e78b9bc-0e4e-4303-822e-7246ecedff2d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j456h" Jul 08 01:42:02.321927 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.321565 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/67d33362-8538-40e2-a54c-9a4ec41504db-run\") pod \"tuned-xvdkf\" (UID: \"67d33362-8538-40e2-a54c-9a4ec41504db\") " pod="openshift-cluster-node-tuning-operator/tuned-xvdkf" Jul 08 01:42:02.321927 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.321578 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/67d33362-8538-40e2-a54c-9a4ec41504db-etc-kubernetes\") pod \"tuned-xvdkf\" (UID: \"67d33362-8538-40e2-a54c-9a4ec41504db\") " pod="openshift-cluster-node-tuning-operator/tuned-xvdkf" Jul 08 01:42:02.321927 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.321613 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9409c6b8-7a8b-4e5d-8b04-18b36e285356-node-log\") pod \"ovnkube-node-hgtm2\" (UID: \"9409c6b8-7a8b-4e5d-8b04-18b36e285356\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgtm2" Jul 08 01:42:02.321927 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.321624 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/67d33362-8538-40e2-a54c-9a4ec41504db-etc-kubernetes\") pod \"tuned-xvdkf\" (UID: \"67d33362-8538-40e2-a54c-9a4ec41504db\") " pod="openshift-cluster-node-tuning-operator/tuned-xvdkf" Jul 08 01:42:02.321927 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.321672 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9409c6b8-7a8b-4e5d-8b04-18b36e285356-node-log\") pod \"ovnkube-node-hgtm2\" (UID: \"9409c6b8-7a8b-4e5d-8b04-18b36e285356\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgtm2" Jul 08 01:42:02.321927 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.321704 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9409c6b8-7a8b-4e5d-8b04-18b36e285356-host-run-ovn-kubernetes\") pod \"ovnkube-node-hgtm2\" (UID: \"9409c6b8-7a8b-4e5d-8b04-18b36e285356\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgtm2" Jul 08 01:42:02.321927 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.321730 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b091ceff-3f95-4de4-906b-5a43e8161af3-os-release\") pod \"multus-f4vdc\" (UID: \"b091ceff-3f95-4de4-906b-5a43e8161af3\") " pod="openshift-multus/multus-f4vdc" Jul 08 01:42:02.321927 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.321751 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b091ceff-3f95-4de4-906b-5a43e8161af3-hostroot\") pod \"multus-f4vdc\" (UID: \"b091ceff-3f95-4de4-906b-5a43e8161af3\") " pod="openshift-multus/multus-f4vdc" Jul 08 01:42:02.321927 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.321776 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/dfaa7d20-7f57-4e48-b50c-8d67d58abe22-os-release\") pod \"multus-additional-cni-plugins-nkz4s\" (UID: \"dfaa7d20-7f57-4e48-b50c-8d67d58abe22\") " pod="openshift-multus/multus-additional-cni-plugins-nkz4s" Jul 08 01:42:02.321927 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.321802 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9409c6b8-7a8b-4e5d-8b04-18b36e285356-run-systemd\") pod \"ovnkube-node-hgtm2\" (UID: \"9409c6b8-7a8b-4e5d-8b04-18b36e285356\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgtm2" Jul 08 01:42:02.322805 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.321825 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/87674b91-e601-4694-a3e1-bb0bd80b5c4f-original-pull-secret\") pod \"global-pull-secret-syncer-6hr9n\" (UID: \"87674b91-e601-4694-a3e1-bb0bd80b5c4f\") " pod="kube-system/global-pull-secret-syncer-6hr9n" Jul 08 01:42:02.322805 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.321847 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3e78b9bc-0e4e-4303-822e-7246ecedff2d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-j456h\" (UID: \"3e78b9bc-0e4e-4303-822e-7246ecedff2d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j456h" Jul 08 01:42:02.322805 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.321869 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3e78b9bc-0e4e-4303-822e-7246ecedff2d-device-dir\") pod \"aws-ebs-csi-driver-node-j456h\" (UID: \"3e78b9bc-0e4e-4303-822e-7246ecedff2d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j456h" Jul 08 01:42:02.322805 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.321893 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/67d33362-8538-40e2-a54c-9a4ec41504db-sys\") pod \"tuned-xvdkf\" (UID: \"67d33362-8538-40e2-a54c-9a4ec41504db\") " pod="openshift-cluster-node-tuning-operator/tuned-xvdkf" Jul 08 01:42:02.322805 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.321920 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4979g\" (UniqueName: \"kubernetes.io/projected/67d33362-8538-40e2-a54c-9a4ec41504db-kube-api-access-4979g\") pod \"tuned-xvdkf\" (UID: \"67d33362-8538-40e2-a54c-9a4ec41504db\") " pod="openshift-cluster-node-tuning-operator/tuned-xvdkf" Jul 08 01:42:02.322805 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.321947 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3e78b9bc-0e4e-4303-822e-7246ecedff2d-etc-selinux\") pod \"aws-ebs-csi-driver-node-j456h\" (UID: \"3e78b9bc-0e4e-4303-822e-7246ecedff2d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j456h" Jul 08 01:42:02.322805 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.321972 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b091ceff-3f95-4de4-906b-5a43e8161af3-host-var-lib-cni-multus\") pod \"multus-f4vdc\" (UID: \"b091ceff-3f95-4de4-906b-5a43e8161af3\") " pod="openshift-multus/multus-f4vdc" Jul 08 01:42:02.322805 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.321998 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dfaa7d20-7f57-4e48-b50c-8d67d58abe22-system-cni-dir\") pod \"multus-additional-cni-plugins-nkz4s\" (UID: \"dfaa7d20-7f57-4e48-b50c-8d67d58abe22\") " pod="openshift-multus/multus-additional-cni-plugins-nkz4s" Jul 08 01:42:02.322805 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.322026 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/dfaa7d20-7f57-4e48-b50c-8d67d58abe22-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-nkz4s\" (UID: \"dfaa7d20-7f57-4e48-b50c-8d67d58abe22\") " pod="openshift-multus/multus-additional-cni-plugins-nkz4s" Jul 08 01:42:02.322805 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.322053 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/87674b91-e601-4694-a3e1-bb0bd80b5c4f-kubelet-config\") pod \"global-pull-secret-syncer-6hr9n\" (UID: \"87674b91-e601-4694-a3e1-bb0bd80b5c4f\") " pod="kube-system/global-pull-secret-syncer-6hr9n" Jul 08 01:42:02.322805 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.322075 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b091ceff-3f95-4de4-906b-5a43e8161af3-cni-binary-copy\") pod \"multus-f4vdc\" (UID: \"b091ceff-3f95-4de4-906b-5a43e8161af3\") " pod="openshift-multus/multus-f4vdc" Jul 08 01:42:02.322805 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.322080 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/67d33362-8538-40e2-a54c-9a4ec41504db-etc-sysconfig\") pod \"tuned-xvdkf\" (UID: \"67d33362-8538-40e2-a54c-9a4ec41504db\") " pod="openshift-cluster-node-tuning-operator/tuned-xvdkf" Jul 08 01:42:02.322805 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.322108 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3e78b9bc-0e4e-4303-822e-7246ecedff2d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-j456h\" (UID: \"3e78b9bc-0e4e-4303-822e-7246ecedff2d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j456h" Jul 08 01:42:02.322805 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.322132 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9409c6b8-7a8b-4e5d-8b04-18b36e285356-host-run-netns\") pod \"ovnkube-node-hgtm2\" (UID: \"9409c6b8-7a8b-4e5d-8b04-18b36e285356\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgtm2" Jul 08 01:42:02.322805 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.322137 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/67d33362-8538-40e2-a54c-9a4ec41504db-etc-sysconfig\") pod \"tuned-xvdkf\" (UID: \"67d33362-8538-40e2-a54c-9a4ec41504db\") " pod="openshift-cluster-node-tuning-operator/tuned-xvdkf" Jul 08 01:42:02.322805 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.322158 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9409c6b8-7a8b-4e5d-8b04-18b36e285356-run-openvswitch\") pod \"ovnkube-node-hgtm2\" (UID: \"9409c6b8-7a8b-4e5d-8b04-18b36e285356\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgtm2" Jul 08 01:42:02.322805 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.322186 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a94ad3dd-a657-4061-82a9-ab28622ab193-agent-certs\") pod \"konnectivity-agent-dj8dv\" (UID: \"a94ad3dd-a657-4061-82a9-ab28622ab193\") " pod="kube-system/konnectivity-agent-dj8dv" Jul 08 01:42:02.323770 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.322191 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3e78b9bc-0e4e-4303-822e-7246ecedff2d-device-dir\") pod \"aws-ebs-csi-driver-node-j456h\" (UID: \"3e78b9bc-0e4e-4303-822e-7246ecedff2d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j456h" Jul 08 01:42:02.323770 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.322216 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b091ceff-3f95-4de4-906b-5a43e8161af3-os-release\") pod \"multus-f4vdc\" (UID: \"b091ceff-3f95-4de4-906b-5a43e8161af3\") " pod="openshift-multus/multus-f4vdc" Jul 08 01:42:02.323770 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.322220 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9409c6b8-7a8b-4e5d-8b04-18b36e285356-etc-openvswitch\") pod \"ovnkube-node-hgtm2\" (UID: \"9409c6b8-7a8b-4e5d-8b04-18b36e285356\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgtm2" Jul 08 01:42:02.323770 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.322277 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9409c6b8-7a8b-4e5d-8b04-18b36e285356-etc-openvswitch\") pod \"ovnkube-node-hgtm2\" (UID: \"9409c6b8-7a8b-4e5d-8b04-18b36e285356\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgtm2" Jul 08 01:42:02.323770 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.322281 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b091ceff-3f95-4de4-906b-5a43e8161af3-hostroot\") pod \"multus-f4vdc\" (UID: \"b091ceff-3f95-4de4-906b-5a43e8161af3\") " pod="openshift-multus/multus-f4vdc" Jul 08 01:42:02.323770 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.322335 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/67d33362-8538-40e2-a54c-9a4ec41504db-sys\") pod \"tuned-xvdkf\" (UID: \"67d33362-8538-40e2-a54c-9a4ec41504db\") " pod="openshift-cluster-node-tuning-operator/tuned-xvdkf" Jul 08 01:42:02.323770 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.322369 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3e78b9bc-0e4e-4303-822e-7246ecedff2d-etc-selinux\") pod \"aws-ebs-csi-driver-node-j456h\" (UID: \"3e78b9bc-0e4e-4303-822e-7246ecedff2d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j456h" Jul 08 01:42:02.323770 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.322411 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b091ceff-3f95-4de4-906b-5a43e8161af3-host-var-lib-cni-multus\") pod \"multus-f4vdc\" (UID: \"b091ceff-3f95-4de4-906b-5a43e8161af3\") " pod="openshift-multus/multus-f4vdc" Jul 08 01:42:02.323770 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.322479 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/87674b91-e601-4694-a3e1-bb0bd80b5c4f-kubelet-config\") pod \"global-pull-secret-syncer-6hr9n\" (UID: \"87674b91-e601-4694-a3e1-bb0bd80b5c4f\") " pod="kube-system/global-pull-secret-syncer-6hr9n" Jul 08 01:42:02.323770 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.322524 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9409c6b8-7a8b-4e5d-8b04-18b36e285356-run-systemd\") pod \"ovnkube-node-hgtm2\" (UID: \"9409c6b8-7a8b-4e5d-8b04-18b36e285356\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgtm2" Jul 08 01:42:02.323770 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.322572 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9409c6b8-7a8b-4e5d-8b04-18b36e285356-log-socket\") pod \"ovnkube-node-hgtm2\" (UID: \"9409c6b8-7a8b-4e5d-8b04-18b36e285356\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgtm2" Jul 08 01:42:02.323770 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.322603 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9409c6b8-7a8b-4e5d-8b04-18b36e285356-host-cni-bin\") pod \"ovnkube-node-hgtm2\" (UID: \"9409c6b8-7a8b-4e5d-8b04-18b36e285356\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgtm2" Jul 08 01:42:02.323770 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:42:02.322623 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 01:42:02.323770 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.322637 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/dfaa7d20-7f57-4e48-b50c-8d67d58abe22-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-nkz4s\" (UID: \"dfaa7d20-7f57-4e48-b50c-8d67d58abe22\") " pod="openshift-multus/multus-additional-cni-plugins-nkz4s" Jul 08 01:42:02.323770 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.322664 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6d567423-f240-4ed8-87ba-743127287631-tmp-dir\") pod \"node-resolver-pk46r\" (UID: \"6d567423-f240-4ed8-87ba-743127287631\") " pod="openshift-dns/node-resolver-pk46r" Jul 08 01:42:02.323770 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:42:02.322713 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87674b91-e601-4694-a3e1-bb0bd80b5c4f-original-pull-secret podName:87674b91-e601-4694-a3e1-bb0bd80b5c4f nodeName:}" failed. No retries permitted until 2026-07-08 01:42:02.822677697 +0000 UTC m=+3.020004549 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/87674b91-e601-4694-a3e1-bb0bd80b5c4f-original-pull-secret") pod "global-pull-secret-syncer-6hr9n" (UID: "87674b91-e601-4694-a3e1-bb0bd80b5c4f") : object "kube-system"/"original-pull-secret" not registered Jul 08 01:42:02.323770 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.322724 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9409c6b8-7a8b-4e5d-8b04-18b36e285356-log-socket\") pod \"ovnkube-node-hgtm2\" (UID: \"9409c6b8-7a8b-4e5d-8b04-18b36e285356\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgtm2" Jul 08 01:42:02.324613 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.322733 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3e78b9bc-0e4e-4303-822e-7246ecedff2d-sys-fs\") pod \"aws-ebs-csi-driver-node-j456h\" (UID: \"3e78b9bc-0e4e-4303-822e-7246ecedff2d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j456h" Jul 08 01:42:02.324613 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.322767 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9409c6b8-7a8b-4e5d-8b04-18b36e285356-host-cni-bin\") pod \"ovnkube-node-hgtm2\" (UID: \"9409c6b8-7a8b-4e5d-8b04-18b36e285356\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgtm2" Jul 08 01:42:02.324613 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.322762 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5cb4d2ec-61d0-4b04-a043-39c3d834cf1a-serviceca\") pod \"node-ca-xljcg\" (UID: \"5cb4d2ec-61d0-4b04-a043-39c3d834cf1a\") " pod="openshift-image-registry/node-ca-xljcg" Jul 08 01:42:02.324613 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.322804 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9409c6b8-7a8b-4e5d-8b04-18b36e285356-host-slash\") pod \"ovnkube-node-hgtm2\" (UID: \"9409c6b8-7a8b-4e5d-8b04-18b36e285356\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgtm2" Jul 08 01:42:02.324613 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.323035 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3e78b9bc-0e4e-4303-822e-7246ecedff2d-socket-dir\") pod \"aws-ebs-csi-driver-node-j456h\" (UID: \"3e78b9bc-0e4e-4303-822e-7246ecedff2d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j456h" Jul 08 01:42:02.324613 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.323083 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b091ceff-3f95-4de4-906b-5a43e8161af3-multus-conf-dir\") pod \"multus-f4vdc\" (UID: \"b091ceff-3f95-4de4-906b-5a43e8161af3\") " pod="openshift-multus/multus-f4vdc" Jul 08 01:42:02.324613 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.323146 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9409c6b8-7a8b-4e5d-8b04-18b36e285356-run-openvswitch\") pod \"ovnkube-node-hgtm2\" (UID: \"9409c6b8-7a8b-4e5d-8b04-18b36e285356\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgtm2" Jul 08 01:42:02.324613 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.323184 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9409c6b8-7a8b-4e5d-8b04-18b36e285356-host-run-netns\") pod \"ovnkube-node-hgtm2\" (UID: \"9409c6b8-7a8b-4e5d-8b04-18b36e285356\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgtm2" Jul 08 01:42:02.324613 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.323246 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5cb4d2ec-61d0-4b04-a043-39c3d834cf1a-serviceca\") pod \"node-ca-xljcg\" (UID: \"5cb4d2ec-61d0-4b04-a043-39c3d834cf1a\") " pod="openshift-image-registry/node-ca-xljcg" Jul 08 01:42:02.324613 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.323326 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3e78b9bc-0e4e-4303-822e-7246ecedff2d-sys-fs\") pod \"aws-ebs-csi-driver-node-j456h\" (UID: \"3e78b9bc-0e4e-4303-822e-7246ecedff2d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j456h" Jul 08 01:42:02.324613 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.323371 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9409c6b8-7a8b-4e5d-8b04-18b36e285356-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hgtm2\" (UID: \"9409c6b8-7a8b-4e5d-8b04-18b36e285356\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgtm2" Jul 08 01:42:02.324613 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.323401 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-585z2\" (UniqueName: \"kubernetes.io/projected/9409c6b8-7a8b-4e5d-8b04-18b36e285356-kube-api-access-585z2\") pod \"ovnkube-node-hgtm2\" (UID: \"9409c6b8-7a8b-4e5d-8b04-18b36e285356\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgtm2" Jul 08 01:42:02.324613 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.323456 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b091ceff-3f95-4de4-906b-5a43e8161af3-system-cni-dir\") pod \"multus-f4vdc\" (UID: \"b091ceff-3f95-4de4-906b-5a43e8161af3\") " pod="openshift-multus/multus-f4vdc" Jul 08 01:42:02.324613 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.323484 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kbpj8\" (UniqueName: \"kubernetes.io/projected/77d11f18-f68a-4d7c-8217-be0a83114e14-kube-api-access-kbpj8\") pod \"iptables-alerter-srhs5\" (UID: \"77d11f18-f68a-4d7c-8217-be0a83114e14\") " pod="openshift-network-operator/iptables-alerter-srhs5" Jul 08 01:42:02.324613 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.323511 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/67d33362-8538-40e2-a54c-9a4ec41504db-etc-sysctl-d\") pod \"tuned-xvdkf\" (UID: \"67d33362-8538-40e2-a54c-9a4ec41504db\") " pod="openshift-cluster-node-tuning-operator/tuned-xvdkf" Jul 08 01:42:02.324613 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.323537 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hm2b6\" (UniqueName: \"kubernetes.io/projected/5cb4d2ec-61d0-4b04-a043-39c3d834cf1a-kube-api-access-hm2b6\") pod \"node-ca-xljcg\" (UID: \"5cb4d2ec-61d0-4b04-a043-39c3d834cf1a\") " pod="openshift-image-registry/node-ca-xljcg" Jul 08 01:42:02.324613 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.323603 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9409c6b8-7a8b-4e5d-8b04-18b36e285356-host-kubelet\") pod \"ovnkube-node-hgtm2\" (UID: \"9409c6b8-7a8b-4e5d-8b04-18b36e285356\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgtm2" Jul 08 01:42:02.325465 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.323627 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9409c6b8-7a8b-4e5d-8b04-18b36e285356-ovnkube-config\") pod \"ovnkube-node-hgtm2\" (UID: \"9409c6b8-7a8b-4e5d-8b04-18b36e285356\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgtm2" Jul 08 01:42:02.325465 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.323649 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b091ceff-3f95-4de4-906b-5a43e8161af3-host-run-k8s-cni-cncf-io\") pod \"multus-f4vdc\" (UID: \"b091ceff-3f95-4de4-906b-5a43e8161af3\") " pod="openshift-multus/multus-f4vdc" Jul 08 01:42:02.325465 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.323673 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a94ad3dd-a657-4061-82a9-ab28622ab193-konnectivity-ca\") pod \"konnectivity-agent-dj8dv\" (UID: \"a94ad3dd-a657-4061-82a9-ab28622ab193\") " pod="kube-system/konnectivity-agent-dj8dv" Jul 08 01:42:02.325465 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.323703 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/dfaa7d20-7f57-4e48-b50c-8d67d58abe22-cnibin\") pod \"multus-additional-cni-plugins-nkz4s\" (UID: \"dfaa7d20-7f57-4e48-b50c-8d67d58abe22\") " pod="openshift-multus/multus-additional-cni-plugins-nkz4s" Jul 08 01:42:02.325465 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.323729 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/87674b91-e601-4694-a3e1-bb0bd80b5c4f-dbus\") pod \"global-pull-secret-syncer-6hr9n\" (UID: \"87674b91-e601-4694-a3e1-bb0bd80b5c4f\") " pod="kube-system/global-pull-secret-syncer-6hr9n" Jul 08 01:42:02.325465 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.323752 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/67d33362-8538-40e2-a54c-9a4ec41504db-lib-modules\") pod \"tuned-xvdkf\" (UID: \"67d33362-8538-40e2-a54c-9a4ec41504db\") " pod="openshift-cluster-node-tuning-operator/tuned-xvdkf" Jul 08 01:42:02.325465 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.323777 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/67d33362-8538-40e2-a54c-9a4ec41504db-var-lib-kubelet\") pod \"tuned-xvdkf\" (UID: \"67d33362-8538-40e2-a54c-9a4ec41504db\") " pod="openshift-cluster-node-tuning-operator/tuned-xvdkf" Jul 08 01:42:02.325465 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.323880 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9409c6b8-7a8b-4e5d-8b04-18b36e285356-env-overrides\") pod \"ovnkube-node-hgtm2\" (UID: \"9409c6b8-7a8b-4e5d-8b04-18b36e285356\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgtm2" Jul 08 01:42:02.325465 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.323909 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b091ceff-3f95-4de4-906b-5a43e8161af3-multus-cni-dir\") pod \"multus-f4vdc\" (UID: \"b091ceff-3f95-4de4-906b-5a43e8161af3\") " pod="openshift-multus/multus-f4vdc" Jul 08 01:42:02.325465 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.323942 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/77d11f18-f68a-4d7c-8217-be0a83114e14-iptables-alerter-script\") pod \"iptables-alerter-srhs5\" (UID: \"77d11f18-f68a-4d7c-8217-be0a83114e14\") " pod="openshift-network-operator/iptables-alerter-srhs5" Jul 08 01:42:02.325465 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.323971 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/67d33362-8538-40e2-a54c-9a4ec41504db-etc-modprobe-d\") pod \"tuned-xvdkf\" (UID: \"67d33362-8538-40e2-a54c-9a4ec41504db\") " pod="openshift-cluster-node-tuning-operator/tuned-xvdkf" Jul 08 01:42:02.325465 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.324002 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9409c6b8-7a8b-4e5d-8b04-18b36e285356-ovnkube-script-lib\") pod \"ovnkube-node-hgtm2\" (UID: \"9409c6b8-7a8b-4e5d-8b04-18b36e285356\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgtm2" Jul 08 01:42:02.325465 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.324031 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7fb8m\" (UniqueName: \"kubernetes.io/projected/dfaa7d20-7f57-4e48-b50c-8d67d58abe22-kube-api-access-7fb8m\") pod \"multus-additional-cni-plugins-nkz4s\" (UID: \"dfaa7d20-7f57-4e48-b50c-8d67d58abe22\") " pod="openshift-multus/multus-additional-cni-plugins-nkz4s" Jul 08 01:42:02.325465 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.324058 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9409c6b8-7a8b-4e5d-8b04-18b36e285356-systemd-units\") pod \"ovnkube-node-hgtm2\" (UID: \"9409c6b8-7a8b-4e5d-8b04-18b36e285356\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgtm2" Jul 08 01:42:02.325465 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.324091 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9409c6b8-7a8b-4e5d-8b04-18b36e285356-var-lib-openvswitch\") pod \"ovnkube-node-hgtm2\" (UID: \"9409c6b8-7a8b-4e5d-8b04-18b36e285356\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgtm2" Jul 08 01:42:02.325465 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.324119 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3e78b9bc-0e4e-4303-822e-7246ecedff2d-registration-dir\") pod \"aws-ebs-csi-driver-node-j456h\" (UID: \"3e78b9bc-0e4e-4303-822e-7246ecedff2d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j456h" Jul 08 01:42:02.325465 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.324151 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hrmp8\" (UniqueName: \"kubernetes.io/projected/3e78b9bc-0e4e-4303-822e-7246ecedff2d-kube-api-access-hrmp8\") pod \"aws-ebs-csi-driver-node-j456h\" (UID: \"3e78b9bc-0e4e-4303-822e-7246ecedff2d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j456h" Jul 08 01:42:02.326237 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.324179 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/67d33362-8538-40e2-a54c-9a4ec41504db-etc-sysctl-conf\") pod \"tuned-xvdkf\" (UID: \"67d33362-8538-40e2-a54c-9a4ec41504db\") " pod="openshift-cluster-node-tuning-operator/tuned-xvdkf" Jul 08 01:42:02.326237 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.324224 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b091ceff-3f95-4de4-906b-5a43e8161af3-host-run-netns\") pod \"multus-f4vdc\" (UID: \"b091ceff-3f95-4de4-906b-5a43e8161af3\") " pod="openshift-multus/multus-f4vdc" Jul 08 01:42:02.326237 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.324250 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b091ceff-3f95-4de4-906b-5a43e8161af3-host-run-multus-certs\") pod \"multus-f4vdc\" (UID: \"b091ceff-3f95-4de4-906b-5a43e8161af3\") " pod="openshift-multus/multus-f4vdc" Jul 08 01:42:02.326237 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.324295 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6d567423-f240-4ed8-87ba-743127287631-hosts-file\") pod \"node-resolver-pk46r\" (UID: \"6d567423-f240-4ed8-87ba-743127287631\") " pod="openshift-dns/node-resolver-pk46r" Jul 08 01:42:02.326237 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.324323 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/77d11f18-f68a-4d7c-8217-be0a83114e14-host-slash\") pod \"iptables-alerter-srhs5\" (UID: \"77d11f18-f68a-4d7c-8217-be0a83114e14\") " pod="openshift-network-operator/iptables-alerter-srhs5" Jul 08 01:42:02.326237 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.324464 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/67d33362-8538-40e2-a54c-9a4ec41504db-etc-systemd\") pod \"tuned-xvdkf\" (UID: \"67d33362-8538-40e2-a54c-9a4ec41504db\") " pod="openshift-cluster-node-tuning-operator/tuned-xvdkf" Jul 08 01:42:02.326237 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.324493 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m66r8\" (UniqueName: \"kubernetes.io/projected/b091ceff-3f95-4de4-906b-5a43e8161af3-kube-api-access-m66r8\") pod \"multus-f4vdc\" (UID: \"b091ceff-3f95-4de4-906b-5a43e8161af3\") " pod="openshift-multus/multus-f4vdc" Jul 08 01:42:02.326237 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.324520 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7ww6n\" (UniqueName: \"kubernetes.io/projected/6d567423-f240-4ed8-87ba-743127287631-kube-api-access-7ww6n\") pod \"node-resolver-pk46r\" (UID: \"6d567423-f240-4ed8-87ba-743127287631\") " pod="openshift-dns/node-resolver-pk46r" Jul 08 01:42:02.326237 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.324548 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b091ceff-3f95-4de4-906b-5a43e8161af3-host-var-lib-kubelet\") pod \"multus-f4vdc\" (UID: \"b091ceff-3f95-4de4-906b-5a43e8161af3\") " pod="openshift-multus/multus-f4vdc" Jul 08 01:42:02.326237 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.324641 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b091ceff-3f95-4de4-906b-5a43e8161af3-host-var-lib-kubelet\") pod \"multus-f4vdc\" (UID: \"b091ceff-3f95-4de4-906b-5a43e8161af3\") " pod="openshift-multus/multus-f4vdc" Jul 08 01:42:02.326237 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.324674 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/77d11f18-f68a-4d7c-8217-be0a83114e14-host-slash\") pod \"iptables-alerter-srhs5\" (UID: \"77d11f18-f68a-4d7c-8217-be0a83114e14\") " pod="openshift-network-operator/iptables-alerter-srhs5" Jul 08 01:42:02.326237 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.324715 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/67d33362-8538-40e2-a54c-9a4ec41504db-var-lib-kubelet\") pod \"tuned-xvdkf\" (UID: \"67d33362-8538-40e2-a54c-9a4ec41504db\") " pod="openshift-cluster-node-tuning-operator/tuned-xvdkf" Jul 08 01:42:02.326237 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.322157 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9409c6b8-7a8b-4e5d-8b04-18b36e285356-host-run-ovn-kubernetes\") pod \"ovnkube-node-hgtm2\" (UID: \"9409c6b8-7a8b-4e5d-8b04-18b36e285356\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgtm2" Jul 08 01:42:02.326237 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.325130 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9409c6b8-7a8b-4e5d-8b04-18b36e285356-host-slash\") pod \"ovnkube-node-hgtm2\" (UID: \"9409c6b8-7a8b-4e5d-8b04-18b36e285356\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgtm2" Jul 08 01:42:02.326237 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.325168 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/67d33362-8538-40e2-a54c-9a4ec41504db-tmp\") pod \"tuned-xvdkf\" (UID: \"67d33362-8538-40e2-a54c-9a4ec41504db\") " pod="openshift-cluster-node-tuning-operator/tuned-xvdkf" Jul 08 01:42:02.326237 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.325211 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/67d33362-8538-40e2-a54c-9a4ec41504db-etc-modprobe-d\") pod \"tuned-xvdkf\" (UID: \"67d33362-8538-40e2-a54c-9a4ec41504db\") " pod="openshift-cluster-node-tuning-operator/tuned-xvdkf" Jul 08 01:42:02.326237 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.325215 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/67d33362-8538-40e2-a54c-9a4ec41504db-etc-tuned\") pod \"tuned-xvdkf\" (UID: \"67d33362-8538-40e2-a54c-9a4ec41504db\") " pod="openshift-cluster-node-tuning-operator/tuned-xvdkf" Jul 08 01:42:02.326237 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.325241 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b091ceff-3f95-4de4-906b-5a43e8161af3-host-run-k8s-cni-cncf-io\") pod \"multus-f4vdc\" (UID: \"b091ceff-3f95-4de4-906b-5a43e8161af3\") " pod="openshift-multus/multus-f4vdc" Jul 08 01:42:02.327064 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.325248 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b091ceff-3f95-4de4-906b-5a43e8161af3-host-run-netns\") pod \"multus-f4vdc\" (UID: \"b091ceff-3f95-4de4-906b-5a43e8161af3\") " pod="openshift-multus/multus-f4vdc" Jul 08 01:42:02.327064 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.325326 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b091ceff-3f95-4de4-906b-5a43e8161af3-system-cni-dir\") pod \"multus-f4vdc\" (UID: \"b091ceff-3f95-4de4-906b-5a43e8161af3\") " pod="openshift-multus/multus-f4vdc" Jul 08 01:42:02.327064 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.325354 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/67d33362-8538-40e2-a54c-9a4ec41504db-etc-sysctl-d\") pod \"tuned-xvdkf\" (UID: \"67d33362-8538-40e2-a54c-9a4ec41504db\") " pod="openshift-cluster-node-tuning-operator/tuned-xvdkf" Jul 08 01:42:02.327064 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.325362 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9409c6b8-7a8b-4e5d-8b04-18b36e285356-host-kubelet\") pod \"ovnkube-node-hgtm2\" (UID: \"9409c6b8-7a8b-4e5d-8b04-18b36e285356\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgtm2" Jul 08 01:42:02.327064 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.325356 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/67d33362-8538-40e2-a54c-9a4ec41504db-etc-sysctl-conf\") pod \"tuned-xvdkf\" (UID: \"67d33362-8538-40e2-a54c-9a4ec41504db\") " pod="openshift-cluster-node-tuning-operator/tuned-xvdkf" Jul 08 01:42:02.327064 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.325386 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9409c6b8-7a8b-4e5d-8b04-18b36e285356-ovn-node-metrics-cert\") pod \"ovnkube-node-hgtm2\" (UID: \"9409c6b8-7a8b-4e5d-8b04-18b36e285356\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgtm2" Jul 08 01:42:02.327064 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.325415 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9409c6b8-7a8b-4e5d-8b04-18b36e285356-systemd-units\") pod \"ovnkube-node-hgtm2\" (UID: \"9409c6b8-7a8b-4e5d-8b04-18b36e285356\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgtm2" Jul 08 01:42:02.327064 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.325469 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a94ad3dd-a657-4061-82a9-ab28622ab193-agent-certs\") pod \"konnectivity-agent-dj8dv\" (UID: \"a94ad3dd-a657-4061-82a9-ab28622ab193\") " pod="kube-system/konnectivity-agent-dj8dv" Jul 08 01:42:02.327064 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.325495 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/67d33362-8538-40e2-a54c-9a4ec41504db-etc-systemd\") pod \"tuned-xvdkf\" (UID: \"67d33362-8538-40e2-a54c-9a4ec41504db\") " pod="openshift-cluster-node-tuning-operator/tuned-xvdkf" Jul 08 01:42:02.327064 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.325521 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9409c6b8-7a8b-4e5d-8b04-18b36e285356-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hgtm2\" (UID: \"9409c6b8-7a8b-4e5d-8b04-18b36e285356\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgtm2" Jul 08 01:42:02.327064 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.325620 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/87674b91-e601-4694-a3e1-bb0bd80b5c4f-dbus\") pod \"global-pull-secret-syncer-6hr9n\" (UID: \"87674b91-e601-4694-a3e1-bb0bd80b5c4f\") " pod="kube-system/global-pull-secret-syncer-6hr9n" Jul 08 01:42:02.327064 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.325650 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3e78b9bc-0e4e-4303-822e-7246ecedff2d-registration-dir\") pod \"aws-ebs-csi-driver-node-j456h\" (UID: \"3e78b9bc-0e4e-4303-822e-7246ecedff2d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j456h" Jul 08 01:42:02.327064 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.325667 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b091ceff-3f95-4de4-906b-5a43e8161af3-host-run-multus-certs\") pod \"multus-f4vdc\" (UID: \"b091ceff-3f95-4de4-906b-5a43e8161af3\") " pod="openshift-multus/multus-f4vdc" Jul 08 01:42:02.327064 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.325725 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b091ceff-3f95-4de4-906b-5a43e8161af3-multus-cni-dir\") pod \"multus-f4vdc\" (UID: \"b091ceff-3f95-4de4-906b-5a43e8161af3\") " pod="openshift-multus/multus-f4vdc" Jul 08 01:42:02.327064 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.325783 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/77d11f18-f68a-4d7c-8217-be0a83114e14-iptables-alerter-script\") pod \"iptables-alerter-srhs5\" (UID: \"77d11f18-f68a-4d7c-8217-be0a83114e14\") " pod="openshift-network-operator/iptables-alerter-srhs5" Jul 08 01:42:02.327064 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.325826 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/67d33362-8538-40e2-a54c-9a4ec41504db-lib-modules\") pod \"tuned-xvdkf\" (UID: \"67d33362-8538-40e2-a54c-9a4ec41504db\") " pod="openshift-cluster-node-tuning-operator/tuned-xvdkf" Jul 08 01:42:02.327064 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.325847 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9409c6b8-7a8b-4e5d-8b04-18b36e285356-var-lib-openvswitch\") pod \"ovnkube-node-hgtm2\" (UID: \"9409c6b8-7a8b-4e5d-8b04-18b36e285356\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgtm2" Jul 08 01:42:02.327064 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.325941 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9409c6b8-7a8b-4e5d-8b04-18b36e285356-ovnkube-config\") pod \"ovnkube-node-hgtm2\" (UID: \"9409c6b8-7a8b-4e5d-8b04-18b36e285356\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgtm2" Jul 08 01:42:02.327991 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.325963 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9409c6b8-7a8b-4e5d-8b04-18b36e285356-ovnkube-script-lib\") pod \"ovnkube-node-hgtm2\" (UID: \"9409c6b8-7a8b-4e5d-8b04-18b36e285356\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgtm2" Jul 08 01:42:02.327991 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.326030 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9409c6b8-7a8b-4e5d-8b04-18b36e285356-env-overrides\") pod \"ovnkube-node-hgtm2\" (UID: \"9409c6b8-7a8b-4e5d-8b04-18b36e285356\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgtm2" Jul 08 01:42:02.327991 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.326069 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a94ad3dd-a657-4061-82a9-ab28622ab193-konnectivity-ca\") pod \"konnectivity-agent-dj8dv\" (UID: \"a94ad3dd-a657-4061-82a9-ab28622ab193\") " pod="kube-system/konnectivity-agent-dj8dv" Jul 08 01:42:02.329477 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:42:02.329453 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 01:42:02.329575 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:42:02.329482 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 01:42:02.329575 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:42:02.329493 2563 projected.go:196] Error preparing data for projected volume kube-api-access-w2lfl for pod openshift-network-diagnostics/network-check-target-dvf9v: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 01:42:02.329575 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:42:02.329557 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/79d3b000-b3ab-40bd-97a1-47536d14a052-kube-api-access-w2lfl podName:79d3b000-b3ab-40bd-97a1-47536d14a052 nodeName:}" failed. No retries permitted until 2026-07-08 01:42:02.829537721 +0000 UTC m=+3.026864555 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-w2lfl" (UniqueName: "kubernetes.io/projected/79d3b000-b3ab-40bd-97a1-47536d14a052-kube-api-access-w2lfl") pod "network-check-target-dvf9v" (UID: "79d3b000-b3ab-40bd-97a1-47536d14a052") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 01:42:02.336160 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.336125 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hrmp8\" (UniqueName: \"kubernetes.io/projected/3e78b9bc-0e4e-4303-822e-7246ecedff2d-kube-api-access-hrmp8\") pod \"aws-ebs-csi-driver-node-j456h\" (UID: \"3e78b9bc-0e4e-4303-822e-7246ecedff2d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j456h" Jul 08 01:42:02.336160 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.336136 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m66r8\" (UniqueName: \"kubernetes.io/projected/b091ceff-3f95-4de4-906b-5a43e8161af3-kube-api-access-m66r8\") pod \"multus-f4vdc\" (UID: \"b091ceff-3f95-4de4-906b-5a43e8161af3\") " pod="openshift-multus/multus-f4vdc" Jul 08 01:42:02.336376 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.336191 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hm2b6\" (UniqueName: \"kubernetes.io/projected/5cb4d2ec-61d0-4b04-a043-39c3d834cf1a-kube-api-access-hm2b6\") pod \"node-ca-xljcg\" (UID: \"5cb4d2ec-61d0-4b04-a043-39c3d834cf1a\") " pod="openshift-image-registry/node-ca-xljcg" Jul 08 01:42:02.336376 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.336307 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-585z2\" (UniqueName: \"kubernetes.io/projected/9409c6b8-7a8b-4e5d-8b04-18b36e285356-kube-api-access-585z2\") pod \"ovnkube-node-hgtm2\" (UID: \"9409c6b8-7a8b-4e5d-8b04-18b36e285356\") " pod="openshift-ovn-kubernetes/ovnkube-node-hgtm2" Jul 08 01:42:02.336874 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.336850 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4979g\" (UniqueName: \"kubernetes.io/projected/67d33362-8538-40e2-a54c-9a4ec41504db-kube-api-access-4979g\") pod \"tuned-xvdkf\" (UID: \"67d33362-8538-40e2-a54c-9a4ec41504db\") " pod="openshift-cluster-node-tuning-operator/tuned-xvdkf" Jul 08 01:42:02.337783 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.337761 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kbpj8\" (UniqueName: \"kubernetes.io/projected/77d11f18-f68a-4d7c-8217-be0a83114e14-kube-api-access-kbpj8\") pod \"iptables-alerter-srhs5\" (UID: \"77d11f18-f68a-4d7c-8217-be0a83114e14\") " pod="openshift-network-operator/iptables-alerter-srhs5" Jul 08 01:42:02.400760 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.400693 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-233.ec2.internal" event={"ID":"d3d20294c54eebf1cdd45bd4f32b1e5e","Type":"ContainerStarted","Data":"c86b3139528fd14bbc4230a67ddff1712e59c2acc77b73a241ba7877db6c1234"} Jul 08 01:42:02.401893 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.401864 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-233.ec2.internal" event={"ID":"61e1c42ac9a08ecfb3c8cc5e93139196","Type":"ContainerStarted","Data":"95efdf3f201d16f632a816211a038bf7bf3407758f5008f0fbd28514f3c3b4d5"} Jul 08 01:42:02.425190 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.425098 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/dfaa7d20-7f57-4e48-b50c-8d67d58abe22-cnibin\") pod \"multus-additional-cni-plugins-nkz4s\" (UID: \"dfaa7d20-7f57-4e48-b50c-8d67d58abe22\") " pod="openshift-multus/multus-additional-cni-plugins-nkz4s" Jul 08 01:42:02.425190 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.425150 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7fb8m\" (UniqueName: \"kubernetes.io/projected/dfaa7d20-7f57-4e48-b50c-8d67d58abe22-kube-api-access-7fb8m\") pod \"multus-additional-cni-plugins-nkz4s\" (UID: \"dfaa7d20-7f57-4e48-b50c-8d67d58abe22\") " pod="openshift-multus/multus-additional-cni-plugins-nkz4s" Jul 08 01:42:02.425190 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.425180 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6d567423-f240-4ed8-87ba-743127287631-hosts-file\") pod \"node-resolver-pk46r\" (UID: \"6d567423-f240-4ed8-87ba-743127287631\") " pod="openshift-dns/node-resolver-pk46r" Jul 08 01:42:02.425469 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.425235 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/dfaa7d20-7f57-4e48-b50c-8d67d58abe22-cnibin\") pod \"multus-additional-cni-plugins-nkz4s\" (UID: \"dfaa7d20-7f57-4e48-b50c-8d67d58abe22\") " pod="openshift-multus/multus-additional-cni-plugins-nkz4s" Jul 08 01:42:02.425469 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.425318 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7ww6n\" (UniqueName: \"kubernetes.io/projected/6d567423-f240-4ed8-87ba-743127287631-kube-api-access-7ww6n\") pod \"node-resolver-pk46r\" (UID: \"6d567423-f240-4ed8-87ba-743127287631\") " pod="openshift-dns/node-resolver-pk46r" Jul 08 01:42:02.425469 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.425358 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c391d2cf-3212-40c8-9456-a38c24ba080d-metrics-certs\") pod \"network-metrics-daemon-w4psj\" (UID: \"c391d2cf-3212-40c8-9456-a38c24ba080d\") " pod="openshift-multus/network-metrics-daemon-w4psj" Jul 08 01:42:02.425469 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.425387 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dlpb9\" (UniqueName: \"kubernetes.io/projected/c391d2cf-3212-40c8-9456-a38c24ba080d-kube-api-access-dlpb9\") pod \"network-metrics-daemon-w4psj\" (UID: \"c391d2cf-3212-40c8-9456-a38c24ba080d\") " pod="openshift-multus/network-metrics-daemon-w4psj" Jul 08 01:42:02.425469 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.425415 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/dfaa7d20-7f57-4e48-b50c-8d67d58abe22-cni-binary-copy\") pod \"multus-additional-cni-plugins-nkz4s\" (UID: \"dfaa7d20-7f57-4e48-b50c-8d67d58abe22\") " pod="openshift-multus/multus-additional-cni-plugins-nkz4s" Jul 08 01:42:02.425469 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.425459 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/dfaa7d20-7f57-4e48-b50c-8d67d58abe22-tuning-conf-dir\") pod \"multus-additional-cni-plugins-nkz4s\" (UID: \"dfaa7d20-7f57-4e48-b50c-8d67d58abe22\") " pod="openshift-multus/multus-additional-cni-plugins-nkz4s" Jul 08 01:42:02.425734 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.425489 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/dfaa7d20-7f57-4e48-b50c-8d67d58abe22-os-release\") pod \"multus-additional-cni-plugins-nkz4s\" (UID: \"dfaa7d20-7f57-4e48-b50c-8d67d58abe22\") " pod="openshift-multus/multus-additional-cni-plugins-nkz4s" Jul 08 01:42:02.425734 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.425388 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6d567423-f240-4ed8-87ba-743127287631-hosts-file\") pod \"node-resolver-pk46r\" (UID: \"6d567423-f240-4ed8-87ba-743127287631\") " pod="openshift-dns/node-resolver-pk46r" Jul 08 01:42:02.425734 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.425531 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dfaa7d20-7f57-4e48-b50c-8d67d58abe22-system-cni-dir\") pod \"multus-additional-cni-plugins-nkz4s\" (UID: \"dfaa7d20-7f57-4e48-b50c-8d67d58abe22\") " pod="openshift-multus/multus-additional-cni-plugins-nkz4s" Jul 08 01:42:02.425734 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.425558 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/dfaa7d20-7f57-4e48-b50c-8d67d58abe22-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-nkz4s\" (UID: \"dfaa7d20-7f57-4e48-b50c-8d67d58abe22\") " pod="openshift-multus/multus-additional-cni-plugins-nkz4s" Jul 08 01:42:02.425734 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:42:02.425589 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 01:42:02.425734 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:42:02.425662 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c391d2cf-3212-40c8-9456-a38c24ba080d-metrics-certs podName:c391d2cf-3212-40c8-9456-a38c24ba080d nodeName:}" failed. No retries permitted until 2026-07-08 01:42:02.925639085 +0000 UTC m=+3.122965921 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c391d2cf-3212-40c8-9456-a38c24ba080d-metrics-certs") pod "network-metrics-daemon-w4psj" (UID: "c391d2cf-3212-40c8-9456-a38c24ba080d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 01:42:02.425734 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.425681 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/dfaa7d20-7f57-4e48-b50c-8d67d58abe22-os-release\") pod \"multus-additional-cni-plugins-nkz4s\" (UID: \"dfaa7d20-7f57-4e48-b50c-8d67d58abe22\") " pod="openshift-multus/multus-additional-cni-plugins-nkz4s" Jul 08 01:42:02.426073 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.425591 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/dfaa7d20-7f57-4e48-b50c-8d67d58abe22-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-nkz4s\" (UID: \"dfaa7d20-7f57-4e48-b50c-8d67d58abe22\") " pod="openshift-multus/multus-additional-cni-plugins-nkz4s" Jul 08 01:42:02.426073 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.425975 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6d567423-f240-4ed8-87ba-743127287631-tmp-dir\") pod \"node-resolver-pk46r\" (UID: \"6d567423-f240-4ed8-87ba-743127287631\") " pod="openshift-dns/node-resolver-pk46r" Jul 08 01:42:02.426073 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.426056 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dfaa7d20-7f57-4e48-b50c-8d67d58abe22-system-cni-dir\") pod \"multus-additional-cni-plugins-nkz4s\" (UID: \"dfaa7d20-7f57-4e48-b50c-8d67d58abe22\") " pod="openshift-multus/multus-additional-cni-plugins-nkz4s" Jul 08 01:42:02.426200 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.426112 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/dfaa7d20-7f57-4e48-b50c-8d67d58abe22-tuning-conf-dir\") pod \"multus-additional-cni-plugins-nkz4s\" (UID: \"dfaa7d20-7f57-4e48-b50c-8d67d58abe22\") " pod="openshift-multus/multus-additional-cni-plugins-nkz4s" Jul 08 01:42:02.426245 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.426229 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/dfaa7d20-7f57-4e48-b50c-8d67d58abe22-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-nkz4s\" (UID: \"dfaa7d20-7f57-4e48-b50c-8d67d58abe22\") " pod="openshift-multus/multus-additional-cni-plugins-nkz4s" Jul 08 01:42:02.426312 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.426229 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/dfaa7d20-7f57-4e48-b50c-8d67d58abe22-cni-binary-copy\") pod \"multus-additional-cni-plugins-nkz4s\" (UID: \"dfaa7d20-7f57-4e48-b50c-8d67d58abe22\") " pod="openshift-multus/multus-additional-cni-plugins-nkz4s" Jul 08 01:42:02.426392 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.426373 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6d567423-f240-4ed8-87ba-743127287631-tmp-dir\") pod \"node-resolver-pk46r\" (UID: \"6d567423-f240-4ed8-87ba-743127287631\") " pod="openshift-dns/node-resolver-pk46r" Jul 08 01:42:02.426579 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.426557 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/dfaa7d20-7f57-4e48-b50c-8d67d58abe22-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-nkz4s\" (UID: \"dfaa7d20-7f57-4e48-b50c-8d67d58abe22\") " pod="openshift-multus/multus-additional-cni-plugins-nkz4s" Jul 08 01:42:02.441129 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.441097 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7ww6n\" (UniqueName: \"kubernetes.io/projected/6d567423-f240-4ed8-87ba-743127287631-kube-api-access-7ww6n\") pod \"node-resolver-pk46r\" (UID: \"6d567423-f240-4ed8-87ba-743127287631\") " pod="openshift-dns/node-resolver-pk46r" Jul 08 01:42:02.441305 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.441198 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7fb8m\" (UniqueName: \"kubernetes.io/projected/dfaa7d20-7f57-4e48-b50c-8d67d58abe22-kube-api-access-7fb8m\") pod \"multus-additional-cni-plugins-nkz4s\" (UID: \"dfaa7d20-7f57-4e48-b50c-8d67d58abe22\") " pod="openshift-multus/multus-additional-cni-plugins-nkz4s" Jul 08 01:42:02.441383 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.441358 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dlpb9\" (UniqueName: \"kubernetes.io/projected/c391d2cf-3212-40c8-9456-a38c24ba080d-kube-api-access-dlpb9\") pod \"network-metrics-daemon-w4psj\" (UID: \"c391d2cf-3212-40c8-9456-a38c24ba080d\") " pod="openshift-multus/network-metrics-daemon-w4psj" Jul 08 01:42:02.499315 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.499272 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-dj8dv" Jul 08 01:42:02.510460 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.510427 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-xljcg" Jul 08 01:42:02.523342 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.523310 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-srhs5" Jul 08 01:42:02.529440 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.529417 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j456h" Jul 08 01:42:02.538374 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.538354 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-xvdkf" Jul 08 01:42:02.547377 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.547356 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-hgtm2" Jul 08 01:42:02.556358 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.556329 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-f4vdc" Jul 08 01:42:02.563394 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.563369 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-nkz4s" Jul 08 01:42:02.570275 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.570254 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-pk46r" Jul 08 01:42:02.829423 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.829321 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/87674b91-e601-4694-a3e1-bb0bd80b5c4f-original-pull-secret\") pod \"global-pull-secret-syncer-6hr9n\" (UID: \"87674b91-e601-4694-a3e1-bb0bd80b5c4f\") " pod="kube-system/global-pull-secret-syncer-6hr9n" Jul 08 01:42:02.829593 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:42:02.829516 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 01:42:02.829593 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:42:02.829583 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87674b91-e601-4694-a3e1-bb0bd80b5c4f-original-pull-secret podName:87674b91-e601-4694-a3e1-bb0bd80b5c4f nodeName:}" failed. No retries permitted until 2026-07-08 01:42:03.829564617 +0000 UTC m=+4.026891457 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/87674b91-e601-4694-a3e1-bb0bd80b5c4f-original-pull-secret") pod "global-pull-secret-syncer-6hr9n" (UID: "87674b91-e601-4694-a3e1-bb0bd80b5c4f") : object "kube-system"/"original-pull-secret" not registered Jul 08 01:42:02.930616 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.930575 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c391d2cf-3212-40c8-9456-a38c24ba080d-metrics-certs\") pod \"network-metrics-daemon-w4psj\" (UID: \"c391d2cf-3212-40c8-9456-a38c24ba080d\") " pod="openshift-multus/network-metrics-daemon-w4psj" Jul 08 01:42:02.930824 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:02.930635 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w2lfl\" (UniqueName: \"kubernetes.io/projected/79d3b000-b3ab-40bd-97a1-47536d14a052-kube-api-access-w2lfl\") pod \"network-check-target-dvf9v\" (UID: \"79d3b000-b3ab-40bd-97a1-47536d14a052\") " pod="openshift-network-diagnostics/network-check-target-dvf9v" Jul 08 01:42:02.930896 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:42:02.930859 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 01:42:02.930952 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:42:02.930897 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 01:42:02.930952 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:42:02.930922 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 01:42:02.930952 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:42:02.930936 2563 projected.go:196] Error preparing data for projected volume kube-api-access-w2lfl for pod openshift-network-diagnostics/network-check-target-dvf9v: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 01:42:02.930952 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:42:02.930946 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c391d2cf-3212-40c8-9456-a38c24ba080d-metrics-certs podName:c391d2cf-3212-40c8-9456-a38c24ba080d nodeName:}" failed. No retries permitted until 2026-07-08 01:42:03.930924191 +0000 UTC m=+4.128251039 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c391d2cf-3212-40c8-9456-a38c24ba080d-metrics-certs") pod "network-metrics-daemon-w4psj" (UID: "c391d2cf-3212-40c8-9456-a38c24ba080d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 01:42:02.931201 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:42:02.930989 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/79d3b000-b3ab-40bd-97a1-47536d14a052-kube-api-access-w2lfl podName:79d3b000-b3ab-40bd-97a1-47536d14a052 nodeName:}" failed. No retries permitted until 2026-07-08 01:42:03.930971989 +0000 UTC m=+4.128298829 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-w2lfl" (UniqueName: "kubernetes.io/projected/79d3b000-b3ab-40bd-97a1-47536d14a052-kube-api-access-w2lfl") pod "network-check-target-dvf9v" (UID: "79d3b000-b3ab-40bd-97a1-47536d14a052") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 01:42:03.108718 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:03.108651 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77d11f18_f68a_4d7c_8217_be0a83114e14.slice/crio-1f5f1ac66b66c5bd361d7ef10ebeddf0309eb370a488dc8ad49c5993b080f198 WatchSource:0}: Error finding container 1f5f1ac66b66c5bd361d7ef10ebeddf0309eb370a488dc8ad49c5993b080f198: Status 404 returned error can't find the container with id 1f5f1ac66b66c5bd361d7ef10ebeddf0309eb370a488dc8ad49c5993b080f198 Jul 08 01:42:03.111079 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:03.111047 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e78b9bc_0e4e_4303_822e_7246ecedff2d.slice/crio-ff2452d94c420974c903f0cddcb31371993150cb7c79fb7506de8c729aea1b17 WatchSource:0}: Error finding container ff2452d94c420974c903f0cddcb31371993150cb7c79fb7506de8c729aea1b17: Status 404 returned error can't find the container with id ff2452d94c420974c903f0cddcb31371993150cb7c79fb7506de8c729aea1b17 Jul 08 01:42:03.114536 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:03.114466 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5cb4d2ec_61d0_4b04_a043_39c3d834cf1a.slice/crio-2e3d4814e6733ecd57e473b7f97b8866bdc2075b3ffce611fa6d4b46e42636aa WatchSource:0}: Error finding container 2e3d4814e6733ecd57e473b7f97b8866bdc2075b3ffce611fa6d4b46e42636aa: Status 404 returned error can't find the container with id 2e3d4814e6733ecd57e473b7f97b8866bdc2075b3ffce611fa6d4b46e42636aa Jul 08 01:42:03.115198 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:03.115136 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda94ad3dd_a657_4061_82a9_ab28622ab193.slice/crio-cd3285e24366d62c79d22533a59df4090b12a0aa268a1dc6583544936553ac62 WatchSource:0}: Error finding container cd3285e24366d62c79d22533a59df4090b12a0aa268a1dc6583544936553ac62: Status 404 returned error can't find the container with id cd3285e24366d62c79d22533a59df4090b12a0aa268a1dc6583544936553ac62 Jul 08 01:42:03.138442 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:03.138412 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67d33362_8538_40e2_a54c_9a4ec41504db.slice/crio-006b223159434e4aef0634b8075ec23fdcb67e8eab21ccd456ca2e0763d60ea1 WatchSource:0}: Error finding container 006b223159434e4aef0634b8075ec23fdcb67e8eab21ccd456ca2e0763d60ea1: Status 404 returned error can't find the container with id 006b223159434e4aef0634b8075ec23fdcb67e8eab21ccd456ca2e0763d60ea1 Jul 08 01:42:03.139839 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:03.139783 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9409c6b8_7a8b_4e5d_8b04_18b36e285356.slice/crio-fafbaa1d863219360c21154fb12904dc1a44a62eb15aaa4f30a4d3857c97acc7 WatchSource:0}: Error finding container fafbaa1d863219360c21154fb12904dc1a44a62eb15aaa4f30a4d3857c97acc7: Status 404 returned error can't find the container with id fafbaa1d863219360c21154fb12904dc1a44a62eb15aaa4f30a4d3857c97acc7 Jul 08 01:42:03.141324 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:03.141227 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d567423_f240_4ed8_87ba_743127287631.slice/crio-50a259242f6135ecf910fb63b4f1fe3535b4d70cd373083daa40b657c347676f WatchSource:0}: Error finding container 50a259242f6135ecf910fb63b4f1fe3535b4d70cd373083daa40b657c347676f: Status 404 returned error can't find the container with id 50a259242f6135ecf910fb63b4f1fe3535b4d70cd373083daa40b657c347676f Jul 08 01:42:03.145321 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:03.145292 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfaa7d20_7f57_4e48_b50c_8d67d58abe22.slice/crio-a912cc9b4ef5adf85da4f984a3d1c3713282f4d07978361534485ad4010238fb WatchSource:0}: Error finding container a912cc9b4ef5adf85da4f984a3d1c3713282f4d07978361534485ad4010238fb: Status 404 returned error can't find the container with id a912cc9b4ef5adf85da4f984a3d1c3713282f4d07978361534485ad4010238fb Jul 08 01:42:03.147052 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:03.147030 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb091ceff_3f95_4de4_906b_5a43e8161af3.slice/crio-8329643dd082bc7265780824accb9341a1b6f6232dfac584897b0b244baa848f WatchSource:0}: Error finding container 8329643dd082bc7265780824accb9341a1b6f6232dfac584897b0b244baa848f: Status 404 returned error can't find the container with id 8329643dd082bc7265780824accb9341a1b6f6232dfac584897b0b244baa848f Jul 08 01:42:03.249377 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:03.249344 2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-07 01:37:02 +0000 UTC" deadline="2027-12-07 09:00:29.744725744 +0000 UTC" Jul 08 01:42:03.249377 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:03.249374 2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12415h18m26.495356124s" Jul 08 01:42:03.396803 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:03.396539 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dvf9v" Jul 08 01:42:03.396961 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:42:03.396871 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dvf9v" podUID="79d3b000-b3ab-40bd-97a1-47536d14a052" Jul 08 01:42:03.405546 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:03.405510 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hgtm2" event={"ID":"9409c6b8-7a8b-4e5d-8b04-18b36e285356","Type":"ContainerStarted","Data":"fafbaa1d863219360c21154fb12904dc1a44a62eb15aaa4f30a4d3857c97acc7"} Jul 08 01:42:03.406716 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:03.406690 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-xljcg" event={"ID":"5cb4d2ec-61d0-4b04-a043-39c3d834cf1a","Type":"ContainerStarted","Data":"2e3d4814e6733ecd57e473b7f97b8866bdc2075b3ffce611fa6d4b46e42636aa"} Jul 08 01:42:03.407978 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:03.407955 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j456h" event={"ID":"3e78b9bc-0e4e-4303-822e-7246ecedff2d","Type":"ContainerStarted","Data":"ff2452d94c420974c903f0cddcb31371993150cb7c79fb7506de8c729aea1b17"} Jul 08 01:42:03.409317 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:03.409291 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-f4vdc" event={"ID":"b091ceff-3f95-4de4-906b-5a43e8161af3","Type":"ContainerStarted","Data":"8329643dd082bc7265780824accb9341a1b6f6232dfac584897b0b244baa848f"} Jul 08 01:42:03.410508 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:03.410487 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nkz4s" event={"ID":"dfaa7d20-7f57-4e48-b50c-8d67d58abe22","Type":"ContainerStarted","Data":"a912cc9b4ef5adf85da4f984a3d1c3713282f4d07978361534485ad4010238fb"} Jul 08 01:42:03.411705 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:03.411674 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-xvdkf" event={"ID":"67d33362-8538-40e2-a54c-9a4ec41504db","Type":"ContainerStarted","Data":"006b223159434e4aef0634b8075ec23fdcb67e8eab21ccd456ca2e0763d60ea1"} Jul 08 01:42:03.412976 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:03.412950 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-dj8dv" event={"ID":"a94ad3dd-a657-4061-82a9-ab28622ab193","Type":"ContainerStarted","Data":"cd3285e24366d62c79d22533a59df4090b12a0aa268a1dc6583544936553ac62"} Jul 08 01:42:03.414215 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:03.414189 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-srhs5" event={"ID":"77d11f18-f68a-4d7c-8217-be0a83114e14","Type":"ContainerStarted","Data":"1f5f1ac66b66c5bd361d7ef10ebeddf0309eb370a488dc8ad49c5993b080f198"} Jul 08 01:42:03.416330 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:03.416301 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-233.ec2.internal" event={"ID":"61e1c42ac9a08ecfb3c8cc5e93139196","Type":"ContainerStarted","Data":"67c6aee34a1ad5758a34d340d267f286c187b9a10a2e464236a96abb1bb4285f"} Jul 08 01:42:03.421066 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:03.421038 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-pk46r" event={"ID":"6d567423-f240-4ed8-87ba-743127287631","Type":"ContainerStarted","Data":"50a259242f6135ecf910fb63b4f1fe3535b4d70cd373083daa40b657c347676f"} Jul 08 01:42:03.434683 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:03.434611 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-233.ec2.internal" podStartSLOduration=1.434595269 podStartE2EDuration="1.434595269s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 01:42:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 01:42:03.434403656 +0000 UTC m=+3.631730513" watchObservedRunningTime="2026-07-08 01:42:03.434595269 +0000 UTC m=+3.631922126" Jul 08 01:42:03.837219 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:03.837145 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/87674b91-e601-4694-a3e1-bb0bd80b5c4f-original-pull-secret\") pod \"global-pull-secret-syncer-6hr9n\" (UID: \"87674b91-e601-4694-a3e1-bb0bd80b5c4f\") " pod="kube-system/global-pull-secret-syncer-6hr9n" Jul 08 01:42:03.837472 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:42:03.837434 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 01:42:03.837673 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:42:03.837528 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87674b91-e601-4694-a3e1-bb0bd80b5c4f-original-pull-secret podName:87674b91-e601-4694-a3e1-bb0bd80b5c4f nodeName:}" failed. No retries permitted until 2026-07-08 01:42:05.837507431 +0000 UTC m=+6.034834266 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/87674b91-e601-4694-a3e1-bb0bd80b5c4f-original-pull-secret") pod "global-pull-secret-syncer-6hr9n" (UID: "87674b91-e601-4694-a3e1-bb0bd80b5c4f") : object "kube-system"/"original-pull-secret" not registered Jul 08 01:42:03.938106 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:03.937935 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c391d2cf-3212-40c8-9456-a38c24ba080d-metrics-certs\") pod \"network-metrics-daemon-w4psj\" (UID: \"c391d2cf-3212-40c8-9456-a38c24ba080d\") " pod="openshift-multus/network-metrics-daemon-w4psj" Jul 08 01:42:03.938106 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:03.937992 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w2lfl\" (UniqueName: \"kubernetes.io/projected/79d3b000-b3ab-40bd-97a1-47536d14a052-kube-api-access-w2lfl\") pod \"network-check-target-dvf9v\" (UID: \"79d3b000-b3ab-40bd-97a1-47536d14a052\") " pod="openshift-network-diagnostics/network-check-target-dvf9v" Jul 08 01:42:03.938414 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:42:03.938126 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 01:42:03.938414 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:42:03.938193 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 01:42:03.938414 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:42:03.938208 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c391d2cf-3212-40c8-9456-a38c24ba080d-metrics-certs podName:c391d2cf-3212-40c8-9456-a38c24ba080d nodeName:}" failed. No retries permitted until 2026-07-08 01:42:05.938186742 +0000 UTC m=+6.135513592 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c391d2cf-3212-40c8-9456-a38c24ba080d-metrics-certs") pod "network-metrics-daemon-w4psj" (UID: "c391d2cf-3212-40c8-9456-a38c24ba080d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 01:42:03.938414 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:42:03.938233 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 01:42:03.938414 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:42:03.938250 2563 projected.go:196] Error preparing data for projected volume kube-api-access-w2lfl for pod openshift-network-diagnostics/network-check-target-dvf9v: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 01:42:03.938414 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:42:03.938306 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/79d3b000-b3ab-40bd-97a1-47536d14a052-kube-api-access-w2lfl podName:79d3b000-b3ab-40bd-97a1-47536d14a052 nodeName:}" failed. No retries permitted until 2026-07-08 01:42:05.93828823 +0000 UTC m=+6.135615083 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-w2lfl" (UniqueName: "kubernetes.io/projected/79d3b000-b3ab-40bd-97a1-47536d14a052-kube-api-access-w2lfl") pod "network-check-target-dvf9v" (UID: "79d3b000-b3ab-40bd-97a1-47536d14a052") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 01:42:04.250649 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:04.250540 2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-07 01:37:02 +0000 UTC" deadline="2028-01-13 21:50:52.539379903 +0000 UTC" Jul 08 01:42:04.250649 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:04.250613 2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13316h8m48.28877287s" Jul 08 01:42:04.398630 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:04.398541 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w4psj" Jul 08 01:42:04.398805 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:42:04.398693 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w4psj" podUID="c391d2cf-3212-40c8-9456-a38c24ba080d" Jul 08 01:42:04.399120 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:04.399100 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6hr9n" Jul 08 01:42:04.399312 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:42:04.399202 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6hr9n" podUID="87674b91-e601-4694-a3e1-bb0bd80b5c4f" Jul 08 01:42:04.439186 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:04.439133 2563 generic.go:356] "Generic (PLEG): container finished" podID="d3d20294c54eebf1cdd45bd4f32b1e5e" containerID="4fcaa80d1293a9d5503eb092b497b6a1fcacc0b0380d21f08c7762dc96d0b3f2" exitCode=0 Jul 08 01:42:04.440197 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:04.440167 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-233.ec2.internal" event={"ID":"d3d20294c54eebf1cdd45bd4f32b1e5e","Type":"ContainerDied","Data":"4fcaa80d1293a9d5503eb092b497b6a1fcacc0b0380d21f08c7762dc96d0b3f2"} Jul 08 01:42:05.396604 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:05.396021 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dvf9v" Jul 08 01:42:05.396604 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:42:05.396151 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dvf9v" podUID="79d3b000-b3ab-40bd-97a1-47536d14a052" Jul 08 01:42:05.483536 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:05.482791 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-233.ec2.internal" event={"ID":"d3d20294c54eebf1cdd45bd4f32b1e5e","Type":"ContainerStarted","Data":"3fb74022985a8b7da8f01d714e2d42c64157202aa15ebe16fa59e80d7ed3447b"} Jul 08 01:42:05.855219 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:05.855175 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/87674b91-e601-4694-a3e1-bb0bd80b5c4f-original-pull-secret\") pod \"global-pull-secret-syncer-6hr9n\" (UID: \"87674b91-e601-4694-a3e1-bb0bd80b5c4f\") " pod="kube-system/global-pull-secret-syncer-6hr9n" Jul 08 01:42:05.855441 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:42:05.855417 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 01:42:05.855536 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:42:05.855492 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87674b91-e601-4694-a3e1-bb0bd80b5c4f-original-pull-secret podName:87674b91-e601-4694-a3e1-bb0bd80b5c4f nodeName:}" failed. No retries permitted until 2026-07-08 01:42:09.855472753 +0000 UTC m=+10.052799604 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/87674b91-e601-4694-a3e1-bb0bd80b5c4f-original-pull-secret") pod "global-pull-secret-syncer-6hr9n" (UID: "87674b91-e601-4694-a3e1-bb0bd80b5c4f") : object "kube-system"/"original-pull-secret" not registered Jul 08 01:42:05.956703 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:05.955858 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c391d2cf-3212-40c8-9456-a38c24ba080d-metrics-certs\") pod \"network-metrics-daemon-w4psj\" (UID: \"c391d2cf-3212-40c8-9456-a38c24ba080d\") " pod="openshift-multus/network-metrics-daemon-w4psj" Jul 08 01:42:05.956703 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:05.955912 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w2lfl\" (UniqueName: \"kubernetes.io/projected/79d3b000-b3ab-40bd-97a1-47536d14a052-kube-api-access-w2lfl\") pod \"network-check-target-dvf9v\" (UID: \"79d3b000-b3ab-40bd-97a1-47536d14a052\") " pod="openshift-network-diagnostics/network-check-target-dvf9v" Jul 08 01:42:05.956703 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:42:05.956071 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 01:42:05.956703 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:42:05.956089 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 01:42:05.956703 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:42:05.956103 2563 projected.go:196] Error preparing data for projected volume kube-api-access-w2lfl for pod openshift-network-diagnostics/network-check-target-dvf9v: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 01:42:05.956703 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:42:05.956166 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/79d3b000-b3ab-40bd-97a1-47536d14a052-kube-api-access-w2lfl podName:79d3b000-b3ab-40bd-97a1-47536d14a052 nodeName:}" failed. No retries permitted until 2026-07-08 01:42:09.95614629 +0000 UTC m=+10.153473131 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-w2lfl" (UniqueName: "kubernetes.io/projected/79d3b000-b3ab-40bd-97a1-47536d14a052-kube-api-access-w2lfl") pod "network-check-target-dvf9v" (UID: "79d3b000-b3ab-40bd-97a1-47536d14a052") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 01:42:05.956703 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:42:05.956607 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 01:42:05.956703 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:42:05.956661 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c391d2cf-3212-40c8-9456-a38c24ba080d-metrics-certs podName:c391d2cf-3212-40c8-9456-a38c24ba080d nodeName:}" failed. No retries permitted until 2026-07-08 01:42:09.956643359 +0000 UTC m=+10.153970202 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c391d2cf-3212-40c8-9456-a38c24ba080d-metrics-certs") pod "network-metrics-daemon-w4psj" (UID: "c391d2cf-3212-40c8-9456-a38c24ba080d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 01:42:06.395999 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:06.395961 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6hr9n" Jul 08 01:42:06.396254 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:42:06.396118 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6hr9n" podUID="87674b91-e601-4694-a3e1-bb0bd80b5c4f" Jul 08 01:42:06.396590 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:06.396553 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w4psj" Jul 08 01:42:06.396704 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:42:06.396682 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w4psj" podUID="c391d2cf-3212-40c8-9456-a38c24ba080d" Jul 08 01:42:07.397309 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:07.396740 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dvf9v" Jul 08 01:42:07.397309 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:42:07.396878 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dvf9v" podUID="79d3b000-b3ab-40bd-97a1-47536d14a052" Jul 08 01:42:08.396800 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:08.396763 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6hr9n" Jul 08 01:42:08.397012 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:08.396845 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w4psj" Jul 08 01:42:08.397012 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:42:08.396968 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w4psj" podUID="c391d2cf-3212-40c8-9456-a38c24ba080d" Jul 08 01:42:08.397413 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:42:08.397361 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6hr9n" podUID="87674b91-e601-4694-a3e1-bb0bd80b5c4f" Jul 08 01:42:09.396153 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:09.395892 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dvf9v" Jul 08 01:42:09.396153 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:42:09.396011 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dvf9v" podUID="79d3b000-b3ab-40bd-97a1-47536d14a052" Jul 08 01:42:09.890605 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:09.890558 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/87674b91-e601-4694-a3e1-bb0bd80b5c4f-original-pull-secret\") pod \"global-pull-secret-syncer-6hr9n\" (UID: \"87674b91-e601-4694-a3e1-bb0bd80b5c4f\") " pod="kube-system/global-pull-secret-syncer-6hr9n" Jul 08 01:42:09.891076 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:42:09.890755 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 01:42:09.891076 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:42:09.890817 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87674b91-e601-4694-a3e1-bb0bd80b5c4f-original-pull-secret podName:87674b91-e601-4694-a3e1-bb0bd80b5c4f nodeName:}" failed. No retries permitted until 2026-07-08 01:42:17.89079954 +0000 UTC m=+18.088126376 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/87674b91-e601-4694-a3e1-bb0bd80b5c4f-original-pull-secret") pod "global-pull-secret-syncer-6hr9n" (UID: "87674b91-e601-4694-a3e1-bb0bd80b5c4f") : object "kube-system"/"original-pull-secret" not registered Jul 08 01:42:09.991311 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:09.991264 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c391d2cf-3212-40c8-9456-a38c24ba080d-metrics-certs\") pod \"network-metrics-daemon-w4psj\" (UID: \"c391d2cf-3212-40c8-9456-a38c24ba080d\") " pod="openshift-multus/network-metrics-daemon-w4psj" Jul 08 01:42:09.991494 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:09.991319 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w2lfl\" (UniqueName: \"kubernetes.io/projected/79d3b000-b3ab-40bd-97a1-47536d14a052-kube-api-access-w2lfl\") pod \"network-check-target-dvf9v\" (UID: \"79d3b000-b3ab-40bd-97a1-47536d14a052\") " pod="openshift-network-diagnostics/network-check-target-dvf9v" Jul 08 01:42:09.991494 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:42:09.991438 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 01:42:09.991494 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:42:09.991478 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 01:42:09.991494 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:42:09.991496 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 01:42:09.991686 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:42:09.991510 2563 projected.go:196] Error preparing data for projected volume kube-api-access-w2lfl for pod openshift-network-diagnostics/network-check-target-dvf9v: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 01:42:09.991686 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:42:09.991514 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c391d2cf-3212-40c8-9456-a38c24ba080d-metrics-certs podName:c391d2cf-3212-40c8-9456-a38c24ba080d nodeName:}" failed. No retries permitted until 2026-07-08 01:42:17.991493067 +0000 UTC m=+18.188819914 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c391d2cf-3212-40c8-9456-a38c24ba080d-metrics-certs") pod "network-metrics-daemon-w4psj" (UID: "c391d2cf-3212-40c8-9456-a38c24ba080d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 01:42:09.991686 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:42:09.991557 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/79d3b000-b3ab-40bd-97a1-47536d14a052-kube-api-access-w2lfl podName:79d3b000-b3ab-40bd-97a1-47536d14a052 nodeName:}" failed. No retries permitted until 2026-07-08 01:42:17.991541416 +0000 UTC m=+18.188868262 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-w2lfl" (UniqueName: "kubernetes.io/projected/79d3b000-b3ab-40bd-97a1-47536d14a052-kube-api-access-w2lfl") pod "network-check-target-dvf9v" (UID: "79d3b000-b3ab-40bd-97a1-47536d14a052") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 01:42:10.397298 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:10.396816 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w4psj" Jul 08 01:42:10.397298 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:42:10.396940 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w4psj" podUID="c391d2cf-3212-40c8-9456-a38c24ba080d" Jul 08 01:42:10.397869 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:10.397684 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6hr9n" Jul 08 01:42:10.397869 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:42:10.397799 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6hr9n" podUID="87674b91-e601-4694-a3e1-bb0bd80b5c4f" Jul 08 01:42:11.396724 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:11.396691 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dvf9v" Jul 08 01:42:11.397282 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:42:11.396798 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dvf9v" podUID="79d3b000-b3ab-40bd-97a1-47536d14a052" Jul 08 01:42:12.396771 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:12.396737 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w4psj" Jul 08 01:42:12.397283 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:12.396737 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6hr9n" Jul 08 01:42:12.397283 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:42:12.396892 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w4psj" podUID="c391d2cf-3212-40c8-9456-a38c24ba080d" Jul 08 01:42:12.397283 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:42:12.397036 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6hr9n" podUID="87674b91-e601-4694-a3e1-bb0bd80b5c4f" Jul 08 01:42:13.396312 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:13.396269 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dvf9v" Jul 08 01:42:13.396506 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:42:13.396398 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dvf9v" podUID="79d3b000-b3ab-40bd-97a1-47536d14a052" Jul 08 01:42:14.396470 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:14.396435 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6hr9n" Jul 08 01:42:14.396940 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:14.396453 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w4psj" Jul 08 01:42:14.396940 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:42:14.396574 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6hr9n" podUID="87674b91-e601-4694-a3e1-bb0bd80b5c4f" Jul 08 01:42:14.396940 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:42:14.396712 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w4psj" podUID="c391d2cf-3212-40c8-9456-a38c24ba080d" Jul 08 01:42:15.396718 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:15.396685 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dvf9v" Jul 08 01:42:15.397173 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:42:15.396790 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dvf9v" podUID="79d3b000-b3ab-40bd-97a1-47536d14a052" Jul 08 01:42:16.396462 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:16.396427 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6hr9n" Jul 08 01:42:16.396630 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:42:16.396567 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6hr9n" podUID="87674b91-e601-4694-a3e1-bb0bd80b5c4f" Jul 08 01:42:16.396698 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:16.396623 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w4psj" Jul 08 01:42:16.396771 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:42:16.396749 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w4psj" podUID="c391d2cf-3212-40c8-9456-a38c24ba080d" Jul 08 01:42:17.396268 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:17.396233 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dvf9v" Jul 08 01:42:17.396498 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:42:17.396367 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dvf9v" podUID="79d3b000-b3ab-40bd-97a1-47536d14a052" Jul 08 01:42:17.954825 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:17.954793 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/87674b91-e601-4694-a3e1-bb0bd80b5c4f-original-pull-secret\") pod \"global-pull-secret-syncer-6hr9n\" (UID: \"87674b91-e601-4694-a3e1-bb0bd80b5c4f\") " pod="kube-system/global-pull-secret-syncer-6hr9n" Jul 08 01:42:17.955298 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:42:17.954941 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 01:42:17.955298 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:42:17.954992 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87674b91-e601-4694-a3e1-bb0bd80b5c4f-original-pull-secret podName:87674b91-e601-4694-a3e1-bb0bd80b5c4f nodeName:}" failed. No retries permitted until 2026-07-08 01:42:33.954979082 +0000 UTC m=+34.152305914 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/87674b91-e601-4694-a3e1-bb0bd80b5c4f-original-pull-secret") pod "global-pull-secret-syncer-6hr9n" (UID: "87674b91-e601-4694-a3e1-bb0bd80b5c4f") : object "kube-system"/"original-pull-secret" not registered Jul 08 01:42:18.055598 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:18.055565 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c391d2cf-3212-40c8-9456-a38c24ba080d-metrics-certs\") pod \"network-metrics-daemon-w4psj\" (UID: \"c391d2cf-3212-40c8-9456-a38c24ba080d\") " pod="openshift-multus/network-metrics-daemon-w4psj" Jul 08 01:42:18.055598 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:18.055599 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w2lfl\" (UniqueName: \"kubernetes.io/projected/79d3b000-b3ab-40bd-97a1-47536d14a052-kube-api-access-w2lfl\") pod \"network-check-target-dvf9v\" (UID: \"79d3b000-b3ab-40bd-97a1-47536d14a052\") " pod="openshift-network-diagnostics/network-check-target-dvf9v" Jul 08 01:42:18.055806 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:42:18.055714 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 01:42:18.055806 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:42:18.055771 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 01:42:18.055806 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:42:18.055787 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c391d2cf-3212-40c8-9456-a38c24ba080d-metrics-certs podName:c391d2cf-3212-40c8-9456-a38c24ba080d nodeName:}" failed. No retries permitted until 2026-07-08 01:42:34.055766019 +0000 UTC m=+34.253092862 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c391d2cf-3212-40c8-9456-a38c24ba080d-metrics-certs") pod "network-metrics-daemon-w4psj" (UID: "c391d2cf-3212-40c8-9456-a38c24ba080d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 01:42:18.055806 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:42:18.055790 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 01:42:18.055806 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:42:18.055805 2563 projected.go:196] Error preparing data for projected volume kube-api-access-w2lfl for pod openshift-network-diagnostics/network-check-target-dvf9v: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 01:42:18.055991 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:42:18.055840 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/79d3b000-b3ab-40bd-97a1-47536d14a052-kube-api-access-w2lfl podName:79d3b000-b3ab-40bd-97a1-47536d14a052 nodeName:}" failed. No retries permitted until 2026-07-08 01:42:34.055828704 +0000 UTC m=+34.253155552 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-w2lfl" (UniqueName: "kubernetes.io/projected/79d3b000-b3ab-40bd-97a1-47536d14a052-kube-api-access-w2lfl") pod "network-check-target-dvf9v" (UID: "79d3b000-b3ab-40bd-97a1-47536d14a052") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 01:42:18.396177 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:18.396086 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w4psj" Jul 08 01:42:18.396354 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:18.396085 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6hr9n" Jul 08 01:42:18.396354 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:42:18.396239 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w4psj" podUID="c391d2cf-3212-40c8-9456-a38c24ba080d" Jul 08 01:42:18.396354 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:42:18.396314 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6hr9n" podUID="87674b91-e601-4694-a3e1-bb0bd80b5c4f" Jul 08 01:42:19.396354 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:19.396315 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dvf9v" Jul 08 01:42:19.396753 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:42:19.396448 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dvf9v" podUID="79d3b000-b3ab-40bd-97a1-47536d14a052" Jul 08 01:42:20.397100 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:20.397037 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6hr9n" Jul 08 01:42:20.397561 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:20.397129 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w4psj" Jul 08 01:42:20.397561 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:42:20.397154 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6hr9n" podUID="87674b91-e601-4694-a3e1-bb0bd80b5c4f" Jul 08 01:42:20.397561 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:42:20.397233 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w4psj" podUID="c391d2cf-3212-40c8-9456-a38c24ba080d" Jul 08 01:42:21.396239 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:21.396207 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dvf9v" Jul 08 01:42:21.396419 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:42:21.396330 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dvf9v" podUID="79d3b000-b3ab-40bd-97a1-47536d14a052" Jul 08 01:42:22.395862 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:22.395839 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6hr9n" Jul 08 01:42:22.396276 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:42:22.395966 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6hr9n" podUID="87674b91-e601-4694-a3e1-bb0bd80b5c4f" Jul 08 01:42:22.396276 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:22.396047 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w4psj" Jul 08 01:42:22.396276 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:42:22.396141 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w4psj" podUID="c391d2cf-3212-40c8-9456-a38c24ba080d" Jul 08 01:42:22.541533 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:22.541133 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-xvdkf" event={"ID":"67d33362-8538-40e2-a54c-9a4ec41504db","Type":"ContainerStarted","Data":"8f79a6e9b1ce73654097fbdbe5232bd7dad7355176ffefca7d94cd746ee5deac"} Jul 08 01:42:22.561419 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:22.561368 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-xvdkf" podStartSLOduration=2.331704894 podStartE2EDuration="21.561344902s" totalImagesPullingTime="19.229640008s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 01:42:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 01:42:22.561041567 +0000 UTC m=+22.758368422" watchObservedRunningTime="2026-07-08 01:42:22.561344902 +0000 UTC m=+22.758671758" Jul 08 01:42:22.561788 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:22.561752 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-233.ec2.internal" podStartSLOduration=20.561729178 podStartE2EDuration="20.561729178s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 01:42:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 01:42:05.500161145 +0000 UTC m=+5.697488006" watchObservedRunningTime="2026-07-08 01:42:22.561729178 +0000 UTC m=+22.759056034" Jul 08 01:42:23.396844 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:23.396660 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dvf9v" Jul 08 01:42:23.397429 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:42:23.396923 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dvf9v" podUID="79d3b000-b3ab-40bd-97a1-47536d14a052" Jul 08 01:42:23.544696 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:23.544657 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-pk46r" event={"ID":"6d567423-f240-4ed8-87ba-743127287631","Type":"ContainerStarted","Data":"81e8aeb603fc2930a2218be167aa4ad0d81e6dc608e00b0acb617f4fce910028"} Jul 08 01:42:23.548033 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:23.548004 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hgtm2" event={"ID":"9409c6b8-7a8b-4e5d-8b04-18b36e285356","Type":"ContainerStarted","Data":"87e0b0b9b05797344a452a17db6a5ca2e932666fe1f7997330e3618498dd1805"} Jul 08 01:42:23.548176 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:23.548090 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hgtm2" event={"ID":"9409c6b8-7a8b-4e5d-8b04-18b36e285356","Type":"ContainerStarted","Data":"deb0641d408910cee0c55c4aa4582514e4102202fbf940a9d9cb210f7973c87a"} Jul 08 01:42:23.548176 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:23.548141 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hgtm2" event={"ID":"9409c6b8-7a8b-4e5d-8b04-18b36e285356","Type":"ContainerStarted","Data":"5719c0a4cbbaa58183fced45c8ae1ca67845c0595d1bf12014d02c91aefa3096"} Jul 08 01:42:23.548289 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:23.548186 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hgtm2" event={"ID":"9409c6b8-7a8b-4e5d-8b04-18b36e285356","Type":"ContainerStarted","Data":"f04be12537c377f0a7766b771f8759ea428b803f7216900d0e43146b651e1ff0"} Jul 08 01:42:23.548289 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:23.548244 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hgtm2" event={"ID":"9409c6b8-7a8b-4e5d-8b04-18b36e285356","Type":"ContainerStarted","Data":"19891181d42e36de363c73d8d295d133e0db59a425539d321a82c69d36034cff"} Jul 08 01:42:23.548289 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:23.548273 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hgtm2" event={"ID":"9409c6b8-7a8b-4e5d-8b04-18b36e285356","Type":"ContainerStarted","Data":"9cc61bd561a76018b76eea3d93969c514c28339b7a5e91a8ffc0d181e1ea439a"} Jul 08 01:42:23.549623 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:23.549598 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-xljcg" event={"ID":"5cb4d2ec-61d0-4b04-a043-39c3d834cf1a","Type":"ContainerStarted","Data":"b89a643f463b0424a66e90f7e6952d378158614f4b7da2ba258ef4b6cdef9c1f"} Jul 08 01:42:23.551124 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:23.551098 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j456h" event={"ID":"3e78b9bc-0e4e-4303-822e-7246ecedff2d","Type":"ContainerStarted","Data":"8bfbad287780128841c2ec4b1161f98dc3860446cb62c50e24e5ec2cf9bd14a0"} Jul 08 01:42:23.552646 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:23.552623 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-f4vdc" event={"ID":"b091ceff-3f95-4de4-906b-5a43e8161af3","Type":"ContainerStarted","Data":"dcb4c3d3d13e7512db3366038dc45466cea31e027cad0b714c72572cba4defb8"} Jul 08 01:42:23.555577 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:23.555336 2563 generic.go:356] "Generic (PLEG): container finished" podID="dfaa7d20-7f57-4e48-b50c-8d67d58abe22" containerID="040d76eef7bac06413a869936d9ced1c13f970df562c494bd5dcfacbac06af74" exitCode=0 Jul 08 01:42:23.556420 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:23.556372 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nkz4s" event={"ID":"dfaa7d20-7f57-4e48-b50c-8d67d58abe22","Type":"ContainerDied","Data":"040d76eef7bac06413a869936d9ced1c13f970df562c494bd5dcfacbac06af74"} Jul 08 01:42:23.558724 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:23.558696 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-dj8dv" event={"ID":"a94ad3dd-a657-4061-82a9-ab28622ab193","Type":"ContainerStarted","Data":"6981d07220ea1c2894a39e8a670641c468aae81c2606a72c32bfd06f119c7ad2"} Jul 08 01:42:23.561081 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:23.561046 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-pk46r" podStartSLOduration=3.337616972 podStartE2EDuration="22.561032188s" totalImagesPullingTime="19.223415216s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 01:42:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 01:42:23.560896001 +0000 UTC m=+23.758222904" watchObservedRunningTime="2026-07-08 01:42:23.561032188 +0000 UTC m=+23.758359042" Jul 08 01:42:23.600141 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:23.600088 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-xljcg" podStartSLOduration=3.366480542 podStartE2EDuration="22.600072745s" totalImagesPullingTime="19.233592203s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 01:42:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 01:42:23.599330461 +0000 UTC m=+23.796657314" watchObservedRunningTime="2026-07-08 01:42:23.600072745 +0000 UTC m=+23.797399598" Jul 08 01:42:23.619703 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:23.619652 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-f4vdc" podStartSLOduration=3.348823924 podStartE2EDuration="22.619636946s" totalImagesPullingTime="19.270813022s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 01:42:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 01:42:23.619613474 +0000 UTC m=+23.816940326" watchObservedRunningTime="2026-07-08 01:42:23.619636946 +0000 UTC m=+23.816963800" Jul 08 01:42:24.005952 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:24.005891 2563 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 08 01:42:24.141552 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:24.141517 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-dj8dv" Jul 08 01:42:24.142235 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:24.142187 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-dj8dv" Jul 08 01:42:24.161168 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:24.161116 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-dj8dv" podStartSLOduration=11.971345779 podStartE2EDuration="23.161095893s" totalImagesPullingTime="11.189750114s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 01:42:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 01:42:23.636647463 +0000 UTC m=+23.833974317" watchObservedRunningTime="2026-07-08 01:42:24.161095893 +0000 UTC m=+24.358422749" Jul 08 01:42:24.282637 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:24.282480 2563 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-08T01:42:24.005910398Z","UUID":"9ab1d33b-bfd5-47b0-9d19-def890fba062","Handler":null,"Name":"","Endpoint":""} Jul 08 01:42:24.284082 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:24.284052 2563 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 08 01:42:24.284211 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:24.284094 2563 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 08 01:42:24.396214 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:24.396183 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w4psj" Jul 08 01:42:24.396452 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:24.396178 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6hr9n" Jul 08 01:42:24.396452 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:42:24.396310 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w4psj" podUID="c391d2cf-3212-40c8-9456-a38c24ba080d" Jul 08 01:42:24.396452 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:42:24.396376 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6hr9n" podUID="87674b91-e601-4694-a3e1-bb0bd80b5c4f" Jul 08 01:42:24.563769 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:24.563684 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-srhs5" event={"ID":"77d11f18-f68a-4d7c-8217-be0a83114e14","Type":"ContainerStarted","Data":"262db3fff7e3007397dc50304c84546beed5ed98e49751572e1a161f526faa8d"} Jul 08 01:42:24.566639 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:24.566595 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j456h" event={"ID":"3e78b9bc-0e4e-4303-822e-7246ecedff2d","Type":"ContainerStarted","Data":"8152f5c13b4377ad3ce740d8d1a65e608f410944e3a08634d706994259bed2f8"} Jul 08 01:42:24.581329 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:24.581268 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-srhs5" podStartSLOduration=4.323258162 podStartE2EDuration="23.581245434s" totalImagesPullingTime="19.257987272s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 01:42:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 01:42:24.580934781 +0000 UTC m=+24.778261636" watchObservedRunningTime="2026-07-08 01:42:24.581245434 +0000 UTC m=+24.778572289" Jul 08 01:42:25.396007 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:25.395976 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dvf9v" Jul 08 01:42:25.396166 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:42:25.396092 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dvf9v" podUID="79d3b000-b3ab-40bd-97a1-47536d14a052" Jul 08 01:42:25.571135 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:25.571040 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j456h" event={"ID":"3e78b9bc-0e4e-4303-822e-7246ecedff2d","Type":"ContainerStarted","Data":"944bca88457b556c67c37dafd8ee934ecbbd5e3ced356767dc288bdc3b5228f5"} Jul 08 01:42:25.574082 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:25.574058 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hgtm2" event={"ID":"9409c6b8-7a8b-4e5d-8b04-18b36e285356","Type":"ContainerStarted","Data":"605494c7c0eda8b95c910b10d7598740e95cf4e40712bc9cbbd101a3152e53e2"} Jul 08 01:42:25.574238 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:25.574107 2563 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 08 01:42:26.396387 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:26.396171 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6hr9n" Jul 08 01:42:26.396580 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:26.396258 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w4psj" Jul 08 01:42:26.396580 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:42:26.396464 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6hr9n" podUID="87674b91-e601-4694-a3e1-bb0bd80b5c4f" Jul 08 01:42:26.396678 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:42:26.396575 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w4psj" podUID="c391d2cf-3212-40c8-9456-a38c24ba080d" Jul 08 01:42:27.301393 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:27.301361 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-dj8dv" Jul 08 01:42:27.301948 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:27.301476 2563 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 08 01:42:27.301948 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:27.301938 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-dj8dv" Jul 08 01:42:27.316862 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:27.316817 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j456h" podStartSLOduration=4.727077937 podStartE2EDuration="26.316800261s" totalImagesPullingTime="21.589722324s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 01:42:01 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 01:42:25.590411058 +0000 UTC m=+25.787737909" watchObservedRunningTime="2026-07-08 01:42:27.316800261 +0000 UTC m=+27.514127117" Jul 08 01:42:27.396224 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:27.396182 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dvf9v" Jul 08 01:42:27.396400 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:42:27.396317 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dvf9v" podUID="79d3b000-b3ab-40bd-97a1-47536d14a052" Jul 08 01:42:28.396325 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:28.396289 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6hr9n" Jul 08 01:42:28.396839 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:28.396305 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w4psj" Jul 08 01:42:28.396839 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:42:28.396409 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6hr9n" podUID="87674b91-e601-4694-a3e1-bb0bd80b5c4f" Jul 08 01:42:28.396839 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:42:28.396509 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w4psj" podUID="c391d2cf-3212-40c8-9456-a38c24ba080d" Jul 08 01:42:29.396807 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:29.396570 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dvf9v" Jul 08 01:42:29.397313 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:42:29.396830 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dvf9v" podUID="79d3b000-b3ab-40bd-97a1-47536d14a052" Jul 08 01:42:29.584326 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:29.584286 2563 generic.go:356] "Generic (PLEG): container finished" podID="dfaa7d20-7f57-4e48-b50c-8d67d58abe22" containerID="3de464cbb2e1cd612787c884388dee0808520e304c7f4dd7925b6ee0765029e3" exitCode=0 Jul 08 01:42:29.584498 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:29.584381 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nkz4s" event={"ID":"dfaa7d20-7f57-4e48-b50c-8d67d58abe22","Type":"ContainerDied","Data":"3de464cbb2e1cd612787c884388dee0808520e304c7f4dd7925b6ee0765029e3"} Jul 08 01:42:29.588022 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:29.588000 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hgtm2" event={"ID":"9409c6b8-7a8b-4e5d-8b04-18b36e285356","Type":"ContainerStarted","Data":"ba669a2f2a0bffad146b9ce5cec1fa76bfa8edf1698d1eadbf606fbe90af6e5d"} Jul 08 01:42:29.588273 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:29.588250 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hgtm2" Jul 08 01:42:29.588337 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:29.588305 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hgtm2" Jul 08 01:42:29.603498 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:29.603469 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hgtm2" Jul 08 01:42:29.631860 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:29.631804 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-hgtm2" podStartSLOduration=9.335854605 podStartE2EDuration="28.631787398s" totalImagesPullingTime="19.295932793s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 01:42:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 01:42:29.629781668 +0000 UTC m=+29.827108522" watchObservedRunningTime="2026-07-08 01:42:29.631787398 +0000 UTC m=+29.829114252" Jul 08 01:42:30.399543 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:30.397987 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6hr9n" Jul 08 01:42:30.399543 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:42:30.398141 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6hr9n" podUID="87674b91-e601-4694-a3e1-bb0bd80b5c4f" Jul 08 01:42:30.399543 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:30.398645 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w4psj" Jul 08 01:42:30.399543 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:42:30.398795 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w4psj" podUID="c391d2cf-3212-40c8-9456-a38c24ba080d" Jul 08 01:42:30.590475 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:30.590446 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hgtm2" Jul 08 01:42:30.605944 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:30.605919 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hgtm2" Jul 08 01:42:30.732138 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:30.731558 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-6hr9n"] Jul 08 01:42:30.732138 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:30.731685 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6hr9n" Jul 08 01:42:30.732138 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:42:30.731803 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6hr9n" podUID="87674b91-e601-4694-a3e1-bb0bd80b5c4f" Jul 08 01:42:30.732547 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:30.732513 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-dvf9v"] Jul 08 01:42:30.732661 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:30.732628 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dvf9v" Jul 08 01:42:30.732743 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:42:30.732717 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dvf9v" podUID="79d3b000-b3ab-40bd-97a1-47536d14a052" Jul 08 01:42:30.733175 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:30.733153 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-w4psj"] Jul 08 01:42:30.733297 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:30.733250 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w4psj" Jul 08 01:42:30.733368 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:42:30.733350 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w4psj" podUID="c391d2cf-3212-40c8-9456-a38c24ba080d" Jul 08 01:42:31.594104 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:31.593900 2563 generic.go:356] "Generic (PLEG): container finished" podID="dfaa7d20-7f57-4e48-b50c-8d67d58abe22" containerID="07e6b1999bd15edd5b26476010805c5173d06257463cf19fb3877cf32a6d00cb" exitCode=0 Jul 08 01:42:31.594561 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:31.593979 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nkz4s" event={"ID":"dfaa7d20-7f57-4e48-b50c-8d67d58abe22","Type":"ContainerDied","Data":"07e6b1999bd15edd5b26476010805c5173d06257463cf19fb3877cf32a6d00cb"} Jul 08 01:42:32.396347 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:32.396270 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dvf9v" Jul 08 01:42:32.396347 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:32.396270 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w4psj" Jul 08 01:42:32.399481 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:42:32.396457 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dvf9v" podUID="79d3b000-b3ab-40bd-97a1-47536d14a052" Jul 08 01:42:32.399481 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:42:32.396928 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w4psj" podUID="c391d2cf-3212-40c8-9456-a38c24ba080d" Jul 08 01:42:32.399481 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:32.396990 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6hr9n" Jul 08 01:42:32.399481 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:42:32.397130 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6hr9n" podUID="87674b91-e601-4694-a3e1-bb0bd80b5c4f" Jul 08 01:42:33.600653 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:33.600614 2563 generic.go:356] "Generic (PLEG): container finished" podID="dfaa7d20-7f57-4e48-b50c-8d67d58abe22" containerID="655c7fba1b611258c764eb4c9d36ac9f69e92ea877b3c479bd6299c2c42be9a1" exitCode=0 Jul 08 01:42:33.601332 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:33.600670 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nkz4s" event={"ID":"dfaa7d20-7f57-4e48-b50c-8d67d58abe22","Type":"ContainerDied","Data":"655c7fba1b611258c764eb4c9d36ac9f69e92ea877b3c479bd6299c2c42be9a1"} Jul 08 01:42:33.971555 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:33.971511 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/87674b91-e601-4694-a3e1-bb0bd80b5c4f-original-pull-secret\") pod \"global-pull-secret-syncer-6hr9n\" (UID: \"87674b91-e601-4694-a3e1-bb0bd80b5c4f\") " pod="kube-system/global-pull-secret-syncer-6hr9n" Jul 08 01:42:33.971752 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:42:33.971646 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 01:42:33.971752 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:42:33.971730 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87674b91-e601-4694-a3e1-bb0bd80b5c4f-original-pull-secret podName:87674b91-e601-4694-a3e1-bb0bd80b5c4f nodeName:}" failed. No retries permitted until 2026-07-08 01:43:05.971706903 +0000 UTC m=+66.169033735 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/87674b91-e601-4694-a3e1-bb0bd80b5c4f-original-pull-secret") pod "global-pull-secret-syncer-6hr9n" (UID: "87674b91-e601-4694-a3e1-bb0bd80b5c4f") : object "kube-system"/"original-pull-secret" not registered Jul 08 01:42:34.072059 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:34.072017 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c391d2cf-3212-40c8-9456-a38c24ba080d-metrics-certs\") pod \"network-metrics-daemon-w4psj\" (UID: \"c391d2cf-3212-40c8-9456-a38c24ba080d\") " pod="openshift-multus/network-metrics-daemon-w4psj" Jul 08 01:42:34.072257 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:34.072072 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w2lfl\" (UniqueName: \"kubernetes.io/projected/79d3b000-b3ab-40bd-97a1-47536d14a052-kube-api-access-w2lfl\") pod \"network-check-target-dvf9v\" (UID: \"79d3b000-b3ab-40bd-97a1-47536d14a052\") " pod="openshift-network-diagnostics/network-check-target-dvf9v" Jul 08 01:42:34.072257 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:42:34.072192 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 01:42:34.072257 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:42:34.072240 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 01:42:34.072257 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:42:34.072261 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 01:42:34.072445 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:42:34.072275 2563 projected.go:196] Error preparing data for projected volume kube-api-access-w2lfl for pod openshift-network-diagnostics/network-check-target-dvf9v: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 01:42:34.072445 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:42:34.072301 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c391d2cf-3212-40c8-9456-a38c24ba080d-metrics-certs podName:c391d2cf-3212-40c8-9456-a38c24ba080d nodeName:}" failed. No retries permitted until 2026-07-08 01:43:06.072279734 +0000 UTC m=+66.269606590 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c391d2cf-3212-40c8-9456-a38c24ba080d-metrics-certs") pod "network-metrics-daemon-w4psj" (UID: "c391d2cf-3212-40c8-9456-a38c24ba080d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 01:42:34.072445 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:42:34.072325 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/79d3b000-b3ab-40bd-97a1-47536d14a052-kube-api-access-w2lfl podName:79d3b000-b3ab-40bd-97a1-47536d14a052 nodeName:}" failed. No retries permitted until 2026-07-08 01:43:06.072309247 +0000 UTC m=+66.269636082 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-w2lfl" (UniqueName: "kubernetes.io/projected/79d3b000-b3ab-40bd-97a1-47536d14a052-kube-api-access-w2lfl") pod "network-check-target-dvf9v" (UID: "79d3b000-b3ab-40bd-97a1-47536d14a052") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 01:42:34.396753 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:34.396673 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6hr9n" Jul 08 01:42:34.396918 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:34.396673 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w4psj" Jul 08 01:42:34.396918 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:34.396823 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dvf9v" Jul 08 01:42:34.396918 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:42:34.396796 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6hr9n" podUID="87674b91-e601-4694-a3e1-bb0bd80b5c4f" Jul 08 01:42:34.397053 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:42:34.396927 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w4psj" podUID="c391d2cf-3212-40c8-9456-a38c24ba080d" Jul 08 01:42:34.397053 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:42:34.396991 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dvf9v" podUID="79d3b000-b3ab-40bd-97a1-47536d14a052" Jul 08 01:42:35.223154 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:35.223116 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-233.ec2.internal" event="NodeReady" Jul 08 01:42:35.223755 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:35.223275 2563 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 08 01:42:35.287913 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:35.287883 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-26bmx"] Jul 08 01:42:35.289898 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:35.289882 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-26bmx" Jul 08 01:42:35.293305 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:35.293280 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 08 01:42:35.293416 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:35.293318 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 08 01:42:35.293416 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:35.293388 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-mll5t\"" Jul 08 01:42:35.294821 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:35.294799 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-g2zrw"] Jul 08 01:42:35.296392 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:35.296378 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-g2zrw" Jul 08 01:42:35.298802 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:35.298784 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 08 01:42:35.298898 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:35.298826 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-wf48v\"" Jul 08 01:42:35.298898 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:35.298882 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 08 01:42:35.298985 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:35.298900 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 08 01:42:35.302180 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:35.302160 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-26bmx"] Jul 08 01:42:35.307851 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:35.307832 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-g2zrw"] Jul 08 01:42:35.382252 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:35.382222 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/90eac80c-1b42-4aa3-a3dd-9ea155f26507-config-volume\") pod \"dns-default-26bmx\" (UID: \"90eac80c-1b42-4aa3-a3dd-9ea155f26507\") " pod="openshift-dns/dns-default-26bmx" Jul 08 01:42:35.382252 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:35.382261 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9a9bc2dd-f544-4078-8fef-60c76f403a4e-cert\") pod \"ingress-canary-g2zrw\" (UID: \"9a9bc2dd-f544-4078-8fef-60c76f403a4e\") " pod="openshift-ingress-canary/ingress-canary-g2zrw" Jul 08 01:42:35.382483 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:35.382315 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/90eac80c-1b42-4aa3-a3dd-9ea155f26507-metrics-tls\") pod \"dns-default-26bmx\" (UID: \"90eac80c-1b42-4aa3-a3dd-9ea155f26507\") " pod="openshift-dns/dns-default-26bmx" Jul 08 01:42:35.382483 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:35.382411 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/90eac80c-1b42-4aa3-a3dd-9ea155f26507-tmp-dir\") pod \"dns-default-26bmx\" (UID: \"90eac80c-1b42-4aa3-a3dd-9ea155f26507\") " pod="openshift-dns/dns-default-26bmx" Jul 08 01:42:35.382483 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:35.382450 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qznpx\" (UniqueName: \"kubernetes.io/projected/9a9bc2dd-f544-4078-8fef-60c76f403a4e-kube-api-access-qznpx\") pod \"ingress-canary-g2zrw\" (UID: \"9a9bc2dd-f544-4078-8fef-60c76f403a4e\") " pod="openshift-ingress-canary/ingress-canary-g2zrw" Jul 08 01:42:35.382620 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:35.382488 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jmh9x\" (UniqueName: \"kubernetes.io/projected/90eac80c-1b42-4aa3-a3dd-9ea155f26507-kube-api-access-jmh9x\") pod \"dns-default-26bmx\" (UID: \"90eac80c-1b42-4aa3-a3dd-9ea155f26507\") " pod="openshift-dns/dns-default-26bmx" Jul 08 01:42:35.482844 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:35.482764 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9a9bc2dd-f544-4078-8fef-60c76f403a4e-cert\") pod \"ingress-canary-g2zrw\" (UID: \"9a9bc2dd-f544-4078-8fef-60c76f403a4e\") " pod="openshift-ingress-canary/ingress-canary-g2zrw" Jul 08 01:42:35.482844 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:35.482828 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/90eac80c-1b42-4aa3-a3dd-9ea155f26507-metrics-tls\") pod \"dns-default-26bmx\" (UID: \"90eac80c-1b42-4aa3-a3dd-9ea155f26507\") " pod="openshift-dns/dns-default-26bmx" Jul 08 01:42:35.483059 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:35.482875 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/90eac80c-1b42-4aa3-a3dd-9ea155f26507-tmp-dir\") pod \"dns-default-26bmx\" (UID: \"90eac80c-1b42-4aa3-a3dd-9ea155f26507\") " pod="openshift-dns/dns-default-26bmx" Jul 08 01:42:35.483059 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:35.482896 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qznpx\" (UniqueName: \"kubernetes.io/projected/9a9bc2dd-f544-4078-8fef-60c76f403a4e-kube-api-access-qznpx\") pod \"ingress-canary-g2zrw\" (UID: \"9a9bc2dd-f544-4078-8fef-60c76f403a4e\") " pod="openshift-ingress-canary/ingress-canary-g2zrw" Jul 08 01:42:35.483059 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:35.482918 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jmh9x\" (UniqueName: \"kubernetes.io/projected/90eac80c-1b42-4aa3-a3dd-9ea155f26507-kube-api-access-jmh9x\") pod \"dns-default-26bmx\" (UID: \"90eac80c-1b42-4aa3-a3dd-9ea155f26507\") " pod="openshift-dns/dns-default-26bmx" Jul 08 01:42:35.483059 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:42:35.482945 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 01:42:35.483059 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:42:35.483021 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/90eac80c-1b42-4aa3-a3dd-9ea155f26507-metrics-tls podName:90eac80c-1b42-4aa3-a3dd-9ea155f26507 nodeName:}" failed. No retries permitted until 2026-07-08 01:42:35.982998101 +0000 UTC m=+36.180324937 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/90eac80c-1b42-4aa3-a3dd-9ea155f26507-metrics-tls") pod "dns-default-26bmx" (UID: "90eac80c-1b42-4aa3-a3dd-9ea155f26507") : secret "dns-default-metrics-tls" not found Jul 08 01:42:35.483320 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:35.482950 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/90eac80c-1b42-4aa3-a3dd-9ea155f26507-config-volume\") pod \"dns-default-26bmx\" (UID: \"90eac80c-1b42-4aa3-a3dd-9ea155f26507\") " pod="openshift-dns/dns-default-26bmx" Jul 08 01:42:35.483404 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:35.483341 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/90eac80c-1b42-4aa3-a3dd-9ea155f26507-tmp-dir\") pod \"dns-default-26bmx\" (UID: \"90eac80c-1b42-4aa3-a3dd-9ea155f26507\") " pod="openshift-dns/dns-default-26bmx" Jul 08 01:42:35.483541 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:35.483523 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/90eac80c-1b42-4aa3-a3dd-9ea155f26507-config-volume\") pod \"dns-default-26bmx\" (UID: \"90eac80c-1b42-4aa3-a3dd-9ea155f26507\") " pod="openshift-dns/dns-default-26bmx" Jul 08 01:42:35.487912 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:35.487887 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9a9bc2dd-f544-4078-8fef-60c76f403a4e-cert\") pod \"ingress-canary-g2zrw\" (UID: \"9a9bc2dd-f544-4078-8fef-60c76f403a4e\") " pod="openshift-ingress-canary/ingress-canary-g2zrw" Jul 08 01:42:35.491503 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:35.491460 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qznpx\" (UniqueName: \"kubernetes.io/projected/9a9bc2dd-f544-4078-8fef-60c76f403a4e-kube-api-access-qznpx\") pod \"ingress-canary-g2zrw\" (UID: \"9a9bc2dd-f544-4078-8fef-60c76f403a4e\") " pod="openshift-ingress-canary/ingress-canary-g2zrw" Jul 08 01:42:35.491690 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:35.491633 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jmh9x\" (UniqueName: \"kubernetes.io/projected/90eac80c-1b42-4aa3-a3dd-9ea155f26507-kube-api-access-jmh9x\") pod \"dns-default-26bmx\" (UID: \"90eac80c-1b42-4aa3-a3dd-9ea155f26507\") " pod="openshift-dns/dns-default-26bmx" Jul 08 01:42:35.604812 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:35.604783 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:42:35.610102 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:35.610086 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-g2zrw" Jul 08 01:42:35.693884 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:35.693700 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:42:35.750584 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:35.750483 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-g2zrw"] Jul 08 01:42:35.754089 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:35.754056 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:42:35.754896 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:42:35.754871 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a9bc2dd_f544_4078_8fef_60c76f403a4e.slice/crio-b32d6288dc238f86c455a7db150c72f56a4666cf6a1bf0873da8f3440ba07a8e WatchSource:0}: Error finding container b32d6288dc238f86c455a7db150c72f56a4666cf6a1bf0873da8f3440ba07a8e: Status 404 returned error can't find the container with id b32d6288dc238f86c455a7db150c72f56a4666cf6a1bf0873da8f3440ba07a8e Jul 08 01:42:35.986352 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:35.986314 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/90eac80c-1b42-4aa3-a3dd-9ea155f26507-metrics-tls\") pod \"dns-default-26bmx\" (UID: \"90eac80c-1b42-4aa3-a3dd-9ea155f26507\") " pod="openshift-dns/dns-default-26bmx" Jul 08 01:42:35.986547 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:42:35.986440 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 01:42:35.986635 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:42:35.986549 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/90eac80c-1b42-4aa3-a3dd-9ea155f26507-metrics-tls podName:90eac80c-1b42-4aa3-a3dd-9ea155f26507 nodeName:}" failed. No retries permitted until 2026-07-08 01:42:36.986527234 +0000 UTC m=+37.183854071 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/90eac80c-1b42-4aa3-a3dd-9ea155f26507-metrics-tls") pod "dns-default-26bmx" (UID: "90eac80c-1b42-4aa3-a3dd-9ea155f26507") : secret "dns-default-metrics-tls" not found Jul 08 01:42:36.396336 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:36.396306 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6hr9n" Jul 08 01:42:36.396846 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:36.396310 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w4psj" Jul 08 01:42:36.396846 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:36.396315 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dvf9v" Jul 08 01:42:36.399313 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:36.399296 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 08 01:42:36.399313 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:36.399305 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 08 01:42:36.399484 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:36.399305 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 08 01:42:36.400307 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:36.400290 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-ljqx5\"" Jul 08 01:42:36.400413 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:36.400291 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 08 01:42:36.400413 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:36.400336 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-wrx2c\"" Jul 08 01:42:36.609668 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:36.609627 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-g2zrw" event={"ID":"9a9bc2dd-f544-4078-8fef-60c76f403a4e","Type":"ContainerStarted","Data":"b32d6288dc238f86c455a7db150c72f56a4666cf6a1bf0873da8f3440ba07a8e"} Jul 08 01:42:36.993469 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:36.993431 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/90eac80c-1b42-4aa3-a3dd-9ea155f26507-metrics-tls\") pod \"dns-default-26bmx\" (UID: \"90eac80c-1b42-4aa3-a3dd-9ea155f26507\") " pod="openshift-dns/dns-default-26bmx" Jul 08 01:42:36.993628 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:42:36.993587 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 01:42:36.993705 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:42:36.993657 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/90eac80c-1b42-4aa3-a3dd-9ea155f26507-metrics-tls podName:90eac80c-1b42-4aa3-a3dd-9ea155f26507 nodeName:}" failed. No retries permitted until 2026-07-08 01:42:38.993636887 +0000 UTC m=+39.190963720 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/90eac80c-1b42-4aa3-a3dd-9ea155f26507-metrics-tls") pod "dns-default-26bmx" (UID: "90eac80c-1b42-4aa3-a3dd-9ea155f26507") : secret "dns-default-metrics-tls" not found Jul 08 01:42:39.010828 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:39.010786 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/90eac80c-1b42-4aa3-a3dd-9ea155f26507-metrics-tls\") pod \"dns-default-26bmx\" (UID: \"90eac80c-1b42-4aa3-a3dd-9ea155f26507\") " pod="openshift-dns/dns-default-26bmx" Jul 08 01:42:39.011322 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:42:39.011003 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 01:42:39.011322 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:42:39.011089 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/90eac80c-1b42-4aa3-a3dd-9ea155f26507-metrics-tls podName:90eac80c-1b42-4aa3-a3dd-9ea155f26507 nodeName:}" failed. No retries permitted until 2026-07-08 01:42:43.011067135 +0000 UTC m=+43.208393987 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/90eac80c-1b42-4aa3-a3dd-9ea155f26507-metrics-tls") pod "dns-default-26bmx" (UID: "90eac80c-1b42-4aa3-a3dd-9ea155f26507") : secret "dns-default-metrics-tls" not found Jul 08 01:42:39.240526 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:39.240494 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:42:39.342800 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:39.342700 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:42:39.610964 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:39.610945 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:42:39.622481 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:39.622450 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nkz4s" event={"ID":"dfaa7d20-7f57-4e48-b50c-8d67d58abe22","Type":"ContainerStarted","Data":"710272a3d13c5a147b62f56b24d52d409632337a1f278aaf1b78c18ebb87905c"} Jul 08 01:42:39.819293 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:39.819250 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:42:39.874119 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:39.874033 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:42:40.626535 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:40.626459 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-g2zrw" event={"ID":"9a9bc2dd-f544-4078-8fef-60c76f403a4e","Type":"ContainerStarted","Data":"cc9bfd4115efa0212769807e39d3e7f5df853ee03857ab0c625362db63de41c0"} Jul 08 01:42:40.629109 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:40.629081 2563 generic.go:356] "Generic (PLEG): container finished" podID="dfaa7d20-7f57-4e48-b50c-8d67d58abe22" containerID="710272a3d13c5a147b62f56b24d52d409632337a1f278aaf1b78c18ebb87905c" exitCode=0 Jul 08 01:42:40.629217 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:40.629126 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nkz4s" event={"ID":"dfaa7d20-7f57-4e48-b50c-8d67d58abe22","Type":"ContainerDied","Data":"710272a3d13c5a147b62f56b24d52d409632337a1f278aaf1b78c18ebb87905c"} Jul 08 01:42:40.653176 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:40.652975 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-g2zrw" podStartSLOduration=1.920390474 podStartE2EDuration="5.652959699s" totalImagesPullingTime="3.732569225s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 01:42:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 01:42:40.641861814 +0000 UTC m=+40.839188677" watchObservedRunningTime="2026-07-08 01:42:40.652959699 +0000 UTC m=+40.850286569" Jul 08 01:42:41.634236 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:41.634183 2563 generic.go:356] "Generic (PLEG): container finished" podID="dfaa7d20-7f57-4e48-b50c-8d67d58abe22" containerID="5f14b437624b43fe4ec5eb27d1f5eed21da623784cddee442fbbd77cb950179a" exitCode=0 Jul 08 01:42:41.634236 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:41.634226 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nkz4s" event={"ID":"dfaa7d20-7f57-4e48-b50c-8d67d58abe22","Type":"ContainerDied","Data":"5f14b437624b43fe4ec5eb27d1f5eed21da623784cddee442fbbd77cb950179a"} Jul 08 01:42:42.301942 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:42.301911 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:42:42.358627 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:42.358584 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:42:42.639458 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:42.639373 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nkz4s" event={"ID":"dfaa7d20-7f57-4e48-b50c-8d67d58abe22","Type":"ContainerStarted","Data":"1e80986adbaa21960b0f89cd32042292df6e20d903a397ddd590e13bc201795a"} Jul 08 01:42:42.666380 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:42.666331 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-nkz4s" podStartSLOduration=8.97457354 podStartE2EDuration="41.666314643s" totalImagesPullingTime="32.691741103s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 01:42:01 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 01:42:42.664539576 +0000 UTC m=+42.861866435" watchObservedRunningTime="2026-07-08 01:42:42.666314643 +0000 UTC m=+42.863641496" Jul 08 01:42:42.786820 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:42.786793 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:42:42.838660 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:42.838622 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:42:43.037888 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:43.037856 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/90eac80c-1b42-4aa3-a3dd-9ea155f26507-metrics-tls\") pod \"dns-default-26bmx\" (UID: \"90eac80c-1b42-4aa3-a3dd-9ea155f26507\") " pod="openshift-dns/dns-default-26bmx" Jul 08 01:42:43.038053 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:42:43.037973 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 01:42:43.038053 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:42:43.038024 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/90eac80c-1b42-4aa3-a3dd-9ea155f26507-metrics-tls podName:90eac80c-1b42-4aa3-a3dd-9ea155f26507 nodeName:}" failed. No retries permitted until 2026-07-08 01:42:51.038011995 +0000 UTC m=+51.235338827 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/90eac80c-1b42-4aa3-a3dd-9ea155f26507-metrics-tls") pod "dns-default-26bmx" (UID: "90eac80c-1b42-4aa3-a3dd-9ea155f26507") : secret "dns-default-metrics-tls" not found Jul 08 01:42:43.280819 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:43.280786 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:42:43.338574 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:43.338492 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:42:43.654815 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:43.654740 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:42:43.756862 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:43.756826 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:42:51.093886 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:51.093842 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/90eac80c-1b42-4aa3-a3dd-9ea155f26507-metrics-tls\") pod \"dns-default-26bmx\" (UID: \"90eac80c-1b42-4aa3-a3dd-9ea155f26507\") " pod="openshift-dns/dns-default-26bmx" Jul 08 01:42:51.094364 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:42:51.093999 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 01:42:51.094364 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:42:51.094065 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/90eac80c-1b42-4aa3-a3dd-9ea155f26507-metrics-tls podName:90eac80c-1b42-4aa3-a3dd-9ea155f26507 nodeName:}" failed. No retries permitted until 2026-07-08 01:43:07.094050069 +0000 UTC m=+67.291376901 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/90eac80c-1b42-4aa3-a3dd-9ea155f26507-metrics-tls") pod "dns-default-26bmx" (UID: "90eac80c-1b42-4aa3-a3dd-9ea155f26507") : secret "dns-default-metrics-tls" not found Jul 08 01:42:59.763394 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:59.763361 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:42:59.816252 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:42:59.816215 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:43:02.278840 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:02.278803 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:43:02.339188 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:02.339153 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:43:02.606640 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:02.606559 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hgtm2" Jul 08 01:43:02.753846 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:02.753806 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:43:02.816707 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:02.816674 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:43:05.454313 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:05.454280 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-fnz7w"] Jul 08 01:43:05.456679 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:05.456662 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-fnz7w" Jul 08 01:43:05.460525 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:05.460505 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 08 01:43:05.462266 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:05.462245 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 08 01:43:05.463307 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:05.463284 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-2zk7n"] Jul 08 01:43:05.465109 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:05.465091 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-2zk7n" Jul 08 01:43:05.466177 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:05.466161 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-94tvw\"" Jul 08 01:43:05.467464 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:05.467449 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 08 01:43:05.467537 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:05.467483 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 08 01:43:05.467728 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:05.467715 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 08 01:43:05.468558 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:05.468545 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 08 01:43:05.470542 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:05.470527 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-lzwph\"" Jul 08 01:43:05.472805 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:05.472784 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-fnz7w"] Jul 08 01:43:05.478855 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:05.478836 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 08 01:43:05.486629 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:05.486602 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f6640b83-15b8-45d6-93cd-83809ee952e1-tmp\") pod \"insights-operator-5c847dcfc4-2zk7n\" (UID: \"f6640b83-15b8-45d6-93cd-83809ee952e1\") " pod="openshift-insights/insights-operator-5c847dcfc4-2zk7n" Jul 08 01:43:05.486734 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:05.486639 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f6640b83-15b8-45d6-93cd-83809ee952e1-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-2zk7n\" (UID: \"f6640b83-15b8-45d6-93cd-83809ee952e1\") " pod="openshift-insights/insights-operator-5c847dcfc4-2zk7n" Jul 08 01:43:05.486734 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:05.486656 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f6640b83-15b8-45d6-93cd-83809ee952e1-serving-cert\") pod \"insights-operator-5c847dcfc4-2zk7n\" (UID: \"f6640b83-15b8-45d6-93cd-83809ee952e1\") " pod="openshift-insights/insights-operator-5c847dcfc4-2zk7n" Jul 08 01:43:05.486734 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:05.486689 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7fc4abce-ffae-4252-a2d6-358ff46351a5-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-fnz7w\" (UID: \"7fc4abce-ffae-4252-a2d6-358ff46351a5\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-fnz7w" Jul 08 01:43:05.486858 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:05.486747 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f6640b83-15b8-45d6-93cd-83809ee952e1-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-2zk7n\" (UID: \"f6640b83-15b8-45d6-93cd-83809ee952e1\") " pod="openshift-insights/insights-operator-5c847dcfc4-2zk7n" Jul 08 01:43:05.486858 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:05.486763 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wtjgq\" (UniqueName: \"kubernetes.io/projected/f6640b83-15b8-45d6-93cd-83809ee952e1-kube-api-access-wtjgq\") pod \"insights-operator-5c847dcfc4-2zk7n\" (UID: \"f6640b83-15b8-45d6-93cd-83809ee952e1\") " pod="openshift-insights/insights-operator-5c847dcfc4-2zk7n" Jul 08 01:43:05.486858 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:05.486786 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/f6640b83-15b8-45d6-93cd-83809ee952e1-snapshots\") pod \"insights-operator-5c847dcfc4-2zk7n\" (UID: \"f6640b83-15b8-45d6-93cd-83809ee952e1\") " pod="openshift-insights/insights-operator-5c847dcfc4-2zk7n" Jul 08 01:43:05.486858 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:05.486811 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/7fc4abce-ffae-4252-a2d6-358ff46351a5-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-fnz7w\" (UID: \"7fc4abce-ffae-4252-a2d6-358ff46351a5\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-fnz7w" Jul 08 01:43:05.495343 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:05.495313 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-2zk7n"] Jul 08 01:43:05.554811 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:05.554777 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-znsjt"] Jul 08 01:43:05.558019 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:05.558000 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-znsjt" Jul 08 01:43:05.560692 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:05.560671 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 08 01:43:05.560692 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:05.560686 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 08 01:43:05.560873 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:05.560704 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-wjqkm\"" Jul 08 01:43:05.560917 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:05.560905 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 08 01:43:05.561015 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:05.560997 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 08 01:43:05.568766 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:05.568743 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-znsjt"] Jul 08 01:43:05.587063 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:05.587033 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/f6640b83-15b8-45d6-93cd-83809ee952e1-snapshots\") pod \"insights-operator-5c847dcfc4-2zk7n\" (UID: \"f6640b83-15b8-45d6-93cd-83809ee952e1\") " pod="openshift-insights/insights-operator-5c847dcfc4-2zk7n" Jul 08 01:43:05.587242 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:05.587077 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/7fc4abce-ffae-4252-a2d6-358ff46351a5-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-fnz7w\" (UID: \"7fc4abce-ffae-4252-a2d6-358ff46351a5\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-fnz7w" Jul 08 01:43:05.587242 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:05.587126 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f6640b83-15b8-45d6-93cd-83809ee952e1-tmp\") pod \"insights-operator-5c847dcfc4-2zk7n\" (UID: \"f6640b83-15b8-45d6-93cd-83809ee952e1\") " pod="openshift-insights/insights-operator-5c847dcfc4-2zk7n" Jul 08 01:43:05.587242 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:05.587147 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f6640b83-15b8-45d6-93cd-83809ee952e1-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-2zk7n\" (UID: \"f6640b83-15b8-45d6-93cd-83809ee952e1\") " pod="openshift-insights/insights-operator-5c847dcfc4-2zk7n" Jul 08 01:43:05.587242 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:05.587170 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f6640b83-15b8-45d6-93cd-83809ee952e1-serving-cert\") pod \"insights-operator-5c847dcfc4-2zk7n\" (UID: \"f6640b83-15b8-45d6-93cd-83809ee952e1\") " pod="openshift-insights/insights-operator-5c847dcfc4-2zk7n" Jul 08 01:43:05.587242 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:05.587223 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ba7355ad-22c6-4a3e-ab65-5f13466b4dfb-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-znsjt\" (UID: \"ba7355ad-22c6-4a3e-ab65-5f13466b4dfb\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-znsjt" Jul 08 01:43:05.587492 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:05.587248 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f7hkf\" (UniqueName: \"kubernetes.io/projected/ba7355ad-22c6-4a3e-ab65-5f13466b4dfb-kube-api-access-f7hkf\") pod \"service-ca-operator-5d46d9ffd4-znsjt\" (UID: \"ba7355ad-22c6-4a3e-ab65-5f13466b4dfb\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-znsjt" Jul 08 01:43:05.587492 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:05.587287 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7fc4abce-ffae-4252-a2d6-358ff46351a5-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-fnz7w\" (UID: \"7fc4abce-ffae-4252-a2d6-358ff46351a5\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-fnz7w" Jul 08 01:43:05.587492 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:05.587399 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ba7355ad-22c6-4a3e-ab65-5f13466b4dfb-config\") pod \"service-ca-operator-5d46d9ffd4-znsjt\" (UID: \"ba7355ad-22c6-4a3e-ab65-5f13466b4dfb\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-znsjt" Jul 08 01:43:05.587492 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:43:05.587445 2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 08 01:43:05.587492 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:05.587439 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f6640b83-15b8-45d6-93cd-83809ee952e1-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-2zk7n\" (UID: \"f6640b83-15b8-45d6-93cd-83809ee952e1\") " pod="openshift-insights/insights-operator-5c847dcfc4-2zk7n" Jul 08 01:43:05.587492 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:05.587488 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wtjgq\" (UniqueName: \"kubernetes.io/projected/f6640b83-15b8-45d6-93cd-83809ee952e1-kube-api-access-wtjgq\") pod \"insights-operator-5c847dcfc4-2zk7n\" (UID: \"f6640b83-15b8-45d6-93cd-83809ee952e1\") " pod="openshift-insights/insights-operator-5c847dcfc4-2zk7n" Jul 08 01:43:05.587900 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:43:05.587523 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7fc4abce-ffae-4252-a2d6-358ff46351a5-networking-console-plugin-cert podName:7fc4abce-ffae-4252-a2d6-358ff46351a5 nodeName:}" failed. No retries permitted until 2026-07-08 01:43:06.087500531 +0000 UTC m=+66.284827369 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/7fc4abce-ffae-4252-a2d6-358ff46351a5-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-fnz7w" (UID: "7fc4abce-ffae-4252-a2d6-358ff46351a5") : secret "networking-console-plugin-cert" not found Jul 08 01:43:05.587900 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:05.587684 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f6640b83-15b8-45d6-93cd-83809ee952e1-tmp\") pod \"insights-operator-5c847dcfc4-2zk7n\" (UID: \"f6640b83-15b8-45d6-93cd-83809ee952e1\") " pod="openshift-insights/insights-operator-5c847dcfc4-2zk7n" Jul 08 01:43:05.587900 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:05.587765 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/f6640b83-15b8-45d6-93cd-83809ee952e1-snapshots\") pod \"insights-operator-5c847dcfc4-2zk7n\" (UID: \"f6640b83-15b8-45d6-93cd-83809ee952e1\") " pod="openshift-insights/insights-operator-5c847dcfc4-2zk7n" Jul 08 01:43:05.587900 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:05.587847 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/7fc4abce-ffae-4252-a2d6-358ff46351a5-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-fnz7w\" (UID: \"7fc4abce-ffae-4252-a2d6-358ff46351a5\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-fnz7w" Jul 08 01:43:05.588057 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:05.588038 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f6640b83-15b8-45d6-93cd-83809ee952e1-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-2zk7n\" (UID: \"f6640b83-15b8-45d6-93cd-83809ee952e1\") " pod="openshift-insights/insights-operator-5c847dcfc4-2zk7n" Jul 08 01:43:05.588177 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:05.588161 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f6640b83-15b8-45d6-93cd-83809ee952e1-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-2zk7n\" (UID: \"f6640b83-15b8-45d6-93cd-83809ee952e1\") " pod="openshift-insights/insights-operator-5c847dcfc4-2zk7n" Jul 08 01:43:05.590857 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:05.590837 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f6640b83-15b8-45d6-93cd-83809ee952e1-serving-cert\") pod \"insights-operator-5c847dcfc4-2zk7n\" (UID: \"f6640b83-15b8-45d6-93cd-83809ee952e1\") " pod="openshift-insights/insights-operator-5c847dcfc4-2zk7n" Jul 08 01:43:05.603493 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:05.603466 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wtjgq\" (UniqueName: \"kubernetes.io/projected/f6640b83-15b8-45d6-93cd-83809ee952e1-kube-api-access-wtjgq\") pod \"insights-operator-5c847dcfc4-2zk7n\" (UID: \"f6640b83-15b8-45d6-93cd-83809ee952e1\") " pod="openshift-insights/insights-operator-5c847dcfc4-2zk7n" Jul 08 01:43:05.687581 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:05.687542 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-c4cbb95d4-fv9kj"] Jul 08 01:43:05.688656 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:05.688626 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ba7355ad-22c6-4a3e-ab65-5f13466b4dfb-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-znsjt\" (UID: \"ba7355ad-22c6-4a3e-ab65-5f13466b4dfb\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-znsjt" Jul 08 01:43:05.688793 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:05.688660 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f7hkf\" (UniqueName: \"kubernetes.io/projected/ba7355ad-22c6-4a3e-ab65-5f13466b4dfb-kube-api-access-f7hkf\") pod \"service-ca-operator-5d46d9ffd4-znsjt\" (UID: \"ba7355ad-22c6-4a3e-ab65-5f13466b4dfb\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-znsjt" Jul 08 01:43:05.688793 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:05.688732 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ba7355ad-22c6-4a3e-ab65-5f13466b4dfb-config\") pod \"service-ca-operator-5d46d9ffd4-znsjt\" (UID: \"ba7355ad-22c6-4a3e-ab65-5f13466b4dfb\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-znsjt" Jul 08 01:43:05.689489 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:05.689464 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ba7355ad-22c6-4a3e-ab65-5f13466b4dfb-config\") pod \"service-ca-operator-5d46d9ffd4-znsjt\" (UID: \"ba7355ad-22c6-4a3e-ab65-5f13466b4dfb\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-znsjt" Jul 08 01:43:05.690250 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:05.690237 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-c4cbb95d4-fv9kj" Jul 08 01:43:05.691315 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:05.691292 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ba7355ad-22c6-4a3e-ab65-5f13466b4dfb-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-znsjt\" (UID: \"ba7355ad-22c6-4a3e-ab65-5f13466b4dfb\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-znsjt" Jul 08 01:43:05.696566 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:05.696545 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 08 01:43:05.701464 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:05.701448 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 08 01:43:05.704754 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:05.704716 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f7hkf\" (UniqueName: \"kubernetes.io/projected/ba7355ad-22c6-4a3e-ab65-5f13466b4dfb-kube-api-access-f7hkf\") pod \"service-ca-operator-5d46d9ffd4-znsjt\" (UID: \"ba7355ad-22c6-4a3e-ab65-5f13466b4dfb\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-znsjt" Jul 08 01:43:05.714702 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:05.714674 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 08 01:43:05.714828 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:05.714744 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-ccvds\"" Jul 08 01:43:05.715210 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:05.715174 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 08 01:43:05.715857 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:05.715837 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-c4cbb95d4-fv9kj"] Jul 08 01:43:05.742187 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:05.742157 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:43:05.773897 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:05.773865 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-2zk7n" Jul 08 01:43:05.789122 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:05.789094 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fce3b999-191d-4c34-a4d9-00bcb819c462-trusted-ca\") pod \"image-registry-c4cbb95d4-fv9kj\" (UID: \"fce3b999-191d-4c34-a4d9-00bcb819c462\") " pod="openshift-image-registry/image-registry-c4cbb95d4-fv9kj" Jul 08 01:43:05.789262 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:05.789133 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5ntr6\" (UniqueName: \"kubernetes.io/projected/fce3b999-191d-4c34-a4d9-00bcb819c462-kube-api-access-5ntr6\") pod \"image-registry-c4cbb95d4-fv9kj\" (UID: \"fce3b999-191d-4c34-a4d9-00bcb819c462\") " pod="openshift-image-registry/image-registry-c4cbb95d4-fv9kj" Jul 08 01:43:05.789262 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:05.789159 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fce3b999-191d-4c34-a4d9-00bcb819c462-bound-sa-token\") pod \"image-registry-c4cbb95d4-fv9kj\" (UID: \"fce3b999-191d-4c34-a4d9-00bcb819c462\") " pod="openshift-image-registry/image-registry-c4cbb95d4-fv9kj" Jul 08 01:43:05.789262 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:05.789239 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fce3b999-191d-4c34-a4d9-00bcb819c462-ca-trust-extracted\") pod \"image-registry-c4cbb95d4-fv9kj\" (UID: \"fce3b999-191d-4c34-a4d9-00bcb819c462\") " pod="openshift-image-registry/image-registry-c4cbb95d4-fv9kj" Jul 08 01:43:05.789388 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:05.789293 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fce3b999-191d-4c34-a4d9-00bcb819c462-registry-certificates\") pod \"image-registry-c4cbb95d4-fv9kj\" (UID: \"fce3b999-191d-4c34-a4d9-00bcb819c462\") " pod="openshift-image-registry/image-registry-c4cbb95d4-fv9kj" Jul 08 01:43:05.789388 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:05.789320 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fce3b999-191d-4c34-a4d9-00bcb819c462-image-registry-private-configuration\") pod \"image-registry-c4cbb95d4-fv9kj\" (UID: \"fce3b999-191d-4c34-a4d9-00bcb819c462\") " pod="openshift-image-registry/image-registry-c4cbb95d4-fv9kj" Jul 08 01:43:05.789388 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:05.789337 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fce3b999-191d-4c34-a4d9-00bcb819c462-installation-pull-secrets\") pod \"image-registry-c4cbb95d4-fv9kj\" (UID: \"fce3b999-191d-4c34-a4d9-00bcb819c462\") " pod="openshift-image-registry/image-registry-c4cbb95d4-fv9kj" Jul 08 01:43:05.789388 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:05.789372 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fce3b999-191d-4c34-a4d9-00bcb819c462-registry-tls\") pod \"image-registry-c4cbb95d4-fv9kj\" (UID: \"fce3b999-191d-4c34-a4d9-00bcb819c462\") " pod="openshift-image-registry/image-registry-c4cbb95d4-fv9kj" Jul 08 01:43:05.831082 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:05.831046 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:43:05.866793 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:05.866759 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-znsjt" Jul 08 01:43:05.890228 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:05.890183 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fce3b999-191d-4c34-a4d9-00bcb819c462-trusted-ca\") pod \"image-registry-c4cbb95d4-fv9kj\" (UID: \"fce3b999-191d-4c34-a4d9-00bcb819c462\") " pod="openshift-image-registry/image-registry-c4cbb95d4-fv9kj" Jul 08 01:43:05.890396 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:05.890246 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5ntr6\" (UniqueName: \"kubernetes.io/projected/fce3b999-191d-4c34-a4d9-00bcb819c462-kube-api-access-5ntr6\") pod \"image-registry-c4cbb95d4-fv9kj\" (UID: \"fce3b999-191d-4c34-a4d9-00bcb819c462\") " pod="openshift-image-registry/image-registry-c4cbb95d4-fv9kj" Jul 08 01:43:05.890396 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:05.890273 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fce3b999-191d-4c34-a4d9-00bcb819c462-bound-sa-token\") pod \"image-registry-c4cbb95d4-fv9kj\" (UID: \"fce3b999-191d-4c34-a4d9-00bcb819c462\") " pod="openshift-image-registry/image-registry-c4cbb95d4-fv9kj" Jul 08 01:43:05.890396 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:05.890312 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fce3b999-191d-4c34-a4d9-00bcb819c462-ca-trust-extracted\") pod \"image-registry-c4cbb95d4-fv9kj\" (UID: \"fce3b999-191d-4c34-a4d9-00bcb819c462\") " pod="openshift-image-registry/image-registry-c4cbb95d4-fv9kj" Jul 08 01:43:05.890396 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:05.890373 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fce3b999-191d-4c34-a4d9-00bcb819c462-registry-certificates\") pod \"image-registry-c4cbb95d4-fv9kj\" (UID: \"fce3b999-191d-4c34-a4d9-00bcb819c462\") " pod="openshift-image-registry/image-registry-c4cbb95d4-fv9kj" Jul 08 01:43:05.890591 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:05.890405 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fce3b999-191d-4c34-a4d9-00bcb819c462-image-registry-private-configuration\") pod \"image-registry-c4cbb95d4-fv9kj\" (UID: \"fce3b999-191d-4c34-a4d9-00bcb819c462\") " pod="openshift-image-registry/image-registry-c4cbb95d4-fv9kj" Jul 08 01:43:05.890591 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:05.890428 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fce3b999-191d-4c34-a4d9-00bcb819c462-installation-pull-secrets\") pod \"image-registry-c4cbb95d4-fv9kj\" (UID: \"fce3b999-191d-4c34-a4d9-00bcb819c462\") " pod="openshift-image-registry/image-registry-c4cbb95d4-fv9kj" Jul 08 01:43:05.890707 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:05.890643 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fce3b999-191d-4c34-a4d9-00bcb819c462-registry-tls\") pod \"image-registry-c4cbb95d4-fv9kj\" (UID: \"fce3b999-191d-4c34-a4d9-00bcb819c462\") " pod="openshift-image-registry/image-registry-c4cbb95d4-fv9kj" Jul 08 01:43:05.890771 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:43:05.890754 2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 08 01:43:05.890825 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:43:05.890772 2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-c4cbb95d4-fv9kj: secret "image-registry-tls" not found Jul 08 01:43:05.890825 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:05.890807 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fce3b999-191d-4c34-a4d9-00bcb819c462-ca-trust-extracted\") pod \"image-registry-c4cbb95d4-fv9kj\" (UID: \"fce3b999-191d-4c34-a4d9-00bcb819c462\") " pod="openshift-image-registry/image-registry-c4cbb95d4-fv9kj" Jul 08 01:43:05.890901 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:43:05.890832 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fce3b999-191d-4c34-a4d9-00bcb819c462-registry-tls podName:fce3b999-191d-4c34-a4d9-00bcb819c462 nodeName:}" failed. No retries permitted until 2026-07-08 01:43:06.3908139 +0000 UTC m=+66.588140737 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fce3b999-191d-4c34-a4d9-00bcb819c462-registry-tls") pod "image-registry-c4cbb95d4-fv9kj" (UID: "fce3b999-191d-4c34-a4d9-00bcb819c462") : secret "image-registry-tls" not found Jul 08 01:43:05.891006 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:05.890978 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fce3b999-191d-4c34-a4d9-00bcb819c462-registry-certificates\") pod \"image-registry-c4cbb95d4-fv9kj\" (UID: \"fce3b999-191d-4c34-a4d9-00bcb819c462\") " pod="openshift-image-registry/image-registry-c4cbb95d4-fv9kj" Jul 08 01:43:05.891284 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:05.891261 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fce3b999-191d-4c34-a4d9-00bcb819c462-trusted-ca\") pod \"image-registry-c4cbb95d4-fv9kj\" (UID: \"fce3b999-191d-4c34-a4d9-00bcb819c462\") " pod="openshift-image-registry/image-registry-c4cbb95d4-fv9kj" Jul 08 01:43:05.892841 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:05.892819 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fce3b999-191d-4c34-a4d9-00bcb819c462-installation-pull-secrets\") pod \"image-registry-c4cbb95d4-fv9kj\" (UID: \"fce3b999-191d-4c34-a4d9-00bcb819c462\") " pod="openshift-image-registry/image-registry-c4cbb95d4-fv9kj" Jul 08 01:43:05.892991 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:05.892976 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fce3b999-191d-4c34-a4d9-00bcb819c462-image-registry-private-configuration\") pod \"image-registry-c4cbb95d4-fv9kj\" (UID: \"fce3b999-191d-4c34-a4d9-00bcb819c462\") " pod="openshift-image-registry/image-registry-c4cbb95d4-fv9kj" Jul 08 01:43:05.897268 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:05.897245 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-2zk7n"] Jul 08 01:43:05.899905 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:43:05.899848 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6640b83_15b8_45d6_93cd_83809ee952e1.slice/crio-e2284f5eb558b3636c0fefab53ac54f4b671ab42f8dca3721b8942bc4fab287f WatchSource:0}: Error finding container e2284f5eb558b3636c0fefab53ac54f4b671ab42f8dca3721b8942bc4fab287f: Status 404 returned error can't find the container with id e2284f5eb558b3636c0fefab53ac54f4b671ab42f8dca3721b8942bc4fab287f Jul 08 01:43:05.900079 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:05.900062 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5ntr6\" (UniqueName: \"kubernetes.io/projected/fce3b999-191d-4c34-a4d9-00bcb819c462-kube-api-access-5ntr6\") pod \"image-registry-c4cbb95d4-fv9kj\" (UID: \"fce3b999-191d-4c34-a4d9-00bcb819c462\") " pod="openshift-image-registry/image-registry-c4cbb95d4-fv9kj" Jul 08 01:43:05.903843 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:05.903823 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fce3b999-191d-4c34-a4d9-00bcb819c462-bound-sa-token\") pod \"image-registry-c4cbb95d4-fv9kj\" (UID: \"fce3b999-191d-4c34-a4d9-00bcb819c462\") " pod="openshift-image-registry/image-registry-c4cbb95d4-fv9kj" Jul 08 01:43:05.991603 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:05.991455 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/87674b91-e601-4694-a3e1-bb0bd80b5c4f-original-pull-secret\") pod \"global-pull-secret-syncer-6hr9n\" (UID: \"87674b91-e601-4694-a3e1-bb0bd80b5c4f\") " pod="kube-system/global-pull-secret-syncer-6hr9n" Jul 08 01:43:05.991603 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:05.991587 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-znsjt"] Jul 08 01:43:05.993907 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:05.993884 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 08 01:43:05.995381 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:43:05.995359 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba7355ad_22c6_4a3e_ab65_5f13466b4dfb.slice/crio-17fca29ca8143ecfed021b8a86e0053c4ef15e317919c30fdb1dd780402fbe50 WatchSource:0}: Error finding container 17fca29ca8143ecfed021b8a86e0053c4ef15e317919c30fdb1dd780402fbe50: Status 404 returned error can't find the container with id 17fca29ca8143ecfed021b8a86e0053c4ef15e317919c30fdb1dd780402fbe50 Jul 08 01:43:06.003705 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:06.003685 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/87674b91-e601-4694-a3e1-bb0bd80b5c4f-original-pull-secret\") pod \"global-pull-secret-syncer-6hr9n\" (UID: \"87674b91-e601-4694-a3e1-bb0bd80b5c4f\") " pod="kube-system/global-pull-secret-syncer-6hr9n" Jul 08 01:43:06.092132 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:06.092097 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7fc4abce-ffae-4252-a2d6-358ff46351a5-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-fnz7w\" (UID: \"7fc4abce-ffae-4252-a2d6-358ff46351a5\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-fnz7w" Jul 08 01:43:06.092132 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:06.092135 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c391d2cf-3212-40c8-9456-a38c24ba080d-metrics-certs\") pod \"network-metrics-daemon-w4psj\" (UID: \"c391d2cf-3212-40c8-9456-a38c24ba080d\") " pod="openshift-multus/network-metrics-daemon-w4psj" Jul 08 01:43:06.092368 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:06.092161 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w2lfl\" (UniqueName: \"kubernetes.io/projected/79d3b000-b3ab-40bd-97a1-47536d14a052-kube-api-access-w2lfl\") pod \"network-check-target-dvf9v\" (UID: \"79d3b000-b3ab-40bd-97a1-47536d14a052\") " pod="openshift-network-diagnostics/network-check-target-dvf9v" Jul 08 01:43:06.092368 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:43:06.092305 2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 08 01:43:06.092445 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:43:06.092377 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7fc4abce-ffae-4252-a2d6-358ff46351a5-networking-console-plugin-cert podName:7fc4abce-ffae-4252-a2d6-358ff46351a5 nodeName:}" failed. No retries permitted until 2026-07-08 01:43:07.092363221 +0000 UTC m=+67.289690057 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/7fc4abce-ffae-4252-a2d6-358ff46351a5-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-fnz7w" (UID: "7fc4abce-ffae-4252-a2d6-358ff46351a5") : secret "networking-console-plugin-cert" not found Jul 08 01:43:06.095005 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:06.094990 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 08 01:43:06.095072 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:06.094990 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 08 01:43:06.103294 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:43:06.103268 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 08 01:43:06.103353 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:43:06.103341 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c391d2cf-3212-40c8-9456-a38c24ba080d-metrics-certs podName:c391d2cf-3212-40c8-9456-a38c24ba080d nodeName:}" failed. No retries permitted until 2026-07-08 01:44:10.10331972 +0000 UTC m=+130.300646552 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c391d2cf-3212-40c8-9456-a38c24ba080d-metrics-certs") pod "network-metrics-daemon-w4psj" (UID: "c391d2cf-3212-40c8-9456-a38c24ba080d") : secret "metrics-daemon-secret" not found Jul 08 01:43:06.105380 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:06.105365 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 08 01:43:06.109354 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:06.109336 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6hr9n" Jul 08 01:43:06.116500 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:06.116480 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w2lfl\" (UniqueName: \"kubernetes.io/projected/79d3b000-b3ab-40bd-97a1-47536d14a052-kube-api-access-w2lfl\") pod \"network-check-target-dvf9v\" (UID: \"79d3b000-b3ab-40bd-97a1-47536d14a052\") " pod="openshift-network-diagnostics/network-check-target-dvf9v" Jul 08 01:43:06.124091 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:06.124065 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-ljqx5\"" Jul 08 01:43:06.132596 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:06.132566 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dvf9v" Jul 08 01:43:06.236950 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:06.236910 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-6hr9n"] Jul 08 01:43:06.240677 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:43:06.240650 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87674b91_e601_4694_a3e1_bb0bd80b5c4f.slice/crio-4a15a261acb088dd4ec85d06198a024c10142fa0b7592aa9874f1a8b0cf7f177 WatchSource:0}: Error finding container 4a15a261acb088dd4ec85d06198a024c10142fa0b7592aa9874f1a8b0cf7f177: Status 404 returned error can't find the container with id 4a15a261acb088dd4ec85d06198a024c10142fa0b7592aa9874f1a8b0cf7f177 Jul 08 01:43:06.274962 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:06.274933 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-dvf9v"] Jul 08 01:43:06.279508 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:43:06.279481 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79d3b000_b3ab_40bd_97a1_47536d14a052.slice/crio-c46f81033d76c2dab670e6db59da028edaf41fc651720ee73a173901bef1e8ce WatchSource:0}: Error finding container c46f81033d76c2dab670e6db59da028edaf41fc651720ee73a173901bef1e8ce: Status 404 returned error can't find the container with id c46f81033d76c2dab670e6db59da028edaf41fc651720ee73a173901bef1e8ce Jul 08 01:43:06.398146 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:06.398108 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fce3b999-191d-4c34-a4d9-00bcb819c462-registry-tls\") pod \"image-registry-c4cbb95d4-fv9kj\" (UID: \"fce3b999-191d-4c34-a4d9-00bcb819c462\") " pod="openshift-image-registry/image-registry-c4cbb95d4-fv9kj" Jul 08 01:43:06.398343 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:43:06.398258 2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 08 01:43:06.398343 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:43:06.398272 2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-c4cbb95d4-fv9kj: secret "image-registry-tls" not found Jul 08 01:43:06.398343 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:43:06.398329 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fce3b999-191d-4c34-a4d9-00bcb819c462-registry-tls podName:fce3b999-191d-4c34-a4d9-00bcb819c462 nodeName:}" failed. No retries permitted until 2026-07-08 01:43:07.398314741 +0000 UTC m=+67.595641573 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fce3b999-191d-4c34-a4d9-00bcb819c462-registry-tls") pod "image-registry-c4cbb95d4-fv9kj" (UID: "fce3b999-191d-4c34-a4d9-00bcb819c462") : secret "image-registry-tls" not found Jul 08 01:43:06.695725 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:06.695636 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-znsjt" event={"ID":"ba7355ad-22c6-4a3e-ab65-5f13466b4dfb","Type":"ContainerStarted","Data":"17fca29ca8143ecfed021b8a86e0053c4ef15e317919c30fdb1dd780402fbe50"} Jul 08 01:43:06.699072 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:06.699037 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-2zk7n" event={"ID":"f6640b83-15b8-45d6-93cd-83809ee952e1","Type":"ContainerStarted","Data":"e2284f5eb558b3636c0fefab53ac54f4b671ab42f8dca3721b8942bc4fab287f"} Jul 08 01:43:06.700579 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:06.700547 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-6hr9n" event={"ID":"87674b91-e601-4694-a3e1-bb0bd80b5c4f","Type":"ContainerStarted","Data":"4a15a261acb088dd4ec85d06198a024c10142fa0b7592aa9874f1a8b0cf7f177"} Jul 08 01:43:06.702387 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:06.702363 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-dvf9v" event={"ID":"79d3b000-b3ab-40bd-97a1-47536d14a052","Type":"ContainerStarted","Data":"c46f81033d76c2dab670e6db59da028edaf41fc651720ee73a173901bef1e8ce"} Jul 08 01:43:07.103214 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:07.102863 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7fc4abce-ffae-4252-a2d6-358ff46351a5-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-fnz7w\" (UID: \"7fc4abce-ffae-4252-a2d6-358ff46351a5\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-fnz7w" Jul 08 01:43:07.103214 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:07.102938 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/90eac80c-1b42-4aa3-a3dd-9ea155f26507-metrics-tls\") pod \"dns-default-26bmx\" (UID: \"90eac80c-1b42-4aa3-a3dd-9ea155f26507\") " pod="openshift-dns/dns-default-26bmx" Jul 08 01:43:07.103214 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:43:07.103101 2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 08 01:43:07.103668 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:43:07.103538 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7fc4abce-ffae-4252-a2d6-358ff46351a5-networking-console-plugin-cert podName:7fc4abce-ffae-4252-a2d6-358ff46351a5 nodeName:}" failed. No retries permitted until 2026-07-08 01:43:09.103513143 +0000 UTC m=+69.300839994 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/7fc4abce-ffae-4252-a2d6-358ff46351a5-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-fnz7w" (UID: "7fc4abce-ffae-4252-a2d6-358ff46351a5") : secret "networking-console-plugin-cert" not found Jul 08 01:43:07.103668 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:43:07.103570 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 01:43:07.103668 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:43:07.103611 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/90eac80c-1b42-4aa3-a3dd-9ea155f26507-metrics-tls podName:90eac80c-1b42-4aa3-a3dd-9ea155f26507 nodeName:}" failed. No retries permitted until 2026-07-08 01:43:39.103599925 +0000 UTC m=+99.300926771 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/90eac80c-1b42-4aa3-a3dd-9ea155f26507-metrics-tls") pod "dns-default-26bmx" (UID: "90eac80c-1b42-4aa3-a3dd-9ea155f26507") : secret "dns-default-metrics-tls" not found Jul 08 01:43:07.343298 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:07.343218 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:43:07.405579 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:07.405496 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fce3b999-191d-4c34-a4d9-00bcb819c462-registry-tls\") pod \"image-registry-c4cbb95d4-fv9kj\" (UID: \"fce3b999-191d-4c34-a4d9-00bcb819c462\") " pod="openshift-image-registry/image-registry-c4cbb95d4-fv9kj" Jul 08 01:43:07.405729 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:43:07.405695 2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 08 01:43:07.405729 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:43:07.405713 2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-c4cbb95d4-fv9kj: secret "image-registry-tls" not found Jul 08 01:43:07.405832 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:43:07.405772 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fce3b999-191d-4c34-a4d9-00bcb819c462-registry-tls podName:fce3b999-191d-4c34-a4d9-00bcb819c462 nodeName:}" failed. No retries permitted until 2026-07-08 01:43:09.40575514 +0000 UTC m=+69.603081985 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fce3b999-191d-4c34-a4d9-00bcb819c462-registry-tls") pod "image-registry-c4cbb95d4-fv9kj" (UID: "fce3b999-191d-4c34-a4d9-00bcb819c462") : secret "image-registry-tls" not found Jul 08 01:43:07.406451 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:07.406422 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:43:09.120493 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:09.120456 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7fc4abce-ffae-4252-a2d6-358ff46351a5-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-fnz7w\" (UID: \"7fc4abce-ffae-4252-a2d6-358ff46351a5\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-fnz7w" Jul 08 01:43:09.120960 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:43:09.120603 2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 08 01:43:09.120960 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:43:09.120673 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7fc4abce-ffae-4252-a2d6-358ff46351a5-networking-console-plugin-cert podName:7fc4abce-ffae-4252-a2d6-358ff46351a5 nodeName:}" failed. No retries permitted until 2026-07-08 01:43:13.120657574 +0000 UTC m=+73.317984405 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/7fc4abce-ffae-4252-a2d6-358ff46351a5-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-fnz7w" (UID: "7fc4abce-ffae-4252-a2d6-358ff46351a5") : secret "networking-console-plugin-cert" not found Jul 08 01:43:09.423552 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:09.423514 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fce3b999-191d-4c34-a4d9-00bcb819c462-registry-tls\") pod \"image-registry-c4cbb95d4-fv9kj\" (UID: \"fce3b999-191d-4c34-a4d9-00bcb819c462\") " pod="openshift-image-registry/image-registry-c4cbb95d4-fv9kj" Jul 08 01:43:09.423710 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:43:09.423693 2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 08 01:43:09.423757 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:43:09.423715 2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-c4cbb95d4-fv9kj: secret "image-registry-tls" not found Jul 08 01:43:09.423791 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:43:09.423771 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fce3b999-191d-4c34-a4d9-00bcb819c462-registry-tls podName:fce3b999-191d-4c34-a4d9-00bcb819c462 nodeName:}" failed. No retries permitted until 2026-07-08 01:43:13.423755766 +0000 UTC m=+73.621082599 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fce3b999-191d-4c34-a4d9-00bcb819c462-registry-tls") pod "image-registry-c4cbb95d4-fv9kj" (UID: "fce3b999-191d-4c34-a4d9-00bcb819c462") : secret "image-registry-tls" not found Jul 08 01:43:10.235586 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:10.235551 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:43:10.258208 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:10.258160 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-jzzpg"] Jul 08 01:43:10.260712 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:10.260691 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-jzzpg" Jul 08 01:43:10.263984 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:10.263958 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-dkpxl\"" Jul 08 01:43:10.264102 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:10.264002 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 08 01:43:10.264214 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:10.264176 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 08 01:43:10.274969 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:10.274942 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-jzzpg"] Jul 08 01:43:10.330339 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:10.330292 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gvh9k\" (UniqueName: \"kubernetes.io/projected/cdf8cdb7-12da-46c7-a1ad-f082952fe0ca-kube-api-access-gvh9k\") pod \"migrator-d57d58cc9-jzzpg\" (UID: \"cdf8cdb7-12da-46c7-a1ad-f082952fe0ca\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-jzzpg" Jul 08 01:43:10.330619 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:10.330599 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:43:10.399216 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:10.399170 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:43:10.430812 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:10.430772 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gvh9k\" (UniqueName: \"kubernetes.io/projected/cdf8cdb7-12da-46c7-a1ad-f082952fe0ca-kube-api-access-gvh9k\") pod \"migrator-d57d58cc9-jzzpg\" (UID: \"cdf8cdb7-12da-46c7-a1ad-f082952fe0ca\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-jzzpg" Jul 08 01:43:10.440097 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:10.440063 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gvh9k\" (UniqueName: \"kubernetes.io/projected/cdf8cdb7-12da-46c7-a1ad-f082952fe0ca-kube-api-access-gvh9k\") pod \"migrator-d57d58cc9-jzzpg\" (UID: \"cdf8cdb7-12da-46c7-a1ad-f082952fe0ca\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-jzzpg" Jul 08 01:43:10.572527 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:10.572437 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-jzzpg" Jul 08 01:43:11.312624 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:11.312482 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-jzzpg"] Jul 08 01:43:11.317661 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:43:11.317587 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcdf8cdb7_12da_46c7_a1ad_f082952fe0ca.slice/crio-ea11db239fca4b40c5a68756a2c712213626077738d4ce362096d18428f3b376 WatchSource:0}: Error finding container ea11db239fca4b40c5a68756a2c712213626077738d4ce362096d18428f3b376: Status 404 returned error can't find the container with id ea11db239fca4b40c5a68756a2c712213626077738d4ce362096d18428f3b376 Jul 08 01:43:11.721220 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:11.720948 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-znsjt" event={"ID":"ba7355ad-22c6-4a3e-ab65-5f13466b4dfb","Type":"ContainerStarted","Data":"edacba5da9018164a93d750823248b61035184426a2648d9c213b12293210b8a"} Jul 08 01:43:11.723073 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:11.723046 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-2zk7n" event={"ID":"f6640b83-15b8-45d6-93cd-83809ee952e1","Type":"ContainerStarted","Data":"655bdb2fffc619a6511fcfd0ca08216b05c535f62e473dbab0b835be29517c33"} Jul 08 01:43:11.725301 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:11.725275 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-6hr9n" event={"ID":"87674b91-e601-4694-a3e1-bb0bd80b5c4f","Type":"ContainerStarted","Data":"2d495e5ae7bf332e652b684bee6a14f621c5d7069edb0d25583eabc543079d5b"} Jul 08 01:43:11.727998 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:11.727975 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-dvf9v" event={"ID":"79d3b000-b3ab-40bd-97a1-47536d14a052","Type":"ContainerStarted","Data":"35d4e4a96f751f69e6dfe1c9ee6c5211ac0d3295b9b53e2b97b988d4615e1ce3"} Jul 08 01:43:11.728122 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:11.728079 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-dvf9v" Jul 08 01:43:11.729332 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:11.729312 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-jzzpg" event={"ID":"cdf8cdb7-12da-46c7-a1ad-f082952fe0ca","Type":"ContainerStarted","Data":"ea11db239fca4b40c5a68756a2c712213626077738d4ce362096d18428f3b376"} Jul 08 01:43:11.741089 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:11.741031 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-znsjt" podStartSLOduration=1.570912267 podStartE2EDuration="6.741009435s" totalImagesPullingTime="5.170097168s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 01:43:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 01:43:11.739804868 +0000 UTC m=+71.937131724" watchObservedRunningTime="2026-07-08 01:43:11.741009435 +0000 UTC m=+71.938336290" Jul 08 01:43:11.757605 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:11.756700 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-dvf9v" podStartSLOduration=65.848948868 podStartE2EDuration="1m10.756679795s" totalImagesPullingTime="4.907730927s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 01:42:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 01:43:11.755610406 +0000 UTC m=+71.952937261" watchObservedRunningTime="2026-07-08 01:43:11.756679795 +0000 UTC m=+71.954006650" Jul 08 01:43:11.773329 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:11.773272 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5c847dcfc4-2zk7n" podStartSLOduration=1.51185283 podStartE2EDuration="6.773250182s" totalImagesPullingTime="5.261397352s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 01:43:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 01:43:11.772958993 +0000 UTC m=+71.970285850" watchObservedRunningTime="2026-07-08 01:43:11.773250182 +0000 UTC m=+71.970577040" Jul 08 01:43:11.788412 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:11.788275 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-6hr9n" podStartSLOduration=65.822589097 podStartE2EDuration="1m10.788259874s" totalImagesPullingTime="4.965670777s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 01:42:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 01:43:11.787873053 +0000 UTC m=+71.985199909" watchObservedRunningTime="2026-07-08 01:43:11.788259874 +0000 UTC m=+71.985586722" Jul 08 01:43:12.643818 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:12.643739 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:43:12.713303 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:12.713271 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:43:12.735177 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:12.735098 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-jzzpg" event={"ID":"cdf8cdb7-12da-46c7-a1ad-f082952fe0ca","Type":"ContainerStarted","Data":"0f35e5e8f5a08595bd8e6a1547efdd446577c32e9f895111148977b7003b9399"} Jul 08 01:43:12.735177 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:12.735162 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-jzzpg" event={"ID":"cdf8cdb7-12da-46c7-a1ad-f082952fe0ca","Type":"ContainerStarted","Data":"9bdbef83fff69e396ad6f862a61209a54748f098b186ba05fac9c13fee89078a"} Jul 08 01:43:12.757208 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:12.757138 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-jzzpg" podStartSLOduration=1.811043131 podStartE2EDuration="2.757123652s" totalImagesPullingTime="946.080521ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 01:43:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 01:43:12.75636793 +0000 UTC m=+72.953694785" watchObservedRunningTime="2026-07-08 01:43:12.757123652 +0000 UTC m=+72.954450524" Jul 08 01:43:12.842214 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:12.842169 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:43:12.940309 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:12.940262 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:43:12.958625 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:12.958560 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-v5xxc"] Jul 08 01:43:12.979436 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:12.979411 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-v5xxc"] Jul 08 01:43:12.979580 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:12.979532 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-v5xxc" Jul 08 01:43:12.982349 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:12.982319 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-67hz8\"" Jul 08 01:43:12.982349 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:12.982319 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 08 01:43:12.982550 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:12.982324 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 08 01:43:13.020436 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:13.020403 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:43:13.051709 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:13.051674 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nft2q\" (UniqueName: \"kubernetes.io/projected/fb8a1eb9-e14f-47c1-af1f-7015b945c379-kube-api-access-nft2q\") pod \"insights-runtime-extractor-v5xxc\" (UID: \"fb8a1eb9-e14f-47c1-af1f-7015b945c379\") " pod="openshift-insights/insights-runtime-extractor-v5xxc" Jul 08 01:43:13.051892 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:13.051727 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/fb8a1eb9-e14f-47c1-af1f-7015b945c379-data-volume\") pod \"insights-runtime-extractor-v5xxc\" (UID: \"fb8a1eb9-e14f-47c1-af1f-7015b945c379\") " pod="openshift-insights/insights-runtime-extractor-v5xxc" Jul 08 01:43:13.051892 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:13.051834 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fb8a1eb9-e14f-47c1-af1f-7015b945c379-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-v5xxc\" (UID: \"fb8a1eb9-e14f-47c1-af1f-7015b945c379\") " pod="openshift-insights/insights-runtime-extractor-v5xxc" Jul 08 01:43:13.051978 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:13.051891 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fb8a1eb9-e14f-47c1-af1f-7015b945c379-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-v5xxc\" (UID: \"fb8a1eb9-e14f-47c1-af1f-7015b945c379\") " pod="openshift-insights/insights-runtime-extractor-v5xxc" Jul 08 01:43:13.051978 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:13.051955 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/fb8a1eb9-e14f-47c1-af1f-7015b945c379-crio-socket\") pod \"insights-runtime-extractor-v5xxc\" (UID: \"fb8a1eb9-e14f-47c1-af1f-7015b945c379\") " pod="openshift-insights/insights-runtime-extractor-v5xxc" Jul 08 01:43:13.152300 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:13.152267 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fb8a1eb9-e14f-47c1-af1f-7015b945c379-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-v5xxc\" (UID: \"fb8a1eb9-e14f-47c1-af1f-7015b945c379\") " pod="openshift-insights/insights-runtime-extractor-v5xxc" Jul 08 01:43:13.152454 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:13.152318 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fb8a1eb9-e14f-47c1-af1f-7015b945c379-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-v5xxc\" (UID: \"fb8a1eb9-e14f-47c1-af1f-7015b945c379\") " pod="openshift-insights/insights-runtime-extractor-v5xxc" Jul 08 01:43:13.152454 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:13.152392 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/fb8a1eb9-e14f-47c1-af1f-7015b945c379-crio-socket\") pod \"insights-runtime-extractor-v5xxc\" (UID: \"fb8a1eb9-e14f-47c1-af1f-7015b945c379\") " pod="openshift-insights/insights-runtime-extractor-v5xxc" Jul 08 01:43:13.152454 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:13.152426 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nft2q\" (UniqueName: \"kubernetes.io/projected/fb8a1eb9-e14f-47c1-af1f-7015b945c379-kube-api-access-nft2q\") pod \"insights-runtime-extractor-v5xxc\" (UID: \"fb8a1eb9-e14f-47c1-af1f-7015b945c379\") " pod="openshift-insights/insights-runtime-extractor-v5xxc" Jul 08 01:43:13.152454 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:43:13.152432 2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 08 01:43:13.152616 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:43:13.152473 2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 08 01:43:13.152616 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:13.152482 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7fc4abce-ffae-4252-a2d6-358ff46351a5-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-fnz7w\" (UID: \"7fc4abce-ffae-4252-a2d6-358ff46351a5\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-fnz7w" Jul 08 01:43:13.152616 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:43:13.152497 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb8a1eb9-e14f-47c1-af1f-7015b945c379-insights-runtime-extractor-tls podName:fb8a1eb9-e14f-47c1-af1f-7015b945c379 nodeName:}" failed. No retries permitted until 2026-07-08 01:43:13.652476628 +0000 UTC m=+73.849803477 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fb8a1eb9-e14f-47c1-af1f-7015b945c379-insights-runtime-extractor-tls") pod "insights-runtime-extractor-v5xxc" (UID: "fb8a1eb9-e14f-47c1-af1f-7015b945c379") : secret "insights-runtime-extractor-tls" not found Jul 08 01:43:13.152817 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:43:13.152534 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fb8a1eb9-e14f-47c1-af1f-7015b945c379-kube-rbac-proxy-cm podName:fb8a1eb9-e14f-47c1-af1f-7015b945c379 nodeName:}" failed. No retries permitted until 2026-07-08 01:43:13.652518055 +0000 UTC m=+73.849844913 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/fb8a1eb9-e14f-47c1-af1f-7015b945c379-kube-rbac-proxy-cm") pod "insights-runtime-extractor-v5xxc" (UID: "fb8a1eb9-e14f-47c1-af1f-7015b945c379") : configmap "kube-rbac-proxy" not found Jul 08 01:43:13.152903 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:13.152885 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/fb8a1eb9-e14f-47c1-af1f-7015b945c379-data-volume\") pod \"insights-runtime-extractor-v5xxc\" (UID: \"fb8a1eb9-e14f-47c1-af1f-7015b945c379\") " pod="openshift-insights/insights-runtime-extractor-v5xxc" Jul 08 01:43:13.152965 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:13.152942 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/fb8a1eb9-e14f-47c1-af1f-7015b945c379-crio-socket\") pod \"insights-runtime-extractor-v5xxc\" (UID: \"fb8a1eb9-e14f-47c1-af1f-7015b945c379\") " pod="openshift-insights/insights-runtime-extractor-v5xxc" Jul 08 01:43:13.155950 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:43:13.153042 2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 08 01:43:13.155950 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:13.153328 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/fb8a1eb9-e14f-47c1-af1f-7015b945c379-data-volume\") pod \"insights-runtime-extractor-v5xxc\" (UID: \"fb8a1eb9-e14f-47c1-af1f-7015b945c379\") " pod="openshift-insights/insights-runtime-extractor-v5xxc" Jul 08 01:43:13.155950 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:43:13.153933 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7fc4abce-ffae-4252-a2d6-358ff46351a5-networking-console-plugin-cert podName:7fc4abce-ffae-4252-a2d6-358ff46351a5 nodeName:}" failed. No retries permitted until 2026-07-08 01:43:21.153909445 +0000 UTC m=+81.351236290 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/7fc4abce-ffae-4252-a2d6-358ff46351a5-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-fnz7w" (UID: "7fc4abce-ffae-4252-a2d6-358ff46351a5") : secret "networking-console-plugin-cert" not found Jul 08 01:43:13.163955 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:13.163935 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nft2q\" (UniqueName: \"kubernetes.io/projected/fb8a1eb9-e14f-47c1-af1f-7015b945c379-kube-api-access-nft2q\") pod \"insights-runtime-extractor-v5xxc\" (UID: \"fb8a1eb9-e14f-47c1-af1f-7015b945c379\") " pod="openshift-insights/insights-runtime-extractor-v5xxc" Jul 08 01:43:13.346226 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:13.346141 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:43:13.449588 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:13.449555 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:43:13.456055 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:13.456037 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fce3b999-191d-4c34-a4d9-00bcb819c462-registry-tls\") pod \"image-registry-c4cbb95d4-fv9kj\" (UID: \"fce3b999-191d-4c34-a4d9-00bcb819c462\") " pod="openshift-image-registry/image-registry-c4cbb95d4-fv9kj" Jul 08 01:43:13.456211 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:43:13.456182 2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 08 01:43:13.456211 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:43:13.456211 2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-c4cbb95d4-fv9kj: secret "image-registry-tls" not found Jul 08 01:43:13.456285 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:43:13.456272 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fce3b999-191d-4c34-a4d9-00bcb819c462-registry-tls podName:fce3b999-191d-4c34-a4d9-00bcb819c462 nodeName:}" failed. No retries permitted until 2026-07-08 01:43:21.456255142 +0000 UTC m=+81.653581985 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fce3b999-191d-4c34-a4d9-00bcb819c462-registry-tls") pod "image-registry-c4cbb95d4-fv9kj" (UID: "fce3b999-191d-4c34-a4d9-00bcb819c462") : secret "image-registry-tls" not found Jul 08 01:43:13.658114 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:13.658024 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fb8a1eb9-e14f-47c1-af1f-7015b945c379-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-v5xxc\" (UID: \"fb8a1eb9-e14f-47c1-af1f-7015b945c379\") " pod="openshift-insights/insights-runtime-extractor-v5xxc" Jul 08 01:43:13.658114 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:13.658077 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fb8a1eb9-e14f-47c1-af1f-7015b945c379-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-v5xxc\" (UID: \"fb8a1eb9-e14f-47c1-af1f-7015b945c379\") " pod="openshift-insights/insights-runtime-extractor-v5xxc" Jul 08 01:43:13.658551 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:43:13.658177 2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 08 01:43:13.658551 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:43:13.658215 2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 08 01:43:13.658551 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:43:13.658267 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fb8a1eb9-e14f-47c1-af1f-7015b945c379-kube-rbac-proxy-cm podName:fb8a1eb9-e14f-47c1-af1f-7015b945c379 nodeName:}" failed. No retries permitted until 2026-07-08 01:43:14.658251921 +0000 UTC m=+74.855578753 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/fb8a1eb9-e14f-47c1-af1f-7015b945c379-kube-rbac-proxy-cm") pod "insights-runtime-extractor-v5xxc" (UID: "fb8a1eb9-e14f-47c1-af1f-7015b945c379") : configmap "kube-rbac-proxy" not found Jul 08 01:43:13.658551 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:43:13.658281 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb8a1eb9-e14f-47c1-af1f-7015b945c379-insights-runtime-extractor-tls podName:fb8a1eb9-e14f-47c1-af1f-7015b945c379 nodeName:}" failed. No retries permitted until 2026-07-08 01:43:14.658275026 +0000 UTC m=+74.855601858 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fb8a1eb9-e14f-47c1-af1f-7015b945c379-insights-runtime-extractor-tls") pod "insights-runtime-extractor-v5xxc" (UID: "fb8a1eb9-e14f-47c1-af1f-7015b945c379") : secret "insights-runtime-extractor-tls" not found Jul 08 01:43:14.667759 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:14.667720 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fb8a1eb9-e14f-47c1-af1f-7015b945c379-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-v5xxc\" (UID: \"fb8a1eb9-e14f-47c1-af1f-7015b945c379\") " pod="openshift-insights/insights-runtime-extractor-v5xxc" Jul 08 01:43:14.668140 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:14.667776 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fb8a1eb9-e14f-47c1-af1f-7015b945c379-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-v5xxc\" (UID: \"fb8a1eb9-e14f-47c1-af1f-7015b945c379\") " pod="openshift-insights/insights-runtime-extractor-v5xxc" Jul 08 01:43:14.668140 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:43:14.667887 2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 08 01:43:14.668140 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:43:14.667953 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb8a1eb9-e14f-47c1-af1f-7015b945c379-insights-runtime-extractor-tls podName:fb8a1eb9-e14f-47c1-af1f-7015b945c379 nodeName:}" failed. No retries permitted until 2026-07-08 01:43:16.667938075 +0000 UTC m=+76.865264911 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fb8a1eb9-e14f-47c1-af1f-7015b945c379-insights-runtime-extractor-tls") pod "insights-runtime-extractor-v5xxc" (UID: "fb8a1eb9-e14f-47c1-af1f-7015b945c379") : secret "insights-runtime-extractor-tls" not found Jul 08 01:43:14.668140 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:43:14.667887 2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 08 01:43:14.668140 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:43:14.667996 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fb8a1eb9-e14f-47c1-af1f-7015b945c379-kube-rbac-proxy-cm podName:fb8a1eb9-e14f-47c1-af1f-7015b945c379 nodeName:}" failed. No retries permitted until 2026-07-08 01:43:16.667985172 +0000 UTC m=+76.865312005 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/fb8a1eb9-e14f-47c1-af1f-7015b945c379-kube-rbac-proxy-cm") pod "insights-runtime-extractor-v5xxc" (UID: "fb8a1eb9-e14f-47c1-af1f-7015b945c379") : configmap "kube-rbac-proxy" not found Jul 08 01:43:14.896313 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:14.896275 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:43:14.972077 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:14.972041 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:43:15.031073 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:15.031041 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:43:15.218559 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:15.218531 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-pk46r_6d567423-f240-4ed8-87ba-743127287631/dns-node-resolver/0.log" Jul 08 01:43:16.019579 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:16.019550 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:43:16.224334 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:16.224307 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-xljcg_5cb4d2ec-61d0-4b04-a043-39c3d834cf1a/node-ca/0.log" Jul 08 01:43:16.682999 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:16.682964 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fb8a1eb9-e14f-47c1-af1f-7015b945c379-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-v5xxc\" (UID: \"fb8a1eb9-e14f-47c1-af1f-7015b945c379\") " pod="openshift-insights/insights-runtime-extractor-v5xxc" Jul 08 01:43:16.683178 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:16.683011 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fb8a1eb9-e14f-47c1-af1f-7015b945c379-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-v5xxc\" (UID: \"fb8a1eb9-e14f-47c1-af1f-7015b945c379\") " pod="openshift-insights/insights-runtime-extractor-v5xxc" Jul 08 01:43:16.683178 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:43:16.683119 2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 08 01:43:16.683178 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:43:16.683177 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb8a1eb9-e14f-47c1-af1f-7015b945c379-insights-runtime-extractor-tls podName:fb8a1eb9-e14f-47c1-af1f-7015b945c379 nodeName:}" failed. No retries permitted until 2026-07-08 01:43:20.683163513 +0000 UTC m=+80.880490345 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fb8a1eb9-e14f-47c1-af1f-7015b945c379-insights-runtime-extractor-tls") pod "insights-runtime-extractor-v5xxc" (UID: "fb8a1eb9-e14f-47c1-af1f-7015b945c379") : secret "insights-runtime-extractor-tls" not found Jul 08 01:43:16.683314 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:43:16.683123 2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 08 01:43:16.683314 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:43:16.683275 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fb8a1eb9-e14f-47c1-af1f-7015b945c379-kube-rbac-proxy-cm podName:fb8a1eb9-e14f-47c1-af1f-7015b945c379 nodeName:}" failed. No retries permitted until 2026-07-08 01:43:20.683260157 +0000 UTC m=+80.880586993 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/fb8a1eb9-e14f-47c1-af1f-7015b945c379-kube-rbac-proxy-cm") pod "insights-runtime-extractor-v5xxc" (UID: "fb8a1eb9-e14f-47c1-af1f-7015b945c379") : configmap "kube-rbac-proxy" not found Jul 08 01:43:16.821314 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:16.821286 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-g2zrw_9a9bc2dd-f544-4078-8fef-60c76f403a4e/serve-healthcheck-canary/0.log" Jul 08 01:43:19.046052 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:19.046016 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:43:19.147855 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:19.147822 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:43:19.259798 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:19.259768 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:43:19.357460 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:19.357372 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:43:19.425261 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:19.425230 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:43:19.748385 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:19.748354 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:43:19.829718 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:19.829693 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:43:20.548574 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:20.548540 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:43:20.716764 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:20.716729 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fb8a1eb9-e14f-47c1-af1f-7015b945c379-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-v5xxc\" (UID: \"fb8a1eb9-e14f-47c1-af1f-7015b945c379\") " pod="openshift-insights/insights-runtime-extractor-v5xxc" Jul 08 01:43:20.716982 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:43:20.716857 2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 08 01:43:20.716982 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:43:20.716919 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fb8a1eb9-e14f-47c1-af1f-7015b945c379-kube-rbac-proxy-cm podName:fb8a1eb9-e14f-47c1-af1f-7015b945c379 nodeName:}" failed. No retries permitted until 2026-07-08 01:43:28.716902794 +0000 UTC m=+88.914229625 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/fb8a1eb9-e14f-47c1-af1f-7015b945c379-kube-rbac-proxy-cm") pod "insights-runtime-extractor-v5xxc" (UID: "fb8a1eb9-e14f-47c1-af1f-7015b945c379") : configmap "kube-rbac-proxy" not found Jul 08 01:43:20.716982 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:20.716862 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fb8a1eb9-e14f-47c1-af1f-7015b945c379-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-v5xxc\" (UID: \"fb8a1eb9-e14f-47c1-af1f-7015b945c379\") " pod="openshift-insights/insights-runtime-extractor-v5xxc" Jul 08 01:43:20.716982 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:43:20.716953 2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 08 01:43:20.717157 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:43:20.717041 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb8a1eb9-e14f-47c1-af1f-7015b945c379-insights-runtime-extractor-tls podName:fb8a1eb9-e14f-47c1-af1f-7015b945c379 nodeName:}" failed. No retries permitted until 2026-07-08 01:43:28.717023252 +0000 UTC m=+88.914350102 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fb8a1eb9-e14f-47c1-af1f-7015b945c379-insights-runtime-extractor-tls") pod "insights-runtime-extractor-v5xxc" (UID: "fb8a1eb9-e14f-47c1-af1f-7015b945c379") : secret "insights-runtime-extractor-tls" not found Jul 08 01:43:20.938131 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:20.938100 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:43:21.221575 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:21.221481 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7fc4abce-ffae-4252-a2d6-358ff46351a5-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-fnz7w\" (UID: \"7fc4abce-ffae-4252-a2d6-358ff46351a5\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-fnz7w" Jul 08 01:43:21.221728 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:43:21.221639 2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 08 01:43:21.221728 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:43:21.221703 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7fc4abce-ffae-4252-a2d6-358ff46351a5-networking-console-plugin-cert podName:7fc4abce-ffae-4252-a2d6-358ff46351a5 nodeName:}" failed. No retries permitted until 2026-07-08 01:43:37.221689391 +0000 UTC m=+97.419016223 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/7fc4abce-ffae-4252-a2d6-358ff46351a5-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-fnz7w" (UID: "7fc4abce-ffae-4252-a2d6-358ff46351a5") : secret "networking-console-plugin-cert" not found Jul 08 01:43:21.343019 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:21.342983 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:43:21.524055 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:21.523967 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fce3b999-191d-4c34-a4d9-00bcb819c462-registry-tls\") pod \"image-registry-c4cbb95d4-fv9kj\" (UID: \"fce3b999-191d-4c34-a4d9-00bcb819c462\") " pod="openshift-image-registry/image-registry-c4cbb95d4-fv9kj" Jul 08 01:43:21.524231 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:43:21.524087 2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 08 01:43:21.524231 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:43:21.524100 2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-c4cbb95d4-fv9kj: secret "image-registry-tls" not found Jul 08 01:43:21.524231 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:43:21.524157 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fce3b999-191d-4c34-a4d9-00bcb819c462-registry-tls podName:fce3b999-191d-4c34-a4d9-00bcb819c462 nodeName:}" failed. No retries permitted until 2026-07-08 01:43:37.524143529 +0000 UTC m=+97.721470361 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fce3b999-191d-4c34-a4d9-00bcb819c462-registry-tls") pod "image-registry-c4cbb95d4-fv9kj" (UID: "fce3b999-191d-4c34-a4d9-00bcb819c462") : secret "image-registry-tls" not found Jul 08 01:43:21.531213 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:21.531178 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:43:22.140605 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:22.140573 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:43:22.535630 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:22.535603 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:43:22.737877 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:22.737849 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:43:22.838260 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:22.838171 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:43:22.938582 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:22.938552 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:43:23.337445 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:23.337416 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:43:23.394606 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:23.394576 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:43:23.736396 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:23.736368 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:43:23.803060 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:23.803030 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:43:24.137161 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:24.137085 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:43:24.336394 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:24.336362 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:43:24.931460 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:24.931428 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:43:25.338507 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:25.338429 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:43:25.387067 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:25.387035 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:43:25.729976 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:25.729944 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:43:25.936735 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:25.936702 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:43:26.341726 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:26.341695 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:43:26.939306 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:26.939275 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:43:27.515354 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:27.515321 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:43:27.574282 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:27.574229 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:43:27.741404 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:27.741375 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:43:28.156766 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:28.156737 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:43:28.352019 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:28.351990 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:43:28.745737 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:28.745705 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:43:28.783407 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:28.783380 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fb8a1eb9-e14f-47c1-af1f-7015b945c379-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-v5xxc\" (UID: \"fb8a1eb9-e14f-47c1-af1f-7015b945c379\") " pod="openshift-insights/insights-runtime-extractor-v5xxc" Jul 08 01:43:28.783553 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:28.783423 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fb8a1eb9-e14f-47c1-af1f-7015b945c379-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-v5xxc\" (UID: \"fb8a1eb9-e14f-47c1-af1f-7015b945c379\") " pod="openshift-insights/insights-runtime-extractor-v5xxc" Jul 08 01:43:28.783553 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:43:28.783523 2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 08 01:43:28.783636 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:43:28.783585 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb8a1eb9-e14f-47c1-af1f-7015b945c379-insights-runtime-extractor-tls podName:fb8a1eb9-e14f-47c1-af1f-7015b945c379 nodeName:}" failed. No retries permitted until 2026-07-08 01:43:44.783565323 +0000 UTC m=+104.980892158 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fb8a1eb9-e14f-47c1-af1f-7015b945c379-insights-runtime-extractor-tls") pod "insights-runtime-extractor-v5xxc" (UID: "fb8a1eb9-e14f-47c1-af1f-7015b945c379") : secret "insights-runtime-extractor-tls" not found Jul 08 01:43:28.783937 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:28.783921 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fb8a1eb9-e14f-47c1-af1f-7015b945c379-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-v5xxc\" (UID: \"fb8a1eb9-e14f-47c1-af1f-7015b945c379\") " pod="openshift-insights/insights-runtime-extractor-v5xxc" Jul 08 01:43:28.938502 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:28.938470 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:43:29.465420 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:29.465372 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:43:29.565767 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:29.565736 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:43:29.627912 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:29.627883 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:43:29.736295 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:29.736193 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:43:32.748404 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:32.748370 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:43:32.853212 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:32.853164 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:43:33.024486 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:33.024403 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:43:33.089732 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:33.089707 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:43:33.219878 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:33.219846 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:43:33.320181 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:33.320077 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:43:33.427610 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:33.427575 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:43:33.492796 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:33.492769 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:43:33.910418 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:33.910386 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:43:34.431776 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:34.431744 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:43:34.635543 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:34.635511 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:43:34.750239 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:34.750148 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:43:35.050740 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:35.050663 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:43:35.107248 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:35.107192 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:43:36.702160 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:36.702124 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c6b77cd-8n5d7"] Jul 08 01:43:36.704786 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:36.704771 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c6b77cd-8n5d7" Jul 08 01:43:36.713003 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:36.712981 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jul 08 01:43:36.713886 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:36.713867 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 08 01:43:36.713991 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:36.713870 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 08 01:43:36.713991 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:36.713899 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-c4cbb95d4-fv9kj"] Jul 08 01:43:36.713991 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:36.713918 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 08 01:43:36.714173 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:43:36.714153 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-c4cbb95d4-fv9kj" podUID="fce3b999-191d-4c34-a4d9-00bcb819c462" Jul 08 01:43:36.724932 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:36.724912 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c6b77cd-8n5d7"] Jul 08 01:43:36.791781 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:36.791748 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7d8d487dc6-glrxr"] Jul 08 01:43:36.793745 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:36.793725 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7d8d487dc6-glrxr" Jul 08 01:43:36.805041 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:36.805020 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-c4cbb95d4-fv9kj" Jul 08 01:43:36.809570 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:36.809546 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-c4cbb95d4-fv9kj" Jul 08 01:43:36.812895 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:36.812872 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7d8d487dc6-glrxr"] Jul 08 01:43:36.840887 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:36.840859 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:43:36.845976 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:36.845955 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/e7350b62-3288-4c9f-aed9-0d8c51d8a38f-klusterlet-config\") pod \"klusterlet-addon-workmgr-7c6b77cd-8n5d7\" (UID: \"e7350b62-3288-4c9f-aed9-0d8c51d8a38f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c6b77cd-8n5d7" Jul 08 01:43:36.846098 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:36.845983 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pf2nx\" (UniqueName: \"kubernetes.io/projected/e7350b62-3288-4c9f-aed9-0d8c51d8a38f-kube-api-access-pf2nx\") pod \"klusterlet-addon-workmgr-7c6b77cd-8n5d7\" (UID: \"e7350b62-3288-4c9f-aed9-0d8c51d8a38f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c6b77cd-8n5d7" Jul 08 01:43:36.846098 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:36.846005 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e7350b62-3288-4c9f-aed9-0d8c51d8a38f-tmp\") pod \"klusterlet-addon-workmgr-7c6b77cd-8n5d7\" (UID: \"e7350b62-3288-4c9f-aed9-0d8c51d8a38f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c6b77cd-8n5d7" Jul 08 01:43:36.924655 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:36.924621 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:43:36.946328 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:36.946305 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fce3b999-191d-4c34-a4d9-00bcb819c462-ca-trust-extracted\") pod \"fce3b999-191d-4c34-a4d9-00bcb819c462\" (UID: \"fce3b999-191d-4c34-a4d9-00bcb819c462\") " Jul 08 01:43:36.946468 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:36.946359 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fce3b999-191d-4c34-a4d9-00bcb819c462-trusted-ca\") pod \"fce3b999-191d-4c34-a4d9-00bcb819c462\" (UID: \"fce3b999-191d-4c34-a4d9-00bcb819c462\") " Jul 08 01:43:36.946468 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:36.946388 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fce3b999-191d-4c34-a4d9-00bcb819c462-registry-certificates\") pod \"fce3b999-191d-4c34-a4d9-00bcb819c462\" (UID: \"fce3b999-191d-4c34-a4d9-00bcb819c462\") " Jul 08 01:43:36.946468 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:36.946458 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fce3b999-191d-4c34-a4d9-00bcb819c462-installation-pull-secrets\") pod \"fce3b999-191d-4c34-a4d9-00bcb819c462\" (UID: \"fce3b999-191d-4c34-a4d9-00bcb819c462\") " Jul 08 01:43:36.946610 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:36.946492 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5ntr6\" (UniqueName: \"kubernetes.io/projected/fce3b999-191d-4c34-a4d9-00bcb819c462-kube-api-access-5ntr6\") pod \"fce3b999-191d-4c34-a4d9-00bcb819c462\" (UID: \"fce3b999-191d-4c34-a4d9-00bcb819c462\") " Jul 08 01:43:36.946610 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:36.946531 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fce3b999-191d-4c34-a4d9-00bcb819c462-bound-sa-token\") pod \"fce3b999-191d-4c34-a4d9-00bcb819c462\" (UID: \"fce3b999-191d-4c34-a4d9-00bcb819c462\") " Jul 08 01:43:36.946610 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:36.946563 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fce3b999-191d-4c34-a4d9-00bcb819c462-image-registry-private-configuration\") pod \"fce3b999-191d-4c34-a4d9-00bcb819c462\" (UID: \"fce3b999-191d-4c34-a4d9-00bcb819c462\") " Jul 08 01:43:36.946821 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:36.946618 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fce3b999-191d-4c34-a4d9-00bcb819c462-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "fce3b999-191d-4c34-a4d9-00bcb819c462" (UID: "fce3b999-191d-4c34-a4d9-00bcb819c462"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 01:43:36.946821 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:36.946646 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ffc4949b-e7e2-4f59-b7a8-975de1b95e8e-bound-sa-token\") pod \"image-registry-7d8d487dc6-glrxr\" (UID: \"ffc4949b-e7e2-4f59-b7a8-975de1b95e8e\") " pod="openshift-image-registry/image-registry-7d8d487dc6-glrxr" Jul 08 01:43:36.946821 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:36.946711 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ffc4949b-e7e2-4f59-b7a8-975de1b95e8e-ca-trust-extracted\") pod \"image-registry-7d8d487dc6-glrxr\" (UID: \"ffc4949b-e7e2-4f59-b7a8-975de1b95e8e\") " pod="openshift-image-registry/image-registry-7d8d487dc6-glrxr" Jul 08 01:43:36.946821 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:36.946761 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/e7350b62-3288-4c9f-aed9-0d8c51d8a38f-klusterlet-config\") pod \"klusterlet-addon-workmgr-7c6b77cd-8n5d7\" (UID: \"e7350b62-3288-4c9f-aed9-0d8c51d8a38f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c6b77cd-8n5d7" Jul 08 01:43:36.946821 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:36.946788 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pf2nx\" (UniqueName: \"kubernetes.io/projected/e7350b62-3288-4c9f-aed9-0d8c51d8a38f-kube-api-access-pf2nx\") pod \"klusterlet-addon-workmgr-7c6b77cd-8n5d7\" (UID: \"e7350b62-3288-4c9f-aed9-0d8c51d8a38f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c6b77cd-8n5d7" Jul 08 01:43:36.946821 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:36.946817 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e7350b62-3288-4c9f-aed9-0d8c51d8a38f-tmp\") pod \"klusterlet-addon-workmgr-7c6b77cd-8n5d7\" (UID: \"e7350b62-3288-4c9f-aed9-0d8c51d8a38f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c6b77cd-8n5d7" Jul 08 01:43:36.947117 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:36.946846 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ffc4949b-e7e2-4f59-b7a8-975de1b95e8e-registry-certificates\") pod \"image-registry-7d8d487dc6-glrxr\" (UID: \"ffc4949b-e7e2-4f59-b7a8-975de1b95e8e\") " pod="openshift-image-registry/image-registry-7d8d487dc6-glrxr" Jul 08 01:43:36.947117 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:36.946870 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z8vdp\" (UniqueName: \"kubernetes.io/projected/ffc4949b-e7e2-4f59-b7a8-975de1b95e8e-kube-api-access-z8vdp\") pod \"image-registry-7d8d487dc6-glrxr\" (UID: \"ffc4949b-e7e2-4f59-b7a8-975de1b95e8e\") " pod="openshift-image-registry/image-registry-7d8d487dc6-glrxr" Jul 08 01:43:36.947117 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:36.946895 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fce3b999-191d-4c34-a4d9-00bcb819c462-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "fce3b999-191d-4c34-a4d9-00bcb819c462" (UID: "fce3b999-191d-4c34-a4d9-00bcb819c462"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 01:43:36.947117 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:36.947024 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ffc4949b-e7e2-4f59-b7a8-975de1b95e8e-trusted-ca\") pod \"image-registry-7d8d487dc6-glrxr\" (UID: \"ffc4949b-e7e2-4f59-b7a8-975de1b95e8e\") " pod="openshift-image-registry/image-registry-7d8d487dc6-glrxr" Jul 08 01:43:36.947117 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:36.947054 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ffc4949b-e7e2-4f59-b7a8-975de1b95e8e-installation-pull-secrets\") pod \"image-registry-7d8d487dc6-glrxr\" (UID: \"ffc4949b-e7e2-4f59-b7a8-975de1b95e8e\") " pod="openshift-image-registry/image-registry-7d8d487dc6-glrxr" Jul 08 01:43:36.947117 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:36.947089 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ffc4949b-e7e2-4f59-b7a8-975de1b95e8e-registry-tls\") pod \"image-registry-7d8d487dc6-glrxr\" (UID: \"ffc4949b-e7e2-4f59-b7a8-975de1b95e8e\") " pod="openshift-image-registry/image-registry-7d8d487dc6-glrxr" Jul 08 01:43:36.947422 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:36.947123 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ffc4949b-e7e2-4f59-b7a8-975de1b95e8e-image-registry-private-configuration\") pod \"image-registry-7d8d487dc6-glrxr\" (UID: \"ffc4949b-e7e2-4f59-b7a8-975de1b95e8e\") " pod="openshift-image-registry/image-registry-7d8d487dc6-glrxr" Jul 08 01:43:36.947422 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:36.947224 2563 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fce3b999-191d-4c34-a4d9-00bcb819c462-ca-trust-extracted\") on node \"ip-10-0-142-233.ec2.internal\" DevicePath \"\"" Jul 08 01:43:36.947422 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:36.947261 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e7350b62-3288-4c9f-aed9-0d8c51d8a38f-tmp\") pod \"klusterlet-addon-workmgr-7c6b77cd-8n5d7\" (UID: \"e7350b62-3288-4c9f-aed9-0d8c51d8a38f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c6b77cd-8n5d7" Jul 08 01:43:36.947422 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:36.947275 2563 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fce3b999-191d-4c34-a4d9-00bcb819c462-registry-certificates\") on node \"ip-10-0-142-233.ec2.internal\" DevicePath \"\"" Jul 08 01:43:36.947422 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:36.947376 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fce3b999-191d-4c34-a4d9-00bcb819c462-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "fce3b999-191d-4c34-a4d9-00bcb819c462" (UID: "fce3b999-191d-4c34-a4d9-00bcb819c462"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 01:43:36.949048 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:36.949018 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fce3b999-191d-4c34-a4d9-00bcb819c462-kube-api-access-5ntr6" (OuterVolumeSpecName: "kube-api-access-5ntr6") pod "fce3b999-191d-4c34-a4d9-00bcb819c462" (UID: "fce3b999-191d-4c34-a4d9-00bcb819c462"). InnerVolumeSpecName "kube-api-access-5ntr6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 01:43:36.949154 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:36.949099 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fce3b999-191d-4c34-a4d9-00bcb819c462-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "fce3b999-191d-4c34-a4d9-00bcb819c462" (UID: "fce3b999-191d-4c34-a4d9-00bcb819c462"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 01:43:36.949221 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:36.949183 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fce3b999-191d-4c34-a4d9-00bcb819c462-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "fce3b999-191d-4c34-a4d9-00bcb819c462" (UID: "fce3b999-191d-4c34-a4d9-00bcb819c462"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 01:43:36.949298 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:36.949276 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fce3b999-191d-4c34-a4d9-00bcb819c462-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "fce3b999-191d-4c34-a4d9-00bcb819c462" (UID: "fce3b999-191d-4c34-a4d9-00bcb819c462"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 01:43:36.949587 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:36.949572 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/e7350b62-3288-4c9f-aed9-0d8c51d8a38f-klusterlet-config\") pod \"klusterlet-addon-workmgr-7c6b77cd-8n5d7\" (UID: \"e7350b62-3288-4c9f-aed9-0d8c51d8a38f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c6b77cd-8n5d7" Jul 08 01:43:36.954170 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:36.954149 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pf2nx\" (UniqueName: \"kubernetes.io/projected/e7350b62-3288-4c9f-aed9-0d8c51d8a38f-kube-api-access-pf2nx\") pod \"klusterlet-addon-workmgr-7c6b77cd-8n5d7\" (UID: \"e7350b62-3288-4c9f-aed9-0d8c51d8a38f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c6b77cd-8n5d7" Jul 08 01:43:37.014050 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:37.014021 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c6b77cd-8n5d7" Jul 08 01:43:37.048492 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:37.048461 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ffc4949b-e7e2-4f59-b7a8-975de1b95e8e-trusted-ca\") pod \"image-registry-7d8d487dc6-glrxr\" (UID: \"ffc4949b-e7e2-4f59-b7a8-975de1b95e8e\") " pod="openshift-image-registry/image-registry-7d8d487dc6-glrxr" Jul 08 01:43:37.048632 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:37.048497 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ffc4949b-e7e2-4f59-b7a8-975de1b95e8e-installation-pull-secrets\") pod \"image-registry-7d8d487dc6-glrxr\" (UID: \"ffc4949b-e7e2-4f59-b7a8-975de1b95e8e\") " pod="openshift-image-registry/image-registry-7d8d487dc6-glrxr" Jul 08 01:43:37.048632 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:37.048521 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ffc4949b-e7e2-4f59-b7a8-975de1b95e8e-registry-tls\") pod \"image-registry-7d8d487dc6-glrxr\" (UID: \"ffc4949b-e7e2-4f59-b7a8-975de1b95e8e\") " pod="openshift-image-registry/image-registry-7d8d487dc6-glrxr" Jul 08 01:43:37.048632 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:37.048543 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ffc4949b-e7e2-4f59-b7a8-975de1b95e8e-image-registry-private-configuration\") pod \"image-registry-7d8d487dc6-glrxr\" (UID: \"ffc4949b-e7e2-4f59-b7a8-975de1b95e8e\") " pod="openshift-image-registry/image-registry-7d8d487dc6-glrxr" Jul 08 01:43:37.048632 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:37.048564 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ffc4949b-e7e2-4f59-b7a8-975de1b95e8e-bound-sa-token\") pod \"image-registry-7d8d487dc6-glrxr\" (UID: \"ffc4949b-e7e2-4f59-b7a8-975de1b95e8e\") " pod="openshift-image-registry/image-registry-7d8d487dc6-glrxr" Jul 08 01:43:37.048632 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:37.048618 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ffc4949b-e7e2-4f59-b7a8-975de1b95e8e-ca-trust-extracted\") pod \"image-registry-7d8d487dc6-glrxr\" (UID: \"ffc4949b-e7e2-4f59-b7a8-975de1b95e8e\") " pod="openshift-image-registry/image-registry-7d8d487dc6-glrxr" Jul 08 01:43:37.048903 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:37.048663 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ffc4949b-e7e2-4f59-b7a8-975de1b95e8e-registry-certificates\") pod \"image-registry-7d8d487dc6-glrxr\" (UID: \"ffc4949b-e7e2-4f59-b7a8-975de1b95e8e\") " pod="openshift-image-registry/image-registry-7d8d487dc6-glrxr" Jul 08 01:43:37.048903 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:37.048690 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z8vdp\" (UniqueName: \"kubernetes.io/projected/ffc4949b-e7e2-4f59-b7a8-975de1b95e8e-kube-api-access-z8vdp\") pod \"image-registry-7d8d487dc6-glrxr\" (UID: \"ffc4949b-e7e2-4f59-b7a8-975de1b95e8e\") " pod="openshift-image-registry/image-registry-7d8d487dc6-glrxr" Jul 08 01:43:37.048903 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:37.048782 2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fce3b999-191d-4c34-a4d9-00bcb819c462-trusted-ca\") on node \"ip-10-0-142-233.ec2.internal\" DevicePath \"\"" Jul 08 01:43:37.048903 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:37.048798 2563 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fce3b999-191d-4c34-a4d9-00bcb819c462-installation-pull-secrets\") on node \"ip-10-0-142-233.ec2.internal\" DevicePath \"\"" Jul 08 01:43:37.048903 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:37.048809 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5ntr6\" (UniqueName: \"kubernetes.io/projected/fce3b999-191d-4c34-a4d9-00bcb819c462-kube-api-access-5ntr6\") on node \"ip-10-0-142-233.ec2.internal\" DevicePath \"\"" Jul 08 01:43:37.048903 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:37.048821 2563 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fce3b999-191d-4c34-a4d9-00bcb819c462-bound-sa-token\") on node \"ip-10-0-142-233.ec2.internal\" DevicePath \"\"" Jul 08 01:43:37.048903 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:37.048835 2563 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fce3b999-191d-4c34-a4d9-00bcb819c462-image-registry-private-configuration\") on node \"ip-10-0-142-233.ec2.internal\" DevicePath \"\"" Jul 08 01:43:37.049247 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:37.049158 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ffc4949b-e7e2-4f59-b7a8-975de1b95e8e-ca-trust-extracted\") pod \"image-registry-7d8d487dc6-glrxr\" (UID: \"ffc4949b-e7e2-4f59-b7a8-975de1b95e8e\") " pod="openshift-image-registry/image-registry-7d8d487dc6-glrxr" Jul 08 01:43:37.049663 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:37.049634 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ffc4949b-e7e2-4f59-b7a8-975de1b95e8e-registry-certificates\") pod \"image-registry-7d8d487dc6-glrxr\" (UID: \"ffc4949b-e7e2-4f59-b7a8-975de1b95e8e\") " pod="openshift-image-registry/image-registry-7d8d487dc6-glrxr" Jul 08 01:43:37.049897 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:37.049874 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ffc4949b-e7e2-4f59-b7a8-975de1b95e8e-trusted-ca\") pod \"image-registry-7d8d487dc6-glrxr\" (UID: \"ffc4949b-e7e2-4f59-b7a8-975de1b95e8e\") " pod="openshift-image-registry/image-registry-7d8d487dc6-glrxr" Jul 08 01:43:37.051071 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:37.051038 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ffc4949b-e7e2-4f59-b7a8-975de1b95e8e-image-registry-private-configuration\") pod \"image-registry-7d8d487dc6-glrxr\" (UID: \"ffc4949b-e7e2-4f59-b7a8-975de1b95e8e\") " pod="openshift-image-registry/image-registry-7d8d487dc6-glrxr" Jul 08 01:43:37.051282 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:37.051262 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ffc4949b-e7e2-4f59-b7a8-975de1b95e8e-registry-tls\") pod \"image-registry-7d8d487dc6-glrxr\" (UID: \"ffc4949b-e7e2-4f59-b7a8-975de1b95e8e\") " pod="openshift-image-registry/image-registry-7d8d487dc6-glrxr" Jul 08 01:43:37.051387 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:37.051365 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ffc4949b-e7e2-4f59-b7a8-975de1b95e8e-installation-pull-secrets\") pod \"image-registry-7d8d487dc6-glrxr\" (UID: \"ffc4949b-e7e2-4f59-b7a8-975de1b95e8e\") " pod="openshift-image-registry/image-registry-7d8d487dc6-glrxr" Jul 08 01:43:37.056779 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:37.056759 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z8vdp\" (UniqueName: \"kubernetes.io/projected/ffc4949b-e7e2-4f59-b7a8-975de1b95e8e-kube-api-access-z8vdp\") pod \"image-registry-7d8d487dc6-glrxr\" (UID: \"ffc4949b-e7e2-4f59-b7a8-975de1b95e8e\") " pod="openshift-image-registry/image-registry-7d8d487dc6-glrxr" Jul 08 01:43:37.056881 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:37.056819 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ffc4949b-e7e2-4f59-b7a8-975de1b95e8e-bound-sa-token\") pod \"image-registry-7d8d487dc6-glrxr\" (UID: \"ffc4949b-e7e2-4f59-b7a8-975de1b95e8e\") " pod="openshift-image-registry/image-registry-7d8d487dc6-glrxr" Jul 08 01:43:37.103530 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:37.103502 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7d8d487dc6-glrxr" Jul 08 01:43:37.139402 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:37.139370 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c6b77cd-8n5d7"] Jul 08 01:43:37.142811 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:43:37.142788 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7350b62_3288_4c9f_aed9_0d8c51d8a38f.slice/crio-544a15260d9fdb68570f25956eb566e84579938b56aa790de657aea97a5c4c96 WatchSource:0}: Error finding container 544a15260d9fdb68570f25956eb566e84579938b56aa790de657aea97a5c4c96: Status 404 returned error can't find the container with id 544a15260d9fdb68570f25956eb566e84579938b56aa790de657aea97a5c4c96 Jul 08 01:43:37.250694 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:37.250659 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7fc4abce-ffae-4252-a2d6-358ff46351a5-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-fnz7w\" (UID: \"7fc4abce-ffae-4252-a2d6-358ff46351a5\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-fnz7w" Jul 08 01:43:37.253017 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:37.252996 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7fc4abce-ffae-4252-a2d6-358ff46351a5-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-fnz7w\" (UID: \"7fc4abce-ffae-4252-a2d6-358ff46351a5\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-fnz7w" Jul 08 01:43:37.256737 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:37.256713 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7d8d487dc6-glrxr"] Jul 08 01:43:37.260835 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:43:37.260809 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podffc4949b_e7e2_4f59_b7a8_975de1b95e8e.slice/crio-9dab257f07183a11911253a8f1d9c9ec54f8ca9a18a97673332098854e5578e0 WatchSource:0}: Error finding container 9dab257f07183a11911253a8f1d9c9ec54f8ca9a18a97673332098854e5578e0: Status 404 returned error can't find the container with id 9dab257f07183a11911253a8f1d9c9ec54f8ca9a18a97673332098854e5578e0 Jul 08 01:43:37.265446 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:37.265430 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-fnz7w" Jul 08 01:43:37.391000 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:37.390969 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-fnz7w"] Jul 08 01:43:37.395649 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:43:37.395624 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7fc4abce_ffae_4252_a2d6_358ff46351a5.slice/crio-a6c8d50a6b092ab9787696cd50bf742c76ca3376cd56ff1b5eba012a773ac2ed WatchSource:0}: Error finding container a6c8d50a6b092ab9787696cd50bf742c76ca3376cd56ff1b5eba012a773ac2ed: Status 404 returned error can't find the container with id a6c8d50a6b092ab9787696cd50bf742c76ca3376cd56ff1b5eba012a773ac2ed Jul 08 01:43:37.553695 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:37.553599 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fce3b999-191d-4c34-a4d9-00bcb819c462-registry-tls\") pod \"image-registry-c4cbb95d4-fv9kj\" (UID: \"fce3b999-191d-4c34-a4d9-00bcb819c462\") " pod="openshift-image-registry/image-registry-c4cbb95d4-fv9kj" Jul 08 01:43:37.555918 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:37.555894 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fce3b999-191d-4c34-a4d9-00bcb819c462-registry-tls\") pod \"image-registry-c4cbb95d4-fv9kj\" (UID: \"fce3b999-191d-4c34-a4d9-00bcb819c462\") " pod="openshift-image-registry/image-registry-c4cbb95d4-fv9kj" Jul 08 01:43:37.653913 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:37.653875 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fce3b999-191d-4c34-a4d9-00bcb819c462-registry-tls\") pod \"fce3b999-191d-4c34-a4d9-00bcb819c462\" (UID: \"fce3b999-191d-4c34-a4d9-00bcb819c462\") " Jul 08 01:43:37.655834 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:37.655813 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fce3b999-191d-4c34-a4d9-00bcb819c462-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "fce3b999-191d-4c34-a4d9-00bcb819c462" (UID: "fce3b999-191d-4c34-a4d9-00bcb819c462"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 01:43:37.754619 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:37.754586 2563 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fce3b999-191d-4c34-a4d9-00bcb819c462-registry-tls\") on node \"ip-10-0-142-233.ec2.internal\" DevicePath \"\"" Jul 08 01:43:37.809226 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:37.809120 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-fnz7w" event={"ID":"7fc4abce-ffae-4252-a2d6-358ff46351a5","Type":"ContainerStarted","Data":"a6c8d50a6b092ab9787696cd50bf742c76ca3376cd56ff1b5eba012a773ac2ed"} Jul 08 01:43:37.810210 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:37.810173 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c6b77cd-8n5d7" event={"ID":"e7350b62-3288-4c9f-aed9-0d8c51d8a38f","Type":"ContainerStarted","Data":"544a15260d9fdb68570f25956eb566e84579938b56aa790de657aea97a5c4c96"} Jul 08 01:43:37.811539 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:37.811519 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-c4cbb95d4-fv9kj" Jul 08 01:43:37.811682 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:37.811520 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7d8d487dc6-glrxr" event={"ID":"ffc4949b-e7e2-4f59-b7a8-975de1b95e8e","Type":"ContainerStarted","Data":"df236e6b5c0a2440789952baedbe692575420b61c29dd6c276a0b920257f3d65"} Jul 08 01:43:37.811808 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:37.811790 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7d8d487dc6-glrxr" Jul 08 01:43:37.811866 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:37.811831 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7d8d487dc6-glrxr" event={"ID":"ffc4949b-e7e2-4f59-b7a8-975de1b95e8e","Type":"ContainerStarted","Data":"9dab257f07183a11911253a8f1d9c9ec54f8ca9a18a97673332098854e5578e0"} Jul 08 01:43:37.837352 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:37.837290 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7d8d487dc6-glrxr" podStartSLOduration=1.8372699639999999 podStartE2EDuration="1.837269964s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 01:43:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 01:43:37.837038841 +0000 UTC m=+98.034365694" watchObservedRunningTime="2026-07-08 01:43:37.837269964 +0000 UTC m=+98.034596819" Jul 08 01:43:37.865039 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:37.865008 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-c4cbb95d4-fv9kj"] Jul 08 01:43:37.869600 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:37.869574 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-c4cbb95d4-fv9kj"] Jul 08 01:43:38.401014 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:38.400978 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fce3b999-191d-4c34-a4d9-00bcb819c462" path="/var/lib/kubelet/pods/fce3b999-191d-4c34-a4d9-00bcb819c462/volumes" Jul 08 01:43:38.817309 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:38.817268 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-fnz7w" event={"ID":"7fc4abce-ffae-4252-a2d6-358ff46351a5","Type":"ContainerStarted","Data":"fa3dda699c661a397fbe215447bc0fdd30515fc7274530f2a9d3d82ff3b8070c"} Jul 08 01:43:38.834377 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:38.834227 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6bffdf9778-fnz7w" podStartSLOduration=32.722568761 podStartE2EDuration="33.834190117s" totalImagesPullingTime="1.111621356s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 01:43:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 01:43:38.83332841 +0000 UTC m=+99.030655261" watchObservedRunningTime="2026-07-08 01:43:38.834190117 +0000 UTC m=+99.031516971" Jul 08 01:43:38.930648 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:38.930605 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:43:39.036767 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:39.036727 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:43:39.129183 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:39.129104 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:43:39.167998 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:39.167970 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/90eac80c-1b42-4aa3-a3dd-9ea155f26507-metrics-tls\") pod \"dns-default-26bmx\" (UID: \"90eac80c-1b42-4aa3-a3dd-9ea155f26507\") " pod="openshift-dns/dns-default-26bmx" Jul 08 01:43:39.170739 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:39.170699 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/90eac80c-1b42-4aa3-a3dd-9ea155f26507-metrics-tls\") pod \"dns-default-26bmx\" (UID: \"90eac80c-1b42-4aa3-a3dd-9ea155f26507\") " pod="openshift-dns/dns-default-26bmx" Jul 08 01:43:39.207410 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:39.207382 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-mll5t\"" Jul 08 01:43:39.215589 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:39.215561 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-26bmx" Jul 08 01:43:39.701088 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:39.701052 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-26bmx"] Jul 08 01:43:39.706058 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:43:39.706032 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90eac80c_1b42_4aa3_a3dd_9ea155f26507.slice/crio-0ebfb72dc2b1a6a4c078c98a13fd05f5063e52c8c6f497ea7cc9eae0546e116a WatchSource:0}: Error finding container 0ebfb72dc2b1a6a4c078c98a13fd05f5063e52c8c6f497ea7cc9eae0546e116a: Status 404 returned error can't find the container with id 0ebfb72dc2b1a6a4c078c98a13fd05f5063e52c8c6f497ea7cc9eae0546e116a Jul 08 01:43:39.822087 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:39.822005 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-26bmx" event={"ID":"90eac80c-1b42-4aa3-a3dd-9ea155f26507","Type":"ContainerStarted","Data":"0ebfb72dc2b1a6a4c078c98a13fd05f5063e52c8c6f497ea7cc9eae0546e116a"} Jul 08 01:43:41.154149 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:41.154106 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:43:41.255596 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:41.255563 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:43:41.322391 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:41.322355 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:43:41.469377 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:41.469336 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:43:41.705981 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:41.705926 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:43:41.830693 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:41.830595 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c6b77cd-8n5d7" event={"ID":"e7350b62-3288-4c9f-aed9-0d8c51d8a38f","Type":"ContainerStarted","Data":"0449c941ef23897acffac6d8a316f717954311990d7ba5d72f03f7b8d7301d77"} Jul 08 01:43:41.830693 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:41.830683 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c6b77cd-8n5d7" Jul 08 01:43:41.832671 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:41.832648 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c6b77cd-8n5d7" Jul 08 01:43:41.847150 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:41.847092 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c6b77cd-8n5d7" podStartSLOduration=1.5250659450000001 podStartE2EDuration="5.847073112s" totalImagesPullingTime="4.322007167s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 01:43:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 01:43:41.846361519 +0000 UTC m=+102.043688374" watchObservedRunningTime="2026-07-08 01:43:41.847073112 +0000 UTC m=+102.044399972" Jul 08 01:43:42.737840 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:42.737811 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-dvf9v" Jul 08 01:43:43.663977 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:43.663948 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:43:43.767937 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:43.767905 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:43:43.842156 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:43.842120 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-26bmx" event={"ID":"90eac80c-1b42-4aa3-a3dd-9ea155f26507","Type":"ContainerStarted","Data":"297e5ec118f47393661e0f37c99aa249b489d0132ffbab1b4dbfcdaa7c0caa33"} Jul 08 01:43:43.842345 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:43.842213 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-26bmx" event={"ID":"90eac80c-1b42-4aa3-a3dd-9ea155f26507","Type":"ContainerStarted","Data":"1fdd59c5a85f6f3f07190eb2b4f38d8e8e7f648ea1a9105f775814406c1ac32f"} Jul 08 01:43:43.863753 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:43.863695 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-26bmx" podStartSLOduration=65.800971863 podStartE2EDuration="1m8.863680539s" totalImagesPullingTime="3.062708676s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 01:42:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 01:43:43.863639029 +0000 UTC m=+104.060965884" watchObservedRunningTime="2026-07-08 01:43:43.863680539 +0000 UTC m=+104.061007393" Jul 08 01:43:44.819405 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:44.819364 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fb8a1eb9-e14f-47c1-af1f-7015b945c379-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-v5xxc\" (UID: \"fb8a1eb9-e14f-47c1-af1f-7015b945c379\") " pod="openshift-insights/insights-runtime-extractor-v5xxc" Jul 08 01:43:44.821533 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:44.821513 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fb8a1eb9-e14f-47c1-af1f-7015b945c379-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-v5xxc\" (UID: \"fb8a1eb9-e14f-47c1-af1f-7015b945c379\") " pod="openshift-insights/insights-runtime-extractor-v5xxc" Jul 08 01:43:44.845805 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:44.845775 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-26bmx" Jul 08 01:43:45.088440 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:45.088345 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-v5xxc" Jul 08 01:43:45.235575 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:45.235548 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-v5xxc"] Jul 08 01:43:45.238000 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:43:45.237972 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb8a1eb9_e14f_47c1_af1f_7015b945c379.slice/crio-22e628bec1fcbee172e6ed180324e2b6c20c8a966725b71b143ffa7f37c12e38 WatchSource:0}: Error finding container 22e628bec1fcbee172e6ed180324e2b6c20c8a966725b71b143ffa7f37c12e38: Status 404 returned error can't find the container with id 22e628bec1fcbee172e6ed180324e2b6c20c8a966725b71b143ffa7f37c12e38 Jul 08 01:43:45.850551 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:45.850514 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-v5xxc" event={"ID":"fb8a1eb9-e14f-47c1-af1f-7015b945c379","Type":"ContainerStarted","Data":"22e628bec1fcbee172e6ed180324e2b6c20c8a966725b71b143ffa7f37c12e38"} Jul 08 01:43:47.354805 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:47.354772 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:43:47.455835 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:47.455756 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:43:47.582778 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:47.582745 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:43:49.463720 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:49.463684 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:43:49.528717 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:49.528686 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:43:49.866554 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:49.866518 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-v5xxc" event={"ID":"fb8a1eb9-e14f-47c1-af1f-7015b945c379","Type":"ContainerStarted","Data":"716be1e7ab33ffd339c98994fb6a6905ebb819051eeb445c67ada7fa838f8d43"} Jul 08 01:43:50.871755 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:50.871715 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-v5xxc" event={"ID":"fb8a1eb9-e14f-47c1-af1f-7015b945c379","Type":"ContainerStarted","Data":"35b0f02d36c9340c2733b07f5f36eca159aa43d05078ac9648d88240db6ae4ee"} Jul 08 01:43:52.880154 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:52.880118 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-v5xxc" event={"ID":"fb8a1eb9-e14f-47c1-af1f-7015b945c379","Type":"ContainerStarted","Data":"57776a9e53ba877562b91146c9d901da2028feefd09938343b336dbf41d3727d"} Jul 08 01:43:52.899611 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:52.899558 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-v5xxc" podStartSLOduration=33.954265296 podStartE2EDuration="40.89954115s" totalImagesPullingTime="6.945275854s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 01:43:12 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 01:43:52.898330829 +0000 UTC m=+113.095657683" watchObservedRunningTime="2026-07-08 01:43:52.89954115 +0000 UTC m=+113.096868005" Jul 08 01:43:53.066432 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:53.063272 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:43:53.142771 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:53.142683 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:43:54.852874 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:54.852837 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-26bmx" Jul 08 01:43:57.108357 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:57.108322 2563 patch_prober.go:28] interesting pod/image-registry-7d8d487dc6-glrxr container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 08 01:43:57.108766 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:57.108385 2563 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-7d8d487dc6-glrxr" podUID="ffc4949b-e7e2-4f59-b7a8-975de1b95e8e" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 08 01:43:57.567811 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:57.567778 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:43:58.821869 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:58.821839 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7d8d487dc6-glrxr" Jul 08 01:43:58.956730 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:58.956700 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:43:59.061276 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:59.061244 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:43:59.183691 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:59.183663 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:43:59.245125 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:59.245096 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:43:59.500867 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:59.500780 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:43:59.709641 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:59.709607 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:43:59.750655 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:59.750618 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-xr27g"] Jul 08 01:43:59.752996 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:59.752950 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-xr27g" Jul 08 01:43:59.756305 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:59.756283 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 08 01:43:59.756423 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:59.756303 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-tgp5k\"" Jul 08 01:43:59.756423 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:59.756283 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 08 01:43:59.756504 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:59.756283 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 08 01:43:59.756504 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:59.756283 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 08 01:43:59.756656 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:59.756642 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 08 01:43:59.759961 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:59.759670 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-zcqnl"] Jul 08 01:43:59.761749 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:59.761732 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-zcqnl" Jul 08 01:43:59.764372 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:59.764350 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 08 01:43:59.764541 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:59.764518 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 08 01:43:59.764828 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:59.764812 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-n72sj\"" Jul 08 01:43:59.765782 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:59.765678 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 08 01:43:59.767132 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:59.767113 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-xr27g"] Jul 08 01:43:59.773599 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:59.773578 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-5nr7z"] Jul 08 01:43:59.776097 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:59.776075 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-5nr7z" Jul 08 01:43:59.776395 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:59.776364 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-zcqnl"] Jul 08 01:43:59.778477 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:59.778455 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 08 01:43:59.778950 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:59.778933 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-7h5cl\"" Jul 08 01:43:59.779162 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:59.779143 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 08 01:43:59.779374 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:59.779357 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 08 01:43:59.826258 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:59.826223 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x4qzt\" (UniqueName: \"kubernetes.io/projected/ab2e1e98-5ab8-49f9-adf1-f8d71eb75839-kube-api-access-x4qzt\") pod \"node-exporter-5nr7z\" (UID: \"ab2e1e98-5ab8-49f9-adf1-f8d71eb75839\") " pod="openshift-monitoring/node-exporter-5nr7z" Jul 08 01:43:59.826258 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:59.826266 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ab2e1e98-5ab8-49f9-adf1-f8d71eb75839-sys\") pod \"node-exporter-5nr7z\" (UID: \"ab2e1e98-5ab8-49f9-adf1-f8d71eb75839\") " pod="openshift-monitoring/node-exporter-5nr7z" Jul 08 01:43:59.826720 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:59.826289 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ab2e1e98-5ab8-49f9-adf1-f8d71eb75839-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5nr7z\" (UID: \"ab2e1e98-5ab8-49f9-adf1-f8d71eb75839\") " pod="openshift-monitoring/node-exporter-5nr7z" Jul 08 01:43:59.826720 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:59.826319 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3e1469f5-2f2c-44e0-b1a1-8793239f8da7-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-xr27g\" (UID: \"3e1469f5-2f2c-44e0-b1a1-8793239f8da7\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-xr27g" Jul 08 01:43:59.826720 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:59.826443 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hqqbs\" (UniqueName: \"kubernetes.io/projected/5b3a9d0f-b665-4bfd-93f1-9f845c205bd2-kube-api-access-hqqbs\") pod \"kube-state-metrics-7c9dbb8b7d-zcqnl\" (UID: \"5b3a9d0f-b665-4bfd-93f1-9f845c205bd2\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-zcqnl" Jul 08 01:43:59.826720 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:59.826485 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ab2e1e98-5ab8-49f9-adf1-f8d71eb75839-root\") pod \"node-exporter-5nr7z\" (UID: \"ab2e1e98-5ab8-49f9-adf1-f8d71eb75839\") " pod="openshift-monitoring/node-exporter-5nr7z" Jul 08 01:43:59.826720 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:59.826510 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ab2e1e98-5ab8-49f9-adf1-f8d71eb75839-node-exporter-wtmp\") pod \"node-exporter-5nr7z\" (UID: \"ab2e1e98-5ab8-49f9-adf1-f8d71eb75839\") " pod="openshift-monitoring/node-exporter-5nr7z" Jul 08 01:43:59.826720 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:59.826576 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7xs7g\" (UniqueName: \"kubernetes.io/projected/3e1469f5-2f2c-44e0-b1a1-8793239f8da7-kube-api-access-7xs7g\") pod \"openshift-state-metrics-54cf96dfcf-xr27g\" (UID: \"3e1469f5-2f2c-44e0-b1a1-8793239f8da7\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-xr27g" Jul 08 01:43:59.826720 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:59.826613 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5b3a9d0f-b665-4bfd-93f1-9f845c205bd2-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-zcqnl\" (UID: \"5b3a9d0f-b665-4bfd-93f1-9f845c205bd2\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-zcqnl" Jul 08 01:43:59.826720 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:59.826644 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5b3a9d0f-b665-4bfd-93f1-9f845c205bd2-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-zcqnl\" (UID: \"5b3a9d0f-b665-4bfd-93f1-9f845c205bd2\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-zcqnl" Jul 08 01:43:59.826720 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:59.826684 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5b3a9d0f-b665-4bfd-93f1-9f845c205bd2-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-zcqnl\" (UID: \"5b3a9d0f-b665-4bfd-93f1-9f845c205bd2\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-zcqnl" Jul 08 01:43:59.826720 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:59.826719 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ab2e1e98-5ab8-49f9-adf1-f8d71eb75839-metrics-client-ca\") pod \"node-exporter-5nr7z\" (UID: \"ab2e1e98-5ab8-49f9-adf1-f8d71eb75839\") " pod="openshift-monitoring/node-exporter-5nr7z" Jul 08 01:43:59.827124 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:59.826744 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ab2e1e98-5ab8-49f9-adf1-f8d71eb75839-node-exporter-tls\") pod \"node-exporter-5nr7z\" (UID: \"ab2e1e98-5ab8-49f9-adf1-f8d71eb75839\") " pod="openshift-monitoring/node-exporter-5nr7z" Jul 08 01:43:59.827124 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:59.826768 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ab2e1e98-5ab8-49f9-adf1-f8d71eb75839-node-exporter-accelerators-collector-config\") pod \"node-exporter-5nr7z\" (UID: \"ab2e1e98-5ab8-49f9-adf1-f8d71eb75839\") " pod="openshift-monitoring/node-exporter-5nr7z" Jul 08 01:43:59.827124 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:59.826793 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3e1469f5-2f2c-44e0-b1a1-8793239f8da7-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-xr27g\" (UID: \"3e1469f5-2f2c-44e0-b1a1-8793239f8da7\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-xr27g" Jul 08 01:43:59.827124 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:59.826824 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ab2e1e98-5ab8-49f9-adf1-f8d71eb75839-node-exporter-textfile\") pod \"node-exporter-5nr7z\" (UID: \"ab2e1e98-5ab8-49f9-adf1-f8d71eb75839\") " pod="openshift-monitoring/node-exporter-5nr7z" Jul 08 01:43:59.827124 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:59.826853 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/5b3a9d0f-b665-4bfd-93f1-9f845c205bd2-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-zcqnl\" (UID: \"5b3a9d0f-b665-4bfd-93f1-9f845c205bd2\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-zcqnl" Jul 08 01:43:59.827124 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:59.826932 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3e1469f5-2f2c-44e0-b1a1-8793239f8da7-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-xr27g\" (UID: \"3e1469f5-2f2c-44e0-b1a1-8793239f8da7\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-xr27g" Jul 08 01:43:59.827124 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:59.826978 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/5b3a9d0f-b665-4bfd-93f1-9f845c205bd2-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-zcqnl\" (UID: \"5b3a9d0f-b665-4bfd-93f1-9f845c205bd2\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-zcqnl" Jul 08 01:43:59.833862 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:59.833812 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:43:59.903741 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:59.903705 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:43:59.927924 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:59.927891 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3e1469f5-2f2c-44e0-b1a1-8793239f8da7-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-xr27g\" (UID: \"3e1469f5-2f2c-44e0-b1a1-8793239f8da7\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-xr27g" Jul 08 01:43:59.928075 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:59.927934 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/5b3a9d0f-b665-4bfd-93f1-9f845c205bd2-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-zcqnl\" (UID: \"5b3a9d0f-b665-4bfd-93f1-9f845c205bd2\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-zcqnl" Jul 08 01:43:59.928075 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:59.928042 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x4qzt\" (UniqueName: \"kubernetes.io/projected/ab2e1e98-5ab8-49f9-adf1-f8d71eb75839-kube-api-access-x4qzt\") pod \"node-exporter-5nr7z\" (UID: \"ab2e1e98-5ab8-49f9-adf1-f8d71eb75839\") " pod="openshift-monitoring/node-exporter-5nr7z" Jul 08 01:43:59.928075 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:59.928073 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ab2e1e98-5ab8-49f9-adf1-f8d71eb75839-sys\") pod \"node-exporter-5nr7z\" (UID: \"ab2e1e98-5ab8-49f9-adf1-f8d71eb75839\") " pod="openshift-monitoring/node-exporter-5nr7z" Jul 08 01:43:59.928286 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:59.928092 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ab2e1e98-5ab8-49f9-adf1-f8d71eb75839-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5nr7z\" (UID: \"ab2e1e98-5ab8-49f9-adf1-f8d71eb75839\") " pod="openshift-monitoring/node-exporter-5nr7z" Jul 08 01:43:59.928286 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:59.928108 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3e1469f5-2f2c-44e0-b1a1-8793239f8da7-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-xr27g\" (UID: \"3e1469f5-2f2c-44e0-b1a1-8793239f8da7\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-xr27g" Jul 08 01:43:59.928286 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:59.928157 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hqqbs\" (UniqueName: \"kubernetes.io/projected/5b3a9d0f-b665-4bfd-93f1-9f845c205bd2-kube-api-access-hqqbs\") pod \"kube-state-metrics-7c9dbb8b7d-zcqnl\" (UID: \"5b3a9d0f-b665-4bfd-93f1-9f845c205bd2\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-zcqnl" Jul 08 01:43:59.928286 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:59.928148 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ab2e1e98-5ab8-49f9-adf1-f8d71eb75839-sys\") pod \"node-exporter-5nr7z\" (UID: \"ab2e1e98-5ab8-49f9-adf1-f8d71eb75839\") " pod="openshift-monitoring/node-exporter-5nr7z" Jul 08 01:43:59.928286 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:59.928175 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ab2e1e98-5ab8-49f9-adf1-f8d71eb75839-root\") pod \"node-exporter-5nr7z\" (UID: \"ab2e1e98-5ab8-49f9-adf1-f8d71eb75839\") " pod="openshift-monitoring/node-exporter-5nr7z" Jul 08 01:43:59.928286 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:59.928226 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ab2e1e98-5ab8-49f9-adf1-f8d71eb75839-node-exporter-wtmp\") pod \"node-exporter-5nr7z\" (UID: \"ab2e1e98-5ab8-49f9-adf1-f8d71eb75839\") " pod="openshift-monitoring/node-exporter-5nr7z" Jul 08 01:43:59.928286 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:59.928250 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7xs7g\" (UniqueName: \"kubernetes.io/projected/3e1469f5-2f2c-44e0-b1a1-8793239f8da7-kube-api-access-7xs7g\") pod \"openshift-state-metrics-54cf96dfcf-xr27g\" (UID: \"3e1469f5-2f2c-44e0-b1a1-8793239f8da7\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-xr27g" Jul 08 01:43:59.928286 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:59.928265 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ab2e1e98-5ab8-49f9-adf1-f8d71eb75839-root\") pod \"node-exporter-5nr7z\" (UID: \"ab2e1e98-5ab8-49f9-adf1-f8d71eb75839\") " pod="openshift-monitoring/node-exporter-5nr7z" Jul 08 01:43:59.928286 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:59.928279 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5b3a9d0f-b665-4bfd-93f1-9f845c205bd2-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-zcqnl\" (UID: \"5b3a9d0f-b665-4bfd-93f1-9f845c205bd2\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-zcqnl" Jul 08 01:43:59.928722 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:59.928306 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5b3a9d0f-b665-4bfd-93f1-9f845c205bd2-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-zcqnl\" (UID: \"5b3a9d0f-b665-4bfd-93f1-9f845c205bd2\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-zcqnl" Jul 08 01:43:59.928722 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:59.928335 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5b3a9d0f-b665-4bfd-93f1-9f845c205bd2-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-zcqnl\" (UID: \"5b3a9d0f-b665-4bfd-93f1-9f845c205bd2\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-zcqnl" Jul 08 01:43:59.928722 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:59.928364 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ab2e1e98-5ab8-49f9-adf1-f8d71eb75839-metrics-client-ca\") pod \"node-exporter-5nr7z\" (UID: \"ab2e1e98-5ab8-49f9-adf1-f8d71eb75839\") " pod="openshift-monitoring/node-exporter-5nr7z" Jul 08 01:43:59.928722 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:59.928392 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ab2e1e98-5ab8-49f9-adf1-f8d71eb75839-node-exporter-tls\") pod \"node-exporter-5nr7z\" (UID: \"ab2e1e98-5ab8-49f9-adf1-f8d71eb75839\") " pod="openshift-monitoring/node-exporter-5nr7z" Jul 08 01:43:59.928722 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:59.928411 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/5b3a9d0f-b665-4bfd-93f1-9f845c205bd2-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-zcqnl\" (UID: \"5b3a9d0f-b665-4bfd-93f1-9f845c205bd2\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-zcqnl" Jul 08 01:43:59.928722 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:59.928421 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ab2e1e98-5ab8-49f9-adf1-f8d71eb75839-node-exporter-accelerators-collector-config\") pod \"node-exporter-5nr7z\" (UID: \"ab2e1e98-5ab8-49f9-adf1-f8d71eb75839\") " pod="openshift-monitoring/node-exporter-5nr7z" Jul 08 01:43:59.928722 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:59.928445 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3e1469f5-2f2c-44e0-b1a1-8793239f8da7-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-xr27g\" (UID: \"3e1469f5-2f2c-44e0-b1a1-8793239f8da7\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-xr27g" Jul 08 01:43:59.928722 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:59.928484 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ab2e1e98-5ab8-49f9-adf1-f8d71eb75839-node-exporter-textfile\") pod \"node-exporter-5nr7z\" (UID: \"ab2e1e98-5ab8-49f9-adf1-f8d71eb75839\") " pod="openshift-monitoring/node-exporter-5nr7z" Jul 08 01:43:59.928722 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:59.928521 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/5b3a9d0f-b665-4bfd-93f1-9f845c205bd2-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-zcqnl\" (UID: \"5b3a9d0f-b665-4bfd-93f1-9f845c205bd2\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-zcqnl" Jul 08 01:43:59.928722 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:59.928553 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ab2e1e98-5ab8-49f9-adf1-f8d71eb75839-node-exporter-wtmp\") pod \"node-exporter-5nr7z\" (UID: \"ab2e1e98-5ab8-49f9-adf1-f8d71eb75839\") " pod="openshift-monitoring/node-exporter-5nr7z" Jul 08 01:43:59.928722 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:43:59.928664 2563 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 08 01:43:59.928722 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:43:59.928730 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab2e1e98-5ab8-49f9-adf1-f8d71eb75839-node-exporter-tls podName:ab2e1e98-5ab8-49f9-adf1-f8d71eb75839 nodeName:}" failed. No retries permitted until 2026-07-08 01:44:00.428712827 +0000 UTC m=+120.626039675 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/ab2e1e98-5ab8-49f9-adf1-f8d71eb75839-node-exporter-tls") pod "node-exporter-5nr7z" (UID: "ab2e1e98-5ab8-49f9-adf1-f8d71eb75839") : secret "node-exporter-tls" not found Jul 08 01:43:59.929340 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:59.928734 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3e1469f5-2f2c-44e0-b1a1-8793239f8da7-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-xr27g\" (UID: \"3e1469f5-2f2c-44e0-b1a1-8793239f8da7\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-xr27g" Jul 08 01:43:59.929340 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:59.928963 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ab2e1e98-5ab8-49f9-adf1-f8d71eb75839-node-exporter-textfile\") pod \"node-exporter-5nr7z\" (UID: \"ab2e1e98-5ab8-49f9-adf1-f8d71eb75839\") " pod="openshift-monitoring/node-exporter-5nr7z" Jul 08 01:43:59.929340 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:59.929174 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5b3a9d0f-b665-4bfd-93f1-9f845c205bd2-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-zcqnl\" (UID: \"5b3a9d0f-b665-4bfd-93f1-9f845c205bd2\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-zcqnl" Jul 08 01:43:59.929505 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:59.929474 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ab2e1e98-5ab8-49f9-adf1-f8d71eb75839-metrics-client-ca\") pod \"node-exporter-5nr7z\" (UID: \"ab2e1e98-5ab8-49f9-adf1-f8d71eb75839\") " pod="openshift-monitoring/node-exporter-5nr7z" Jul 08 01:43:59.929617 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:59.929584 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/5b3a9d0f-b665-4bfd-93f1-9f845c205bd2-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-zcqnl\" (UID: \"5b3a9d0f-b665-4bfd-93f1-9f845c205bd2\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-zcqnl" Jul 08 01:43:59.929934 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:59.929913 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ab2e1e98-5ab8-49f9-adf1-f8d71eb75839-node-exporter-accelerators-collector-config\") pod \"node-exporter-5nr7z\" (UID: \"ab2e1e98-5ab8-49f9-adf1-f8d71eb75839\") " pod="openshift-monitoring/node-exporter-5nr7z" Jul 08 01:43:59.931069 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:59.931042 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5b3a9d0f-b665-4bfd-93f1-9f845c205bd2-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-zcqnl\" (UID: \"5b3a9d0f-b665-4bfd-93f1-9f845c205bd2\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-zcqnl" Jul 08 01:43:59.931185 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:59.931068 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ab2e1e98-5ab8-49f9-adf1-f8d71eb75839-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5nr7z\" (UID: \"ab2e1e98-5ab8-49f9-adf1-f8d71eb75839\") " pod="openshift-monitoring/node-exporter-5nr7z" Jul 08 01:43:59.931185 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:59.931118 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5b3a9d0f-b665-4bfd-93f1-9f845c205bd2-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-zcqnl\" (UID: \"5b3a9d0f-b665-4bfd-93f1-9f845c205bd2\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-zcqnl" Jul 08 01:43:59.931299 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:59.931282 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3e1469f5-2f2c-44e0-b1a1-8793239f8da7-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-xr27g\" (UID: \"3e1469f5-2f2c-44e0-b1a1-8793239f8da7\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-xr27g" Jul 08 01:43:59.931417 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:59.931402 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3e1469f5-2f2c-44e0-b1a1-8793239f8da7-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-xr27g\" (UID: \"3e1469f5-2f2c-44e0-b1a1-8793239f8da7\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-xr27g" Jul 08 01:43:59.937136 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:59.937109 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x4qzt\" (UniqueName: \"kubernetes.io/projected/ab2e1e98-5ab8-49f9-adf1-f8d71eb75839-kube-api-access-x4qzt\") pod \"node-exporter-5nr7z\" (UID: \"ab2e1e98-5ab8-49f9-adf1-f8d71eb75839\") " pod="openshift-monitoring/node-exporter-5nr7z" Jul 08 01:43:59.937368 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:59.937349 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hqqbs\" (UniqueName: \"kubernetes.io/projected/5b3a9d0f-b665-4bfd-93f1-9f845c205bd2-kube-api-access-hqqbs\") pod \"kube-state-metrics-7c9dbb8b7d-zcqnl\" (UID: \"5b3a9d0f-b665-4bfd-93f1-9f845c205bd2\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-zcqnl" Jul 08 01:43:59.937525 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:43:59.937507 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7xs7g\" (UniqueName: \"kubernetes.io/projected/3e1469f5-2f2c-44e0-b1a1-8793239f8da7-kube-api-access-7xs7g\") pod \"openshift-state-metrics-54cf96dfcf-xr27g\" (UID: \"3e1469f5-2f2c-44e0-b1a1-8793239f8da7\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-xr27g" Jul 08 01:44:00.026700 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:00.026628 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:44:00.062844 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:00.062810 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-xr27g" Jul 08 01:44:00.070742 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:00.070700 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-zcqnl" Jul 08 01:44:00.128393 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:00.128307 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:44:00.199429 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:00.199403 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-xr27g"] Jul 08 01:44:00.200998 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:44:00.200974 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e1469f5_2f2c_44e0_b1a1_8793239f8da7.slice/crio-f99e585b240474874d43e9775c1ffc8e9a5a81af77ec8b3523bdd88f52956917 WatchSource:0}: Error finding container f99e585b240474874d43e9775c1ffc8e9a5a81af77ec8b3523bdd88f52956917: Status 404 returned error can't find the container with id f99e585b240474874d43e9775c1ffc8e9a5a81af77ec8b3523bdd88f52956917 Jul 08 01:44:00.206805 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:00.206715 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:44:00.226006 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:00.225981 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-zcqnl"] Jul 08 01:44:00.236356 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:44:00.236324 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b3a9d0f_b665_4bfd_93f1_9f845c205bd2.slice/crio-0ff1d2a85bd32bf790ba5eb3c09661866b82695e425417b8f58c07415e367305 WatchSource:0}: Error finding container 0ff1d2a85bd32bf790ba5eb3c09661866b82695e425417b8f58c07415e367305: Status 404 returned error can't find the container with id 0ff1d2a85bd32bf790ba5eb3c09661866b82695e425417b8f58c07415e367305 Jul 08 01:44:00.433075 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:00.433040 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ab2e1e98-5ab8-49f9-adf1-f8d71eb75839-node-exporter-tls\") pod \"node-exporter-5nr7z\" (UID: \"ab2e1e98-5ab8-49f9-adf1-f8d71eb75839\") " pod="openshift-monitoring/node-exporter-5nr7z" Jul 08 01:44:00.435237 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:00.435216 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ab2e1e98-5ab8-49f9-adf1-f8d71eb75839-node-exporter-tls\") pod \"node-exporter-5nr7z\" (UID: \"ab2e1e98-5ab8-49f9-adf1-f8d71eb75839\") " pod="openshift-monitoring/node-exporter-5nr7z" Jul 08 01:44:00.687023 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:00.686994 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-7h5cl\"" Jul 08 01:44:00.695414 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:00.695393 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-5nr7z" Jul 08 01:44:00.704629 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:44:00.704607 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab2e1e98_5ab8_49f9_adf1_f8d71eb75839.slice/crio-4d0f603cbac9befdfc2b853c7a5258f436b6981db2e6b41885359e54232c0246 WatchSource:0}: Error finding container 4d0f603cbac9befdfc2b853c7a5258f436b6981db2e6b41885359e54232c0246: Status 404 returned error can't find the container with id 4d0f603cbac9befdfc2b853c7a5258f436b6981db2e6b41885359e54232c0246 Jul 08 01:44:00.851635 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:00.851599 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:44:00.908253 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:00.908190 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-xr27g" event={"ID":"3e1469f5-2f2c-44e0-b1a1-8793239f8da7","Type":"ContainerStarted","Data":"9569ee008bd369160d5e6e70e06608813edab80ab52420b0730561820cfd20d9"} Jul 08 01:44:00.908436 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:00.908283 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-xr27g" event={"ID":"3e1469f5-2f2c-44e0-b1a1-8793239f8da7","Type":"ContainerStarted","Data":"f14cb27794c05872b5a1d1193f17f319abb9349ee8a1261f5b3726662ebeb13f"} Jul 08 01:44:00.908436 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:00.908313 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-xr27g" event={"ID":"3e1469f5-2f2c-44e0-b1a1-8793239f8da7","Type":"ContainerStarted","Data":"f99e585b240474874d43e9775c1ffc8e9a5a81af77ec8b3523bdd88f52956917"} Jul 08 01:44:00.910188 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:00.910159 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-zcqnl" event={"ID":"5b3a9d0f-b665-4bfd-93f1-9f845c205bd2","Type":"ContainerStarted","Data":"0ff1d2a85bd32bf790ba5eb3c09661866b82695e425417b8f58c07415e367305"} Jul 08 01:44:00.911764 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:00.911724 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5nr7z" event={"ID":"ab2e1e98-5ab8-49f9-adf1-f8d71eb75839","Type":"ContainerStarted","Data":"4d0f603cbac9befdfc2b853c7a5258f436b6981db2e6b41885359e54232c0246"} Jul 08 01:44:00.992115 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:00.992023 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 08 01:44:00.995286 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:00.995264 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 08 01:44:00.998082 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:00.998060 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 08 01:44:00.998437 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:00.998065 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 08 01:44:00.999159 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:00.999088 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:44:01.000964 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:01.000887 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 08 01:44:01.001099 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:01.000965 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 08 01:44:01.001099 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:01.000985 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 08 01:44:01.001099 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:01.001023 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 08 01:44:01.001347 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:01.001286 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 08 01:44:01.001421 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:01.001409 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 08 01:44:01.001473 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:01.001437 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 08 01:44:01.001523 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:01.001476 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-2b8wr\"" Jul 08 01:44:01.014309 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:01.014281 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 08 01:44:01.037108 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:01.037074 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b638638f-d919-45b7-aa82-4818e5308708-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"b638638f-d919-45b7-aa82-4818e5308708\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 01:44:01.037108 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:01.037110 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b638638f-d919-45b7-aa82-4818e5308708-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"b638638f-d919-45b7-aa82-4818e5308708\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 01:44:01.037355 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:01.037139 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b638638f-d919-45b7-aa82-4818e5308708-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"b638638f-d919-45b7-aa82-4818e5308708\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 01:44:01.037355 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:01.037160 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b638638f-d919-45b7-aa82-4818e5308708-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"b638638f-d919-45b7-aa82-4818e5308708\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 01:44:01.037355 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:01.037190 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b638638f-d919-45b7-aa82-4818e5308708-config-out\") pod \"alertmanager-main-0\" (UID: \"b638638f-d919-45b7-aa82-4818e5308708\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 01:44:01.037355 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:01.037243 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b638638f-d919-45b7-aa82-4818e5308708-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"b638638f-d919-45b7-aa82-4818e5308708\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 01:44:01.037355 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:01.037276 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z72sr\" (UniqueName: \"kubernetes.io/projected/b638638f-d919-45b7-aa82-4818e5308708-kube-api-access-z72sr\") pod \"alertmanager-main-0\" (UID: \"b638638f-d919-45b7-aa82-4818e5308708\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 01:44:01.037355 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:01.037303 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b638638f-d919-45b7-aa82-4818e5308708-tls-assets\") pod \"alertmanager-main-0\" (UID: \"b638638f-d919-45b7-aa82-4818e5308708\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 01:44:01.037355 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:01.037325 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b638638f-d919-45b7-aa82-4818e5308708-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"b638638f-d919-45b7-aa82-4818e5308708\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 01:44:01.037708 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:01.037364 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b638638f-d919-45b7-aa82-4818e5308708-config-volume\") pod \"alertmanager-main-0\" (UID: \"b638638f-d919-45b7-aa82-4818e5308708\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 01:44:01.037708 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:01.037402 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b638638f-d919-45b7-aa82-4818e5308708-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"b638638f-d919-45b7-aa82-4818e5308708\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 01:44:01.037708 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:01.037427 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b638638f-d919-45b7-aa82-4818e5308708-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"b638638f-d919-45b7-aa82-4818e5308708\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 01:44:01.037708 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:01.037450 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b638638f-d919-45b7-aa82-4818e5308708-web-config\") pod \"alertmanager-main-0\" (UID: \"b638638f-d919-45b7-aa82-4818e5308708\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 01:44:01.078895 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:01.078836 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:44:01.138748 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:01.138508 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z72sr\" (UniqueName: \"kubernetes.io/projected/b638638f-d919-45b7-aa82-4818e5308708-kube-api-access-z72sr\") pod \"alertmanager-main-0\" (UID: \"b638638f-d919-45b7-aa82-4818e5308708\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 01:44:01.138748 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:01.138557 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b638638f-d919-45b7-aa82-4818e5308708-tls-assets\") pod \"alertmanager-main-0\" (UID: \"b638638f-d919-45b7-aa82-4818e5308708\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 01:44:01.138748 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:01.138588 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b638638f-d919-45b7-aa82-4818e5308708-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"b638638f-d919-45b7-aa82-4818e5308708\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 01:44:01.138748 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:01.138625 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b638638f-d919-45b7-aa82-4818e5308708-config-volume\") pod \"alertmanager-main-0\" (UID: \"b638638f-d919-45b7-aa82-4818e5308708\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 01:44:01.138748 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:01.138664 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b638638f-d919-45b7-aa82-4818e5308708-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"b638638f-d919-45b7-aa82-4818e5308708\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 01:44:01.138748 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:01.138691 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b638638f-d919-45b7-aa82-4818e5308708-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"b638638f-d919-45b7-aa82-4818e5308708\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 01:44:01.138748 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:01.138717 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b638638f-d919-45b7-aa82-4818e5308708-web-config\") pod \"alertmanager-main-0\" (UID: \"b638638f-d919-45b7-aa82-4818e5308708\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 01:44:01.140622 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:01.138767 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b638638f-d919-45b7-aa82-4818e5308708-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"b638638f-d919-45b7-aa82-4818e5308708\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 01:44:01.140622 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:01.138794 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b638638f-d919-45b7-aa82-4818e5308708-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"b638638f-d919-45b7-aa82-4818e5308708\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 01:44:01.140622 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:01.138827 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b638638f-d919-45b7-aa82-4818e5308708-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"b638638f-d919-45b7-aa82-4818e5308708\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 01:44:01.140622 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:01.138857 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b638638f-d919-45b7-aa82-4818e5308708-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"b638638f-d919-45b7-aa82-4818e5308708\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 01:44:01.140622 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:01.138901 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b638638f-d919-45b7-aa82-4818e5308708-config-out\") pod \"alertmanager-main-0\" (UID: \"b638638f-d919-45b7-aa82-4818e5308708\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 01:44:01.140622 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:01.138949 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b638638f-d919-45b7-aa82-4818e5308708-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"b638638f-d919-45b7-aa82-4818e5308708\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 01:44:01.140622 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:44:01.139336 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b638638f-d919-45b7-aa82-4818e5308708-alertmanager-trusted-ca-bundle podName:b638638f-d919-45b7-aa82-4818e5308708 nodeName:}" failed. No retries permitted until 2026-07-08 01:44:01.639308541 +0000 UTC m=+121.836635377 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/b638638f-d919-45b7-aa82-4818e5308708-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "b638638f-d919-45b7-aa82-4818e5308708") : configmap references non-existent config key: ca-bundle.crt Jul 08 01:44:01.140622 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:01.140074 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b638638f-d919-45b7-aa82-4818e5308708-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"b638638f-d919-45b7-aa82-4818e5308708\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 01:44:01.140622 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:01.140413 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b638638f-d919-45b7-aa82-4818e5308708-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"b638638f-d919-45b7-aa82-4818e5308708\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 01:44:01.143673 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:01.143622 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b638638f-d919-45b7-aa82-4818e5308708-config-volume\") pod \"alertmanager-main-0\" (UID: \"b638638f-d919-45b7-aa82-4818e5308708\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 01:44:01.144016 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:01.143967 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b638638f-d919-45b7-aa82-4818e5308708-config-out\") pod \"alertmanager-main-0\" (UID: \"b638638f-d919-45b7-aa82-4818e5308708\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 01:44:01.144300 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:01.144258 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b638638f-d919-45b7-aa82-4818e5308708-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"b638638f-d919-45b7-aa82-4818e5308708\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 01:44:01.144589 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:01.144565 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b638638f-d919-45b7-aa82-4818e5308708-tls-assets\") pod \"alertmanager-main-0\" (UID: \"b638638f-d919-45b7-aa82-4818e5308708\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 01:44:01.144700 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:01.144653 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b638638f-d919-45b7-aa82-4818e5308708-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"b638638f-d919-45b7-aa82-4818e5308708\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 01:44:01.145089 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:01.144923 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b638638f-d919-45b7-aa82-4818e5308708-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"b638638f-d919-45b7-aa82-4818e5308708\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 01:44:01.145766 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:01.145291 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b638638f-d919-45b7-aa82-4818e5308708-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"b638638f-d919-45b7-aa82-4818e5308708\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 01:44:01.145766 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:01.145726 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b638638f-d919-45b7-aa82-4818e5308708-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"b638638f-d919-45b7-aa82-4818e5308708\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 01:44:01.145953 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:01.145929 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b638638f-d919-45b7-aa82-4818e5308708-web-config\") pod \"alertmanager-main-0\" (UID: \"b638638f-d919-45b7-aa82-4818e5308708\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 01:44:01.179521 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:01.179439 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z72sr\" (UniqueName: \"kubernetes.io/projected/b638638f-d919-45b7-aa82-4818e5308708-kube-api-access-z72sr\") pod \"alertmanager-main-0\" (UID: \"b638638f-d919-45b7-aa82-4818e5308708\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 01:44:01.490181 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:01.490144 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:44:01.551616 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:01.551579 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:44:01.642913 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:01.642861 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b638638f-d919-45b7-aa82-4818e5308708-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"b638638f-d919-45b7-aa82-4818e5308708\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 01:44:01.643640 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:01.643613 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b638638f-d919-45b7-aa82-4818e5308708-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"b638638f-d919-45b7-aa82-4818e5308708\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 01:44:01.751688 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:01.751596 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:44:01.852388 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:01.852335 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:44:01.908786 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:01.908754 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 08 01:44:01.921915 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:01.921879 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5nr7z" event={"ID":"ab2e1e98-5ab8-49f9-adf1-f8d71eb75839","Type":"ContainerStarted","Data":"fed898821cf1dafb363352f4741f544a411696204ec9f34c69e1b9be3faa571d"} Jul 08 01:44:01.924735 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:01.924699 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-xr27g" event={"ID":"3e1469f5-2f2c-44e0-b1a1-8793239f8da7","Type":"ContainerStarted","Data":"5cf4a7bf77a658539ad6e43ca1c834c790e1a75be31d2a530809d862a4a6c5d4"} Jul 08 01:44:01.926776 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:01.926744 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-zcqnl" event={"ID":"5b3a9d0f-b665-4bfd-93f1-9f845c205bd2","Type":"ContainerStarted","Data":"30a75bfb5896a1e5554f64b3798ad63d360eea42df1f9e1325cdf511730edff3"} Jul 08 01:44:02.028518 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:02.025923 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-xr27g" podStartSLOduration=1.537206329 podStartE2EDuration="3.025900627s" totalImagesPullingTime="1.488694298s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 01:43:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 01:44:02.02144547 +0000 UTC m=+122.218772327" watchObservedRunningTime="2026-07-08 01:44:02.025900627 +0000 UTC m=+122.223227483" Jul 08 01:44:02.114044 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:02.113873 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 08 01:44:02.116646 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:44:02.116618 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb638638f_d919_45b7_aa82_4818e5308708.slice/crio-5ef8fcb0630641679771d3a6262cf7fc95a8e08b6c6bee0305f7b6c02e45a70f WatchSource:0}: Error finding container 5ef8fcb0630641679771d3a6262cf7fc95a8e08b6c6bee0305f7b6c02e45a70f: Status 404 returned error can't find the container with id 5ef8fcb0630641679771d3a6262cf7fc95a8e08b6c6bee0305f7b6c02e45a70f Jul 08 01:44:02.221253 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:02.221221 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:44:02.354598 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:02.354503 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:44:02.856098 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:02.856065 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-69d55c7cdf-9cd4t"] Jul 08 01:44:02.859168 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:02.859146 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-69d55c7cdf-9cd4t" Jul 08 01:44:02.864247 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:02.864223 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 08 01:44:02.864370 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:02.864354 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 08 01:44:02.864677 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:02.864659 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 08 01:44:02.864762 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:02.864689 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-ef8ckijru072v\"" Jul 08 01:44:02.867025 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:02.866974 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-rxs4s\"" Jul 08 01:44:02.867025 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:02.866989 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 08 01:44:02.867219 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:02.867110 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 08 01:44:02.878117 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:02.878083 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-69d55c7cdf-9cd4t"] Jul 08 01:44:02.934150 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:02.934112 2563 generic.go:356] "Generic (PLEG): container finished" podID="ab2e1e98-5ab8-49f9-adf1-f8d71eb75839" containerID="fed898821cf1dafb363352f4741f544a411696204ec9f34c69e1b9be3faa571d" exitCode=0 Jul 08 01:44:02.934328 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:02.934147 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5nr7z" event={"ID":"ab2e1e98-5ab8-49f9-adf1-f8d71eb75839","Type":"ContainerDied","Data":"fed898821cf1dafb363352f4741f544a411696204ec9f34c69e1b9be3faa571d"} Jul 08 01:44:02.936230 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:02.936188 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b638638f-d919-45b7-aa82-4818e5308708","Type":"ContainerStarted","Data":"5ef8fcb0630641679771d3a6262cf7fc95a8e08b6c6bee0305f7b6c02e45a70f"} Jul 08 01:44:02.938808 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:02.938781 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-zcqnl" event={"ID":"5b3a9d0f-b665-4bfd-93f1-9f845c205bd2","Type":"ContainerStarted","Data":"8acb1b2cbe06d642336febfd5139f63ccb4868f411312be02689270b3827ea95"} Jul 08 01:44:02.938931 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:02.938834 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-zcqnl" event={"ID":"5b3a9d0f-b665-4bfd-93f1-9f845c205bd2","Type":"ContainerStarted","Data":"c6673d1e40e2e041fd019f877ef63c4a395f02259bbe2280dd4907a90aa2a6d9"} Jul 08 01:44:02.953599 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:02.953571 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4eadd54e-4cd0-4218-8627-b21db83ed247-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-69d55c7cdf-9cd4t\" (UID: \"4eadd54e-4cd0-4218-8627-b21db83ed247\") " pod="openshift-monitoring/thanos-querier-69d55c7cdf-9cd4t" Jul 08 01:44:02.953756 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:02.953606 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4eadd54e-4cd0-4218-8627-b21db83ed247-metrics-client-ca\") pod \"thanos-querier-69d55c7cdf-9cd4t\" (UID: \"4eadd54e-4cd0-4218-8627-b21db83ed247\") " pod="openshift-monitoring/thanos-querier-69d55c7cdf-9cd4t" Jul 08 01:44:02.953756 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:02.953726 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4eadd54e-4cd0-4218-8627-b21db83ed247-secret-grpc-tls\") pod \"thanos-querier-69d55c7cdf-9cd4t\" (UID: \"4eadd54e-4cd0-4218-8627-b21db83ed247\") " pod="openshift-monitoring/thanos-querier-69d55c7cdf-9cd4t" Jul 08 01:44:02.953756 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:02.953753 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/4eadd54e-4cd0-4218-8627-b21db83ed247-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-69d55c7cdf-9cd4t\" (UID: \"4eadd54e-4cd0-4218-8627-b21db83ed247\") " pod="openshift-monitoring/thanos-querier-69d55c7cdf-9cd4t" Jul 08 01:44:02.953915 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:02.953850 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/4eadd54e-4cd0-4218-8627-b21db83ed247-secret-thanos-querier-tls\") pod \"thanos-querier-69d55c7cdf-9cd4t\" (UID: \"4eadd54e-4cd0-4218-8627-b21db83ed247\") " pod="openshift-monitoring/thanos-querier-69d55c7cdf-9cd4t" Jul 08 01:44:02.953915 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:02.953889 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/4eadd54e-4cd0-4218-8627-b21db83ed247-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-69d55c7cdf-9cd4t\" (UID: \"4eadd54e-4cd0-4218-8627-b21db83ed247\") " pod="openshift-monitoring/thanos-querier-69d55c7cdf-9cd4t" Jul 08 01:44:02.954028 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:02.953945 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b9lmr\" (UniqueName: \"kubernetes.io/projected/4eadd54e-4cd0-4218-8627-b21db83ed247-kube-api-access-b9lmr\") pod \"thanos-querier-69d55c7cdf-9cd4t\" (UID: \"4eadd54e-4cd0-4218-8627-b21db83ed247\") " pod="openshift-monitoring/thanos-querier-69d55c7cdf-9cd4t" Jul 08 01:44:02.954078 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:02.954027 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4eadd54e-4cd0-4218-8627-b21db83ed247-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-69d55c7cdf-9cd4t\" (UID: \"4eadd54e-4cd0-4218-8627-b21db83ed247\") " pod="openshift-monitoring/thanos-querier-69d55c7cdf-9cd4t" Jul 08 01:44:02.984735 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:02.984688 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:44:03.006243 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:03.006164 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-zcqnl" podStartSLOduration=2.432760955 podStartE2EDuration="4.006146782s" totalImagesPullingTime="1.573385827s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 01:43:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 01:44:03.004119583 +0000 UTC m=+123.201446440" watchObservedRunningTime="2026-07-08 01:44:03.006146782 +0000 UTC m=+123.203473636" Jul 08 01:44:03.054557 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:03.054532 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4eadd54e-4cd0-4218-8627-b21db83ed247-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-69d55c7cdf-9cd4t\" (UID: \"4eadd54e-4cd0-4218-8627-b21db83ed247\") " pod="openshift-monitoring/thanos-querier-69d55c7cdf-9cd4t" Jul 08 01:44:03.054690 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:03.054674 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4eadd54e-4cd0-4218-8627-b21db83ed247-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-69d55c7cdf-9cd4t\" (UID: \"4eadd54e-4cd0-4218-8627-b21db83ed247\") " pod="openshift-monitoring/thanos-querier-69d55c7cdf-9cd4t" Jul 08 01:44:03.054748 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:03.054705 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4eadd54e-4cd0-4218-8627-b21db83ed247-metrics-client-ca\") pod \"thanos-querier-69d55c7cdf-9cd4t\" (UID: \"4eadd54e-4cd0-4218-8627-b21db83ed247\") " pod="openshift-monitoring/thanos-querier-69d55c7cdf-9cd4t" Jul 08 01:44:03.054835 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:03.054818 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4eadd54e-4cd0-4218-8627-b21db83ed247-secret-grpc-tls\") pod \"thanos-querier-69d55c7cdf-9cd4t\" (UID: \"4eadd54e-4cd0-4218-8627-b21db83ed247\") " pod="openshift-monitoring/thanos-querier-69d55c7cdf-9cd4t" Jul 08 01:44:03.054888 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:03.054857 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/4eadd54e-4cd0-4218-8627-b21db83ed247-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-69d55c7cdf-9cd4t\" (UID: \"4eadd54e-4cd0-4218-8627-b21db83ed247\") " pod="openshift-monitoring/thanos-querier-69d55c7cdf-9cd4t" Jul 08 01:44:03.054942 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:03.054921 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/4eadd54e-4cd0-4218-8627-b21db83ed247-secret-thanos-querier-tls\") pod \"thanos-querier-69d55c7cdf-9cd4t\" (UID: \"4eadd54e-4cd0-4218-8627-b21db83ed247\") " pod="openshift-monitoring/thanos-querier-69d55c7cdf-9cd4t" Jul 08 01:44:03.054990 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:03.054949 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/4eadd54e-4cd0-4218-8627-b21db83ed247-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-69d55c7cdf-9cd4t\" (UID: \"4eadd54e-4cd0-4218-8627-b21db83ed247\") " pod="openshift-monitoring/thanos-querier-69d55c7cdf-9cd4t" Jul 08 01:44:03.055041 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:03.055000 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b9lmr\" (UniqueName: \"kubernetes.io/projected/4eadd54e-4cd0-4218-8627-b21db83ed247-kube-api-access-b9lmr\") pod \"thanos-querier-69d55c7cdf-9cd4t\" (UID: \"4eadd54e-4cd0-4218-8627-b21db83ed247\") " pod="openshift-monitoring/thanos-querier-69d55c7cdf-9cd4t" Jul 08 01:44:03.056121 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:03.056059 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4eadd54e-4cd0-4218-8627-b21db83ed247-metrics-client-ca\") pod \"thanos-querier-69d55c7cdf-9cd4t\" (UID: \"4eadd54e-4cd0-4218-8627-b21db83ed247\") " pod="openshift-monitoring/thanos-querier-69d55c7cdf-9cd4t" Jul 08 01:44:03.057432 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:03.057401 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4eadd54e-4cd0-4218-8627-b21db83ed247-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-69d55c7cdf-9cd4t\" (UID: \"4eadd54e-4cd0-4218-8627-b21db83ed247\") " pod="openshift-monitoring/thanos-querier-69d55c7cdf-9cd4t" Jul 08 01:44:03.057633 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:03.057608 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4eadd54e-4cd0-4218-8627-b21db83ed247-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-69d55c7cdf-9cd4t\" (UID: \"4eadd54e-4cd0-4218-8627-b21db83ed247\") " pod="openshift-monitoring/thanos-querier-69d55c7cdf-9cd4t" Jul 08 01:44:03.057693 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:03.057671 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4eadd54e-4cd0-4218-8627-b21db83ed247-secret-grpc-tls\") pod \"thanos-querier-69d55c7cdf-9cd4t\" (UID: \"4eadd54e-4cd0-4218-8627-b21db83ed247\") " pod="openshift-monitoring/thanos-querier-69d55c7cdf-9cd4t" Jul 08 01:44:03.057772 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:03.057736 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/4eadd54e-4cd0-4218-8627-b21db83ed247-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-69d55c7cdf-9cd4t\" (UID: \"4eadd54e-4cd0-4218-8627-b21db83ed247\") " pod="openshift-monitoring/thanos-querier-69d55c7cdf-9cd4t" Jul 08 01:44:03.057817 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:03.057803 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/4eadd54e-4cd0-4218-8627-b21db83ed247-secret-thanos-querier-tls\") pod \"thanos-querier-69d55c7cdf-9cd4t\" (UID: \"4eadd54e-4cd0-4218-8627-b21db83ed247\") " pod="openshift-monitoring/thanos-querier-69d55c7cdf-9cd4t" Jul 08 01:44:03.058594 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:03.058571 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/4eadd54e-4cd0-4218-8627-b21db83ed247-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-69d55c7cdf-9cd4t\" (UID: \"4eadd54e-4cd0-4218-8627-b21db83ed247\") " pod="openshift-monitoring/thanos-querier-69d55c7cdf-9cd4t" Jul 08 01:44:03.066636 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:03.066604 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b9lmr\" (UniqueName: \"kubernetes.io/projected/4eadd54e-4cd0-4218-8627-b21db83ed247-kube-api-access-b9lmr\") pod \"thanos-querier-69d55c7cdf-9cd4t\" (UID: \"4eadd54e-4cd0-4218-8627-b21db83ed247\") " pod="openshift-monitoring/thanos-querier-69d55c7cdf-9cd4t" Jul 08 01:44:03.171023 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:03.170997 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-69d55c7cdf-9cd4t" Jul 08 01:44:03.178158 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:03.178136 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:44:03.271965 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:03.271910 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:44:03.310015 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:03.309991 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-69d55c7cdf-9cd4t"] Jul 08 01:44:03.312218 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:44:03.312173 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4eadd54e_4cd0_4218_8627_b21db83ed247.slice/crio-c913ec75b50cb0de5e5c2d9ae68789f87150354499f96fe54f8a5df2e7c9b8f5 WatchSource:0}: Error finding container c913ec75b50cb0de5e5c2d9ae68789f87150354499f96fe54f8a5df2e7c9b8f5: Status 404 returned error can't find the container with id c913ec75b50cb0de5e5c2d9ae68789f87150354499f96fe54f8a5df2e7c9b8f5 Jul 08 01:44:03.888255 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:03.888224 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:44:03.945284 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:03.945250 2563 generic.go:356] "Generic (PLEG): container finished" podID="b638638f-d919-45b7-aa82-4818e5308708" containerID="6555c509586a4aab28cb58a336117373500088900c50ffc430a852301d3db813" exitCode=0 Jul 08 01:44:03.945451 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:03.945346 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b638638f-d919-45b7-aa82-4818e5308708","Type":"ContainerDied","Data":"6555c509586a4aab28cb58a336117373500088900c50ffc430a852301d3db813"} Jul 08 01:44:03.946815 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:03.946694 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-69d55c7cdf-9cd4t" event={"ID":"4eadd54e-4cd0-4218-8627-b21db83ed247","Type":"ContainerStarted","Data":"c913ec75b50cb0de5e5c2d9ae68789f87150354499f96fe54f8a5df2e7c9b8f5"} Jul 08 01:44:03.949190 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:03.949161 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5nr7z" event={"ID":"ab2e1e98-5ab8-49f9-adf1-f8d71eb75839","Type":"ContainerStarted","Data":"a98ede0cd33fb691a7c5e553bc19de45e74b2ecaa51d37412758d92e5d0139ee"} Jul 08 01:44:03.949321 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:03.949243 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5nr7z" event={"ID":"ab2e1e98-5ab8-49f9-adf1-f8d71eb75839","Type":"ContainerStarted","Data":"7274f9edf3d849c846c84f1d101111673a4bf7b93cc31138646b87654200a22f"} Jul 08 01:44:04.013718 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:04.013660 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-5nr7z" podStartSLOduration=3.793168207 podStartE2EDuration="5.013638456s" totalImagesPullingTime="1.106592204s" totalInitContainerRuntime="113.878045ms" isStatefulPod=true podCreationTimestamp="2026-07-08 01:43:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 01:44:04.011766609 +0000 UTC m=+124.209093464" watchObservedRunningTime="2026-07-08 01:44:04.013638456 +0000 UTC m=+124.210965310" Jul 08 01:44:04.146547 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:04.146460 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-7548986fcb-5rqh8"] Jul 08 01:44:04.148912 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:04.148892 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7548986fcb-5rqh8" Jul 08 01:44:04.151727 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:04.151686 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 08 01:44:04.151857 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:04.151777 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 08 01:44:04.152032 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:04.152006 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 08 01:44:04.152119 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:04.152030 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-eqi2eo4lt2vbm\"" Jul 08 01:44:04.152119 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:04.152030 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-g7gp6\"" Jul 08 01:44:04.152119 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:04.152011 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 08 01:44:04.162424 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:04.162399 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7548986fcb-5rqh8"] Jul 08 01:44:04.166319 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:04.166254 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/2580ccd3-a6cf-40ee-a444-a64534500bc9-secret-metrics-server-tls\") pod \"metrics-server-7548986fcb-5rqh8\" (UID: \"2580ccd3-a6cf-40ee-a444-a64534500bc9\") " pod="openshift-monitoring/metrics-server-7548986fcb-5rqh8" Jul 08 01:44:04.166438 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:04.166339 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/2580ccd3-a6cf-40ee-a444-a64534500bc9-metrics-server-audit-profiles\") pod \"metrics-server-7548986fcb-5rqh8\" (UID: \"2580ccd3-a6cf-40ee-a444-a64534500bc9\") " pod="openshift-monitoring/metrics-server-7548986fcb-5rqh8" Jul 08 01:44:04.166438 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:04.166403 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2580ccd3-a6cf-40ee-a444-a64534500bc9-client-ca-bundle\") pod \"metrics-server-7548986fcb-5rqh8\" (UID: \"2580ccd3-a6cf-40ee-a444-a64534500bc9\") " pod="openshift-monitoring/metrics-server-7548986fcb-5rqh8" Jul 08 01:44:04.166561 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:04.166436 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2580ccd3-a6cf-40ee-a444-a64534500bc9-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7548986fcb-5rqh8\" (UID: \"2580ccd3-a6cf-40ee-a444-a64534500bc9\") " pod="openshift-monitoring/metrics-server-7548986fcb-5rqh8" Jul 08 01:44:04.166561 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:04.166464 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/2580ccd3-a6cf-40ee-a444-a64534500bc9-audit-log\") pod \"metrics-server-7548986fcb-5rqh8\" (UID: \"2580ccd3-a6cf-40ee-a444-a64534500bc9\") " pod="openshift-monitoring/metrics-server-7548986fcb-5rqh8" Jul 08 01:44:04.166561 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:04.166500 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/2580ccd3-a6cf-40ee-a444-a64534500bc9-secret-metrics-server-client-certs\") pod \"metrics-server-7548986fcb-5rqh8\" (UID: \"2580ccd3-a6cf-40ee-a444-a64534500bc9\") " pod="openshift-monitoring/metrics-server-7548986fcb-5rqh8" Jul 08 01:44:04.166561 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:04.166521 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ll6pj\" (UniqueName: \"kubernetes.io/projected/2580ccd3-a6cf-40ee-a444-a64534500bc9-kube-api-access-ll6pj\") pod \"metrics-server-7548986fcb-5rqh8\" (UID: \"2580ccd3-a6cf-40ee-a444-a64534500bc9\") " pod="openshift-monitoring/metrics-server-7548986fcb-5rqh8" Jul 08 01:44:04.267771 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:04.267722 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/2580ccd3-a6cf-40ee-a444-a64534500bc9-secret-metrics-server-tls\") pod \"metrics-server-7548986fcb-5rqh8\" (UID: \"2580ccd3-a6cf-40ee-a444-a64534500bc9\") " pod="openshift-monitoring/metrics-server-7548986fcb-5rqh8" Jul 08 01:44:04.267771 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:04.267777 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/2580ccd3-a6cf-40ee-a444-a64534500bc9-metrics-server-audit-profiles\") pod \"metrics-server-7548986fcb-5rqh8\" (UID: \"2580ccd3-a6cf-40ee-a444-a64534500bc9\") " pod="openshift-monitoring/metrics-server-7548986fcb-5rqh8" Jul 08 01:44:04.267984 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:04.267818 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2580ccd3-a6cf-40ee-a444-a64534500bc9-client-ca-bundle\") pod \"metrics-server-7548986fcb-5rqh8\" (UID: \"2580ccd3-a6cf-40ee-a444-a64534500bc9\") " pod="openshift-monitoring/metrics-server-7548986fcb-5rqh8" Jul 08 01:44:04.267984 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:04.267846 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2580ccd3-a6cf-40ee-a444-a64534500bc9-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7548986fcb-5rqh8\" (UID: \"2580ccd3-a6cf-40ee-a444-a64534500bc9\") " pod="openshift-monitoring/metrics-server-7548986fcb-5rqh8" Jul 08 01:44:04.267984 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:04.267911 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/2580ccd3-a6cf-40ee-a444-a64534500bc9-audit-log\") pod \"metrics-server-7548986fcb-5rqh8\" (UID: \"2580ccd3-a6cf-40ee-a444-a64534500bc9\") " pod="openshift-monitoring/metrics-server-7548986fcb-5rqh8" Jul 08 01:44:04.267984 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:04.267967 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/2580ccd3-a6cf-40ee-a444-a64534500bc9-secret-metrics-server-client-certs\") pod \"metrics-server-7548986fcb-5rqh8\" (UID: \"2580ccd3-a6cf-40ee-a444-a64534500bc9\") " pod="openshift-monitoring/metrics-server-7548986fcb-5rqh8" Jul 08 01:44:04.268165 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:04.267994 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ll6pj\" (UniqueName: \"kubernetes.io/projected/2580ccd3-a6cf-40ee-a444-a64534500bc9-kube-api-access-ll6pj\") pod \"metrics-server-7548986fcb-5rqh8\" (UID: \"2580ccd3-a6cf-40ee-a444-a64534500bc9\") " pod="openshift-monitoring/metrics-server-7548986fcb-5rqh8" Jul 08 01:44:04.268373 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:04.268351 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/2580ccd3-a6cf-40ee-a444-a64534500bc9-audit-log\") pod \"metrics-server-7548986fcb-5rqh8\" (UID: \"2580ccd3-a6cf-40ee-a444-a64534500bc9\") " pod="openshift-monitoring/metrics-server-7548986fcb-5rqh8" Jul 08 01:44:04.268706 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:04.268686 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2580ccd3-a6cf-40ee-a444-a64534500bc9-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7548986fcb-5rqh8\" (UID: \"2580ccd3-a6cf-40ee-a444-a64534500bc9\") " pod="openshift-monitoring/metrics-server-7548986fcb-5rqh8" Jul 08 01:44:04.269042 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:04.269016 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/2580ccd3-a6cf-40ee-a444-a64534500bc9-metrics-server-audit-profiles\") pod \"metrics-server-7548986fcb-5rqh8\" (UID: \"2580ccd3-a6cf-40ee-a444-a64534500bc9\") " pod="openshift-monitoring/metrics-server-7548986fcb-5rqh8" Jul 08 01:44:04.270396 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:04.270366 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/2580ccd3-a6cf-40ee-a444-a64534500bc9-secret-metrics-server-tls\") pod \"metrics-server-7548986fcb-5rqh8\" (UID: \"2580ccd3-a6cf-40ee-a444-a64534500bc9\") " pod="openshift-monitoring/metrics-server-7548986fcb-5rqh8" Jul 08 01:44:04.270507 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:04.270406 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2580ccd3-a6cf-40ee-a444-a64534500bc9-client-ca-bundle\") pod \"metrics-server-7548986fcb-5rqh8\" (UID: \"2580ccd3-a6cf-40ee-a444-a64534500bc9\") " pod="openshift-monitoring/metrics-server-7548986fcb-5rqh8" Jul 08 01:44:04.270507 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:04.270489 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/2580ccd3-a6cf-40ee-a444-a64534500bc9-secret-metrics-server-client-certs\") pod \"metrics-server-7548986fcb-5rqh8\" (UID: \"2580ccd3-a6cf-40ee-a444-a64534500bc9\") " pod="openshift-monitoring/metrics-server-7548986fcb-5rqh8" Jul 08 01:44:04.281207 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:04.281174 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ll6pj\" (UniqueName: \"kubernetes.io/projected/2580ccd3-a6cf-40ee-a444-a64534500bc9-kube-api-access-ll6pj\") pod \"metrics-server-7548986fcb-5rqh8\" (UID: \"2580ccd3-a6cf-40ee-a444-a64534500bc9\") " pod="openshift-monitoring/metrics-server-7548986fcb-5rqh8" Jul 08 01:44:04.460378 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:04.460341 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7548986fcb-5rqh8" Jul 08 01:44:04.569520 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:04.569487 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:44:04.640626 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:04.640594 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:44:04.645791 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:04.645765 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7548986fcb-5rqh8"] Jul 08 01:44:04.648223 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:44:04.648183 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2580ccd3_a6cf_40ee_a444_a64534500bc9.slice/crio-6348d3bb6a04ef012b22fe87aa0b48280aaf062b32f4a350eb846aa002d96471 WatchSource:0}: Error finding container 6348d3bb6a04ef012b22fe87aa0b48280aaf062b32f4a350eb846aa002d96471: Status 404 returned error can't find the container with id 6348d3bb6a04ef012b22fe87aa0b48280aaf062b32f4a350eb846aa002d96471 Jul 08 01:44:04.897154 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:04.897065 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:44:04.957005 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:04.956966 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:44:04.959147 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:04.959115 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7548986fcb-5rqh8" event={"ID":"2580ccd3-a6cf-40ee-a444-a64534500bc9","Type":"ContainerStarted","Data":"6348d3bb6a04ef012b22fe87aa0b48280aaf062b32f4a350eb846aa002d96471"} Jul 08 01:44:05.967156 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:05.967119 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b638638f-d919-45b7-aa82-4818e5308708","Type":"ContainerStarted","Data":"1b2cd219b58e956f6cdd18e0e9384f51a8a1dcaaa74686aeff0cca97a561bab8"} Jul 08 01:44:05.967616 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:05.967230 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b638638f-d919-45b7-aa82-4818e5308708","Type":"ContainerStarted","Data":"91841f69d04c4fc0b6207844cdd73dac1442572f6affcc066996a64ab9ae0ecd"} Jul 08 01:44:05.967616 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:05.967279 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b638638f-d919-45b7-aa82-4818e5308708","Type":"ContainerStarted","Data":"6c12e6bb24c4813eb94be9be51a6fa2aa6009cc8ebcb1093e23e19a03bf2d86e"} Jul 08 01:44:05.967616 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:05.967318 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b638638f-d919-45b7-aa82-4818e5308708","Type":"ContainerStarted","Data":"d7b2dda6696da3ae6c408f93ebb83bd54b979fd30031785c25ed234dfc96b135"} Jul 08 01:44:05.969543 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:05.969512 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-69d55c7cdf-9cd4t" event={"ID":"4eadd54e-4cd0-4218-8627-b21db83ed247","Type":"ContainerStarted","Data":"93d196469007ddca7d2200a6889633878f5a9612733738ea09ccd9f23a4114da"} Jul 08 01:44:05.969675 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:05.969587 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-69d55c7cdf-9cd4t" event={"ID":"4eadd54e-4cd0-4218-8627-b21db83ed247","Type":"ContainerStarted","Data":"a216db41926e50fe4417864bfdac7971869966a406f0009bf98a6aab7bef896b"} Jul 08 01:44:05.969675 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:05.969626 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-69d55c7cdf-9cd4t" event={"ID":"4eadd54e-4cd0-4218-8627-b21db83ed247","Type":"ContainerStarted","Data":"d3b7ac18c018eb929a4061e98e02be83711edbd8e616f3ba248aee03d8160440"} Jul 08 01:44:06.217615 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:06.217580 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 08 01:44:06.219977 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:06.219950 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:44:06.221193 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:06.221176 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 08 01:44:06.223901 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:06.223873 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 08 01:44:06.224004 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:06.223949 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-qxv4v\"" Jul 08 01:44:06.224065 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:06.224026 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 08 01:44:06.224065 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:06.224035 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 08 01:44:06.224900 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:06.224679 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 08 01:44:06.224900 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:06.224701 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 08 01:44:06.224900 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:06.224714 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 08 01:44:06.224900 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:06.224790 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 08 01:44:06.224900 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:06.224716 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-d5q4ai0pubjvs\"" Jul 08 01:44:06.224900 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:06.224832 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 08 01:44:06.225265 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:06.225162 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 08 01:44:06.225265 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:06.225151 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 08 01:44:06.225887 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:06.225665 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 08 01:44:06.225887 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:06.225710 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 08 01:44:06.225887 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:06.225714 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 08 01:44:06.227747 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:06.227727 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 08 01:44:06.238809 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:06.238780 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 08 01:44:06.289114 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:06.289071 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8454f12b-eb6b-4003-bffa-05b00de97455-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"8454f12b-eb6b-4003-bffa-05b00de97455\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 01:44:06.289320 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:06.289141 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8454f12b-eb6b-4003-bffa-05b00de97455-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8454f12b-eb6b-4003-bffa-05b00de97455\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 01:44:06.289320 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:06.289242 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8454f12b-eb6b-4003-bffa-05b00de97455-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8454f12b-eb6b-4003-bffa-05b00de97455\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 01:44:06.289320 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:06.289299 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8454f12b-eb6b-4003-bffa-05b00de97455-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8454f12b-eb6b-4003-bffa-05b00de97455\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 01:44:06.289474 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:06.289333 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8454f12b-eb6b-4003-bffa-05b00de97455-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8454f12b-eb6b-4003-bffa-05b00de97455\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 01:44:06.289474 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:06.289351 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8454f12b-eb6b-4003-bffa-05b00de97455-web-config\") pod \"prometheus-k8s-0\" (UID: \"8454f12b-eb6b-4003-bffa-05b00de97455\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 01:44:06.289474 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:06.289447 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/8454f12b-eb6b-4003-bffa-05b00de97455-config\") pod \"prometheus-k8s-0\" (UID: \"8454f12b-eb6b-4003-bffa-05b00de97455\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 01:44:06.289603 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:06.289481 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8454f12b-eb6b-4003-bffa-05b00de97455-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8454f12b-eb6b-4003-bffa-05b00de97455\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 01:44:06.289603 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:06.289517 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8454f12b-eb6b-4003-bffa-05b00de97455-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8454f12b-eb6b-4003-bffa-05b00de97455\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 01:44:06.289603 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:06.289568 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8454f12b-eb6b-4003-bffa-05b00de97455-config-out\") pod \"prometheus-k8s-0\" (UID: \"8454f12b-eb6b-4003-bffa-05b00de97455\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 01:44:06.289751 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:06.289631 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8454f12b-eb6b-4003-bffa-05b00de97455-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8454f12b-eb6b-4003-bffa-05b00de97455\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 01:44:06.289751 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:06.289672 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8454f12b-eb6b-4003-bffa-05b00de97455-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8454f12b-eb6b-4003-bffa-05b00de97455\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 01:44:06.289751 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:06.289700 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8454f12b-eb6b-4003-bffa-05b00de97455-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8454f12b-eb6b-4003-bffa-05b00de97455\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 01:44:06.289751 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:06.289724 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lj5wz\" (UniqueName: \"kubernetes.io/projected/8454f12b-eb6b-4003-bffa-05b00de97455-kube-api-access-lj5wz\") pod \"prometheus-k8s-0\" (UID: \"8454f12b-eb6b-4003-bffa-05b00de97455\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 01:44:06.289943 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:06.289784 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8454f12b-eb6b-4003-bffa-05b00de97455-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8454f12b-eb6b-4003-bffa-05b00de97455\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 01:44:06.289943 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:06.289848 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8454f12b-eb6b-4003-bffa-05b00de97455-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8454f12b-eb6b-4003-bffa-05b00de97455\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 01:44:06.289943 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:06.289893 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8454f12b-eb6b-4003-bffa-05b00de97455-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"8454f12b-eb6b-4003-bffa-05b00de97455\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 01:44:06.289943 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:06.289910 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8454f12b-eb6b-4003-bffa-05b00de97455-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8454f12b-eb6b-4003-bffa-05b00de97455\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 01:44:06.289943 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:06.289936 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8454f12b-eb6b-4003-bffa-05b00de97455-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8454f12b-eb6b-4003-bffa-05b00de97455\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 01:44:06.290160 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:06.289973 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8454f12b-eb6b-4003-bffa-05b00de97455-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8454f12b-eb6b-4003-bffa-05b00de97455\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 01:44:06.391344 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:06.391305 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8454f12b-eb6b-4003-bffa-05b00de97455-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8454f12b-eb6b-4003-bffa-05b00de97455\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 01:44:06.391344 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:06.391342 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lj5wz\" (UniqueName: \"kubernetes.io/projected/8454f12b-eb6b-4003-bffa-05b00de97455-kube-api-access-lj5wz\") pod \"prometheus-k8s-0\" (UID: \"8454f12b-eb6b-4003-bffa-05b00de97455\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 01:44:06.391541 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:06.391365 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8454f12b-eb6b-4003-bffa-05b00de97455-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8454f12b-eb6b-4003-bffa-05b00de97455\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 01:44:06.391541 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:06.391392 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8454f12b-eb6b-4003-bffa-05b00de97455-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8454f12b-eb6b-4003-bffa-05b00de97455\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 01:44:06.391541 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:06.391420 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8454f12b-eb6b-4003-bffa-05b00de97455-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"8454f12b-eb6b-4003-bffa-05b00de97455\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 01:44:06.391541 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:06.391442 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8454f12b-eb6b-4003-bffa-05b00de97455-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8454f12b-eb6b-4003-bffa-05b00de97455\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 01:44:06.391541 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:06.391467 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8454f12b-eb6b-4003-bffa-05b00de97455-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8454f12b-eb6b-4003-bffa-05b00de97455\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 01:44:06.391541 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:06.391509 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8454f12b-eb6b-4003-bffa-05b00de97455-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8454f12b-eb6b-4003-bffa-05b00de97455\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 01:44:06.391541 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:06.391540 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8454f12b-eb6b-4003-bffa-05b00de97455-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"8454f12b-eb6b-4003-bffa-05b00de97455\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 01:44:06.391887 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:06.391585 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8454f12b-eb6b-4003-bffa-05b00de97455-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8454f12b-eb6b-4003-bffa-05b00de97455\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 01:44:06.391887 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:06.391640 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8454f12b-eb6b-4003-bffa-05b00de97455-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8454f12b-eb6b-4003-bffa-05b00de97455\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 01:44:06.391887 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:06.391674 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8454f12b-eb6b-4003-bffa-05b00de97455-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8454f12b-eb6b-4003-bffa-05b00de97455\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 01:44:06.391887 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:06.391719 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8454f12b-eb6b-4003-bffa-05b00de97455-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8454f12b-eb6b-4003-bffa-05b00de97455\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 01:44:06.391887 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:06.391717 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8454f12b-eb6b-4003-bffa-05b00de97455-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8454f12b-eb6b-4003-bffa-05b00de97455\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 01:44:06.392141 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:06.392086 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8454f12b-eb6b-4003-bffa-05b00de97455-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"8454f12b-eb6b-4003-bffa-05b00de97455\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 01:44:06.392933 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:06.392892 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8454f12b-eb6b-4003-bffa-05b00de97455-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"8454f12b-eb6b-4003-bffa-05b00de97455\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 01:44:06.393007 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:06.392974 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8454f12b-eb6b-4003-bffa-05b00de97455-web-config\") pod \"prometheus-k8s-0\" (UID: \"8454f12b-eb6b-4003-bffa-05b00de97455\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 01:44:06.393062 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:06.393028 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/8454f12b-eb6b-4003-bffa-05b00de97455-config\") pod \"prometheus-k8s-0\" (UID: \"8454f12b-eb6b-4003-bffa-05b00de97455\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 01:44:06.393120 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:06.393074 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8454f12b-eb6b-4003-bffa-05b00de97455-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8454f12b-eb6b-4003-bffa-05b00de97455\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 01:44:06.393120 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:06.393114 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8454f12b-eb6b-4003-bffa-05b00de97455-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8454f12b-eb6b-4003-bffa-05b00de97455\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 01:44:06.393239 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:06.393131 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8454f12b-eb6b-4003-bffa-05b00de97455-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8454f12b-eb6b-4003-bffa-05b00de97455\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 01:44:06.393239 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:06.393146 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8454f12b-eb6b-4003-bffa-05b00de97455-config-out\") pod \"prometheus-k8s-0\" (UID: \"8454f12b-eb6b-4003-bffa-05b00de97455\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 01:44:06.393239 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:06.393228 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8454f12b-eb6b-4003-bffa-05b00de97455-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8454f12b-eb6b-4003-bffa-05b00de97455\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 01:44:06.393382 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:06.393280 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8454f12b-eb6b-4003-bffa-05b00de97455-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8454f12b-eb6b-4003-bffa-05b00de97455\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 01:44:06.395120 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:06.394274 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8454f12b-eb6b-4003-bffa-05b00de97455-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8454f12b-eb6b-4003-bffa-05b00de97455\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 01:44:06.395120 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:06.394575 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8454f12b-eb6b-4003-bffa-05b00de97455-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8454f12b-eb6b-4003-bffa-05b00de97455\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 01:44:06.395120 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:06.394941 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8454f12b-eb6b-4003-bffa-05b00de97455-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8454f12b-eb6b-4003-bffa-05b00de97455\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 01:44:06.396238 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:06.396098 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8454f12b-eb6b-4003-bffa-05b00de97455-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8454f12b-eb6b-4003-bffa-05b00de97455\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 01:44:06.398116 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:06.397871 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8454f12b-eb6b-4003-bffa-05b00de97455-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8454f12b-eb6b-4003-bffa-05b00de97455\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 01:44:06.398116 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:06.397886 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8454f12b-eb6b-4003-bffa-05b00de97455-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8454f12b-eb6b-4003-bffa-05b00de97455\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 01:44:06.398116 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:06.398047 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8454f12b-eb6b-4003-bffa-05b00de97455-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8454f12b-eb6b-4003-bffa-05b00de97455\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 01:44:06.398116 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:06.398067 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8454f12b-eb6b-4003-bffa-05b00de97455-web-config\") pod \"prometheus-k8s-0\" (UID: \"8454f12b-eb6b-4003-bffa-05b00de97455\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 01:44:06.398393 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:06.398158 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8454f12b-eb6b-4003-bffa-05b00de97455-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8454f12b-eb6b-4003-bffa-05b00de97455\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 01:44:06.398393 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:06.398280 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8454f12b-eb6b-4003-bffa-05b00de97455-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8454f12b-eb6b-4003-bffa-05b00de97455\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 01:44:06.398806 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:06.398668 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8454f12b-eb6b-4003-bffa-05b00de97455-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8454f12b-eb6b-4003-bffa-05b00de97455\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 01:44:06.398806 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:06.398746 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8454f12b-eb6b-4003-bffa-05b00de97455-config-out\") pod \"prometheus-k8s-0\" (UID: \"8454f12b-eb6b-4003-bffa-05b00de97455\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 01:44:06.399041 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:06.398840 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8454f12b-eb6b-4003-bffa-05b00de97455-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8454f12b-eb6b-4003-bffa-05b00de97455\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 01:44:06.399041 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:06.398880 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/8454f12b-eb6b-4003-bffa-05b00de97455-config\") pod \"prometheus-k8s-0\" (UID: \"8454f12b-eb6b-4003-bffa-05b00de97455\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 01:44:06.399134 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:06.399115 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8454f12b-eb6b-4003-bffa-05b00de97455-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8454f12b-eb6b-4003-bffa-05b00de97455\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 01:44:06.404522 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:06.404500 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lj5wz\" (UniqueName: \"kubernetes.io/projected/8454f12b-eb6b-4003-bffa-05b00de97455-kube-api-access-lj5wz\") pod \"prometheus-k8s-0\" (UID: \"8454f12b-eb6b-4003-bffa-05b00de97455\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 01:44:06.514981 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:06.514899 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:44:06.534057 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:06.534017 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 08 01:44:06.580727 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:06.580694 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:44:06.694121 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:06.694083 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 08 01:44:06.704830 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:44:06.704796 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8454f12b_eb6b_4003_bffa_05b00de97455.slice/crio-653746afeaf00139e95557bb08e0f19f4f12985ffc71d529b750484d568c2492 WatchSource:0}: Error finding container 653746afeaf00139e95557bb08e0f19f4f12985ffc71d529b750484d568c2492: Status 404 returned error can't find the container with id 653746afeaf00139e95557bb08e0f19f4f12985ffc71d529b750484d568c2492 Jul 08 01:44:06.975359 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:06.975329 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7548986fcb-5rqh8" event={"ID":"2580ccd3-a6cf-40ee-a444-a64534500bc9","Type":"ContainerStarted","Data":"c55b8d3f4b08c68fbb8fc2a9bf09739c32256dea4b4d5298d7dbe275e744c94b"} Jul 08 01:44:06.978872 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:06.978830 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b638638f-d919-45b7-aa82-4818e5308708","Type":"ContainerStarted","Data":"38486d1816b0ca1bdfb355f7fcd4fba15596040a0a40bbadd18323f548356add"} Jul 08 01:44:06.978972 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:06.978901 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b638638f-d919-45b7-aa82-4818e5308708","Type":"ContainerStarted","Data":"c0e37484027d3cf5f47f346f63b28c7190b5a18bc6413a79b878ee6ace9146bd"} Jul 08 01:44:06.981941 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:06.981914 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-69d55c7cdf-9cd4t" event={"ID":"4eadd54e-4cd0-4218-8627-b21db83ed247","Type":"ContainerStarted","Data":"0d103ee4b5aa47e2dccbc7b72c41737cfdbf8ee6ff7a27e499b49479ba473093"} Jul 08 01:44:06.982035 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:06.981995 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-69d55c7cdf-9cd4t" Jul 08 01:44:06.982095 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:06.982039 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-69d55c7cdf-9cd4t" event={"ID":"4eadd54e-4cd0-4218-8627-b21db83ed247","Type":"ContainerStarted","Data":"759473faa1d0f732b17533935d0819ccc2b07a3403e6ce692af51b605dc5d0e9"} Jul 08 01:44:06.983504 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:06.983480 2563 generic.go:356] "Generic (PLEG): container finished" podID="8454f12b-eb6b-4003-bffa-05b00de97455" containerID="d59c6fd4c3503e788cef48720325e3aa2dee45720a1519714c1ec2c8fb7150eb" exitCode=0 Jul 08 01:44:06.983570 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:06.983528 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8454f12b-eb6b-4003-bffa-05b00de97455","Type":"ContainerDied","Data":"d59c6fd4c3503e788cef48720325e3aa2dee45720a1519714c1ec2c8fb7150eb"} Jul 08 01:44:06.983608 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:06.983585 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8454f12b-eb6b-4003-bffa-05b00de97455","Type":"ContainerStarted","Data":"653746afeaf00139e95557bb08e0f19f4f12985ffc71d529b750484d568c2492"} Jul 08 01:44:06.995939 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:06.995885 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-7548986fcb-5rqh8" podStartSLOduration=1.3093640309999999 podStartE2EDuration="2.995866156s" totalImagesPullingTime="1.686502125s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 01:44:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 01:44:06.995026559 +0000 UTC m=+127.192353451" watchObservedRunningTime="2026-07-08 01:44:06.995866156 +0000 UTC m=+127.193193013" Jul 08 01:44:07.019092 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:07.018990 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-69d55c7cdf-9cd4t" podStartSLOduration=1.822296562 podStartE2EDuration="5.018971562s" totalImagesPullingTime="3.196675s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 01:44:02 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 01:44:07.018396036 +0000 UTC m=+127.215722893" watchObservedRunningTime="2026-07-08 01:44:07.018971562 +0000 UTC m=+127.216298416" Jul 08 01:44:07.046567 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:07.046507 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.982433909 podStartE2EDuration="7.046489381s" totalImagesPullingTime="3.040552437s" totalInitContainerRuntime="23.503035ms" isStatefulPod=false podCreationTimestamp="2026-07-08 01:44:00 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 01:44:07.044799635 +0000 UTC m=+127.242126488" watchObservedRunningTime="2026-07-08 01:44:07.046489381 +0000 UTC m=+127.243816235" Jul 08 01:44:07.991972 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:07.991928 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-69d55c7cdf-9cd4t" event={"ID":"4eadd54e-4cd0-4218-8627-b21db83ed247","Type":"ContainerStarted","Data":"627612098fee37dd3af1597899b6f65ae3451c3c6745b766c127fdcbe0bf82be"} Jul 08 01:44:09.128978 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:09.128939 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:44:09.187821 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:09.187780 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:44:10.130869 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:10.130843 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c391d2cf-3212-40c8-9456-a38c24ba080d-metrics-certs\") pod \"network-metrics-daemon-w4psj\" (UID: \"c391d2cf-3212-40c8-9456-a38c24ba080d\") " pod="openshift-multus/network-metrics-daemon-w4psj" Jul 08 01:44:10.134454 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:10.134163 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c391d2cf-3212-40c8-9456-a38c24ba080d-metrics-certs\") pod \"network-metrics-daemon-w4psj\" (UID: \"c391d2cf-3212-40c8-9456-a38c24ba080d\") " pod="openshift-multus/network-metrics-daemon-w4psj" Jul 08 01:44:10.318390 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:10.318366 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-wrx2c\"" Jul 08 01:44:10.326632 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:10.326610 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w4psj" Jul 08 01:44:10.472865 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:10.472831 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-w4psj"] Jul 08 01:44:10.476451 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:44:10.476422 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc391d2cf_3212_40c8_9456_a38c24ba080d.slice/crio-b691040b37b03dc6ad99311f273fdf5b48784e7295787fc120306c7c3497ae92 WatchSource:0}: Error finding container b691040b37b03dc6ad99311f273fdf5b48784e7295787fc120306c7c3497ae92: Status 404 returned error can't find the container with id b691040b37b03dc6ad99311f273fdf5b48784e7295787fc120306c7c3497ae92 Jul 08 01:44:10.511978 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:10.511901 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:44:10.613733 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:10.613704 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:44:11.008056 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:11.008023 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-w4psj" event={"ID":"c391d2cf-3212-40c8-9456-a38c24ba080d","Type":"ContainerStarted","Data":"b691040b37b03dc6ad99311f273fdf5b48784e7295787fc120306c7c3497ae92"} Jul 08 01:44:11.013641 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:11.013605 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8454f12b-eb6b-4003-bffa-05b00de97455","Type":"ContainerStarted","Data":"4d8d8643b1a655c97a579f3c5e760cf9bef4486fadbd6b18b736d78d4376cf49"} Jul 08 01:44:11.013778 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:11.013676 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8454f12b-eb6b-4003-bffa-05b00de97455","Type":"ContainerStarted","Data":"d96d0fd86546e227491ebc79bd18d3ffda58339021636d8418af2af72f11f9ac"} Jul 08 01:44:11.013778 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:11.013709 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8454f12b-eb6b-4003-bffa-05b00de97455","Type":"ContainerStarted","Data":"67293e88bdc2aa83ea4b1a1f59dace5df32578755158bb7988971f131e519b11"} Jul 08 01:44:11.013778 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:11.013743 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8454f12b-eb6b-4003-bffa-05b00de97455","Type":"ContainerStarted","Data":"937434d3b490d52c33f42fba35b72abc651a40c90d10ca03ca202eb12df3513e"} Jul 08 01:44:11.013778 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:11.013766 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8454f12b-eb6b-4003-bffa-05b00de97455","Type":"ContainerStarted","Data":"dea8041483fe16e543189a14ef90e2b4ff5713ee971b0f637843b6b57e39723c"} Jul 08 01:44:11.013979 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:11.013801 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8454f12b-eb6b-4003-bffa-05b00de97455","Type":"ContainerStarted","Data":"babd11c9b9aeafdc241bd0689258ad233e04d9ca903e0a050d7bf30665695005"} Jul 08 01:44:11.074444 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:11.074387 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.041005832 podStartE2EDuration="5.074367121s" totalImagesPullingTime="3.009295205s" totalInitContainerRuntime="24.066084ms" isStatefulPod=false podCreationTimestamp="2026-07-08 01:44:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 01:44:11.074297701 +0000 UTC m=+131.271624557" watchObservedRunningTime="2026-07-08 01:44:11.074367121 +0000 UTC m=+131.271693978" Jul 08 01:44:11.279579 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:11.279504 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:44:11.367467 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:11.367433 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:44:11.534582 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:11.534504 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 08 01:44:12.019680 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:12.019639 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-w4psj" event={"ID":"c391d2cf-3212-40c8-9456-a38c24ba080d","Type":"ContainerStarted","Data":"4d1fb812e25dafa9dd83486a752dbcbf8c336e9be3a9e87ce873de556d598ace"} Jul 08 01:44:12.019886 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:12.019701 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-w4psj" event={"ID":"c391d2cf-3212-40c8-9456-a38c24ba080d","Type":"ContainerStarted","Data":"e40efd1d65e70466b439ba844a9e3dea42fbda9df618d2b8fc35f2e838d09c0f"} Jul 08 01:44:12.233523 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:12.233491 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:44:12.352887 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:12.352814 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:44:12.676405 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:12.676370 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:44:12.952883 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:12.952805 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:44:13.055582 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:13.055544 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:44:14.003189 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:14.003165 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-69d55c7cdf-9cd4t" Jul 08 01:44:14.073304 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:14.073275 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:44:14.089992 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:14.089925 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-w4psj" podStartSLOduration=132.252527456 podStartE2EDuration="2m13.089904197s" totalImagesPullingTime="837.376741ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 01:42:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 01:44:12.052833282 +0000 UTC m=+132.250160136" watchObservedRunningTime="2026-07-08 01:44:14.089904197 +0000 UTC m=+134.287231256" Jul 08 01:44:14.248755 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:14.248726 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:44:14.326042 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:14.325951 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:44:15.543883 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:15.543825 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:44:15.607699 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:15.607659 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:44:17.196626 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:17.196594 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:44:17.297644 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:17.297611 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:44:17.354494 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:17.354461 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:44:20.589549 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:20.589514 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:44:20.650523 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:20.650491 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:44:23.066027 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:23.065991 2563 generic.go:356] "Generic (PLEG): container finished" podID="ba7355ad-22c6-4a3e-ab65-5f13466b4dfb" containerID="edacba5da9018164a93d750823248b61035184426a2648d9c213b12293210b8a" exitCode=0 Jul 08 01:44:23.066481 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:23.066065 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-znsjt" event={"ID":"ba7355ad-22c6-4a3e-ab65-5f13466b4dfb","Type":"ContainerDied","Data":"edacba5da9018164a93d750823248b61035184426a2648d9c213b12293210b8a"} Jul 08 01:44:23.066481 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:23.066379 2563 scope.go:117] "RemoveContainer" containerID="edacba5da9018164a93d750823248b61035184426a2648d9c213b12293210b8a" Jul 08 01:44:24.071772 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:24.071739 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-znsjt" event={"ID":"ba7355ad-22c6-4a3e-ab65-5f13466b4dfb","Type":"ContainerStarted","Data":"46112ff935e7d14e63fea6779cfd54ce10af53ba8582deae13e53e9554c6a079"} Jul 08 01:44:24.461245 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:24.461212 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-7548986fcb-5rqh8" Jul 08 01:44:24.461408 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:24.461280 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-7548986fcb-5rqh8" Jul 08 01:44:35.592921 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:35.592884 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:44:35.650662 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:35.650628 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:44:42.145603 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:42.145569 2563 generic.go:356] "Generic (PLEG): container finished" podID="f6640b83-15b8-45d6-93cd-83809ee952e1" containerID="655bdb2fffc619a6511fcfd0ca08216b05c535f62e473dbab0b835be29517c33" exitCode=0 Jul 08 01:44:42.145984 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:42.145611 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-2zk7n" event={"ID":"f6640b83-15b8-45d6-93cd-83809ee952e1","Type":"ContainerDied","Data":"655bdb2fffc619a6511fcfd0ca08216b05c535f62e473dbab0b835be29517c33"} Jul 08 01:44:42.145984 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:42.145909 2563 scope.go:117] "RemoveContainer" containerID="655bdb2fffc619a6511fcfd0ca08216b05c535f62e473dbab0b835be29517c33" Jul 08 01:44:43.151718 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:43.151678 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-2zk7n" event={"ID":"f6640b83-15b8-45d6-93cd-83809ee952e1","Type":"ContainerStarted","Data":"61a89fe18c3398802c8c36acfd3c7f6700b459424ea4584ad384604794ea0a97"} Jul 08 01:44:44.466180 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:44.466150 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-7548986fcb-5rqh8" Jul 08 01:44:44.470127 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:44:44.470097 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-7548986fcb-5rqh8" Jul 08 01:45:06.534897 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:06.534864 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 08 01:45:06.556982 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:06.556946 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 08 01:45:07.266951 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:07.266920 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 08 01:45:11.970784 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:11.970723 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:45:19.239731 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:19.239659 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:45:19.508338 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:19.508242 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:45:20.293943 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:20.293908 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 08 01:45:20.294367 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:20.294254 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="b638638f-d919-45b7-aa82-4818e5308708" containerName="alertmanager" containerID="cri-o://d7b2dda6696da3ae6c408f93ebb83bd54b979fd30031785c25ed234dfc96b135" gracePeriod=120 Jul 08 01:45:20.294367 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:20.294265 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="b638638f-d919-45b7-aa82-4818e5308708" containerName="kube-rbac-proxy" containerID="cri-o://1b2cd219b58e956f6cdd18e0e9384f51a8a1dcaaa74686aeff0cca97a561bab8" gracePeriod=120 Jul 08 01:45:20.294367 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:20.294260 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="b638638f-d919-45b7-aa82-4818e5308708" containerName="prom-label-proxy" containerID="cri-o://38486d1816b0ca1bdfb355f7fcd4fba15596040a0a40bbadd18323f548356add" gracePeriod=120 Jul 08 01:45:20.294367 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:20.294300 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="b638638f-d919-45b7-aa82-4818e5308708" containerName="kube-rbac-proxy-metric" containerID="cri-o://c0e37484027d3cf5f47f346f63b28c7190b5a18bc6413a79b878ee6ace9146bd" gracePeriod=120 Jul 08 01:45:20.294367 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:20.294335 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="b638638f-d919-45b7-aa82-4818e5308708" containerName="config-reloader" containerID="cri-o://6c12e6bb24c4813eb94be9be51a6fa2aa6009cc8ebcb1093e23e19a03bf2d86e" gracePeriod=120 Jul 08 01:45:20.294626 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:20.294352 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="b638638f-d919-45b7-aa82-4818e5308708" containerName="kube-rbac-proxy-web" containerID="cri-o://91841f69d04c4fc0b6207844cdd73dac1442572f6affcc066996a64ab9ae0ecd" gracePeriod=120 Jul 08 01:45:21.314228 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:21.314178 2563 generic.go:356] "Generic (PLEG): container finished" podID="b638638f-d919-45b7-aa82-4818e5308708" containerID="38486d1816b0ca1bdfb355f7fcd4fba15596040a0a40bbadd18323f548356add" exitCode=0 Jul 08 01:45:21.314228 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:21.314222 2563 generic.go:356] "Generic (PLEG): container finished" podID="b638638f-d919-45b7-aa82-4818e5308708" containerID="c0e37484027d3cf5f47f346f63b28c7190b5a18bc6413a79b878ee6ace9146bd" exitCode=0 Jul 08 01:45:21.314228 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:21.314234 2563 generic.go:356] "Generic (PLEG): container finished" podID="b638638f-d919-45b7-aa82-4818e5308708" containerID="1b2cd219b58e956f6cdd18e0e9384f51a8a1dcaaa74686aeff0cca97a561bab8" exitCode=0 Jul 08 01:45:21.314228 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:21.314242 2563 generic.go:356] "Generic (PLEG): container finished" podID="b638638f-d919-45b7-aa82-4818e5308708" containerID="6c12e6bb24c4813eb94be9be51a6fa2aa6009cc8ebcb1093e23e19a03bf2d86e" exitCode=0 Jul 08 01:45:21.314700 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:21.314248 2563 generic.go:356] "Generic (PLEG): container finished" podID="b638638f-d919-45b7-aa82-4818e5308708" containerID="d7b2dda6696da3ae6c408f93ebb83bd54b979fd30031785c25ed234dfc96b135" exitCode=0 Jul 08 01:45:21.314700 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:21.314241 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b638638f-d919-45b7-aa82-4818e5308708","Type":"ContainerDied","Data":"38486d1816b0ca1bdfb355f7fcd4fba15596040a0a40bbadd18323f548356add"} Jul 08 01:45:21.314700 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:21.314303 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b638638f-d919-45b7-aa82-4818e5308708","Type":"ContainerDied","Data":"c0e37484027d3cf5f47f346f63b28c7190b5a18bc6413a79b878ee6ace9146bd"} Jul 08 01:45:21.314700 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:21.314334 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b638638f-d919-45b7-aa82-4818e5308708","Type":"ContainerDied","Data":"1b2cd219b58e956f6cdd18e0e9384f51a8a1dcaaa74686aeff0cca97a561bab8"} Jul 08 01:45:21.314700 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:21.314359 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b638638f-d919-45b7-aa82-4818e5308708","Type":"ContainerDied","Data":"6c12e6bb24c4813eb94be9be51a6fa2aa6009cc8ebcb1093e23e19a03bf2d86e"} Jul 08 01:45:21.314700 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:21.314383 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b638638f-d919-45b7-aa82-4818e5308708","Type":"ContainerDied","Data":"d7b2dda6696da3ae6c408f93ebb83bd54b979fd30031785c25ed234dfc96b135"} Jul 08 01:45:21.545615 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:21.545589 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 08 01:45:21.683436 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:21.683400 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b638638f-d919-45b7-aa82-4818e5308708-alertmanager-trusted-ca-bundle\") pod \"b638638f-d919-45b7-aa82-4818e5308708\" (UID: \"b638638f-d919-45b7-aa82-4818e5308708\") " Jul 08 01:45:21.683625 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:21.683447 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b638638f-d919-45b7-aa82-4818e5308708-alertmanager-main-db\") pod \"b638638f-d919-45b7-aa82-4818e5308708\" (UID: \"b638638f-d919-45b7-aa82-4818e5308708\") " Jul 08 01:45:21.683625 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:21.683466 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z72sr\" (UniqueName: \"kubernetes.io/projected/b638638f-d919-45b7-aa82-4818e5308708-kube-api-access-z72sr\") pod \"b638638f-d919-45b7-aa82-4818e5308708\" (UID: \"b638638f-d919-45b7-aa82-4818e5308708\") " Jul 08 01:45:21.683625 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:21.683511 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b638638f-d919-45b7-aa82-4818e5308708-config-volume\") pod \"b638638f-d919-45b7-aa82-4818e5308708\" (UID: \"b638638f-d919-45b7-aa82-4818e5308708\") " Jul 08 01:45:21.683625 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:21.683529 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b638638f-d919-45b7-aa82-4818e5308708-metrics-client-ca\") pod \"b638638f-d919-45b7-aa82-4818e5308708\" (UID: \"b638638f-d919-45b7-aa82-4818e5308708\") " Jul 08 01:45:21.683625 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:21.683544 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b638638f-d919-45b7-aa82-4818e5308708-tls-assets\") pod \"b638638f-d919-45b7-aa82-4818e5308708\" (UID: \"b638638f-d919-45b7-aa82-4818e5308708\") " Jul 08 01:45:21.683625 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:21.683561 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b638638f-d919-45b7-aa82-4818e5308708-secret-alertmanager-kube-rbac-proxy-web\") pod \"b638638f-d919-45b7-aa82-4818e5308708\" (UID: \"b638638f-d919-45b7-aa82-4818e5308708\") " Jul 08 01:45:21.683625 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:21.683592 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b638638f-d919-45b7-aa82-4818e5308708-secret-alertmanager-main-tls\") pod \"b638638f-d919-45b7-aa82-4818e5308708\" (UID: \"b638638f-d919-45b7-aa82-4818e5308708\") " Jul 08 01:45:21.683959 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:21.683765 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b638638f-d919-45b7-aa82-4818e5308708-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "b638638f-d919-45b7-aa82-4818e5308708" (UID: "b638638f-d919-45b7-aa82-4818e5308708"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 01:45:21.683959 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:21.683810 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b638638f-d919-45b7-aa82-4818e5308708-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "b638638f-d919-45b7-aa82-4818e5308708" (UID: "b638638f-d919-45b7-aa82-4818e5308708"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 01:45:21.683959 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:21.683829 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b638638f-d919-45b7-aa82-4818e5308708-secret-alertmanager-kube-rbac-proxy-metric\") pod \"b638638f-d919-45b7-aa82-4818e5308708\" (UID: \"b638638f-d919-45b7-aa82-4818e5308708\") " Jul 08 01:45:21.683959 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:21.683872 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b638638f-d919-45b7-aa82-4818e5308708-web-config\") pod \"b638638f-d919-45b7-aa82-4818e5308708\" (UID: \"b638638f-d919-45b7-aa82-4818e5308708\") " Jul 08 01:45:21.683959 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:21.683937 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b638638f-d919-45b7-aa82-4818e5308708-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "b638638f-d919-45b7-aa82-4818e5308708" (UID: "b638638f-d919-45b7-aa82-4818e5308708"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 01:45:21.683959 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:21.683947 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b638638f-d919-45b7-aa82-4818e5308708-secret-alertmanager-kube-rbac-proxy\") pod \"b638638f-d919-45b7-aa82-4818e5308708\" (UID: \"b638638f-d919-45b7-aa82-4818e5308708\") " Jul 08 01:45:21.684278 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:21.683983 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b638638f-d919-45b7-aa82-4818e5308708-config-out\") pod \"b638638f-d919-45b7-aa82-4818e5308708\" (UID: \"b638638f-d919-45b7-aa82-4818e5308708\") " Jul 08 01:45:21.684278 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:21.684027 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b638638f-d919-45b7-aa82-4818e5308708-cluster-tls-config\") pod \"b638638f-d919-45b7-aa82-4818e5308708\" (UID: \"b638638f-d919-45b7-aa82-4818e5308708\") " Jul 08 01:45:21.684413 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:21.684346 2563 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b638638f-d919-45b7-aa82-4818e5308708-metrics-client-ca\") on node \"ip-10-0-142-233.ec2.internal\" DevicePath \"\"" Jul 08 01:45:21.684413 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:21.684363 2563 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b638638f-d919-45b7-aa82-4818e5308708-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-142-233.ec2.internal\" DevicePath \"\"" Jul 08 01:45:21.684413 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:21.684377 2563 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b638638f-d919-45b7-aa82-4818e5308708-alertmanager-main-db\") on node \"ip-10-0-142-233.ec2.internal\" DevicePath \"\"" Jul 08 01:45:21.686893 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:21.686855 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b638638f-d919-45b7-aa82-4818e5308708-config-volume" (OuterVolumeSpecName: "config-volume") pod "b638638f-d919-45b7-aa82-4818e5308708" (UID: "b638638f-d919-45b7-aa82-4818e5308708"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 01:45:21.687144 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:21.687096 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b638638f-d919-45b7-aa82-4818e5308708-kube-api-access-z72sr" (OuterVolumeSpecName: "kube-api-access-z72sr") pod "b638638f-d919-45b7-aa82-4818e5308708" (UID: "b638638f-d919-45b7-aa82-4818e5308708"). InnerVolumeSpecName "kube-api-access-z72sr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 01:45:21.687243 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:21.687221 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b638638f-d919-45b7-aa82-4818e5308708-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "b638638f-d919-45b7-aa82-4818e5308708" (UID: "b638638f-d919-45b7-aa82-4818e5308708"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 01:45:21.687424 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:21.687382 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b638638f-d919-45b7-aa82-4818e5308708-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "b638638f-d919-45b7-aa82-4818e5308708" (UID: "b638638f-d919-45b7-aa82-4818e5308708"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 01:45:21.687424 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:21.687402 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b638638f-d919-45b7-aa82-4818e5308708-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "b638638f-d919-45b7-aa82-4818e5308708" (UID: "b638638f-d919-45b7-aa82-4818e5308708"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 01:45:21.687670 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:21.687643 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b638638f-d919-45b7-aa82-4818e5308708-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "b638638f-d919-45b7-aa82-4818e5308708" (UID: "b638638f-d919-45b7-aa82-4818e5308708"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 01:45:21.687971 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:21.687946 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b638638f-d919-45b7-aa82-4818e5308708-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "b638638f-d919-45b7-aa82-4818e5308708" (UID: "b638638f-d919-45b7-aa82-4818e5308708"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 01:45:21.688171 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:21.688154 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b638638f-d919-45b7-aa82-4818e5308708-config-out" (OuterVolumeSpecName: "config-out") pod "b638638f-d919-45b7-aa82-4818e5308708" (UID: "b638638f-d919-45b7-aa82-4818e5308708"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 01:45:21.691506 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:21.691482 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b638638f-d919-45b7-aa82-4818e5308708-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "b638638f-d919-45b7-aa82-4818e5308708" (UID: "b638638f-d919-45b7-aa82-4818e5308708"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 01:45:21.698603 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:21.698577 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b638638f-d919-45b7-aa82-4818e5308708-web-config" (OuterVolumeSpecName: "web-config") pod "b638638f-d919-45b7-aa82-4818e5308708" (UID: "b638638f-d919-45b7-aa82-4818e5308708"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 01:45:21.785165 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:21.785125 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z72sr\" (UniqueName: \"kubernetes.io/projected/b638638f-d919-45b7-aa82-4818e5308708-kube-api-access-z72sr\") on node \"ip-10-0-142-233.ec2.internal\" DevicePath \"\"" Jul 08 01:45:21.785165 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:21.785158 2563 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b638638f-d919-45b7-aa82-4818e5308708-config-volume\") on node \"ip-10-0-142-233.ec2.internal\" DevicePath \"\"" Jul 08 01:45:21.785165 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:21.785167 2563 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b638638f-d919-45b7-aa82-4818e5308708-tls-assets\") on node \"ip-10-0-142-233.ec2.internal\" DevicePath \"\"" Jul 08 01:45:21.785418 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:21.785177 2563 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b638638f-d919-45b7-aa82-4818e5308708-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-142-233.ec2.internal\" DevicePath \"\"" Jul 08 01:45:21.785418 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:21.785187 2563 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b638638f-d919-45b7-aa82-4818e5308708-secret-alertmanager-main-tls\") on node \"ip-10-0-142-233.ec2.internal\" DevicePath \"\"" Jul 08 01:45:21.785418 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:21.785208 2563 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b638638f-d919-45b7-aa82-4818e5308708-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-142-233.ec2.internal\" DevicePath \"\"" Jul 08 01:45:21.785418 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:21.785217 2563 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b638638f-d919-45b7-aa82-4818e5308708-web-config\") on node \"ip-10-0-142-233.ec2.internal\" DevicePath \"\"" Jul 08 01:45:21.785418 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:21.785225 2563 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b638638f-d919-45b7-aa82-4818e5308708-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-142-233.ec2.internal\" DevicePath \"\"" Jul 08 01:45:21.785418 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:21.785233 2563 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b638638f-d919-45b7-aa82-4818e5308708-config-out\") on node \"ip-10-0-142-233.ec2.internal\" DevicePath \"\"" Jul 08 01:45:21.785418 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:21.785241 2563 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b638638f-d919-45b7-aa82-4818e5308708-cluster-tls-config\") on node \"ip-10-0-142-233.ec2.internal\" DevicePath \"\"" Jul 08 01:45:22.321481 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:22.321445 2563 generic.go:356] "Generic (PLEG): container finished" podID="b638638f-d919-45b7-aa82-4818e5308708" containerID="91841f69d04c4fc0b6207844cdd73dac1442572f6affcc066996a64ab9ae0ecd" exitCode=0 Jul 08 01:45:22.321846 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:22.321520 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b638638f-d919-45b7-aa82-4818e5308708","Type":"ContainerDied","Data":"91841f69d04c4fc0b6207844cdd73dac1442572f6affcc066996a64ab9ae0ecd"} Jul 08 01:45:22.321846 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:22.321534 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 08 01:45:22.321846 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:22.321612 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b638638f-d919-45b7-aa82-4818e5308708","Type":"ContainerDied","Data":"5ef8fcb0630641679771d3a6262cf7fc95a8e08b6c6bee0305f7b6c02e45a70f"} Jul 08 01:45:22.321846 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:22.321648 2563 scope.go:117] "RemoveContainer" containerID="38486d1816b0ca1bdfb355f7fcd4fba15596040a0a40bbadd18323f548356add" Jul 08 01:45:22.331102 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:22.331079 2563 scope.go:117] "RemoveContainer" containerID="c0e37484027d3cf5f47f346f63b28c7190b5a18bc6413a79b878ee6ace9146bd" Jul 08 01:45:22.338667 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:22.338652 2563 scope.go:117] "RemoveContainer" containerID="1b2cd219b58e956f6cdd18e0e9384f51a8a1dcaaa74686aeff0cca97a561bab8" Jul 08 01:45:22.345278 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:22.345260 2563 scope.go:117] "RemoveContainer" containerID="91841f69d04c4fc0b6207844cdd73dac1442572f6affcc066996a64ab9ae0ecd" Jul 08 01:45:22.348555 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:22.348479 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 08 01:45:22.353058 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:22.353037 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 08 01:45:22.354536 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:22.354502 2563 scope.go:117] "RemoveContainer" containerID="6c12e6bb24c4813eb94be9be51a6fa2aa6009cc8ebcb1093e23e19a03bf2d86e" Jul 08 01:45:22.361932 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:22.361908 2563 scope.go:117] "RemoveContainer" containerID="d7b2dda6696da3ae6c408f93ebb83bd54b979fd30031785c25ed234dfc96b135" Jul 08 01:45:22.368895 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:22.368879 2563 scope.go:117] "RemoveContainer" containerID="6555c509586a4aab28cb58a336117373500088900c50ffc430a852301d3db813" Jul 08 01:45:22.375981 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:22.375965 2563 scope.go:117] "RemoveContainer" containerID="38486d1816b0ca1bdfb355f7fcd4fba15596040a0a40bbadd18323f548356add" Jul 08 01:45:22.376326 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:45:22.376305 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"38486d1816b0ca1bdfb355f7fcd4fba15596040a0a40bbadd18323f548356add\": container with ID starting with 38486d1816b0ca1bdfb355f7fcd4fba15596040a0a40bbadd18323f548356add not found: ID does not exist" containerID="38486d1816b0ca1bdfb355f7fcd4fba15596040a0a40bbadd18323f548356add" Jul 08 01:45:22.376386 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:22.376333 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"38486d1816b0ca1bdfb355f7fcd4fba15596040a0a40bbadd18323f548356add"} err="failed to get container status \"38486d1816b0ca1bdfb355f7fcd4fba15596040a0a40bbadd18323f548356add\": rpc error: code = NotFound desc = could not find container \"38486d1816b0ca1bdfb355f7fcd4fba15596040a0a40bbadd18323f548356add\": container with ID starting with 38486d1816b0ca1bdfb355f7fcd4fba15596040a0a40bbadd18323f548356add not found: ID does not exist" Jul 08 01:45:22.376386 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:22.376366 2563 scope.go:117] "RemoveContainer" containerID="c0e37484027d3cf5f47f346f63b28c7190b5a18bc6413a79b878ee6ace9146bd" Jul 08 01:45:22.376621 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:45:22.376602 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c0e37484027d3cf5f47f346f63b28c7190b5a18bc6413a79b878ee6ace9146bd\": container with ID starting with c0e37484027d3cf5f47f346f63b28c7190b5a18bc6413a79b878ee6ace9146bd not found: ID does not exist" containerID="c0e37484027d3cf5f47f346f63b28c7190b5a18bc6413a79b878ee6ace9146bd" Jul 08 01:45:22.376670 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:22.376629 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c0e37484027d3cf5f47f346f63b28c7190b5a18bc6413a79b878ee6ace9146bd"} err="failed to get container status \"c0e37484027d3cf5f47f346f63b28c7190b5a18bc6413a79b878ee6ace9146bd\": rpc error: code = NotFound desc = could not find container \"c0e37484027d3cf5f47f346f63b28c7190b5a18bc6413a79b878ee6ace9146bd\": container with ID starting with c0e37484027d3cf5f47f346f63b28c7190b5a18bc6413a79b878ee6ace9146bd not found: ID does not exist" Jul 08 01:45:22.376670 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:22.376647 2563 scope.go:117] "RemoveContainer" containerID="1b2cd219b58e956f6cdd18e0e9384f51a8a1dcaaa74686aeff0cca97a561bab8" Jul 08 01:45:22.376886 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:45:22.376870 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1b2cd219b58e956f6cdd18e0e9384f51a8a1dcaaa74686aeff0cca97a561bab8\": container with ID starting with 1b2cd219b58e956f6cdd18e0e9384f51a8a1dcaaa74686aeff0cca97a561bab8 not found: ID does not exist" containerID="1b2cd219b58e956f6cdd18e0e9384f51a8a1dcaaa74686aeff0cca97a561bab8" Jul 08 01:45:22.376925 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:22.376892 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1b2cd219b58e956f6cdd18e0e9384f51a8a1dcaaa74686aeff0cca97a561bab8"} err="failed to get container status \"1b2cd219b58e956f6cdd18e0e9384f51a8a1dcaaa74686aeff0cca97a561bab8\": rpc error: code = NotFound desc = could not find container \"1b2cd219b58e956f6cdd18e0e9384f51a8a1dcaaa74686aeff0cca97a561bab8\": container with ID starting with 1b2cd219b58e956f6cdd18e0e9384f51a8a1dcaaa74686aeff0cca97a561bab8 not found: ID does not exist" Jul 08 01:45:22.376925 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:22.376907 2563 scope.go:117] "RemoveContainer" containerID="91841f69d04c4fc0b6207844cdd73dac1442572f6affcc066996a64ab9ae0ecd" Jul 08 01:45:22.377115 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:45:22.377100 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"91841f69d04c4fc0b6207844cdd73dac1442572f6affcc066996a64ab9ae0ecd\": container with ID starting with 91841f69d04c4fc0b6207844cdd73dac1442572f6affcc066996a64ab9ae0ecd not found: ID does not exist" containerID="91841f69d04c4fc0b6207844cdd73dac1442572f6affcc066996a64ab9ae0ecd" Jul 08 01:45:22.377162 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:22.377117 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"91841f69d04c4fc0b6207844cdd73dac1442572f6affcc066996a64ab9ae0ecd"} err="failed to get container status \"91841f69d04c4fc0b6207844cdd73dac1442572f6affcc066996a64ab9ae0ecd\": rpc error: code = NotFound desc = could not find container \"91841f69d04c4fc0b6207844cdd73dac1442572f6affcc066996a64ab9ae0ecd\": container with ID starting with 91841f69d04c4fc0b6207844cdd73dac1442572f6affcc066996a64ab9ae0ecd not found: ID does not exist" Jul 08 01:45:22.377162 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:22.377129 2563 scope.go:117] "RemoveContainer" containerID="6c12e6bb24c4813eb94be9be51a6fa2aa6009cc8ebcb1093e23e19a03bf2d86e" Jul 08 01:45:22.377374 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:45:22.377357 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6c12e6bb24c4813eb94be9be51a6fa2aa6009cc8ebcb1093e23e19a03bf2d86e\": container with ID starting with 6c12e6bb24c4813eb94be9be51a6fa2aa6009cc8ebcb1093e23e19a03bf2d86e not found: ID does not exist" containerID="6c12e6bb24c4813eb94be9be51a6fa2aa6009cc8ebcb1093e23e19a03bf2d86e" Jul 08 01:45:22.377417 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:22.377378 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c12e6bb24c4813eb94be9be51a6fa2aa6009cc8ebcb1093e23e19a03bf2d86e"} err="failed to get container status \"6c12e6bb24c4813eb94be9be51a6fa2aa6009cc8ebcb1093e23e19a03bf2d86e\": rpc error: code = NotFound desc = could not find container \"6c12e6bb24c4813eb94be9be51a6fa2aa6009cc8ebcb1093e23e19a03bf2d86e\": container with ID starting with 6c12e6bb24c4813eb94be9be51a6fa2aa6009cc8ebcb1093e23e19a03bf2d86e not found: ID does not exist" Jul 08 01:45:22.377417 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:22.377391 2563 scope.go:117] "RemoveContainer" containerID="d7b2dda6696da3ae6c408f93ebb83bd54b979fd30031785c25ed234dfc96b135" Jul 08 01:45:22.377618 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:45:22.377603 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d7b2dda6696da3ae6c408f93ebb83bd54b979fd30031785c25ed234dfc96b135\": container with ID starting with d7b2dda6696da3ae6c408f93ebb83bd54b979fd30031785c25ed234dfc96b135 not found: ID does not exist" containerID="d7b2dda6696da3ae6c408f93ebb83bd54b979fd30031785c25ed234dfc96b135" Jul 08 01:45:22.377666 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:22.377620 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d7b2dda6696da3ae6c408f93ebb83bd54b979fd30031785c25ed234dfc96b135"} err="failed to get container status \"d7b2dda6696da3ae6c408f93ebb83bd54b979fd30031785c25ed234dfc96b135\": rpc error: code = NotFound desc = could not find container \"d7b2dda6696da3ae6c408f93ebb83bd54b979fd30031785c25ed234dfc96b135\": container with ID starting with d7b2dda6696da3ae6c408f93ebb83bd54b979fd30031785c25ed234dfc96b135 not found: ID does not exist" Jul 08 01:45:22.377666 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:22.377632 2563 scope.go:117] "RemoveContainer" containerID="6555c509586a4aab28cb58a336117373500088900c50ffc430a852301d3db813" Jul 08 01:45:22.377825 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:45:22.377810 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6555c509586a4aab28cb58a336117373500088900c50ffc430a852301d3db813\": container with ID starting with 6555c509586a4aab28cb58a336117373500088900c50ffc430a852301d3db813 not found: ID does not exist" containerID="6555c509586a4aab28cb58a336117373500088900c50ffc430a852301d3db813" Jul 08 01:45:22.377866 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:22.377829 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6555c509586a4aab28cb58a336117373500088900c50ffc430a852301d3db813"} err="failed to get container status \"6555c509586a4aab28cb58a336117373500088900c50ffc430a852301d3db813\": rpc error: code = NotFound desc = could not find container \"6555c509586a4aab28cb58a336117373500088900c50ffc430a852301d3db813\": container with ID starting with 6555c509586a4aab28cb58a336117373500088900c50ffc430a852301d3db813 not found: ID does not exist" Jul 08 01:45:22.380977 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:22.380956 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 08 01:45:22.381311 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:22.381297 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b638638f-d919-45b7-aa82-4818e5308708" containerName="kube-rbac-proxy-metric" Jul 08 01:45:22.381361 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:22.381312 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="b638638f-d919-45b7-aa82-4818e5308708" containerName="kube-rbac-proxy-metric" Jul 08 01:45:22.381361 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:22.381325 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b638638f-d919-45b7-aa82-4818e5308708" containerName="init-config-reloader" Jul 08 01:45:22.381361 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:22.381331 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="b638638f-d919-45b7-aa82-4818e5308708" containerName="init-config-reloader" Jul 08 01:45:22.381361 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:22.381340 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b638638f-d919-45b7-aa82-4818e5308708" containerName="alertmanager" Jul 08 01:45:22.381361 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:22.381346 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="b638638f-d919-45b7-aa82-4818e5308708" containerName="alertmanager" Jul 08 01:45:22.381361 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:22.381353 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b638638f-d919-45b7-aa82-4818e5308708" containerName="config-reloader" Jul 08 01:45:22.381361 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:22.381358 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="b638638f-d919-45b7-aa82-4818e5308708" containerName="config-reloader" Jul 08 01:45:22.381564 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:22.381365 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b638638f-d919-45b7-aa82-4818e5308708" containerName="kube-rbac-proxy" Jul 08 01:45:22.381564 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:22.381370 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="b638638f-d919-45b7-aa82-4818e5308708" containerName="kube-rbac-proxy" Jul 08 01:45:22.381564 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:22.381377 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b638638f-d919-45b7-aa82-4818e5308708" containerName="prom-label-proxy" Jul 08 01:45:22.381564 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:22.381381 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="b638638f-d919-45b7-aa82-4818e5308708" containerName="prom-label-proxy" Jul 08 01:45:22.381564 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:22.381388 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b638638f-d919-45b7-aa82-4818e5308708" containerName="kube-rbac-proxy-web" Jul 08 01:45:22.381564 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:22.381393 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="b638638f-d919-45b7-aa82-4818e5308708" containerName="kube-rbac-proxy-web" Jul 08 01:45:22.381564 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:22.381442 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="b638638f-d919-45b7-aa82-4818e5308708" containerName="kube-rbac-proxy-metric" Jul 08 01:45:22.381564 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:22.381450 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="b638638f-d919-45b7-aa82-4818e5308708" containerName="config-reloader" Jul 08 01:45:22.381564 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:22.381455 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="b638638f-d919-45b7-aa82-4818e5308708" containerName="kube-rbac-proxy-web" Jul 08 01:45:22.381564 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:22.381463 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="b638638f-d919-45b7-aa82-4818e5308708" containerName="prom-label-proxy" Jul 08 01:45:22.381564 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:22.381468 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="b638638f-d919-45b7-aa82-4818e5308708" containerName="kube-rbac-proxy" Jul 08 01:45:22.381564 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:22.381475 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="b638638f-d919-45b7-aa82-4818e5308708" containerName="alertmanager" Jul 08 01:45:22.386477 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:22.386462 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 08 01:45:22.389024 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:22.388965 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 08 01:45:22.389024 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:22.388965 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 08 01:45:22.389024 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:22.388998 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 08 01:45:22.389024 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:22.388989 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 08 01:45:22.389282 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:22.389229 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 08 01:45:22.389353 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:22.389335 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 08 01:45:22.389402 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:22.389348 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-2b8wr\"" Jul 08 01:45:22.389402 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:22.389336 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 08 01:45:22.389968 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:22.389952 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 08 01:45:22.394454 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:22.394436 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 08 01:45:22.401981 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:22.401952 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b638638f-d919-45b7-aa82-4818e5308708" path="/var/lib/kubelet/pods/b638638f-d919-45b7-aa82-4818e5308708/volumes" Jul 08 01:45:22.402475 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:22.402462 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 08 01:45:22.490254 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:22.490219 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0df62792-f0eb-48bd-81af-51a632480f3f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0df62792-f0eb-48bd-81af-51a632480f3f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 01:45:22.490254 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:22.490256 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0df62792-f0eb-48bd-81af-51a632480f3f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0df62792-f0eb-48bd-81af-51a632480f3f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 01:45:22.490561 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:22.490281 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0df62792-f0eb-48bd-81af-51a632480f3f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0df62792-f0eb-48bd-81af-51a632480f3f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 01:45:22.490561 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:22.490387 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0df62792-f0eb-48bd-81af-51a632480f3f-config-out\") pod \"alertmanager-main-0\" (UID: \"0df62792-f0eb-48bd-81af-51a632480f3f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 01:45:22.490561 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:22.490425 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0df62792-f0eb-48bd-81af-51a632480f3f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0df62792-f0eb-48bd-81af-51a632480f3f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 01:45:22.490561 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:22.490501 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rrsfk\" (UniqueName: \"kubernetes.io/projected/0df62792-f0eb-48bd-81af-51a632480f3f-kube-api-access-rrsfk\") pod \"alertmanager-main-0\" (UID: \"0df62792-f0eb-48bd-81af-51a632480f3f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 01:45:22.490775 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:22.490563 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0df62792-f0eb-48bd-81af-51a632480f3f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0df62792-f0eb-48bd-81af-51a632480f3f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 01:45:22.490775 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:22.490608 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0df62792-f0eb-48bd-81af-51a632480f3f-web-config\") pod \"alertmanager-main-0\" (UID: \"0df62792-f0eb-48bd-81af-51a632480f3f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 01:45:22.490775 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:22.490632 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0df62792-f0eb-48bd-81af-51a632480f3f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0df62792-f0eb-48bd-81af-51a632480f3f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 01:45:22.490775 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:22.490667 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0df62792-f0eb-48bd-81af-51a632480f3f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0df62792-f0eb-48bd-81af-51a632480f3f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 01:45:22.490775 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:22.490691 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0df62792-f0eb-48bd-81af-51a632480f3f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0df62792-f0eb-48bd-81af-51a632480f3f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 01:45:22.490775 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:22.490717 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0df62792-f0eb-48bd-81af-51a632480f3f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0df62792-f0eb-48bd-81af-51a632480f3f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 01:45:22.490775 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:22.490743 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0df62792-f0eb-48bd-81af-51a632480f3f-config-volume\") pod \"alertmanager-main-0\" (UID: \"0df62792-f0eb-48bd-81af-51a632480f3f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 01:45:22.592068 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:22.591976 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0df62792-f0eb-48bd-81af-51a632480f3f-config-out\") pod \"alertmanager-main-0\" (UID: \"0df62792-f0eb-48bd-81af-51a632480f3f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 01:45:22.592068 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:22.592016 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0df62792-f0eb-48bd-81af-51a632480f3f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0df62792-f0eb-48bd-81af-51a632480f3f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 01:45:22.592323 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:22.592072 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rrsfk\" (UniqueName: \"kubernetes.io/projected/0df62792-f0eb-48bd-81af-51a632480f3f-kube-api-access-rrsfk\") pod \"alertmanager-main-0\" (UID: \"0df62792-f0eb-48bd-81af-51a632480f3f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 01:45:22.592323 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:22.592121 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0df62792-f0eb-48bd-81af-51a632480f3f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0df62792-f0eb-48bd-81af-51a632480f3f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 01:45:22.592323 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:22.592159 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0df62792-f0eb-48bd-81af-51a632480f3f-web-config\") pod \"alertmanager-main-0\" (UID: \"0df62792-f0eb-48bd-81af-51a632480f3f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 01:45:22.592323 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:22.592184 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0df62792-f0eb-48bd-81af-51a632480f3f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0df62792-f0eb-48bd-81af-51a632480f3f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 01:45:22.592323 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:22.592230 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0df62792-f0eb-48bd-81af-51a632480f3f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0df62792-f0eb-48bd-81af-51a632480f3f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 01:45:22.592323 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:22.592253 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0df62792-f0eb-48bd-81af-51a632480f3f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0df62792-f0eb-48bd-81af-51a632480f3f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 01:45:22.592323 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:22.592282 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0df62792-f0eb-48bd-81af-51a632480f3f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0df62792-f0eb-48bd-81af-51a632480f3f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 01:45:22.592666 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:22.592407 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0df62792-f0eb-48bd-81af-51a632480f3f-config-volume\") pod \"alertmanager-main-0\" (UID: \"0df62792-f0eb-48bd-81af-51a632480f3f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 01:45:22.592666 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:22.592444 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0df62792-f0eb-48bd-81af-51a632480f3f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0df62792-f0eb-48bd-81af-51a632480f3f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 01:45:22.592666 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:22.592474 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0df62792-f0eb-48bd-81af-51a632480f3f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0df62792-f0eb-48bd-81af-51a632480f3f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 01:45:22.592666 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:22.592505 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0df62792-f0eb-48bd-81af-51a632480f3f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0df62792-f0eb-48bd-81af-51a632480f3f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 01:45:22.592864 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:22.592764 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0df62792-f0eb-48bd-81af-51a632480f3f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0df62792-f0eb-48bd-81af-51a632480f3f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 01:45:22.593234 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:22.593190 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0df62792-f0eb-48bd-81af-51a632480f3f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0df62792-f0eb-48bd-81af-51a632480f3f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 01:45:22.593538 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:22.593509 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0df62792-f0eb-48bd-81af-51a632480f3f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0df62792-f0eb-48bd-81af-51a632480f3f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 01:45:22.595070 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:22.595039 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0df62792-f0eb-48bd-81af-51a632480f3f-config-out\") pod \"alertmanager-main-0\" (UID: \"0df62792-f0eb-48bd-81af-51a632480f3f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 01:45:22.595282 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:22.595259 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0df62792-f0eb-48bd-81af-51a632480f3f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0df62792-f0eb-48bd-81af-51a632480f3f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 01:45:22.595404 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:22.595384 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0df62792-f0eb-48bd-81af-51a632480f3f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0df62792-f0eb-48bd-81af-51a632480f3f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 01:45:22.595725 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:22.595701 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0df62792-f0eb-48bd-81af-51a632480f3f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0df62792-f0eb-48bd-81af-51a632480f3f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 01:45:22.595904 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:22.595884 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0df62792-f0eb-48bd-81af-51a632480f3f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0df62792-f0eb-48bd-81af-51a632480f3f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 01:45:22.595967 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:22.595922 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0df62792-f0eb-48bd-81af-51a632480f3f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0df62792-f0eb-48bd-81af-51a632480f3f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 01:45:22.596114 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:22.596098 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0df62792-f0eb-48bd-81af-51a632480f3f-config-volume\") pod \"alertmanager-main-0\" (UID: \"0df62792-f0eb-48bd-81af-51a632480f3f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 01:45:22.596161 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:22.596101 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0df62792-f0eb-48bd-81af-51a632480f3f-web-config\") pod \"alertmanager-main-0\" (UID: \"0df62792-f0eb-48bd-81af-51a632480f3f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 01:45:22.597117 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:22.597098 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0df62792-f0eb-48bd-81af-51a632480f3f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0df62792-f0eb-48bd-81af-51a632480f3f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 01:45:22.600474 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:22.600457 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rrsfk\" (UniqueName: \"kubernetes.io/projected/0df62792-f0eb-48bd-81af-51a632480f3f-kube-api-access-rrsfk\") pod \"alertmanager-main-0\" (UID: \"0df62792-f0eb-48bd-81af-51a632480f3f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 01:45:22.696471 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:22.696439 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 08 01:45:22.837454 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:22.837419 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 08 01:45:22.839844 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:45:22.839819 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0df62792_f0eb_48bd_81af_51a632480f3f.slice/crio-a5425d3930aa92fb475dda669ebe749a8f4316980177bdc8bcfce8a3d944288b WatchSource:0}: Error finding container a5425d3930aa92fb475dda669ebe749a8f4316980177bdc8bcfce8a3d944288b: Status 404 returned error can't find the container with id a5425d3930aa92fb475dda669ebe749a8f4316980177bdc8bcfce8a3d944288b Jul 08 01:45:23.328097 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:23.328063 2563 generic.go:356] "Generic (PLEG): container finished" podID="0df62792-f0eb-48bd-81af-51a632480f3f" containerID="c81ebd17cdf0931daace5b14d6e4d31615f1252377019e5587e87d53d400c72b" exitCode=0 Jul 08 01:45:23.328097 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:23.328100 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0df62792-f0eb-48bd-81af-51a632480f3f","Type":"ContainerDied","Data":"c81ebd17cdf0931daace5b14d6e4d31615f1252377019e5587e87d53d400c72b"} Jul 08 01:45:23.328637 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:23.328147 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0df62792-f0eb-48bd-81af-51a632480f3f","Type":"ContainerStarted","Data":"a5425d3930aa92fb475dda669ebe749a8f4316980177bdc8bcfce8a3d944288b"} Jul 08 01:45:24.336032 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:24.335997 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0df62792-f0eb-48bd-81af-51a632480f3f","Type":"ContainerStarted","Data":"7d9f8693eef3ff1be91f87cf0658b814add90a0a7247c466182fda0ec3b833da"} Jul 08 01:45:24.336430 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:24.336092 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0df62792-f0eb-48bd-81af-51a632480f3f","Type":"ContainerStarted","Data":"71a31e85aff7d494851aa76465d96cf237ab7ccda96b952c64f19858fa8d4f75"} Jul 08 01:45:24.336430 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:24.336126 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0df62792-f0eb-48bd-81af-51a632480f3f","Type":"ContainerStarted","Data":"8627ba2572bc6184867cdaedb72e41744b65ae82b651bc8c8241fb98103424b4"} Jul 08 01:45:24.336430 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:24.336154 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0df62792-f0eb-48bd-81af-51a632480f3f","Type":"ContainerStarted","Data":"f3bdbdcd3522a7f0695aa025e0f99ccfa28bad097348293d089ce6a8b919b1d3"} Jul 08 01:45:24.336430 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:24.336192 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0df62792-f0eb-48bd-81af-51a632480f3f","Type":"ContainerStarted","Data":"dc4554478cb107927a01b1e26b50a4294aa147d69f5ab4137e2b0c137d844fb2"} Jul 08 01:45:24.336430 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:24.336243 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0df62792-f0eb-48bd-81af-51a632480f3f","Type":"ContainerStarted","Data":"381a81fc39abeee2d7e6d43b1d8c978a34398db2106081de407e2033badff92b"} Jul 08 01:45:24.370102 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:24.370043 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.354486035 podStartE2EDuration="2.370025955s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.53992ms" isStatefulPod=false podCreationTimestamp="2026-07-08 01:45:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 01:45:24.368921812 +0000 UTC m=+204.566248667" watchObservedRunningTime="2026-07-08 01:45:24.370025955 +0000 UTC m=+204.567352809" Jul 08 01:45:24.625762 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:24.625665 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 08 01:45:24.626094 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:24.626020 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="8454f12b-eb6b-4003-bffa-05b00de97455" containerName="kube-rbac-proxy" containerID="cri-o://d96d0fd86546e227491ebc79bd18d3ffda58339021636d8418af2af72f11f9ac" gracePeriod=600 Jul 08 01:45:24.626094 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:24.626046 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="8454f12b-eb6b-4003-bffa-05b00de97455" containerName="kube-rbac-proxy-thanos" containerID="cri-o://4d8d8643b1a655c97a579f3c5e760cf9bef4486fadbd6b18b736d78d4376cf49" gracePeriod=600 Jul 08 01:45:24.626094 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:24.626051 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="8454f12b-eb6b-4003-bffa-05b00de97455" containerName="thanos-sidecar" containerID="cri-o://937434d3b490d52c33f42fba35b72abc651a40c90d10ca03ca202eb12df3513e" gracePeriod=600 Jul 08 01:45:24.626353 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:24.626075 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="8454f12b-eb6b-4003-bffa-05b00de97455" containerName="config-reloader" containerID="cri-o://dea8041483fe16e543189a14ef90e2b4ff5713ee971b0f637843b6b57e39723c" gracePeriod=600 Jul 08 01:45:24.626353 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:24.626052 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="8454f12b-eb6b-4003-bffa-05b00de97455" containerName="kube-rbac-proxy-web" containerID="cri-o://67293e88bdc2aa83ea4b1a1f59dace5df32578755158bb7988971f131e519b11" gracePeriod=600 Jul 08 01:45:24.626353 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:24.626000 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="8454f12b-eb6b-4003-bffa-05b00de97455" containerName="prometheus" containerID="cri-o://babd11c9b9aeafdc241bd0689258ad233e04d9ca903e0a050d7bf30665695005" gracePeriod=600 Jul 08 01:45:24.896836 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:24.896813 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 08 01:45:25.014315 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.014286 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8454f12b-eb6b-4003-bffa-05b00de97455-config-out\") pod \"8454f12b-eb6b-4003-bffa-05b00de97455\" (UID: \"8454f12b-eb6b-4003-bffa-05b00de97455\") " Jul 08 01:45:25.014487 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.014326 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8454f12b-eb6b-4003-bffa-05b00de97455-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"8454f12b-eb6b-4003-bffa-05b00de97455\" (UID: \"8454f12b-eb6b-4003-bffa-05b00de97455\") " Jul 08 01:45:25.014487 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.014347 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8454f12b-eb6b-4003-bffa-05b00de97455-prometheus-k8s-db\") pod \"8454f12b-eb6b-4003-bffa-05b00de97455\" (UID: \"8454f12b-eb6b-4003-bffa-05b00de97455\") " Jul 08 01:45:25.014487 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.014368 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8454f12b-eb6b-4003-bffa-05b00de97455-secret-grpc-tls\") pod \"8454f12b-eb6b-4003-bffa-05b00de97455\" (UID: \"8454f12b-eb6b-4003-bffa-05b00de97455\") " Jul 08 01:45:25.014487 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.014392 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8454f12b-eb6b-4003-bffa-05b00de97455-thanos-prometheus-http-client-file\") pod \"8454f12b-eb6b-4003-bffa-05b00de97455\" (UID: \"8454f12b-eb6b-4003-bffa-05b00de97455\") " Jul 08 01:45:25.014487 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.014419 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8454f12b-eb6b-4003-bffa-05b00de97455-prometheus-k8s-rulefiles-0\") pod \"8454f12b-eb6b-4003-bffa-05b00de97455\" (UID: \"8454f12b-eb6b-4003-bffa-05b00de97455\") " Jul 08 01:45:25.014487 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.014440 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8454f12b-eb6b-4003-bffa-05b00de97455-prometheus-k8s-rulefiles-2\") pod \"8454f12b-eb6b-4003-bffa-05b00de97455\" (UID: \"8454f12b-eb6b-4003-bffa-05b00de97455\") " Jul 08 01:45:25.014487 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.014457 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8454f12b-eb6b-4003-bffa-05b00de97455-secret-kube-rbac-proxy\") pod \"8454f12b-eb6b-4003-bffa-05b00de97455\" (UID: \"8454f12b-eb6b-4003-bffa-05b00de97455\") " Jul 08 01:45:25.014487 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.014482 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8454f12b-eb6b-4003-bffa-05b00de97455-configmap-serving-certs-ca-bundle\") pod \"8454f12b-eb6b-4003-bffa-05b00de97455\" (UID: \"8454f12b-eb6b-4003-bffa-05b00de97455\") " Jul 08 01:45:25.014887 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.014514 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8454f12b-eb6b-4003-bffa-05b00de97455-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"8454f12b-eb6b-4003-bffa-05b00de97455\" (UID: \"8454f12b-eb6b-4003-bffa-05b00de97455\") " Jul 08 01:45:25.014887 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.014545 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8454f12b-eb6b-4003-bffa-05b00de97455-configmap-metrics-client-ca\") pod \"8454f12b-eb6b-4003-bffa-05b00de97455\" (UID: \"8454f12b-eb6b-4003-bffa-05b00de97455\") " Jul 08 01:45:25.014887 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.014572 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/8454f12b-eb6b-4003-bffa-05b00de97455-config\") pod \"8454f12b-eb6b-4003-bffa-05b00de97455\" (UID: \"8454f12b-eb6b-4003-bffa-05b00de97455\") " Jul 08 01:45:25.014887 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.014626 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8454f12b-eb6b-4003-bffa-05b00de97455-prometheus-k8s-rulefiles-1\") pod \"8454f12b-eb6b-4003-bffa-05b00de97455\" (UID: \"8454f12b-eb6b-4003-bffa-05b00de97455\") " Jul 08 01:45:25.014887 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.014661 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8454f12b-eb6b-4003-bffa-05b00de97455-prometheus-trusted-ca-bundle\") pod \"8454f12b-eb6b-4003-bffa-05b00de97455\" (UID: \"8454f12b-eb6b-4003-bffa-05b00de97455\") " Jul 08 01:45:25.014887 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.014719 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8454f12b-eb6b-4003-bffa-05b00de97455-configmap-kubelet-serving-ca-bundle\") pod \"8454f12b-eb6b-4003-bffa-05b00de97455\" (UID: \"8454f12b-eb6b-4003-bffa-05b00de97455\") " Jul 08 01:45:25.014887 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.014761 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8454f12b-eb6b-4003-bffa-05b00de97455-secret-prometheus-k8s-tls\") pod \"8454f12b-eb6b-4003-bffa-05b00de97455\" (UID: \"8454f12b-eb6b-4003-bffa-05b00de97455\") " Jul 08 01:45:25.014887 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.014792 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8454f12b-eb6b-4003-bffa-05b00de97455-tls-assets\") pod \"8454f12b-eb6b-4003-bffa-05b00de97455\" (UID: \"8454f12b-eb6b-4003-bffa-05b00de97455\") " Jul 08 01:45:25.014887 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.014803 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8454f12b-eb6b-4003-bffa-05b00de97455-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "8454f12b-eb6b-4003-bffa-05b00de97455" (UID: "8454f12b-eb6b-4003-bffa-05b00de97455"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 01:45:25.014887 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.014852 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8454f12b-eb6b-4003-bffa-05b00de97455-secret-metrics-client-certs\") pod \"8454f12b-eb6b-4003-bffa-05b00de97455\" (UID: \"8454f12b-eb6b-4003-bffa-05b00de97455\") " Jul 08 01:45:25.014887 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.014883 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8454f12b-eb6b-4003-bffa-05b00de97455-web-config\") pod \"8454f12b-eb6b-4003-bffa-05b00de97455\" (UID: \"8454f12b-eb6b-4003-bffa-05b00de97455\") " Jul 08 01:45:25.015449 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.014907 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lj5wz\" (UniqueName: \"kubernetes.io/projected/8454f12b-eb6b-4003-bffa-05b00de97455-kube-api-access-lj5wz\") pod \"8454f12b-eb6b-4003-bffa-05b00de97455\" (UID: \"8454f12b-eb6b-4003-bffa-05b00de97455\") " Jul 08 01:45:25.015449 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.015209 2563 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8454f12b-eb6b-4003-bffa-05b00de97455-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-142-233.ec2.internal\" DevicePath \"\"" Jul 08 01:45:25.015449 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.015361 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8454f12b-eb6b-4003-bffa-05b00de97455-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "8454f12b-eb6b-4003-bffa-05b00de97455" (UID: "8454f12b-eb6b-4003-bffa-05b00de97455"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 01:45:25.016080 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.015682 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8454f12b-eb6b-4003-bffa-05b00de97455-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "8454f12b-eb6b-4003-bffa-05b00de97455" (UID: "8454f12b-eb6b-4003-bffa-05b00de97455"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 01:45:25.016080 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.015936 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8454f12b-eb6b-4003-bffa-05b00de97455-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "8454f12b-eb6b-4003-bffa-05b00de97455" (UID: "8454f12b-eb6b-4003-bffa-05b00de97455"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 01:45:25.016271 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.016134 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8454f12b-eb6b-4003-bffa-05b00de97455-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "8454f12b-eb6b-4003-bffa-05b00de97455" (UID: "8454f12b-eb6b-4003-bffa-05b00de97455"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 01:45:25.016502 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.016473 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8454f12b-eb6b-4003-bffa-05b00de97455-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "8454f12b-eb6b-4003-bffa-05b00de97455" (UID: "8454f12b-eb6b-4003-bffa-05b00de97455"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 01:45:25.017246 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.017052 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8454f12b-eb6b-4003-bffa-05b00de97455-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "8454f12b-eb6b-4003-bffa-05b00de97455" (UID: "8454f12b-eb6b-4003-bffa-05b00de97455"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 01:45:25.017346 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.017243 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8454f12b-eb6b-4003-bffa-05b00de97455-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "8454f12b-eb6b-4003-bffa-05b00de97455" (UID: "8454f12b-eb6b-4003-bffa-05b00de97455"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 01:45:25.018478 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.018446 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8454f12b-eb6b-4003-bffa-05b00de97455-config" (OuterVolumeSpecName: "config") pod "8454f12b-eb6b-4003-bffa-05b00de97455" (UID: "8454f12b-eb6b-4003-bffa-05b00de97455"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 01:45:25.018950 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.018753 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8454f12b-eb6b-4003-bffa-05b00de97455-config-out" (OuterVolumeSpecName: "config-out") pod "8454f12b-eb6b-4003-bffa-05b00de97455" (UID: "8454f12b-eb6b-4003-bffa-05b00de97455"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 01:45:25.018950 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.018851 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8454f12b-eb6b-4003-bffa-05b00de97455-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "8454f12b-eb6b-4003-bffa-05b00de97455" (UID: "8454f12b-eb6b-4003-bffa-05b00de97455"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 01:45:25.018950 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.018877 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8454f12b-eb6b-4003-bffa-05b00de97455-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "8454f12b-eb6b-4003-bffa-05b00de97455" (UID: "8454f12b-eb6b-4003-bffa-05b00de97455"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 01:45:25.018950 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.018914 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8454f12b-eb6b-4003-bffa-05b00de97455-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "8454f12b-eb6b-4003-bffa-05b00de97455" (UID: "8454f12b-eb6b-4003-bffa-05b00de97455"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 01:45:25.018950 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.018911 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8454f12b-eb6b-4003-bffa-05b00de97455-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "8454f12b-eb6b-4003-bffa-05b00de97455" (UID: "8454f12b-eb6b-4003-bffa-05b00de97455"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 01:45:25.018950 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.018938 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8454f12b-eb6b-4003-bffa-05b00de97455-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "8454f12b-eb6b-4003-bffa-05b00de97455" (UID: "8454f12b-eb6b-4003-bffa-05b00de97455"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 01:45:25.019314 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.019096 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8454f12b-eb6b-4003-bffa-05b00de97455-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "8454f12b-eb6b-4003-bffa-05b00de97455" (UID: "8454f12b-eb6b-4003-bffa-05b00de97455"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 01:45:25.019314 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.019174 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8454f12b-eb6b-4003-bffa-05b00de97455-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "8454f12b-eb6b-4003-bffa-05b00de97455" (UID: "8454f12b-eb6b-4003-bffa-05b00de97455"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 01:45:25.019622 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.019596 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8454f12b-eb6b-4003-bffa-05b00de97455-kube-api-access-lj5wz" (OuterVolumeSpecName: "kube-api-access-lj5wz") pod "8454f12b-eb6b-4003-bffa-05b00de97455" (UID: "8454f12b-eb6b-4003-bffa-05b00de97455"). InnerVolumeSpecName "kube-api-access-lj5wz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 01:45:25.020069 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.020049 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8454f12b-eb6b-4003-bffa-05b00de97455-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "8454f12b-eb6b-4003-bffa-05b00de97455" (UID: "8454f12b-eb6b-4003-bffa-05b00de97455"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 01:45:25.029572 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.029543 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8454f12b-eb6b-4003-bffa-05b00de97455-web-config" (OuterVolumeSpecName: "web-config") pod "8454f12b-eb6b-4003-bffa-05b00de97455" (UID: "8454f12b-eb6b-4003-bffa-05b00de97455"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 01:45:25.116040 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.116011 2563 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8454f12b-eb6b-4003-bffa-05b00de97455-tls-assets\") on node \"ip-10-0-142-233.ec2.internal\" DevicePath \"\"" Jul 08 01:45:25.116040 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.116036 2563 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8454f12b-eb6b-4003-bffa-05b00de97455-secret-metrics-client-certs\") on node \"ip-10-0-142-233.ec2.internal\" DevicePath \"\"" Jul 08 01:45:25.116040 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.116047 2563 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8454f12b-eb6b-4003-bffa-05b00de97455-web-config\") on node \"ip-10-0-142-233.ec2.internal\" DevicePath \"\"" Jul 08 01:45:25.116290 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.116057 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lj5wz\" (UniqueName: \"kubernetes.io/projected/8454f12b-eb6b-4003-bffa-05b00de97455-kube-api-access-lj5wz\") on node \"ip-10-0-142-233.ec2.internal\" DevicePath \"\"" Jul 08 01:45:25.116290 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.116066 2563 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8454f12b-eb6b-4003-bffa-05b00de97455-config-out\") on node \"ip-10-0-142-233.ec2.internal\" DevicePath \"\"" Jul 08 01:45:25.116290 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.116076 2563 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8454f12b-eb6b-4003-bffa-05b00de97455-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-142-233.ec2.internal\" DevicePath \"\"" Jul 08 01:45:25.116290 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.116085 2563 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8454f12b-eb6b-4003-bffa-05b00de97455-prometheus-k8s-db\") on node \"ip-10-0-142-233.ec2.internal\" DevicePath \"\"" Jul 08 01:45:25.116290 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.116093 2563 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8454f12b-eb6b-4003-bffa-05b00de97455-secret-grpc-tls\") on node \"ip-10-0-142-233.ec2.internal\" DevicePath \"\"" Jul 08 01:45:25.116290 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.116101 2563 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8454f12b-eb6b-4003-bffa-05b00de97455-thanos-prometheus-http-client-file\") on node \"ip-10-0-142-233.ec2.internal\" DevicePath \"\"" Jul 08 01:45:25.116290 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.116109 2563 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8454f12b-eb6b-4003-bffa-05b00de97455-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-142-233.ec2.internal\" DevicePath \"\"" Jul 08 01:45:25.116290 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.116117 2563 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8454f12b-eb6b-4003-bffa-05b00de97455-secret-kube-rbac-proxy\") on node \"ip-10-0-142-233.ec2.internal\" DevicePath \"\"" Jul 08 01:45:25.116290 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.116125 2563 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8454f12b-eb6b-4003-bffa-05b00de97455-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-142-233.ec2.internal\" DevicePath \"\"" Jul 08 01:45:25.116290 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.116133 2563 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8454f12b-eb6b-4003-bffa-05b00de97455-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-142-233.ec2.internal\" DevicePath \"\"" Jul 08 01:45:25.116290 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.116141 2563 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8454f12b-eb6b-4003-bffa-05b00de97455-configmap-metrics-client-ca\") on node \"ip-10-0-142-233.ec2.internal\" DevicePath \"\"" Jul 08 01:45:25.116290 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.116149 2563 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/8454f12b-eb6b-4003-bffa-05b00de97455-config\") on node \"ip-10-0-142-233.ec2.internal\" DevicePath \"\"" Jul 08 01:45:25.116290 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.116156 2563 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8454f12b-eb6b-4003-bffa-05b00de97455-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-142-233.ec2.internal\" DevicePath \"\"" Jul 08 01:45:25.116290 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.116165 2563 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8454f12b-eb6b-4003-bffa-05b00de97455-prometheus-trusted-ca-bundle\") on node \"ip-10-0-142-233.ec2.internal\" DevicePath \"\"" Jul 08 01:45:25.116290 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.116173 2563 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8454f12b-eb6b-4003-bffa-05b00de97455-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-142-233.ec2.internal\" DevicePath \"\"" Jul 08 01:45:25.116290 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.116181 2563 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8454f12b-eb6b-4003-bffa-05b00de97455-secret-prometheus-k8s-tls\") on node \"ip-10-0-142-233.ec2.internal\" DevicePath \"\"" Jul 08 01:45:25.343931 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.343896 2563 generic.go:356] "Generic (PLEG): container finished" podID="8454f12b-eb6b-4003-bffa-05b00de97455" containerID="4d8d8643b1a655c97a579f3c5e760cf9bef4486fadbd6b18b736d78d4376cf49" exitCode=0 Jul 08 01:45:25.343931 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.343927 2563 generic.go:356] "Generic (PLEG): container finished" podID="8454f12b-eb6b-4003-bffa-05b00de97455" containerID="d96d0fd86546e227491ebc79bd18d3ffda58339021636d8418af2af72f11f9ac" exitCode=0 Jul 08 01:45:25.343931 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.343937 2563 generic.go:356] "Generic (PLEG): container finished" podID="8454f12b-eb6b-4003-bffa-05b00de97455" containerID="67293e88bdc2aa83ea4b1a1f59dace5df32578755158bb7988971f131e519b11" exitCode=0 Jul 08 01:45:25.344444 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.343946 2563 generic.go:356] "Generic (PLEG): container finished" podID="8454f12b-eb6b-4003-bffa-05b00de97455" containerID="937434d3b490d52c33f42fba35b72abc651a40c90d10ca03ca202eb12df3513e" exitCode=0 Jul 08 01:45:25.344444 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.343955 2563 generic.go:356] "Generic (PLEG): container finished" podID="8454f12b-eb6b-4003-bffa-05b00de97455" containerID="dea8041483fe16e543189a14ef90e2b4ff5713ee971b0f637843b6b57e39723c" exitCode=0 Jul 08 01:45:25.344444 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.343962 2563 generic.go:356] "Generic (PLEG): container finished" podID="8454f12b-eb6b-4003-bffa-05b00de97455" containerID="babd11c9b9aeafdc241bd0689258ad233e04d9ca903e0a050d7bf30665695005" exitCode=0 Jul 08 01:45:25.344444 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.343975 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8454f12b-eb6b-4003-bffa-05b00de97455","Type":"ContainerDied","Data":"4d8d8643b1a655c97a579f3c5e760cf9bef4486fadbd6b18b736d78d4376cf49"} Jul 08 01:45:25.344444 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.344043 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8454f12b-eb6b-4003-bffa-05b00de97455","Type":"ContainerDied","Data":"d96d0fd86546e227491ebc79bd18d3ffda58339021636d8418af2af72f11f9ac"} Jul 08 01:45:25.344444 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.344071 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8454f12b-eb6b-4003-bffa-05b00de97455","Type":"ContainerDied","Data":"67293e88bdc2aa83ea4b1a1f59dace5df32578755158bb7988971f131e519b11"} Jul 08 01:45:25.344444 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.343984 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 08 01:45:25.344444 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.344098 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8454f12b-eb6b-4003-bffa-05b00de97455","Type":"ContainerDied","Data":"937434d3b490d52c33f42fba35b72abc651a40c90d10ca03ca202eb12df3513e"} Jul 08 01:45:25.344444 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.344122 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8454f12b-eb6b-4003-bffa-05b00de97455","Type":"ContainerDied","Data":"dea8041483fe16e543189a14ef90e2b4ff5713ee971b0f637843b6b57e39723c"} Jul 08 01:45:25.344444 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.344146 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8454f12b-eb6b-4003-bffa-05b00de97455","Type":"ContainerDied","Data":"babd11c9b9aeafdc241bd0689258ad233e04d9ca903e0a050d7bf30665695005"} Jul 08 01:45:25.344444 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.344171 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8454f12b-eb6b-4003-bffa-05b00de97455","Type":"ContainerDied","Data":"653746afeaf00139e95557bb08e0f19f4f12985ffc71d529b750484d568c2492"} Jul 08 01:45:25.344444 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.344178 2563 scope.go:117] "RemoveContainer" containerID="4d8d8643b1a655c97a579f3c5e760cf9bef4486fadbd6b18b736d78d4376cf49" Jul 08 01:45:25.352283 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.352266 2563 scope.go:117] "RemoveContainer" containerID="d96d0fd86546e227491ebc79bd18d3ffda58339021636d8418af2af72f11f9ac" Jul 08 01:45:25.369259 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.369242 2563 scope.go:117] "RemoveContainer" containerID="67293e88bdc2aa83ea4b1a1f59dace5df32578755158bb7988971f131e519b11" Jul 08 01:45:25.376184 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.376164 2563 scope.go:117] "RemoveContainer" containerID="937434d3b490d52c33f42fba35b72abc651a40c90d10ca03ca202eb12df3513e" Jul 08 01:45:25.382742 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.382718 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 08 01:45:25.383548 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.383535 2563 scope.go:117] "RemoveContainer" containerID="dea8041483fe16e543189a14ef90e2b4ff5713ee971b0f637843b6b57e39723c" Jul 08 01:45:25.387125 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.387104 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 08 01:45:25.393300 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.393283 2563 scope.go:117] "RemoveContainer" containerID="babd11c9b9aeafdc241bd0689258ad233e04d9ca903e0a050d7bf30665695005" Jul 08 01:45:25.400726 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.400711 2563 scope.go:117] "RemoveContainer" containerID="d59c6fd4c3503e788cef48720325e3aa2dee45720a1519714c1ec2c8fb7150eb" Jul 08 01:45:25.407586 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.407571 2563 scope.go:117] "RemoveContainer" containerID="4d8d8643b1a655c97a579f3c5e760cf9bef4486fadbd6b18b736d78d4376cf49" Jul 08 01:45:25.407843 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:45:25.407823 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4d8d8643b1a655c97a579f3c5e760cf9bef4486fadbd6b18b736d78d4376cf49\": container with ID starting with 4d8d8643b1a655c97a579f3c5e760cf9bef4486fadbd6b18b736d78d4376cf49 not found: ID does not exist" containerID="4d8d8643b1a655c97a579f3c5e760cf9bef4486fadbd6b18b736d78d4376cf49" Jul 08 01:45:25.407907 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.407856 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d8d8643b1a655c97a579f3c5e760cf9bef4486fadbd6b18b736d78d4376cf49"} err="failed to get container status \"4d8d8643b1a655c97a579f3c5e760cf9bef4486fadbd6b18b736d78d4376cf49\": rpc error: code = NotFound desc = could not find container \"4d8d8643b1a655c97a579f3c5e760cf9bef4486fadbd6b18b736d78d4376cf49\": container with ID starting with 4d8d8643b1a655c97a579f3c5e760cf9bef4486fadbd6b18b736d78d4376cf49 not found: ID does not exist" Jul 08 01:45:25.407907 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.407882 2563 scope.go:117] "RemoveContainer" containerID="d96d0fd86546e227491ebc79bd18d3ffda58339021636d8418af2af72f11f9ac" Jul 08 01:45:25.408125 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:45:25.408109 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d96d0fd86546e227491ebc79bd18d3ffda58339021636d8418af2af72f11f9ac\": container with ID starting with d96d0fd86546e227491ebc79bd18d3ffda58339021636d8418af2af72f11f9ac not found: ID does not exist" containerID="d96d0fd86546e227491ebc79bd18d3ffda58339021636d8418af2af72f11f9ac" Jul 08 01:45:25.408168 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.408130 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d96d0fd86546e227491ebc79bd18d3ffda58339021636d8418af2af72f11f9ac"} err="failed to get container status \"d96d0fd86546e227491ebc79bd18d3ffda58339021636d8418af2af72f11f9ac\": rpc error: code = NotFound desc = could not find container \"d96d0fd86546e227491ebc79bd18d3ffda58339021636d8418af2af72f11f9ac\": container with ID starting with d96d0fd86546e227491ebc79bd18d3ffda58339021636d8418af2af72f11f9ac not found: ID does not exist" Jul 08 01:45:25.408168 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.408146 2563 scope.go:117] "RemoveContainer" containerID="67293e88bdc2aa83ea4b1a1f59dace5df32578755158bb7988971f131e519b11" Jul 08 01:45:25.408387 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:45:25.408360 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"67293e88bdc2aa83ea4b1a1f59dace5df32578755158bb7988971f131e519b11\": container with ID starting with 67293e88bdc2aa83ea4b1a1f59dace5df32578755158bb7988971f131e519b11 not found: ID does not exist" containerID="67293e88bdc2aa83ea4b1a1f59dace5df32578755158bb7988971f131e519b11" Jul 08 01:45:25.408451 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.408394 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"67293e88bdc2aa83ea4b1a1f59dace5df32578755158bb7988971f131e519b11"} err="failed to get container status \"67293e88bdc2aa83ea4b1a1f59dace5df32578755158bb7988971f131e519b11\": rpc error: code = NotFound desc = could not find container \"67293e88bdc2aa83ea4b1a1f59dace5df32578755158bb7988971f131e519b11\": container with ID starting with 67293e88bdc2aa83ea4b1a1f59dace5df32578755158bb7988971f131e519b11 not found: ID does not exist" Jul 08 01:45:25.408451 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.408414 2563 scope.go:117] "RemoveContainer" containerID="937434d3b490d52c33f42fba35b72abc651a40c90d10ca03ca202eb12df3513e" Jul 08 01:45:25.408645 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:45:25.408630 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"937434d3b490d52c33f42fba35b72abc651a40c90d10ca03ca202eb12df3513e\": container with ID starting with 937434d3b490d52c33f42fba35b72abc651a40c90d10ca03ca202eb12df3513e not found: ID does not exist" containerID="937434d3b490d52c33f42fba35b72abc651a40c90d10ca03ca202eb12df3513e" Jul 08 01:45:25.408684 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.408648 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"937434d3b490d52c33f42fba35b72abc651a40c90d10ca03ca202eb12df3513e"} err="failed to get container status \"937434d3b490d52c33f42fba35b72abc651a40c90d10ca03ca202eb12df3513e\": rpc error: code = NotFound desc = could not find container \"937434d3b490d52c33f42fba35b72abc651a40c90d10ca03ca202eb12df3513e\": container with ID starting with 937434d3b490d52c33f42fba35b72abc651a40c90d10ca03ca202eb12df3513e not found: ID does not exist" Jul 08 01:45:25.408684 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.408660 2563 scope.go:117] "RemoveContainer" containerID="dea8041483fe16e543189a14ef90e2b4ff5713ee971b0f637843b6b57e39723c" Jul 08 01:45:25.408860 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:45:25.408843 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dea8041483fe16e543189a14ef90e2b4ff5713ee971b0f637843b6b57e39723c\": container with ID starting with dea8041483fe16e543189a14ef90e2b4ff5713ee971b0f637843b6b57e39723c not found: ID does not exist" containerID="dea8041483fe16e543189a14ef90e2b4ff5713ee971b0f637843b6b57e39723c" Jul 08 01:45:25.408897 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.408869 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dea8041483fe16e543189a14ef90e2b4ff5713ee971b0f637843b6b57e39723c"} err="failed to get container status \"dea8041483fe16e543189a14ef90e2b4ff5713ee971b0f637843b6b57e39723c\": rpc error: code = NotFound desc = could not find container \"dea8041483fe16e543189a14ef90e2b4ff5713ee971b0f637843b6b57e39723c\": container with ID starting with dea8041483fe16e543189a14ef90e2b4ff5713ee971b0f637843b6b57e39723c not found: ID does not exist" Jul 08 01:45:25.408897 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.408883 2563 scope.go:117] "RemoveContainer" containerID="babd11c9b9aeafdc241bd0689258ad233e04d9ca903e0a050d7bf30665695005" Jul 08 01:45:25.409114 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:45:25.409098 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"babd11c9b9aeafdc241bd0689258ad233e04d9ca903e0a050d7bf30665695005\": container with ID starting with babd11c9b9aeafdc241bd0689258ad233e04d9ca903e0a050d7bf30665695005 not found: ID does not exist" containerID="babd11c9b9aeafdc241bd0689258ad233e04d9ca903e0a050d7bf30665695005" Jul 08 01:45:25.409173 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.409120 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"babd11c9b9aeafdc241bd0689258ad233e04d9ca903e0a050d7bf30665695005"} err="failed to get container status \"babd11c9b9aeafdc241bd0689258ad233e04d9ca903e0a050d7bf30665695005\": rpc error: code = NotFound desc = could not find container \"babd11c9b9aeafdc241bd0689258ad233e04d9ca903e0a050d7bf30665695005\": container with ID starting with babd11c9b9aeafdc241bd0689258ad233e04d9ca903e0a050d7bf30665695005 not found: ID does not exist" Jul 08 01:45:25.409173 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.409139 2563 scope.go:117] "RemoveContainer" containerID="d59c6fd4c3503e788cef48720325e3aa2dee45720a1519714c1ec2c8fb7150eb" Jul 08 01:45:25.409365 ip-10-0-142-233 kubenswrapper[2563]: E0708 01:45:25.409349 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d59c6fd4c3503e788cef48720325e3aa2dee45720a1519714c1ec2c8fb7150eb\": container with ID starting with d59c6fd4c3503e788cef48720325e3aa2dee45720a1519714c1ec2c8fb7150eb not found: ID does not exist" containerID="d59c6fd4c3503e788cef48720325e3aa2dee45720a1519714c1ec2c8fb7150eb" Jul 08 01:45:25.409424 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.409370 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d59c6fd4c3503e788cef48720325e3aa2dee45720a1519714c1ec2c8fb7150eb"} err="failed to get container status \"d59c6fd4c3503e788cef48720325e3aa2dee45720a1519714c1ec2c8fb7150eb\": rpc error: code = NotFound desc = could not find container \"d59c6fd4c3503e788cef48720325e3aa2dee45720a1519714c1ec2c8fb7150eb\": container with ID starting with d59c6fd4c3503e788cef48720325e3aa2dee45720a1519714c1ec2c8fb7150eb not found: ID does not exist" Jul 08 01:45:25.409424 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.409387 2563 scope.go:117] "RemoveContainer" containerID="4d8d8643b1a655c97a579f3c5e760cf9bef4486fadbd6b18b736d78d4376cf49" Jul 08 01:45:25.409586 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.409569 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d8d8643b1a655c97a579f3c5e760cf9bef4486fadbd6b18b736d78d4376cf49"} err="failed to get container status \"4d8d8643b1a655c97a579f3c5e760cf9bef4486fadbd6b18b736d78d4376cf49\": rpc error: code = NotFound desc = could not find container \"4d8d8643b1a655c97a579f3c5e760cf9bef4486fadbd6b18b736d78d4376cf49\": container with ID starting with 4d8d8643b1a655c97a579f3c5e760cf9bef4486fadbd6b18b736d78d4376cf49 not found: ID does not exist" Jul 08 01:45:25.409627 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.409586 2563 scope.go:117] "RemoveContainer" containerID="d96d0fd86546e227491ebc79bd18d3ffda58339021636d8418af2af72f11f9ac" Jul 08 01:45:25.409763 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.409744 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d96d0fd86546e227491ebc79bd18d3ffda58339021636d8418af2af72f11f9ac"} err="failed to get container status \"d96d0fd86546e227491ebc79bd18d3ffda58339021636d8418af2af72f11f9ac\": rpc error: code = NotFound desc = could not find container \"d96d0fd86546e227491ebc79bd18d3ffda58339021636d8418af2af72f11f9ac\": container with ID starting with d96d0fd86546e227491ebc79bd18d3ffda58339021636d8418af2af72f11f9ac not found: ID does not exist" Jul 08 01:45:25.409835 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.409765 2563 scope.go:117] "RemoveContainer" containerID="67293e88bdc2aa83ea4b1a1f59dace5df32578755158bb7988971f131e519b11" Jul 08 01:45:25.409958 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.409943 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"67293e88bdc2aa83ea4b1a1f59dace5df32578755158bb7988971f131e519b11"} err="failed to get container status \"67293e88bdc2aa83ea4b1a1f59dace5df32578755158bb7988971f131e519b11\": rpc error: code = NotFound desc = could not find container \"67293e88bdc2aa83ea4b1a1f59dace5df32578755158bb7988971f131e519b11\": container with ID starting with 67293e88bdc2aa83ea4b1a1f59dace5df32578755158bb7988971f131e519b11 not found: ID does not exist" Jul 08 01:45:25.410006 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.409958 2563 scope.go:117] "RemoveContainer" containerID="937434d3b490d52c33f42fba35b72abc651a40c90d10ca03ca202eb12df3513e" Jul 08 01:45:25.410154 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.410136 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"937434d3b490d52c33f42fba35b72abc651a40c90d10ca03ca202eb12df3513e"} err="failed to get container status \"937434d3b490d52c33f42fba35b72abc651a40c90d10ca03ca202eb12df3513e\": rpc error: code = NotFound desc = could not find container \"937434d3b490d52c33f42fba35b72abc651a40c90d10ca03ca202eb12df3513e\": container with ID starting with 937434d3b490d52c33f42fba35b72abc651a40c90d10ca03ca202eb12df3513e not found: ID does not exist" Jul 08 01:45:25.410216 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.410154 2563 scope.go:117] "RemoveContainer" containerID="dea8041483fe16e543189a14ef90e2b4ff5713ee971b0f637843b6b57e39723c" Jul 08 01:45:25.410399 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.410380 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dea8041483fe16e543189a14ef90e2b4ff5713ee971b0f637843b6b57e39723c"} err="failed to get container status \"dea8041483fe16e543189a14ef90e2b4ff5713ee971b0f637843b6b57e39723c\": rpc error: code = NotFound desc = could not find container \"dea8041483fe16e543189a14ef90e2b4ff5713ee971b0f637843b6b57e39723c\": container with ID starting with dea8041483fe16e543189a14ef90e2b4ff5713ee971b0f637843b6b57e39723c not found: ID does not exist" Jul 08 01:45:25.410472 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.410400 2563 scope.go:117] "RemoveContainer" containerID="babd11c9b9aeafdc241bd0689258ad233e04d9ca903e0a050d7bf30665695005" Jul 08 01:45:25.410607 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.410588 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"babd11c9b9aeafdc241bd0689258ad233e04d9ca903e0a050d7bf30665695005"} err="failed to get container status \"babd11c9b9aeafdc241bd0689258ad233e04d9ca903e0a050d7bf30665695005\": rpc error: code = NotFound desc = could not find container \"babd11c9b9aeafdc241bd0689258ad233e04d9ca903e0a050d7bf30665695005\": container with ID starting with babd11c9b9aeafdc241bd0689258ad233e04d9ca903e0a050d7bf30665695005 not found: ID does not exist" Jul 08 01:45:25.410607 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.410614 2563 scope.go:117] "RemoveContainer" containerID="d59c6fd4c3503e788cef48720325e3aa2dee45720a1519714c1ec2c8fb7150eb" Jul 08 01:45:25.410926 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.410898 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d59c6fd4c3503e788cef48720325e3aa2dee45720a1519714c1ec2c8fb7150eb"} err="failed to get container status \"d59c6fd4c3503e788cef48720325e3aa2dee45720a1519714c1ec2c8fb7150eb\": rpc error: code = NotFound desc = could not find container \"d59c6fd4c3503e788cef48720325e3aa2dee45720a1519714c1ec2c8fb7150eb\": container with ID starting with d59c6fd4c3503e788cef48720325e3aa2dee45720a1519714c1ec2c8fb7150eb not found: ID does not exist" Jul 08 01:45:25.410926 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.410924 2563 scope.go:117] "RemoveContainer" containerID="4d8d8643b1a655c97a579f3c5e760cf9bef4486fadbd6b18b736d78d4376cf49" Jul 08 01:45:25.411827 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.411769 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d8d8643b1a655c97a579f3c5e760cf9bef4486fadbd6b18b736d78d4376cf49"} err="failed to get container status \"4d8d8643b1a655c97a579f3c5e760cf9bef4486fadbd6b18b736d78d4376cf49\": rpc error: code = NotFound desc = could not find container \"4d8d8643b1a655c97a579f3c5e760cf9bef4486fadbd6b18b736d78d4376cf49\": container with ID starting with 4d8d8643b1a655c97a579f3c5e760cf9bef4486fadbd6b18b736d78d4376cf49 not found: ID does not exist" Jul 08 01:45:25.411827 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.411796 2563 scope.go:117] "RemoveContainer" containerID="d96d0fd86546e227491ebc79bd18d3ffda58339021636d8418af2af72f11f9ac" Jul 08 01:45:25.412182 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.412098 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d96d0fd86546e227491ebc79bd18d3ffda58339021636d8418af2af72f11f9ac"} err="failed to get container status \"d96d0fd86546e227491ebc79bd18d3ffda58339021636d8418af2af72f11f9ac\": rpc error: code = NotFound desc = could not find container \"d96d0fd86546e227491ebc79bd18d3ffda58339021636d8418af2af72f11f9ac\": container with ID starting with d96d0fd86546e227491ebc79bd18d3ffda58339021636d8418af2af72f11f9ac not found: ID does not exist" Jul 08 01:45:25.412182 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.412124 2563 scope.go:117] "RemoveContainer" containerID="67293e88bdc2aa83ea4b1a1f59dace5df32578755158bb7988971f131e519b11" Jul 08 01:45:25.412656 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.412637 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"67293e88bdc2aa83ea4b1a1f59dace5df32578755158bb7988971f131e519b11"} err="failed to get container status \"67293e88bdc2aa83ea4b1a1f59dace5df32578755158bb7988971f131e519b11\": rpc error: code = NotFound desc = could not find container \"67293e88bdc2aa83ea4b1a1f59dace5df32578755158bb7988971f131e519b11\": container with ID starting with 67293e88bdc2aa83ea4b1a1f59dace5df32578755158bb7988971f131e519b11 not found: ID does not exist" Jul 08 01:45:25.412656 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.412657 2563 scope.go:117] "RemoveContainer" containerID="937434d3b490d52c33f42fba35b72abc651a40c90d10ca03ca202eb12df3513e" Jul 08 01:45:25.412918 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.412901 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"937434d3b490d52c33f42fba35b72abc651a40c90d10ca03ca202eb12df3513e"} err="failed to get container status \"937434d3b490d52c33f42fba35b72abc651a40c90d10ca03ca202eb12df3513e\": rpc error: code = NotFound desc = could not find container \"937434d3b490d52c33f42fba35b72abc651a40c90d10ca03ca202eb12df3513e\": container with ID starting with 937434d3b490d52c33f42fba35b72abc651a40c90d10ca03ca202eb12df3513e not found: ID does not exist" Jul 08 01:45:25.412918 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.412919 2563 scope.go:117] "RemoveContainer" containerID="dea8041483fe16e543189a14ef90e2b4ff5713ee971b0f637843b6b57e39723c" Jul 08 01:45:25.413060 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.413041 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 08 01:45:25.413138 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.413124 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dea8041483fe16e543189a14ef90e2b4ff5713ee971b0f637843b6b57e39723c"} err="failed to get container status \"dea8041483fe16e543189a14ef90e2b4ff5713ee971b0f637843b6b57e39723c\": rpc error: code = NotFound desc = could not find container \"dea8041483fe16e543189a14ef90e2b4ff5713ee971b0f637843b6b57e39723c\": container with ID starting with dea8041483fe16e543189a14ef90e2b4ff5713ee971b0f637843b6b57e39723c not found: ID does not exist" Jul 08 01:45:25.413179 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.413139 2563 scope.go:117] "RemoveContainer" containerID="babd11c9b9aeafdc241bd0689258ad233e04d9ca903e0a050d7bf30665695005" Jul 08 01:45:25.413388 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.413371 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"babd11c9b9aeafdc241bd0689258ad233e04d9ca903e0a050d7bf30665695005"} err="failed to get container status \"babd11c9b9aeafdc241bd0689258ad233e04d9ca903e0a050d7bf30665695005\": rpc error: code = NotFound desc = could not find container \"babd11c9b9aeafdc241bd0689258ad233e04d9ca903e0a050d7bf30665695005\": container with ID starting with babd11c9b9aeafdc241bd0689258ad233e04d9ca903e0a050d7bf30665695005 not found: ID does not exist" Jul 08 01:45:25.413435 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.413389 2563 scope.go:117] "RemoveContainer" containerID="d59c6fd4c3503e788cef48720325e3aa2dee45720a1519714c1ec2c8fb7150eb" Jul 08 01:45:25.413435 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.413416 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8454f12b-eb6b-4003-bffa-05b00de97455" containerName="init-config-reloader" Jul 08 01:45:25.413435 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.413427 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="8454f12b-eb6b-4003-bffa-05b00de97455" containerName="init-config-reloader" Jul 08 01:45:25.413565 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.413441 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8454f12b-eb6b-4003-bffa-05b00de97455" containerName="config-reloader" Jul 08 01:45:25.413565 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.413449 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="8454f12b-eb6b-4003-bffa-05b00de97455" containerName="config-reloader" Jul 08 01:45:25.413565 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.413459 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8454f12b-eb6b-4003-bffa-05b00de97455" containerName="kube-rbac-proxy-thanos" Jul 08 01:45:25.413565 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.413465 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="8454f12b-eb6b-4003-bffa-05b00de97455" containerName="kube-rbac-proxy-thanos" Jul 08 01:45:25.413565 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.413477 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8454f12b-eb6b-4003-bffa-05b00de97455" containerName="kube-rbac-proxy" Jul 08 01:45:25.413565 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.413485 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="8454f12b-eb6b-4003-bffa-05b00de97455" containerName="kube-rbac-proxy" Jul 08 01:45:25.413565 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.413496 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8454f12b-eb6b-4003-bffa-05b00de97455" containerName="thanos-sidecar" Jul 08 01:45:25.413565 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.413504 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="8454f12b-eb6b-4003-bffa-05b00de97455" containerName="thanos-sidecar" Jul 08 01:45:25.413565 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.413515 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8454f12b-eb6b-4003-bffa-05b00de97455" containerName="kube-rbac-proxy-web" Jul 08 01:45:25.413565 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.413522 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="8454f12b-eb6b-4003-bffa-05b00de97455" containerName="kube-rbac-proxy-web" Jul 08 01:45:25.413565 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.413532 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8454f12b-eb6b-4003-bffa-05b00de97455" containerName="prometheus" Jul 08 01:45:25.413565 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.413536 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="8454f12b-eb6b-4003-bffa-05b00de97455" containerName="prometheus" Jul 08 01:45:25.413911 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.413590 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d59c6fd4c3503e788cef48720325e3aa2dee45720a1519714c1ec2c8fb7150eb"} err="failed to get container status \"d59c6fd4c3503e788cef48720325e3aa2dee45720a1519714c1ec2c8fb7150eb\": rpc error: code = NotFound desc = could not find container \"d59c6fd4c3503e788cef48720325e3aa2dee45720a1519714c1ec2c8fb7150eb\": container with ID starting with d59c6fd4c3503e788cef48720325e3aa2dee45720a1519714c1ec2c8fb7150eb not found: ID does not exist" Jul 08 01:45:25.413911 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.413609 2563 scope.go:117] "RemoveContainer" containerID="4d8d8643b1a655c97a579f3c5e760cf9bef4486fadbd6b18b736d78d4376cf49" Jul 08 01:45:25.413911 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.413613 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="8454f12b-eb6b-4003-bffa-05b00de97455" containerName="config-reloader" Jul 08 01:45:25.413911 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.413623 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="8454f12b-eb6b-4003-bffa-05b00de97455" containerName="thanos-sidecar" Jul 08 01:45:25.413911 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.413632 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="8454f12b-eb6b-4003-bffa-05b00de97455" containerName="prometheus" Jul 08 01:45:25.413911 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.413642 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="8454f12b-eb6b-4003-bffa-05b00de97455" containerName="kube-rbac-proxy-web" Jul 08 01:45:25.413911 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.413651 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="8454f12b-eb6b-4003-bffa-05b00de97455" containerName="kube-rbac-proxy-thanos" Jul 08 01:45:25.413911 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.413661 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="8454f12b-eb6b-4003-bffa-05b00de97455" containerName="kube-rbac-proxy" Jul 08 01:45:25.413911 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.413795 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d8d8643b1a655c97a579f3c5e760cf9bef4486fadbd6b18b736d78d4376cf49"} err="failed to get container status \"4d8d8643b1a655c97a579f3c5e760cf9bef4486fadbd6b18b736d78d4376cf49\": rpc error: code = NotFound desc = could not find container \"4d8d8643b1a655c97a579f3c5e760cf9bef4486fadbd6b18b736d78d4376cf49\": container with ID starting with 4d8d8643b1a655c97a579f3c5e760cf9bef4486fadbd6b18b736d78d4376cf49 not found: ID does not exist" Jul 08 01:45:25.413911 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.413810 2563 scope.go:117] "RemoveContainer" containerID="d96d0fd86546e227491ebc79bd18d3ffda58339021636d8418af2af72f11f9ac" Jul 08 01:45:25.414239 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.413971 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d96d0fd86546e227491ebc79bd18d3ffda58339021636d8418af2af72f11f9ac"} err="failed to get container status \"d96d0fd86546e227491ebc79bd18d3ffda58339021636d8418af2af72f11f9ac\": rpc error: code = NotFound desc = could not find container \"d96d0fd86546e227491ebc79bd18d3ffda58339021636d8418af2af72f11f9ac\": container with ID starting with d96d0fd86546e227491ebc79bd18d3ffda58339021636d8418af2af72f11f9ac not found: ID does not exist" Jul 08 01:45:25.414239 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.413987 2563 scope.go:117] "RemoveContainer" containerID="67293e88bdc2aa83ea4b1a1f59dace5df32578755158bb7988971f131e519b11" Jul 08 01:45:25.414239 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.414151 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"67293e88bdc2aa83ea4b1a1f59dace5df32578755158bb7988971f131e519b11"} err="failed to get container status \"67293e88bdc2aa83ea4b1a1f59dace5df32578755158bb7988971f131e519b11\": rpc error: code = NotFound desc = could not find container \"67293e88bdc2aa83ea4b1a1f59dace5df32578755158bb7988971f131e519b11\": container with ID starting with 67293e88bdc2aa83ea4b1a1f59dace5df32578755158bb7988971f131e519b11 not found: ID does not exist" Jul 08 01:45:25.414239 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.414165 2563 scope.go:117] "RemoveContainer" containerID="937434d3b490d52c33f42fba35b72abc651a40c90d10ca03ca202eb12df3513e" Jul 08 01:45:25.414401 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.414385 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"937434d3b490d52c33f42fba35b72abc651a40c90d10ca03ca202eb12df3513e"} err="failed to get container status \"937434d3b490d52c33f42fba35b72abc651a40c90d10ca03ca202eb12df3513e\": rpc error: code = NotFound desc = could not find container \"937434d3b490d52c33f42fba35b72abc651a40c90d10ca03ca202eb12df3513e\": container with ID starting with 937434d3b490d52c33f42fba35b72abc651a40c90d10ca03ca202eb12df3513e not found: ID does not exist" Jul 08 01:45:25.414436 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.414401 2563 scope.go:117] "RemoveContainer" containerID="dea8041483fe16e543189a14ef90e2b4ff5713ee971b0f637843b6b57e39723c" Jul 08 01:45:25.414669 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.414634 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dea8041483fe16e543189a14ef90e2b4ff5713ee971b0f637843b6b57e39723c"} err="failed to get container status \"dea8041483fe16e543189a14ef90e2b4ff5713ee971b0f637843b6b57e39723c\": rpc error: code = NotFound desc = could not find container \"dea8041483fe16e543189a14ef90e2b4ff5713ee971b0f637843b6b57e39723c\": container with ID starting with dea8041483fe16e543189a14ef90e2b4ff5713ee971b0f637843b6b57e39723c not found: ID does not exist" Jul 08 01:45:25.414738 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.414671 2563 scope.go:117] "RemoveContainer" containerID="babd11c9b9aeafdc241bd0689258ad233e04d9ca903e0a050d7bf30665695005" Jul 08 01:45:25.414964 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.414946 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"babd11c9b9aeafdc241bd0689258ad233e04d9ca903e0a050d7bf30665695005"} err="failed to get container status \"babd11c9b9aeafdc241bd0689258ad233e04d9ca903e0a050d7bf30665695005\": rpc error: code = NotFound desc = could not find container \"babd11c9b9aeafdc241bd0689258ad233e04d9ca903e0a050d7bf30665695005\": container with ID starting with babd11c9b9aeafdc241bd0689258ad233e04d9ca903e0a050d7bf30665695005 not found: ID does not exist" Jul 08 01:45:25.414964 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.414964 2563 scope.go:117] "RemoveContainer" containerID="d59c6fd4c3503e788cef48720325e3aa2dee45720a1519714c1ec2c8fb7150eb" Jul 08 01:45:25.415213 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.415177 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d59c6fd4c3503e788cef48720325e3aa2dee45720a1519714c1ec2c8fb7150eb"} err="failed to get container status \"d59c6fd4c3503e788cef48720325e3aa2dee45720a1519714c1ec2c8fb7150eb\": rpc error: code = NotFound desc = could not find container \"d59c6fd4c3503e788cef48720325e3aa2dee45720a1519714c1ec2c8fb7150eb\": container with ID starting with d59c6fd4c3503e788cef48720325e3aa2dee45720a1519714c1ec2c8fb7150eb not found: ID does not exist" Jul 08 01:45:25.415266 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.415213 2563 scope.go:117] "RemoveContainer" containerID="4d8d8643b1a655c97a579f3c5e760cf9bef4486fadbd6b18b736d78d4376cf49" Jul 08 01:45:25.415452 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.415435 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d8d8643b1a655c97a579f3c5e760cf9bef4486fadbd6b18b736d78d4376cf49"} err="failed to get container status \"4d8d8643b1a655c97a579f3c5e760cf9bef4486fadbd6b18b736d78d4376cf49\": rpc error: code = NotFound desc = could not find container \"4d8d8643b1a655c97a579f3c5e760cf9bef4486fadbd6b18b736d78d4376cf49\": container with ID starting with 4d8d8643b1a655c97a579f3c5e760cf9bef4486fadbd6b18b736d78d4376cf49 not found: ID does not exist" Jul 08 01:45:25.415505 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.415452 2563 scope.go:117] "RemoveContainer" containerID="d96d0fd86546e227491ebc79bd18d3ffda58339021636d8418af2af72f11f9ac" Jul 08 01:45:25.415648 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.415631 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d96d0fd86546e227491ebc79bd18d3ffda58339021636d8418af2af72f11f9ac"} err="failed to get container status \"d96d0fd86546e227491ebc79bd18d3ffda58339021636d8418af2af72f11f9ac\": rpc error: code = NotFound desc = could not find container \"d96d0fd86546e227491ebc79bd18d3ffda58339021636d8418af2af72f11f9ac\": container with ID starting with d96d0fd86546e227491ebc79bd18d3ffda58339021636d8418af2af72f11f9ac not found: ID does not exist" Jul 08 01:45:25.415701 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.415648 2563 scope.go:117] "RemoveContainer" containerID="67293e88bdc2aa83ea4b1a1f59dace5df32578755158bb7988971f131e519b11" Jul 08 01:45:25.415859 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.415845 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"67293e88bdc2aa83ea4b1a1f59dace5df32578755158bb7988971f131e519b11"} err="failed to get container status \"67293e88bdc2aa83ea4b1a1f59dace5df32578755158bb7988971f131e519b11\": rpc error: code = NotFound desc = could not find container \"67293e88bdc2aa83ea4b1a1f59dace5df32578755158bb7988971f131e519b11\": container with ID starting with 67293e88bdc2aa83ea4b1a1f59dace5df32578755158bb7988971f131e519b11 not found: ID does not exist" Jul 08 01:45:25.415859 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.415858 2563 scope.go:117] "RemoveContainer" containerID="937434d3b490d52c33f42fba35b72abc651a40c90d10ca03ca202eb12df3513e" Jul 08 01:45:25.416098 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.416081 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"937434d3b490d52c33f42fba35b72abc651a40c90d10ca03ca202eb12df3513e"} err="failed to get container status \"937434d3b490d52c33f42fba35b72abc651a40c90d10ca03ca202eb12df3513e\": rpc error: code = NotFound desc = could not find container \"937434d3b490d52c33f42fba35b72abc651a40c90d10ca03ca202eb12df3513e\": container with ID starting with 937434d3b490d52c33f42fba35b72abc651a40c90d10ca03ca202eb12df3513e not found: ID does not exist" Jul 08 01:45:25.416151 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.416098 2563 scope.go:117] "RemoveContainer" containerID="dea8041483fe16e543189a14ef90e2b4ff5713ee971b0f637843b6b57e39723c" Jul 08 01:45:25.416306 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.416290 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dea8041483fe16e543189a14ef90e2b4ff5713ee971b0f637843b6b57e39723c"} err="failed to get container status \"dea8041483fe16e543189a14ef90e2b4ff5713ee971b0f637843b6b57e39723c\": rpc error: code = NotFound desc = could not find container \"dea8041483fe16e543189a14ef90e2b4ff5713ee971b0f637843b6b57e39723c\": container with ID starting with dea8041483fe16e543189a14ef90e2b4ff5713ee971b0f637843b6b57e39723c not found: ID does not exist" Jul 08 01:45:25.416358 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.416306 2563 scope.go:117] "RemoveContainer" containerID="babd11c9b9aeafdc241bd0689258ad233e04d9ca903e0a050d7bf30665695005" Jul 08 01:45:25.416513 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.416495 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"babd11c9b9aeafdc241bd0689258ad233e04d9ca903e0a050d7bf30665695005"} err="failed to get container status \"babd11c9b9aeafdc241bd0689258ad233e04d9ca903e0a050d7bf30665695005\": rpc error: code = NotFound desc = could not find container \"babd11c9b9aeafdc241bd0689258ad233e04d9ca903e0a050d7bf30665695005\": container with ID starting with babd11c9b9aeafdc241bd0689258ad233e04d9ca903e0a050d7bf30665695005 not found: ID does not exist" Jul 08 01:45:25.416564 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.416513 2563 scope.go:117] "RemoveContainer" containerID="d59c6fd4c3503e788cef48720325e3aa2dee45720a1519714c1ec2c8fb7150eb" Jul 08 01:45:25.416751 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.416731 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d59c6fd4c3503e788cef48720325e3aa2dee45720a1519714c1ec2c8fb7150eb"} err="failed to get container status \"d59c6fd4c3503e788cef48720325e3aa2dee45720a1519714c1ec2c8fb7150eb\": rpc error: code = NotFound desc = could not find container \"d59c6fd4c3503e788cef48720325e3aa2dee45720a1519714c1ec2c8fb7150eb\": container with ID starting with d59c6fd4c3503e788cef48720325e3aa2dee45720a1519714c1ec2c8fb7150eb not found: ID does not exist" Jul 08 01:45:25.416751 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.416750 2563 scope.go:117] "RemoveContainer" containerID="4d8d8643b1a655c97a579f3c5e760cf9bef4486fadbd6b18b736d78d4376cf49" Jul 08 01:45:25.416935 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.416921 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d8d8643b1a655c97a579f3c5e760cf9bef4486fadbd6b18b736d78d4376cf49"} err="failed to get container status \"4d8d8643b1a655c97a579f3c5e760cf9bef4486fadbd6b18b736d78d4376cf49\": rpc error: code = NotFound desc = could not find container \"4d8d8643b1a655c97a579f3c5e760cf9bef4486fadbd6b18b736d78d4376cf49\": container with ID starting with 4d8d8643b1a655c97a579f3c5e760cf9bef4486fadbd6b18b736d78d4376cf49 not found: ID does not exist" Jul 08 01:45:25.416977 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.416934 2563 scope.go:117] "RemoveContainer" containerID="d96d0fd86546e227491ebc79bd18d3ffda58339021636d8418af2af72f11f9ac" Jul 08 01:45:25.417101 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.417088 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d96d0fd86546e227491ebc79bd18d3ffda58339021636d8418af2af72f11f9ac"} err="failed to get container status \"d96d0fd86546e227491ebc79bd18d3ffda58339021636d8418af2af72f11f9ac\": rpc error: code = NotFound desc = could not find container \"d96d0fd86546e227491ebc79bd18d3ffda58339021636d8418af2af72f11f9ac\": container with ID starting with d96d0fd86546e227491ebc79bd18d3ffda58339021636d8418af2af72f11f9ac not found: ID does not exist" Jul 08 01:45:25.417147 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.417101 2563 scope.go:117] "RemoveContainer" containerID="67293e88bdc2aa83ea4b1a1f59dace5df32578755158bb7988971f131e519b11" Jul 08 01:45:25.417317 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.417299 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"67293e88bdc2aa83ea4b1a1f59dace5df32578755158bb7988971f131e519b11"} err="failed to get container status \"67293e88bdc2aa83ea4b1a1f59dace5df32578755158bb7988971f131e519b11\": rpc error: code = NotFound desc = could not find container \"67293e88bdc2aa83ea4b1a1f59dace5df32578755158bb7988971f131e519b11\": container with ID starting with 67293e88bdc2aa83ea4b1a1f59dace5df32578755158bb7988971f131e519b11 not found: ID does not exist" Jul 08 01:45:25.417378 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.417318 2563 scope.go:117] "RemoveContainer" containerID="937434d3b490d52c33f42fba35b72abc651a40c90d10ca03ca202eb12df3513e" Jul 08 01:45:25.417493 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.417478 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"937434d3b490d52c33f42fba35b72abc651a40c90d10ca03ca202eb12df3513e"} err="failed to get container status \"937434d3b490d52c33f42fba35b72abc651a40c90d10ca03ca202eb12df3513e\": rpc error: code = NotFound desc = could not find container \"937434d3b490d52c33f42fba35b72abc651a40c90d10ca03ca202eb12df3513e\": container with ID starting with 937434d3b490d52c33f42fba35b72abc651a40c90d10ca03ca202eb12df3513e not found: ID does not exist" Jul 08 01:45:25.417538 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.417493 2563 scope.go:117] "RemoveContainer" containerID="dea8041483fe16e543189a14ef90e2b4ff5713ee971b0f637843b6b57e39723c" Jul 08 01:45:25.417724 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.417703 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dea8041483fe16e543189a14ef90e2b4ff5713ee971b0f637843b6b57e39723c"} err="failed to get container status \"dea8041483fe16e543189a14ef90e2b4ff5713ee971b0f637843b6b57e39723c\": rpc error: code = NotFound desc = could not find container \"dea8041483fe16e543189a14ef90e2b4ff5713ee971b0f637843b6b57e39723c\": container with ID starting with dea8041483fe16e543189a14ef90e2b4ff5713ee971b0f637843b6b57e39723c not found: ID does not exist" Jul 08 01:45:25.417775 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.417726 2563 scope.go:117] "RemoveContainer" containerID="babd11c9b9aeafdc241bd0689258ad233e04d9ca903e0a050d7bf30665695005" Jul 08 01:45:25.417942 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.417924 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"babd11c9b9aeafdc241bd0689258ad233e04d9ca903e0a050d7bf30665695005"} err="failed to get container status \"babd11c9b9aeafdc241bd0689258ad233e04d9ca903e0a050d7bf30665695005\": rpc error: code = NotFound desc = could not find container \"babd11c9b9aeafdc241bd0689258ad233e04d9ca903e0a050d7bf30665695005\": container with ID starting with babd11c9b9aeafdc241bd0689258ad233e04d9ca903e0a050d7bf30665695005 not found: ID does not exist" Jul 08 01:45:25.418003 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.417946 2563 scope.go:117] "RemoveContainer" containerID="d59c6fd4c3503e788cef48720325e3aa2dee45720a1519714c1ec2c8fb7150eb" Jul 08 01:45:25.418214 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.418175 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d59c6fd4c3503e788cef48720325e3aa2dee45720a1519714c1ec2c8fb7150eb"} err="failed to get container status \"d59c6fd4c3503e788cef48720325e3aa2dee45720a1519714c1ec2c8fb7150eb\": rpc error: code = NotFound desc = could not find container \"d59c6fd4c3503e788cef48720325e3aa2dee45720a1519714c1ec2c8fb7150eb\": container with ID starting with d59c6fd4c3503e788cef48720325e3aa2dee45720a1519714c1ec2c8fb7150eb not found: ID does not exist" Jul 08 01:45:25.419399 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.419383 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 08 01:45:25.422005 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.421985 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 08 01:45:25.422104 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.421990 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 08 01:45:25.422177 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.422160 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 08 01:45:25.422336 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.422322 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 08 01:45:25.422834 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.422819 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 08 01:45:25.422885 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.422850 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 08 01:45:25.423157 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.423092 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-d5q4ai0pubjvs\"" Jul 08 01:45:25.423157 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.423143 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 08 01:45:25.423679 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.423659 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 08 01:45:25.423679 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.423670 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-qxv4v\"" Jul 08 01:45:25.423826 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.423666 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 08 01:45:25.424365 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.424350 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 08 01:45:25.424365 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.424357 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 08 01:45:25.424481 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.424417 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 08 01:45:25.425712 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.425693 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 08 01:45:25.427781 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.427761 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 08 01:45:25.441864 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.437575 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 08 01:45:25.519807 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.519769 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/66beb821-daec-44bf-9f8e-065a6747f53e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"66beb821-daec-44bf-9f8e-065a6747f53e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 01:45:25.519807 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.519807 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/66beb821-daec-44bf-9f8e-065a6747f53e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"66beb821-daec-44bf-9f8e-065a6747f53e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 01:45:25.520020 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.519826 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/66beb821-daec-44bf-9f8e-065a6747f53e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"66beb821-daec-44bf-9f8e-065a6747f53e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 01:45:25.520020 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.519877 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/66beb821-daec-44bf-9f8e-065a6747f53e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"66beb821-daec-44bf-9f8e-065a6747f53e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 01:45:25.520020 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.519913 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/66beb821-daec-44bf-9f8e-065a6747f53e-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"66beb821-daec-44bf-9f8e-065a6747f53e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 01:45:25.520020 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.519935 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/66beb821-daec-44bf-9f8e-065a6747f53e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"66beb821-daec-44bf-9f8e-065a6747f53e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 01:45:25.520020 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.519955 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/66beb821-daec-44bf-9f8e-065a6747f53e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"66beb821-daec-44bf-9f8e-065a6747f53e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 01:45:25.520020 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.519971 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/66beb821-daec-44bf-9f8e-065a6747f53e-web-config\") pod \"prometheus-k8s-0\" (UID: \"66beb821-daec-44bf-9f8e-065a6747f53e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 01:45:25.520020 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.519983 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/66beb821-daec-44bf-9f8e-065a6747f53e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"66beb821-daec-44bf-9f8e-065a6747f53e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 01:45:25.520020 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.520000 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/66beb821-daec-44bf-9f8e-065a6747f53e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"66beb821-daec-44bf-9f8e-065a6747f53e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 01:45:25.520308 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.520074 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xjl9m\" (UniqueName: \"kubernetes.io/projected/66beb821-daec-44bf-9f8e-065a6747f53e-kube-api-access-xjl9m\") pod \"prometheus-k8s-0\" (UID: \"66beb821-daec-44bf-9f8e-065a6747f53e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 01:45:25.520308 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.520106 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/66beb821-daec-44bf-9f8e-065a6747f53e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"66beb821-daec-44bf-9f8e-065a6747f53e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 01:45:25.520308 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.520138 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/66beb821-daec-44bf-9f8e-065a6747f53e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"66beb821-daec-44bf-9f8e-065a6747f53e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 01:45:25.520308 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.520154 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/66beb821-daec-44bf-9f8e-065a6747f53e-config-out\") pod \"prometheus-k8s-0\" (UID: \"66beb821-daec-44bf-9f8e-065a6747f53e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 01:45:25.520308 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.520175 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/66beb821-daec-44bf-9f8e-065a6747f53e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"66beb821-daec-44bf-9f8e-065a6747f53e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 01:45:25.520308 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.520188 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/66beb821-daec-44bf-9f8e-065a6747f53e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"66beb821-daec-44bf-9f8e-065a6747f53e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 01:45:25.520308 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.520261 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/66beb821-daec-44bf-9f8e-065a6747f53e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"66beb821-daec-44bf-9f8e-065a6747f53e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 01:45:25.520308 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.520287 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/66beb821-daec-44bf-9f8e-065a6747f53e-config\") pod \"prometheus-k8s-0\" (UID: \"66beb821-daec-44bf-9f8e-065a6747f53e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 01:45:25.520308 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.520301 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/66beb821-daec-44bf-9f8e-065a6747f53e-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"66beb821-daec-44bf-9f8e-065a6747f53e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 01:45:25.520592 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.520319 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/66beb821-daec-44bf-9f8e-065a6747f53e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"66beb821-daec-44bf-9f8e-065a6747f53e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 01:45:25.621269 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.621185 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/66beb821-daec-44bf-9f8e-065a6747f53e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"66beb821-daec-44bf-9f8e-065a6747f53e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 01:45:25.621269 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.621232 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/66beb821-daec-44bf-9f8e-065a6747f53e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"66beb821-daec-44bf-9f8e-065a6747f53e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 01:45:25.621394 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.621343 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/66beb821-daec-44bf-9f8e-065a6747f53e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"66beb821-daec-44bf-9f8e-065a6747f53e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 01:45:25.621394 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.621382 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/66beb821-daec-44bf-9f8e-065a6747f53e-config\") pod \"prometheus-k8s-0\" (UID: \"66beb821-daec-44bf-9f8e-065a6747f53e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 01:45:25.621476 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.621398 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/66beb821-daec-44bf-9f8e-065a6747f53e-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"66beb821-daec-44bf-9f8e-065a6747f53e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 01:45:25.621555 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.621533 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/66beb821-daec-44bf-9f8e-065a6747f53e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"66beb821-daec-44bf-9f8e-065a6747f53e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 01:45:25.621609 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.621587 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/66beb821-daec-44bf-9f8e-065a6747f53e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"66beb821-daec-44bf-9f8e-065a6747f53e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 01:45:25.621656 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.621628 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/66beb821-daec-44bf-9f8e-065a6747f53e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"66beb821-daec-44bf-9f8e-065a6747f53e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 01:45:25.621704 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.621660 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/66beb821-daec-44bf-9f8e-065a6747f53e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"66beb821-daec-44bf-9f8e-065a6747f53e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 01:45:25.621704 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.621693 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/66beb821-daec-44bf-9f8e-065a6747f53e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"66beb821-daec-44bf-9f8e-065a6747f53e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 01:45:25.621801 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.621721 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/66beb821-daec-44bf-9f8e-065a6747f53e-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"66beb821-daec-44bf-9f8e-065a6747f53e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 01:45:25.621801 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.621760 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/66beb821-daec-44bf-9f8e-065a6747f53e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"66beb821-daec-44bf-9f8e-065a6747f53e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 01:45:25.621801 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.621792 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/66beb821-daec-44bf-9f8e-065a6747f53e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"66beb821-daec-44bf-9f8e-065a6747f53e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 01:45:25.622045 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.621816 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/66beb821-daec-44bf-9f8e-065a6747f53e-web-config\") pod \"prometheus-k8s-0\" (UID: \"66beb821-daec-44bf-9f8e-065a6747f53e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 01:45:25.622045 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.621839 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/66beb821-daec-44bf-9f8e-065a6747f53e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"66beb821-daec-44bf-9f8e-065a6747f53e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 01:45:25.622045 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.621867 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/66beb821-daec-44bf-9f8e-065a6747f53e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"66beb821-daec-44bf-9f8e-065a6747f53e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 01:45:25.622045 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.621903 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xjl9m\" (UniqueName: \"kubernetes.io/projected/66beb821-daec-44bf-9f8e-065a6747f53e-kube-api-access-xjl9m\") pod \"prometheus-k8s-0\" (UID: \"66beb821-daec-44bf-9f8e-065a6747f53e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 01:45:25.622045 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.621940 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/66beb821-daec-44bf-9f8e-065a6747f53e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"66beb821-daec-44bf-9f8e-065a6747f53e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 01:45:25.622045 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.621972 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/66beb821-daec-44bf-9f8e-065a6747f53e-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"66beb821-daec-44bf-9f8e-065a6747f53e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 01:45:25.622045 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.621980 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/66beb821-daec-44bf-9f8e-065a6747f53e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"66beb821-daec-44bf-9f8e-065a6747f53e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 01:45:25.622045 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.622006 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/66beb821-daec-44bf-9f8e-065a6747f53e-config-out\") pod \"prometheus-k8s-0\" (UID: \"66beb821-daec-44bf-9f8e-065a6747f53e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 01:45:25.622471 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.622075 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/66beb821-daec-44bf-9f8e-065a6747f53e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"66beb821-daec-44bf-9f8e-065a6747f53e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 01:45:25.622571 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.622544 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/66beb821-daec-44bf-9f8e-065a6747f53e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"66beb821-daec-44bf-9f8e-065a6747f53e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 01:45:25.622655 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.622626 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/66beb821-daec-44bf-9f8e-065a6747f53e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"66beb821-daec-44bf-9f8e-065a6747f53e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 01:45:25.623282 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.623259 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/66beb821-daec-44bf-9f8e-065a6747f53e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"66beb821-daec-44bf-9f8e-065a6747f53e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 01:45:25.624371 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.624351 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/66beb821-daec-44bf-9f8e-065a6747f53e-config\") pod \"prometheus-k8s-0\" (UID: \"66beb821-daec-44bf-9f8e-065a6747f53e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 01:45:25.624510 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.624486 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/66beb821-daec-44bf-9f8e-065a6747f53e-config-out\") pod \"prometheus-k8s-0\" (UID: \"66beb821-daec-44bf-9f8e-065a6747f53e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 01:45:25.624735 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.624706 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/66beb821-daec-44bf-9f8e-065a6747f53e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"66beb821-daec-44bf-9f8e-065a6747f53e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 01:45:25.624962 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.624944 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/66beb821-daec-44bf-9f8e-065a6747f53e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"66beb821-daec-44bf-9f8e-065a6747f53e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 01:45:25.625731 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.625188 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/66beb821-daec-44bf-9f8e-065a6747f53e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"66beb821-daec-44bf-9f8e-065a6747f53e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 01:45:25.625731 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.625446 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/66beb821-daec-44bf-9f8e-065a6747f53e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"66beb821-daec-44bf-9f8e-065a6747f53e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 01:45:25.625731 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.625535 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/66beb821-daec-44bf-9f8e-065a6747f53e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"66beb821-daec-44bf-9f8e-065a6747f53e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 01:45:25.625731 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.625688 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/66beb821-daec-44bf-9f8e-065a6747f53e-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"66beb821-daec-44bf-9f8e-065a6747f53e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 01:45:25.626032 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.625730 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/66beb821-daec-44bf-9f8e-065a6747f53e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"66beb821-daec-44bf-9f8e-065a6747f53e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 01:45:25.626465 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.626445 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/66beb821-daec-44bf-9f8e-065a6747f53e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"66beb821-daec-44bf-9f8e-065a6747f53e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 01:45:25.626825 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.626801 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/66beb821-daec-44bf-9f8e-065a6747f53e-web-config\") pod \"prometheus-k8s-0\" (UID: \"66beb821-daec-44bf-9f8e-065a6747f53e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 01:45:25.627347 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.627327 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/66beb821-daec-44bf-9f8e-065a6747f53e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"66beb821-daec-44bf-9f8e-065a6747f53e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 01:45:25.627641 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.627619 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/66beb821-daec-44bf-9f8e-065a6747f53e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"66beb821-daec-44bf-9f8e-065a6747f53e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 01:45:25.627761 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.627746 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/66beb821-daec-44bf-9f8e-065a6747f53e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"66beb821-daec-44bf-9f8e-065a6747f53e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 01:45:25.630724 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.630709 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xjl9m\" (UniqueName: \"kubernetes.io/projected/66beb821-daec-44bf-9f8e-065a6747f53e-kube-api-access-xjl9m\") pod \"prometheus-k8s-0\" (UID: \"66beb821-daec-44bf-9f8e-065a6747f53e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 01:45:25.729427 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.729387 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 08 01:45:25.870182 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:25.870152 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 08 01:45:25.873330 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:45:25.873261 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66beb821_daec_44bf_9f8e_065a6747f53e.slice/crio-f423de76202d53d510781a2e9d0f0f9e55ace098cd73adde8a5257cf21fab966 WatchSource:0}: Error finding container f423de76202d53d510781a2e9d0f0f9e55ace098cd73adde8a5257cf21fab966: Status 404 returned error can't find the container with id f423de76202d53d510781a2e9d0f0f9e55ace098cd73adde8a5257cf21fab966 Jul 08 01:45:26.350741 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:26.350705 2563 generic.go:356] "Generic (PLEG): container finished" podID="66beb821-daec-44bf-9f8e-065a6747f53e" containerID="dae1ecbfe0f33c97b90c133a83c4161985c3b12fd53d556aa66d4c09f1c1eada" exitCode=0 Jul 08 01:45:26.351108 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:26.350790 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"66beb821-daec-44bf-9f8e-065a6747f53e","Type":"ContainerDied","Data":"dae1ecbfe0f33c97b90c133a83c4161985c3b12fd53d556aa66d4c09f1c1eada"} Jul 08 01:45:26.351108 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:26.350855 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"66beb821-daec-44bf-9f8e-065a6747f53e","Type":"ContainerStarted","Data":"f423de76202d53d510781a2e9d0f0f9e55ace098cd73adde8a5257cf21fab966"} Jul 08 01:45:26.402980 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:26.402953 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8454f12b-eb6b-4003-bffa-05b00de97455" path="/var/lib/kubelet/pods/8454f12b-eb6b-4003-bffa-05b00de97455/volumes" Jul 08 01:45:27.359697 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:27.359661 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"66beb821-daec-44bf-9f8e-065a6747f53e","Type":"ContainerStarted","Data":"bae587113cdacf2a9beb12d28d10e4792389788317ead8c363300aec5d4d3908"} Jul 08 01:45:27.360093 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:27.359743 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"66beb821-daec-44bf-9f8e-065a6747f53e","Type":"ContainerStarted","Data":"54c662ae594a739e5773518a6fbaa64a4b27d6770d18d1c255ad3dcfe4e871d7"} Jul 08 01:45:27.360093 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:27.359786 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"66beb821-daec-44bf-9f8e-065a6747f53e","Type":"ContainerStarted","Data":"56cb14daebab52024beb8ca9f59928a91a95ca66d122db850afa62fbc05682fe"} Jul 08 01:45:27.360093 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:27.359830 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"66beb821-daec-44bf-9f8e-065a6747f53e","Type":"ContainerStarted","Data":"a2c13790146035bd0a827ff27e97e45b2026865966d85b277a9712576fb80bbb"} Jul 08 01:45:27.360093 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:27.359870 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"66beb821-daec-44bf-9f8e-065a6747f53e","Type":"ContainerStarted","Data":"8d38b08f66bf66e5707c89ce5b120f95663af4d2b81a4f75dcfcc765d2be5d1d"} Jul 08 01:45:27.360093 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:27.359912 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"66beb821-daec-44bf-9f8e-065a6747f53e","Type":"ContainerStarted","Data":"1a8248ed022209a0d412eca0bce78bfb034ff6cc0836527e849ddce74d7c9f78"} Jul 08 01:45:27.389156 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:27.389088 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.370685582 podStartE2EDuration="2.389066619s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.381037ms" isStatefulPod=false podCreationTimestamp="2026-07-08 01:45:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 01:45:27.387390983 +0000 UTC m=+207.584717839" watchObservedRunningTime="2026-07-08 01:45:27.389066619 +0000 UTC m=+207.586393472" Jul 08 01:45:29.223089 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:29.223061 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:45:29.324290 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:29.324258 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:45:29.423961 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:29.423923 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:45:29.951757 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:29.951721 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:45:30.016358 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:30.016330 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:45:30.730049 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:30.730016 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 08 01:45:40.480384 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:40.480346 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:45:40.533999 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:40.533970 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:45:40.587957 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:45:40.587926 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:46:07.503544 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:46:07.503511 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:46:13.570261 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:46:13.570222 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:46:13.629899 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:46:13.629867 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:46:25.729819 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:46:25.729723 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 08 01:46:25.745592 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:46:25.745568 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 08 01:46:26.622957 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:46:26.622932 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 08 01:46:34.480272 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:46:34.480239 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:46:34.534904 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:46:34.534843 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:46:35.800945 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:46:35.800916 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:46:35.860359 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:46:35.860327 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:46:35.947411 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:46:35.947379 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:46:36.002570 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:46:36.002541 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:46:36.560819 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:46:36.560786 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:46:36.623401 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:46:36.623369 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:46:46.527721 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:46:46.527690 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:46:46.582381 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:46:46.582343 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:46:46.722342 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:46:46.722314 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:46:46.825358 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:46:46.825266 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:46:46.926288 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:46:46.926253 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:46:50.610068 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:46:50.610041 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:46:50.711239 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:46:50.711186 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:46:51.419471 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:46:51.419434 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:47:00.232501 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:47:00.232475 2563 kubelet.go:1648] "Image garbage collection succeeded" Jul 08 01:47:07.897525 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:47:07.897486 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:47:39.467956 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:47:39.467925 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:47:40.515528 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:47:40.515498 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:47:49.208566 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:47:49.208527 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:47:49.309506 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:47:49.309471 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" limit=1024 Jul 08 01:47:51.514534 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:47:51.514504 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-6hr9n_87674b91-e601-4694-a3e1-bb0bd80b5c4f/global-pull-secret-syncer/0.log" Jul 08 01:47:51.701358 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:47:51.701332 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-dj8dv_a94ad3dd-a657-4061-82a9-ab28622ab193/konnectivity-agent/0.log" Jul 08 01:47:51.857528 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:47:51.857433 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-142-233.ec2.internal_61e1c42ac9a08ecfb3c8cc5e93139196/haproxy/0.log" Jul 08 01:47:54.734267 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:47:54.734243 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0df62792-f0eb-48bd-81af-51a632480f3f/alertmanager/0.log" Jul 08 01:47:54.766814 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:47:54.766789 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0df62792-f0eb-48bd-81af-51a632480f3f/config-reloader/0.log" Jul 08 01:47:54.801343 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:47:54.801317 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0df62792-f0eb-48bd-81af-51a632480f3f/kube-rbac-proxy-web/0.log" Jul 08 01:47:54.837162 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:47:54.837135 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0df62792-f0eb-48bd-81af-51a632480f3f/kube-rbac-proxy/0.log" Jul 08 01:47:54.871088 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:47:54.871063 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0df62792-f0eb-48bd-81af-51a632480f3f/kube-rbac-proxy-metric/0.log" Jul 08 01:47:54.904437 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:47:54.904413 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0df62792-f0eb-48bd-81af-51a632480f3f/prom-label-proxy/0.log" Jul 08 01:47:54.934374 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:47:54.934352 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0df62792-f0eb-48bd-81af-51a632480f3f/init-config-reloader/0.log" Jul 08 01:47:55.009719 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:47:55.009641 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-zcqnl_5b3a9d0f-b665-4bfd-93f1-9f845c205bd2/kube-state-metrics/0.log" Jul 08 01:47:55.056037 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:47:55.056009 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-zcqnl_5b3a9d0f-b665-4bfd-93f1-9f845c205bd2/kube-rbac-proxy-main/0.log" Jul 08 01:47:55.096274 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:47:55.096248 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-zcqnl_5b3a9d0f-b665-4bfd-93f1-9f845c205bd2/kube-rbac-proxy-self/0.log" Jul 08 01:47:55.149364 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:47:55.149338 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-7548986fcb-5rqh8_2580ccd3-a6cf-40ee-a444-a64534500bc9/metrics-server/0.log" Jul 08 01:47:55.253071 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:47:55.253040 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5nr7z_ab2e1e98-5ab8-49f9-adf1-f8d71eb75839/node-exporter/0.log" Jul 08 01:47:55.290776 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:47:55.290702 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5nr7z_ab2e1e98-5ab8-49f9-adf1-f8d71eb75839/kube-rbac-proxy/0.log" Jul 08 01:47:55.324072 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:47:55.324047 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5nr7z_ab2e1e98-5ab8-49f9-adf1-f8d71eb75839/init-textfile/0.log" Jul 08 01:47:55.603725 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:47:55.603656 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-xr27g_3e1469f5-2f2c-44e0-b1a1-8793239f8da7/kube-rbac-proxy-main/0.log" Jul 08 01:47:55.629163 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:47:55.629137 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-xr27g_3e1469f5-2f2c-44e0-b1a1-8793239f8da7/kube-rbac-proxy-self/0.log" Jul 08 01:47:55.658565 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:47:55.658538 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-xr27g_3e1469f5-2f2c-44e0-b1a1-8793239f8da7/openshift-state-metrics/0.log" Jul 08 01:47:55.705906 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:47:55.705882 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_66beb821-daec-44bf-9f8e-065a6747f53e/prometheus/0.log" Jul 08 01:47:55.733112 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:47:55.733085 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_66beb821-daec-44bf-9f8e-065a6747f53e/config-reloader/0.log" Jul 08 01:47:55.761544 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:47:55.761520 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_66beb821-daec-44bf-9f8e-065a6747f53e/thanos-sidecar/0.log" Jul 08 01:47:55.795135 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:47:55.795109 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_66beb821-daec-44bf-9f8e-065a6747f53e/kube-rbac-proxy-web/0.log" Jul 08 01:47:55.824717 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:47:55.820117 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_66beb821-daec-44bf-9f8e-065a6747f53e/kube-rbac-proxy/0.log" Jul 08 01:47:55.851181 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:47:55.851157 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_66beb821-daec-44bf-9f8e-065a6747f53e/kube-rbac-proxy-thanos/0.log" Jul 08 01:47:55.881845 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:47:55.881780 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_66beb821-daec-44bf-9f8e-065a6747f53e/init-config-reloader/0.log" Jul 08 01:47:56.146605 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:47:56.146533 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-69d55c7cdf-9cd4t_4eadd54e-4cd0-4218-8627-b21db83ed247/thanos-query/0.log" Jul 08 01:47:56.175680 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:47:56.175650 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-69d55c7cdf-9cd4t_4eadd54e-4cd0-4218-8627-b21db83ed247/kube-rbac-proxy-web/0.log" Jul 08 01:47:56.202720 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:47:56.202692 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-69d55c7cdf-9cd4t_4eadd54e-4cd0-4218-8627-b21db83ed247/kube-rbac-proxy/0.log" Jul 08 01:47:56.231828 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:47:56.231806 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-69d55c7cdf-9cd4t_4eadd54e-4cd0-4218-8627-b21db83ed247/prom-label-proxy/0.log" Jul 08 01:47:56.254591 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:47:56.254566 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-69d55c7cdf-9cd4t_4eadd54e-4cd0-4218-8627-b21db83ed247/kube-rbac-proxy-rules/0.log" Jul 08 01:47:56.283437 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:47:56.283408 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-69d55c7cdf-9cd4t_4eadd54e-4cd0-4218-8627-b21db83ed247/kube-rbac-proxy-metrics/0.log" Jul 08 01:47:57.559364 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:47:57.559338 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6bffdf9778-fnz7w_7fc4abce-ffae-4252-a2d6-358ff46351a5/networking-console-plugin/0.log" Jul 08 01:47:58.879698 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:47:58.879666 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-r6srx/perf-node-gather-daemonset-rxx5c"] Jul 08 01:47:58.883069 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:47:58.883048 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-r6srx/perf-node-gather-daemonset-rxx5c" Jul 08 01:47:58.885506 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:47:58.885484 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-r6srx\"/\"openshift-service-ca.crt\"" Jul 08 01:47:58.885622 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:47:58.885484 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-r6srx\"/\"kube-root-ca.crt\"" Jul 08 01:47:58.886402 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:47:58.886389 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-r6srx\"/\"default-dockercfg-crbb7\"" Jul 08 01:47:58.891076 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:47:58.891053 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-r6srx/perf-node-gather-daemonset-rxx5c"] Jul 08 01:47:58.959269 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:47:58.959232 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2xgrr\" (UniqueName: \"kubernetes.io/projected/bafa00c9-1ad2-40ed-a2dc-229dbf78ed27-kube-api-access-2xgrr\") pod \"perf-node-gather-daemonset-rxx5c\" (UID: \"bafa00c9-1ad2-40ed-a2dc-229dbf78ed27\") " pod="openshift-must-gather-r6srx/perf-node-gather-daemonset-rxx5c" Jul 08 01:47:58.959465 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:47:58.959323 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/bafa00c9-1ad2-40ed-a2dc-229dbf78ed27-podres\") pod \"perf-node-gather-daemonset-rxx5c\" (UID: \"bafa00c9-1ad2-40ed-a2dc-229dbf78ed27\") " pod="openshift-must-gather-r6srx/perf-node-gather-daemonset-rxx5c" Jul 08 01:47:58.959465 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:47:58.959433 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bafa00c9-1ad2-40ed-a2dc-229dbf78ed27-sys\") pod \"perf-node-gather-daemonset-rxx5c\" (UID: \"bafa00c9-1ad2-40ed-a2dc-229dbf78ed27\") " pod="openshift-must-gather-r6srx/perf-node-gather-daemonset-rxx5c" Jul 08 01:47:58.959574 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:47:58.959456 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/bafa00c9-1ad2-40ed-a2dc-229dbf78ed27-proc\") pod \"perf-node-gather-daemonset-rxx5c\" (UID: \"bafa00c9-1ad2-40ed-a2dc-229dbf78ed27\") " pod="openshift-must-gather-r6srx/perf-node-gather-daemonset-rxx5c" Jul 08 01:47:58.959574 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:47:58.959503 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bafa00c9-1ad2-40ed-a2dc-229dbf78ed27-lib-modules\") pod \"perf-node-gather-daemonset-rxx5c\" (UID: \"bafa00c9-1ad2-40ed-a2dc-229dbf78ed27\") " pod="openshift-must-gather-r6srx/perf-node-gather-daemonset-rxx5c" Jul 08 01:47:59.060511 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:47:59.060467 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/bafa00c9-1ad2-40ed-a2dc-229dbf78ed27-podres\") pod \"perf-node-gather-daemonset-rxx5c\" (UID: \"bafa00c9-1ad2-40ed-a2dc-229dbf78ed27\") " pod="openshift-must-gather-r6srx/perf-node-gather-daemonset-rxx5c" Jul 08 01:47:59.060710 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:47:59.060578 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bafa00c9-1ad2-40ed-a2dc-229dbf78ed27-sys\") pod \"perf-node-gather-daemonset-rxx5c\" (UID: \"bafa00c9-1ad2-40ed-a2dc-229dbf78ed27\") " pod="openshift-must-gather-r6srx/perf-node-gather-daemonset-rxx5c" Jul 08 01:47:59.060710 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:47:59.060602 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/bafa00c9-1ad2-40ed-a2dc-229dbf78ed27-proc\") pod \"perf-node-gather-daemonset-rxx5c\" (UID: \"bafa00c9-1ad2-40ed-a2dc-229dbf78ed27\") " pod="openshift-must-gather-r6srx/perf-node-gather-daemonset-rxx5c" Jul 08 01:47:59.060710 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:47:59.060623 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bafa00c9-1ad2-40ed-a2dc-229dbf78ed27-lib-modules\") pod \"perf-node-gather-daemonset-rxx5c\" (UID: \"bafa00c9-1ad2-40ed-a2dc-229dbf78ed27\") " pod="openshift-must-gather-r6srx/perf-node-gather-daemonset-rxx5c" Jul 08 01:47:59.060710 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:47:59.060639 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/bafa00c9-1ad2-40ed-a2dc-229dbf78ed27-podres\") pod \"perf-node-gather-daemonset-rxx5c\" (UID: \"bafa00c9-1ad2-40ed-a2dc-229dbf78ed27\") " pod="openshift-must-gather-r6srx/perf-node-gather-daemonset-rxx5c" Jul 08 01:47:59.060710 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:47:59.060664 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2xgrr\" (UniqueName: \"kubernetes.io/projected/bafa00c9-1ad2-40ed-a2dc-229dbf78ed27-kube-api-access-2xgrr\") pod \"perf-node-gather-daemonset-rxx5c\" (UID: \"bafa00c9-1ad2-40ed-a2dc-229dbf78ed27\") " pod="openshift-must-gather-r6srx/perf-node-gather-daemonset-rxx5c" Jul 08 01:47:59.060710 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:47:59.060686 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bafa00c9-1ad2-40ed-a2dc-229dbf78ed27-sys\") pod \"perf-node-gather-daemonset-rxx5c\" (UID: \"bafa00c9-1ad2-40ed-a2dc-229dbf78ed27\") " pod="openshift-must-gather-r6srx/perf-node-gather-daemonset-rxx5c" Jul 08 01:47:59.060997 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:47:59.060716 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/bafa00c9-1ad2-40ed-a2dc-229dbf78ed27-proc\") pod \"perf-node-gather-daemonset-rxx5c\" (UID: \"bafa00c9-1ad2-40ed-a2dc-229dbf78ed27\") " pod="openshift-must-gather-r6srx/perf-node-gather-daemonset-rxx5c" Jul 08 01:47:59.060997 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:47:59.060785 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bafa00c9-1ad2-40ed-a2dc-229dbf78ed27-lib-modules\") pod \"perf-node-gather-daemonset-rxx5c\" (UID: \"bafa00c9-1ad2-40ed-a2dc-229dbf78ed27\") " pod="openshift-must-gather-r6srx/perf-node-gather-daemonset-rxx5c" Jul 08 01:47:59.069138 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:47:59.069106 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2xgrr\" (UniqueName: \"kubernetes.io/projected/bafa00c9-1ad2-40ed-a2dc-229dbf78ed27-kube-api-access-2xgrr\") pod \"perf-node-gather-daemonset-rxx5c\" (UID: \"bafa00c9-1ad2-40ed-a2dc-229dbf78ed27\") " pod="openshift-must-gather-r6srx/perf-node-gather-daemonset-rxx5c" Jul 08 01:47:59.193687 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:47:59.193642 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-r6srx/perf-node-gather-daemonset-rxx5c" Jul 08 01:47:59.318409 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:47:59.318382 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-r6srx/perf-node-gather-daemonset-rxx5c"] Jul 08 01:47:59.321097 ip-10-0-142-233 kubenswrapper[2563]: W0708 01:47:59.321067 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podbafa00c9_1ad2_40ed_a2dc_229dbf78ed27.slice/crio-98cc492c5260768b94fee02bbd0cc88af3b142f802ecf1b39fc3c1077aecff2a WatchSource:0}: Error finding container 98cc492c5260768b94fee02bbd0cc88af3b142f802ecf1b39fc3c1077aecff2a: Status 404 returned error can't find the container with id 98cc492c5260768b94fee02bbd0cc88af3b142f802ecf1b39fc3c1077aecff2a Jul 08 01:47:59.741777 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:47:59.741677 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-26bmx_90eac80c-1b42-4aa3-a3dd-9ea155f26507/dns/0.log" Jul 08 01:47:59.763342 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:47:59.763297 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-26bmx_90eac80c-1b42-4aa3-a3dd-9ea155f26507/kube-rbac-proxy/0.log" Jul 08 01:47:59.921009 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:47:59.920968 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-pk46r_6d567423-f240-4ed8-87ba-743127287631/dns-node-resolver/0.log" Jul 08 01:47:59.972133 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:47:59.972098 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-r6srx/perf-node-gather-daemonset-rxx5c" event={"ID":"bafa00c9-1ad2-40ed-a2dc-229dbf78ed27","Type":"ContainerStarted","Data":"08a33225b208e2f7b792cd0e7a2c5a8ad14636a286eeed795a7dd58004799b88"} Jul 08 01:47:59.972321 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:47:59.972192 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-r6srx/perf-node-gather-daemonset-rxx5c" Jul 08 01:47:59.972321 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:47:59.972243 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-r6srx/perf-node-gather-daemonset-rxx5c" event={"ID":"bafa00c9-1ad2-40ed-a2dc-229dbf78ed27","Type":"ContainerStarted","Data":"98cc492c5260768b94fee02bbd0cc88af3b142f802ecf1b39fc3c1077aecff2a"} Jul 08 01:47:59.988625 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:47:59.988572 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-r6srx/perf-node-gather-daemonset-rxx5c" podStartSLOduration=1.9885560249999998 podStartE2EDuration="1.988556025s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 01:47:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 01:47:59.986691584 +0000 UTC m=+360.184018450" watchObservedRunningTime="2026-07-08 01:47:59.988556025 +0000 UTC m=+360.185882878" Jul 08 01:48:00.294416 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:48:00.294390 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-7d8d487dc6-glrxr_ffc4949b-e7e2-4f59-b7a8-975de1b95e8e/registry/0.log" Jul 08 01:48:00.364024 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:48:00.363996 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-xljcg_5cb4d2ec-61d0-4b04-a043-39c3d834cf1a/node-ca/0.log" Jul 08 01:48:01.336041 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:48:01.336015 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-g2zrw_9a9bc2dd-f544-4078-8fef-60c76f403a4e/serve-healthcheck-canary/0.log" Jul 08 01:48:01.672932 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:48:01.672854 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-2zk7n_f6640b83-15b8-45d6-93cd-83809ee952e1/insights-operator/1.log" Jul 08 01:48:01.673082 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:48:01.673060 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-2zk7n_f6640b83-15b8-45d6-93cd-83809ee952e1/insights-operator/0.log" Jul 08 01:48:01.823668 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:48:01.823644 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-v5xxc_fb8a1eb9-e14f-47c1-af1f-7015b945c379/kube-rbac-proxy/0.log" Jul 08 01:48:01.846397 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:48:01.846369 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-v5xxc_fb8a1eb9-e14f-47c1-af1f-7015b945c379/exporter/0.log" Jul 08 01:48:01.868476 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:48:01.868453 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-v5xxc_fb8a1eb9-e14f-47c1-af1f-7015b945c379/extractor/0.log" Jul 08 01:48:05.760259 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:48:05.760230 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-jzzpg_cdf8cdb7-12da-46c7-a1ad-f082952fe0ca/migrator/0.log" Jul 08 01:48:05.780272 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:48:05.780243 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-jzzpg_cdf8cdb7-12da-46c7-a1ad-f082952fe0ca/graceful-termination/0.log" Jul 08 01:48:05.986100 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:48:05.986071 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-r6srx/perf-node-gather-daemonset-rxx5c" Jul 08 01:48:06.992861 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:48:06.992837 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nkz4s_dfaa7d20-7f57-4e48-b50c-8d67d58abe22/kube-multus-additional-cni-plugins/0.log" Jul 08 01:48:07.019571 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:48:07.019543 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nkz4s_dfaa7d20-7f57-4e48-b50c-8d67d58abe22/egress-router-binary-copy/0.log" Jul 08 01:48:07.043983 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:48:07.043951 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nkz4s_dfaa7d20-7f57-4e48-b50c-8d67d58abe22/cni-plugins/0.log" Jul 08 01:48:07.067248 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:48:07.067217 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nkz4s_dfaa7d20-7f57-4e48-b50c-8d67d58abe22/bond-cni-plugin/0.log" Jul 08 01:48:07.090719 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:48:07.090697 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nkz4s_dfaa7d20-7f57-4e48-b50c-8d67d58abe22/routeoverride-cni/0.log" Jul 08 01:48:07.122403 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:48:07.122367 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nkz4s_dfaa7d20-7f57-4e48-b50c-8d67d58abe22/whereabouts-cni-bincopy/0.log" Jul 08 01:48:07.148395 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:48:07.148367 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nkz4s_dfaa7d20-7f57-4e48-b50c-8d67d58abe22/whereabouts-cni/0.log" Jul 08 01:48:07.340150 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:48:07.340077 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-f4vdc_b091ceff-3f95-4de4-906b-5a43e8161af3/kube-multus/0.log" Jul 08 01:48:07.540939 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:48:07.540908 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-w4psj_c391d2cf-3212-40c8-9456-a38c24ba080d/network-metrics-daemon/0.log" Jul 08 01:48:07.566705 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:48:07.566679 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-w4psj_c391d2cf-3212-40c8-9456-a38c24ba080d/kube-rbac-proxy/0.log" Jul 08 01:48:08.381354 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:48:08.381279 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hgtm2_9409c6b8-7a8b-4e5d-8b04-18b36e285356/ovn-controller/0.log" Jul 08 01:48:08.409910 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:48:08.409888 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hgtm2_9409c6b8-7a8b-4e5d-8b04-18b36e285356/ovn-acl-logging/0.log" Jul 08 01:48:08.437986 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:48:08.437960 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hgtm2_9409c6b8-7a8b-4e5d-8b04-18b36e285356/kube-rbac-proxy-node/0.log" Jul 08 01:48:08.464520 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:48:08.464493 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hgtm2_9409c6b8-7a8b-4e5d-8b04-18b36e285356/kube-rbac-proxy-ovn-metrics/0.log" Jul 08 01:48:08.486452 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:48:08.486428 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hgtm2_9409c6b8-7a8b-4e5d-8b04-18b36e285356/northd/0.log" Jul 08 01:48:08.509441 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:48:08.509418 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hgtm2_9409c6b8-7a8b-4e5d-8b04-18b36e285356/nbdb/0.log" Jul 08 01:48:08.531048 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:48:08.531022 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hgtm2_9409c6b8-7a8b-4e5d-8b04-18b36e285356/sbdb/0.log" Jul 08 01:48:08.571277 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:48:08.571249 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hgtm2_9409c6b8-7a8b-4e5d-8b04-18b36e285356/ovnkube-controller/0.log" Jul 08 01:48:10.046259 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:48:10.046233 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-dvf9v_79d3b000-b3ab-40bd-97a1-47536d14a052/network-check-target-container/0.log" Jul 08 01:48:10.931140 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:48:10.931113 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-srhs5_77d11f18-f68a-4d7c-8217-be0a83114e14/iptables-alerter/0.log" Jul 08 01:48:11.577119 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:48:11.577090 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-xvdkf_67d33362-8538-40e2-a54c-9a4ec41504db/tuned/0.log" Jul 08 01:48:14.251526 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:48:14.251496 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-service-ca-operator_service-ca-operator-5d46d9ffd4-znsjt_ba7355ad-22c6-4a3e-ab65-5f13466b4dfb/service-ca-operator/1.log" Jul 08 01:48:14.252516 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:48:14.252498 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-service-ca-operator_service-ca-operator-5d46d9ffd4-znsjt_ba7355ad-22c6-4a3e-ab65-5f13466b4dfb/service-ca-operator/0.log" Jul 08 01:48:14.925843 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:48:14.925816 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-j456h_3e78b9bc-0e4e-4303-822e-7246ecedff2d/csi-driver/0.log" Jul 08 01:48:14.951028 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:48:14.950999 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-j456h_3e78b9bc-0e4e-4303-822e-7246ecedff2d/csi-node-driver-registrar/0.log" Jul 08 01:48:14.972790 ip-10-0-142-233 kubenswrapper[2563]: I0708 01:48:14.972763 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-j456h_3e78b9bc-0e4e-4303-822e-7246ecedff2d/csi-liveness-probe/0.log"